Examples

Miscellaneous examples

Miscellaneous and introductory examples for scikit-learn.

Compact estimator representations

Isotonic Regression

Face completion with a multi-output estimators

Multilabel classification

Comparing anomaly detection algorithms for outlier detection on toy datasets

The Johnson-Lindenstrauss bound for embedding with random projections

Comparison of kernel ridge regression and SVR

Explicit feature map approximation for RBF kernels

Examples based on real world datasets

Applications to real world problems with some medium sized datasets or interactive user interface.

Outlier detection on a real data set

Compressive sensing: tomography reconstruction with L1 prior (Lasso)

Topic extraction with Non-negative Matrix Factorization and Latent Dirichlet Allocation

Faces recognition example using eigenfaces and SVMs

Model Complexity Influence

Species distribution modeling

Visualizing the stock market structure

Wikipedia principal eigenvector

Libsvm GUI

Prediction Latency

Out-of-core classification of text documents

Biclustering

Examples concerning the sklearn.cluster.bicluster module.

A demo of the Spectral Co-Clustering algorithm

A demo of the Spectral Biclustering algorithm

Biclustering documents with the Spectral Co-clustering algorithm

Calibration

Examples illustrating the calibration of predicted probabilities of classifiers.

Comparison of Calibration of Classifiers

Probability Calibration curves

Probability calibration of classifiers

Probability Calibration for 3-class classification

Classification

General examples about classification algorithms.

Recognizing hand-written digits

Normal and Shrinkage Linear Discriminant Analysis for classification

Plot classification probability

Classifier comparison

Linear and Quadratic Discriminant Analysis with covariance ellipsoid

Clustering

Examples concerning the sklearn.cluster module.

Feature agglomeration

A demo of the mean-shift clustering algorithm

Demonstration of k-means assumptions

Online learning of a dictionary of parts of faces

Vector Quantization Example

Agglomerative clustering with and without structure

Demo of affinity propagation clustering algorithm

Segmenting the picture of greek coins in regions

K-means Clustering

Various Agglomerative Clustering on a 2D embedding of digits

Spectral clustering for image segmentation

A demo of structured Ward hierarchical clustering on an image of coins

Demo of DBSCAN clustering algorithm

Color Quantization using K-Means

Hierarchical clustering: structured vs unstructured ward

Agglomerative clustering with different metrics

Inductive Clustering

Demo of OPTICS clustering algorithm

Compare BIRCH and MiniBatchKMeans

Empirical evaluation of the impact of k-means initialization

Adjustment for chance in clustering performance evaluation

Feature agglomeration vs. univariate selection

Comparison of the K-Means and MiniBatchKMeans clustering algorithms

A demo of K-Means clustering on the handwritten digits data

Comparing different hierarchical linkage methods on toy datasets

Selecting the number of clusters with silhouette analysis on KMeans clustering

Comparing different clustering algorithms on toy datasets

Pipelines and composite estimators

Examples of how to compose transformers and pipelines from other estimators. See the User Guide.

Concatenating multiple feature extraction methods

Pipelining: chaining a PCA and a logistic regression

Column Transformer with Mixed Types

Selecting dimensionality reduction with Pipeline and GridSearchCV

Column Transformer with Heterogeneous Data Sources

Effect of transforming the targets in regression model

Covariance estimation

Examples concerning the sklearn.covariance module.

Ledoit-Wolf vs OAS estimation

Sparse inverse covariance estimation

Shrinkage covariance estimation: LedoitWolf vs OAS and max-likelihood

Robust covariance estimation and Mahalanobis distances relevance

Robust vs Empirical covariance estimate

Cross decomposition

Examples concerning the sklearn.cross_decomposition module.

Compare cross decomposition methods

Dataset examples

Examples concerning the sklearn.datasets module.

The Digit Dataset

The Iris Dataset

Plot randomly generated classification dataset

Plot randomly generated multilabel dataset

Decomposition

Examples concerning the sklearn.decomposition module.

Beta-divergence loss functions

PCA example with Iris Data-set

Incremental PCA

Comparison of LDA and PCA 2D projection of Iris dataset

Blind source separation using FastICA

Principal components analysis (PCA)

FastICA on 2D point clouds

Kernel PCA

Model selection with Probabilistic PCA and Factor Analysis (FA)

Sparse coding with a precomputed dictionary

Image denoising using dictionary learning

Faces dataset decompositions

Ensemble methods

Examples concerning the sklearn.ensemble module.

Decision Tree Regression with AdaBoost

Pixel importances with a parallel forest of trees

Plot individual and voting regression predictions

Feature importances with forests of trees

IsolationForest example

Plot the decision boundaries of a VotingClassifier

Comparing random forests and the multi-output meta estimator

Prediction Intervals for Gradient Boosting Regression

Gradient Boosting regularization

Plot class probabilities calculated by the VotingClassifier

Gradient Boosting regression

Two-class AdaBoost

OOB Errors for Random Forests

Hashing feature transformation using Totally Random Trees

Multi-class AdaBoosted Decision Trees

Discrete versus Real AdaBoost

Early stopping of Gradient Boosting

Feature transformations with ensembles of trees

Gradient Boosting Out-of-Bag estimates

Single estimator versus bagging: bias-variance decomposition

Plot the decision surfaces of ensembles of trees on the iris dataset

Tutorial exercises

Exercises for the tutorials

Digits Classification Exercise

Cross-validation on Digits Dataset Exercise

SVM Exercise

Cross-validation on diabetes Dataset Exercise

Feature Selection

Examples concerning the sklearn.feature_selection module.

Recursive feature elimination

Comparison of F-test and mutual information

Pipeline Anova SVM

Recursive feature elimination with cross-validation

Feature selection using SelectFromModel and LassoCV

Test with permutations the significance of a classification score

Univariate Feature Selection

Gaussian Process for Machine Learning

Examples concerning the sklearn.gaussian_process module.

Illustration of Gaussian process classification (GPC) on the XOR dataset

Gaussian process classification (GPC) on iris dataset

Comparison of kernel ridge and Gaussian process regression

Illustration of prior and posterior Gaussian process for different kernels

Iso-probability lines for Gaussian Processes classification (GPC)

Probabilistic predictions with Gaussian process classification (GPC)

Gaussian process regression (GPR) with noise-level estimation

Gaussian Processes regression: basic introductory example

Gaussian process regression (GPR) on Mauna Loa CO2 data.

Missing Value Imputation

Examples concerning the sklearn.impute module.

Imputing missing values with variants of IterativeImputer

Imputing missing values before building an estimator

Inspection

Examples related to the sklearn.inspection module.

Partial Dependence Plots

Generalized Linear Models

Examples concerning the sklearn.linear_model module.

Lasso path using LARS

Plot Ridge coefficients as a function of the regularization

SGD: Maximum margin separating hyperplane

SGD: convex loss functions

Ordinary Least Squares and Ridge Regression Variance

Plot Ridge coefficients as a function of the L2 regularization

SGD: Penalties

Regularization path of L1- Logistic Regression

Polynomial interpolation

Logistic function

SGD: Weighted samples

Logistic Regression 3-class Classifier

Linear Regression Example

Robust linear model estimation using RANSAC

Sparsity Example: Fitting only features 1 and 2

Lasso on dense and sparse data

HuberRegressor vs Ridge on dataset with strong outliers

Joint feature selection with multi-task Lasso

Comparing various online solvers

Orthogonal Matching Pursuit

MNIST classfification using multinomial logistic + L1

Plot multi-class SGD on the iris dataset

Lasso and Elastic Net for Sparse Signals

Theil-Sen Regression

Plot multinomial and One-vs-Rest Logistic Regression

Robust linear estimator fitting

L1 Penalty and Sparsity in Logistic Regression

Lasso and Elastic Net

Automatic Relevance Determination Regression (ARD)

Bayesian Ridge Regression

Lasso model selection: Cross-Validation / AIC / BIC

Multiclass sparse logisitic regression on newgroups20

Early stopping of Stochastic Gradient Descent

Manifold learning

Examples concerning the sklearn.manifold module.

Swiss Roll reduction with LLE

Multi-dimensional scaling

t-SNE: The effect of various perplexity values on the shape

Comparison of Manifold Learning methods

Manifold Learning methods on a severed sphere

Manifold learning on handwritten digits: Locally Linear Embedding, Isomap…

Gaussian Mixture Models

Examples concerning the sklearn.mixture module.

Density Estimation for a Gaussian mixture

Gaussian Mixture Model Ellipsoids

Gaussian Mixture Model Selection

GMM covariances

Gaussian Mixture Model Sine Curve

Concentration Prior Type Analysis of Variation Bayesian Gaussian Mixture

Model Selection

Examples related to the sklearn.model_selection module.

Plotting Cross-Validated Predictions

Plotting Validation Curves

Underfitting vs. Overfitting

Parameter estimation using grid search with cross-validation

Train error vs Test error

Receiver Operating Characteristic (ROC) with cross validation

Comparing randomized search and grid search for hyperparameter estimation

Nested versus non-nested cross-validation

Demonstration of multi-metric evaluation on cross_val_score and GridSearchCV

Balance model complexity and cross-validated score

Sample pipeline for text feature extraction and evaluation

Confusion matrix

Visualizing cross-validation behavior in scikit-learn

Receiver Operating Characteristic (ROC)

Plotting Learning Curves

Precision-Recall

Multioutput methods

Examples concerning the sklearn.multioutput module.

Classifier Chain

Nearest Neighbors

Examples concerning the sklearn.neighbors module.

Nearest Neighbors regression

Outlier detection with Local Outlier Factor (LOF)

Nearest Neighbors Classification

Nearest Centroid Classification

Kernel Density Estimation

Novelty detection with Local Outlier Factor (LOF)

Comparing Nearest Neighbors with and without Neighborhood Components Analysis

Dimensionality Reduction with Neighborhood Components Analysis

Kernel Density Estimate of Species Distributions

Neighborhood Components Analysis Illustration

Simple 1D Kernel Density Estimation

Neural Networks

Examples concerning the sklearn.neural_network module.

Visualization of MLP weights on MNIST

Restricted Boltzmann Machine features for digit classification

Varying regularization in Multi-layer Perceptron

Compare Stochastic learning strategies for MLPClassifier

Preprocessing

Examples concerning the sklearn.preprocessing module.

Using FunctionTransformer to select columns

Using KBinsDiscretizer to discretize continuous features

Demonstrating the different strategies of KBinsDiscretizer

Importance of Feature Scaling

Map data to a normal distribution

Feature discretization

Compare the effect of different scalers on data with outliers

Semi Supervised Classification

Examples concerning the sklearn.semi_supervised module.

Decision boundary of label propagation versus SVM on the Iris dataset

Label Propagation learning a complex structure

Label Propagation digits: Demonstrating performance

Label Propagation digits active learning

Support Vector Machines

Examples concerning the sklearn.svm module.

Non-linear SVM

SVM: Maximum margin separating hyperplane

SVM with custom kernel

SVM: Weighted samples

SVM: Separating hyperplane for unbalanced classes

SVM-Kernels

SVM-Anova: SVM with univariate feature selection

Support Vector Regression (SVR) using linear and non-linear kernels

SVM Margins Example

One-class SVM with non-linear kernel (RBF)

Plot different SVM classifiers in the iris dataset

Scaling the regularization parameter for SVCs

RBF SVM parameters

Working with text documents

Examples concerning the sklearn.feature_extraction.text module.

FeatureHasher and DictVectorizer Comparison

Clustering text documents using k-means

Classification of text documents using sparse features

Decision Trees

Examples concerning the sklearn.tree module.

Decision Tree Regression

Multi-output Decision Tree Regression

Plot the decision surface of a decision tree on the iris dataset

Understanding the decision tree structure