5. Dataset transformations

scikit-learn provides a library of transformers, which may clean (see Preprocessing data), reduce (see Unsupervised dimensionality reduction), expand (see Kernel Approximation) or generate (see Feature extraction) feature representations.

Like other estimators, these are represented by classes with a fit method, which learns model parameters (e.g. mean and standard deviation for normalization) from a training set, and a transform method which applies this transformation model to unseen data. fit_transform may be more convenient and efficient for modelling and transforming the training data simultaneously.

Combining such transformers, either in parallel or series is covered in Pipelines and composite estimators. Pairwise metrics, Affinities and Kernels covers transforming feature spaces into affinity matrices, while Transforming the prediction target (y) considers transformations of the target space (e.g. categorical labels) for use in scikit-learn.

• 5.1. Pipelines and composite estimators
  • 5.1.1. Pipeline: chaining estimators
    • 5.1.1.1. Usage
      • 5.1.1.1.1. Construction
      • 5.1.1.1.2. Accessing steps
      • 5.1.1.1.3. Nested parameters
    • 5.1.1.2. Notes
    • 5.1.1.3. Caching transformers: avoid repeated computation
  • 5.1.2. Transforming target in regression
  • 5.1.3. FeatureUnion: composite feature spaces
    • 5.1.3.1. Usage
  • 5.1.4. ColumnTransformer for heterogeneous data
• 5.2. Feature extraction
  • 5.2.1. Loading features from dicts
  • 5.2.2. Feature hashing
    • 5.2.2.1. Implementation details
  • 5.2.3. Text feature extraction
    • 5.2.3.1. The Bag of Words representation
    • 5.2.3.2. Sparsity
    • 5.2.3.3. Common Vectorizer usage
      • 5.2.3.3.1. Using stop words
    • 5.2.3.4. Tf–idf term weighting
    • 5.2.3.5. Decoding text files
    • 5.2.3.6. Applications and examples
    • 5.2.3.7. Limitations of the Bag of Words representation
    • 5.2.3.8. Vectorizing a large text corpus with the hashing trick
    • 5.2.3.9. Performing out-of-core scaling with HashingVectorizer
    • 5.2.3.10. Customizing the vectorizer classes
  • 5.2.4. Image feature extraction
    • 5.2.4.1. Patch extraction
    • 5.2.4.2. Connectivity graph of an image
• 5.3. Preprocessing data
  • 5.3.1. Standardization, or mean removal and variance scaling
    • 5.3.1.1. Scaling features to a range
    • 5.3.1.2. Scaling sparse data
    • 5.3.1.3. Scaling data with outliers
    • 5.3.1.4. Centering kernel matrices
  • 5.3.2. Non-linear transformation
    • 5.3.2.1. Mapping to a Uniform distribution
    • 5.3.2.2. Mapping to a Gaussian distribution
  • 5.3.3. Normalization
  • 5.3.4. Encoding categorical features
  • 5.3.5. Discretization
    • 5.3.5.1. K-bins discretization
    • 5.3.5.2. Feature binarization
  • 5.3.6. Imputation of missing values
  • 5.3.7. Generating polynomial features
  • 5.3.8. Custom transformers
• 5.4. Imputation of missing values
  • 5.4.1. Univariate vs. Multivariate Imputation
  • 5.4.2. Univariate feature imputation
  • 5.4.3. Multivariate feature imputation
    • 5.4.3.1. Flexibility of IterativeImputer
    • 5.4.3.2. Multiple vs. Single Imputation
  • 5.4.4. References
  • 5.4.5. Marking imputed values
• 5.5. Unsupervised dimensionality reduction
  • 5.5.1. PCA: principal component analysis
  • 5.5.2. Random projections
  • 5.5.3. Feature agglomeration
• 5.6. Random Projection
  • 5.6.1. The Johnson-Lindenstrauss lemma
  • 5.6.2. Gaussian random projection
  • 5.6.3. Sparse random projection
• 5.7. Kernel Approximation
  • 5.7.1. Nystroem Method for Kernel Approximation
  • 5.7.2. Radial Basis Function Kernel
  • 5.7.3. Additive Chi Squared Kernel
  • 5.7.4. Skewed Chi Squared Kernel
  • 5.7.5. Mathematical Details
• 5.8. Pairwise metrics, Affinities and Kernels
  • 5.8.1. Cosine similarity
  • 5.8.2. Linear kernel
  • 5.8.3. Polynomial kernel
  • 5.8.4. Sigmoid kernel
  • 5.8.5. RBF kernel
  • 5.8.6. Laplacian kernel
  • 5.8.7. Chi-squared kernel
• 5.9. Transforming the prediction target (y)
  • 5.9.1. Label binarization
  • 5.9.2. Label encoding