Fix Fixed a bug in cluster.KMeans where rounding errors could prevent convergence to be declared when tol=0. #17959 by Jérémie du Boisberranger.

Fix Fixed a bug in cluster.KMeans and cluster.MiniBatchKMeans where the reported inertia was incorrectly weighted by the sample weights. #17848 by Jérémie du Boisberranger.

Fix Fixed a bug in cluster.MeanShift with bin_seeding=True. When the estimated bandwidth is 0, the behavior is equivalent to bin_seeding=False. #17742 by Jeremie du Boisberranger.

Fix Fixed a bug in cluster.AffinityPropagation, that gives incorrect clusters when the array dtype is float32. #17995 by Thomaz Santana and Amanda Dsouza.

Fix Fixed a bug in decomposition.MiniBatchDictionaryLearning.partial_fit which should update the dictionary by iterating only once over a mini-batch. #17433 by Chiara Marmo.

Fix Avoid overflows on Windows in decomposition.IncrementalPCA.partial_fit for large batch_size and n_samples values. #17985 by Alan Butler and Amanda Dsouza.

Fix Fixed bug in ensemble.MultinomialDeviance where the average of logloss was incorrectly calculated as sum of logloss. #17694 by Markus Rempfler and Tsutomu Kusanagi.

Fix Fixes ensemble.StackingClassifier and ensemble.StackingRegressor compatibility with estimators that do not define n_features_in_. #17357 by Thomas Fan.

Fix Fixes bug in feature_extraction.text.CountVectorizer where sample order invariance was broken when max_features was set and features had the same count. #18016 by Thomas Fan, Roman Yurchak, and Joel Nothman.

Fix linear_model.lars_path does not overwrite X when X_copy=True and Gram='auto'. #17914 by Thomas Fan.

Fix Fixed a bug where metrics.pairwise_distances would raise an error if metric='seuclidean' and X is not type np.float64. #15730 by Forrest Koch.

Fix Fixed a bug in metrics.mean_squared_error where the average of multiple RMSE values was incorrectly calculated as the root of the average of multiple MSE values. #17309 by Swier Heeres.

Fix pipeline.FeatureUnion raises a deprecation warning when None is included in transformer_list. #17360 by Thomas Fan.

Fix Fix utils.estimator_checks.check_estimator so that all test cases support the binary_only estimator tag. #17812 by Bruno Charron.

Efficiency cluster.KMeans efficiency has been improved for very small datasets. In particular it cannot spawn idle threads any more. #17210 and #17235 by Jeremie du Boisberranger.

Fix Fixed a bug in cluster.KMeans where the sample weights provided by the user were modified in place. #17204 by Jeremie du Boisberranger.

Fix Fixed a bug in the repr of third-party estimators that use a **kwargs parameter in their constructor, when changed_only is True which is now the default. #17205 by Nicolas Hug.

Efficiency cluster.Birch implementation of the predict method avoids high memory footprint by calculating the distances matrix using a chunked scheme. #16149 by Jeremie du Boisberranger and Alex Shacked.

Efficiency Major Feature The critical parts of cluster.KMeans have a more optimized implementation. Parallelism is now over the data instead of over initializations allowing better scalability. #11950 by Jeremie du Boisberranger.

Enhancement cluster.KMeans now supports sparse data when solver = "elkan". #11950 by Jeremie du Boisberranger.

Enhancement cluster.AgglomerativeClustering has a faster and more memory efficient implementation of single linkage clustering. #11514 by Leland McInnes.

Fix cluster.KMeans with algorithm="elkan" now converges with tol=0 as with the default algorithm="full". #16075 by Erich Schubert.

Fix Fixed a bug in cluster.Birch where the n_clusters parameter could not have a np.int64 type. #16484 by Jeremie du Boisberranger.

Fix cluster.AgglomerativeCluClustering add specific error when distance matrix is not square and affinity=precomputed. #16257 by Simona Maggio.

API Change The n_jobs parameter of cluster.KMeans, cluster.SpectralCoclustering and cluster.SpectralBiclustering is deprecated. They now use OpenMP based parallelism. For more details on how to control the number of threads, please refer to our Parallelism notes. #11950 by Jeremie du Boisberranger.

API Change The precompute_distances parameter of cluster.KMeans is deprecated. It has no effect. #11950 by Jeremie du Boisberranger.

API Change The random_state parameter has been added to cluster.AffinityPropagation. #16801 by @rcwoolston and Chiara Marmo.

Efficiency compose.ColumnTransformer is now faster when working with dataframes and strings are used to specific subsets of data for transformers. #16431 by Thomas Fan.

Enhancement compose.ColumnTransformer method get_feature_names now supports 'passthrough' columns, with the feature name being either the column name for a dataframe, or 'xi' for column index i. #14048 by Lewis Ball.

Fix compose.ColumnTransformer method get_feature_names now returns correct results when one of the transformer steps applies on an empty list of columns #15963 by Roman Yurchak.

Fix compose.ColumnTransformer.fit will error when selecting a column name that is not unique in the dataframe. #16431 by Thomas Fan.

Efficiency datasets.fetch_openml has reduced memory usage because it no longer stores the full dataset text stream in memory. #16084 by Joel Nothman.

Feature datasets.fetch_california_housing now supports heterogeneous data using pandas by setting as_frame=True. #15950 by Stephanie Andrews and Reshama Shaikh.

Feature embedded dataset loaders load_breast_cancer, load_diabetes, load_digits, load_iris, load_linnerud and load_wine now support loading as a pandas DataFrame by setting as_frame=True. #15980 by @wconnell and Reshama Shaikh.

Enhancement Added return_centers parameter in datasets.make_blobs, which can be used to return centers for each cluster. #15709 by @shivamgargsya and Venkatachalam N.

Enhancement Functions datasets.make_circles and datasets.make_moons now accept two-element tuple. #15707 by Maciej J Mikulski.

Fix datasets.make_multilabel_classification now generates ValueError for arguments n_classes < 1 OR length < 1. #16006 by Rushabh Vasani.

API Change The StreamHandler was removed from sklearn.logger to avoid double logging of messages in common cases where a hander is attached to the root logger, and to follow the Python logging documentation recommendation for libraries to leave the log message handling to users and application code. #16451 by Christoph Deil.

Enhancement decomposition.NMF and decomposition.non_negative_factorization now preserves float32 dtype. #16280 by Jeremie du Boisberranger.

Enhancement TruncatedSVD.transform is now faster on given sparse csc matrices. #16837 by @wornbb.

Fix decomposition.PCA with a float n_components parameter, will exclusively choose the components that explain the variance greater than n_components. #15669 by Krishna Chaitanya

Fix decomposition.PCA with n_components='mle' now correctly handles small eigenvalues, and does not infer 0 as the correct number of components. #16224 by Lisa Schwetlick, and Gelavizh Ahmadi and Marija Vlajic Wheeler and #16841 by Nicolas Hug.

Fix decomposition.KernelPCA method inverse_transform now applies the correct inverse transform to the transformed data. #16655 by Lewis Ball.

Fix Fixed bug that was causing decomposition.KernelPCA to sometimes raise invalid value encountered in multiply during fit. #16718 by Gui Miotto.

Feature Added n_components_ attribute to decomposition.SparsePCA and decomposition.MiniBatchSparsePCA. #16981 by Mateusz Górski.

Major Feature ensemble.HistGradientBoostingClassifier and ensemble.HistGradientBoostingRegressor now support sample_weight. #14696 by Adrin Jalali and Nicolas Hug.

Feature Early stopping in ensemble.HistGradientBoostingClassifier and ensemble.HistGradientBoostingRegressor is now determined with a new early_stopping parameter instead of n_iter_no_change. Default value is ‘auto’, which enables early stopping if there are at least 10,000 samples in the training set. #14516 by Johann Faouzi.

Major Feature ensemble.HistGradientBoostingClassifier and ensemble.HistGradientBoostingRegressor now support monotonic constraints, useful when features are supposed to have a positive/negative effect on the target. #15582 by Nicolas Hug.

API Change Added boolean verbose flag to classes: ensemble.VotingClassifier and ensemble.VotingRegressor. #16069 by Sam Bail, Hanna Bruce MacDonald, Reshama Shaikh, and Chiara Marmo.

API Change Fixed a bug in ensemble.HistGradientBoostingClassifier and ensemble.HistGradientBoostingRegrerssor that would not respect the max_leaf_nodes parameter if the criteria was reached at the same time as the max_depth criteria. #16183 by Nicolas Hug.

Fix Changed the convention for max_depth parameter of ensemble.HistGradientBoostingClassifier and ensemble.HistGradientBoostingRegressor. The depth now corresponds to the number of edges to go from the root to the deepest leaf. Stumps (trees with one split) are now allowed. #16182 by Santhosh B

Fix Fixed a bug in ensemble.BaggingClassifier, ensemble.BaggingRegressor and ensemble.IsolationForest where the attribute estimators_samples_ did not generate the proper indices used during fit. #16437 by Jin-Hwan CHO.

Fix Fixed a bug in ensemble.StackingClassifier and ensemble.StackingRegressor where the sample_weight argument was not being passed to cross_val_predict when evaluating the base estimators on cross-validation folds to obtain the input to the meta estimator. #16539 by Bill DeRose.

Feature Added additional option loss="poisson" to ensemble.HistGradientBoostingRegressor, which adds Poisson deviance with log-link useful for modeling count data. #16692 by Christian Lorentzen

Fix Fixed a bug where ensemble.HistGradientBoostingRegressor and ensemble.HistGradientBoostingClassifier would fail with multiple calls to fit when warm_start=True, early_stopping=True, and there is no validation set. #16663 by Thomas Fan.

Efficiency feature_extraction.text.CountVectorizer now sorts features after pruning them by document frequency. This improves performances for datasets with large vocabularies combined with min_df or max_df. #15834 by Santiago M. Mola.

Enhancement Added support for multioutput data in feature_selection.RFE and feature_selection.RFECV. #16103 by Divyaprabha M.

API Change Adds feature_selection.SelectorMixin back to public API. #16132 by @trimeta.

Enhancement gaussian_process.kernels.Matern returns the RBF kernel when nu=np.inf. #15503 by Sam Dixon.

Fix Fixed bug in gaussian_process.GaussianProcessRegressor that caused predicted standard deviations to only be between 0 and 1 when WhiteKernel is not used. #15782 by @plgreenLIRU.

Enhancement impute.IterativeImputer accepts both scalar and array-like inputs for max_value and min_value. Array-like inputs allow a different max and min to be specified for each feature. #16403 by Narendra Mukherjee.

Enhancement impute.SimpleImputer, impute.KNNImputer, and impute.IterativeImputer accepts pandas’ nullable integer dtype with missing values. #16508 by Thomas Fan.

Feature inspection.partial_dependence and inspection.plot_partial_dependence now support the fast ‘recursion’ method for ensemble.RandomForestRegressor and tree.DecisionTreeRegressor. #15864 by Nicolas Hug.

Major Feature Added generalized linear models (GLM) with non normal error distributions, including linear_model.PoissonRegressor, linear_model.GammaRegressor and linear_model.TweedieRegressor which use Poisson, Gamma and Tweedie distributions respectively. #14300 by Christian Lorentzen, Roman Yurchak, and Olivier Grisel.

Major Feature Support of sample_weight in linear_model.ElasticNet and linear_model.Lasso for dense feature matrix X. #15436 by Christian Lorentzen.

Efficiency linear_model.RidgeCV and linear_model.RidgeClassifierCV now does not allocate a potentially large array to store dual coefficients for all hyperparameters during its fit, nor an array to store all error or LOO predictions unless store_cv_values is True. #15652 by Jérôme Dockès.

Enhancement linear_model.LassoLars and linear_model.Lars now support a jitter parameter that adds random noise to the target. This might help with stability in some edge cases. #15179 by @angelaambroz.

Fix Fixed a bug where if a sample_weight parameter was passed to the fit method of linear_model.RANSACRegressor, it would not be passed to the wrapped base_estimator during the fitting of the final model. #15773 by Jeremy Alexandre.

Fix add best_score_ attribute to linear_model.RidgeCV and linear_model.RidgeClassifierCV. #15653 by Jérôme Dockès.

Fix Fixed a bug in linear_model.RidgeClassifierCV to pass a specific scoring strategy. Before the internal estimator outputs score instead of predictions. #14848 by Venkatachalam N.

Fix linear_model.LogisticRegression will now avoid an unnecessary iteration when solver='newton-cg' by checking for inferior or equal instead of strictly inferior for maximum of absgrad and tol in utils.optimize._newton_cg. #16266 by Rushabh Vasani.

API Change Deprecated public attributes standard_coef_, standard_intercept_, average_coef_, and average_intercept_ in linear_model.SGDClassifier, linear_model.SGDRegressor, linear_model.PassiveAggressiveClassifier, linear_model.PassiveAggressiveRegressor. #16261 by Carlos Brandt.

Fix Efficiency linear_model.ARDRegression is more stable and much faster when n_samples > n_features. It can now scale to hundreds of thousands of samples. The stability fix might imply changes in the number of non-zero coefficients and in the predicted output. #16849 by Nicolas Hug.

Fix Fixed a bug in linear_model.ElasticNetCV, linear_model.MultitaskElasticNetCV, linear_model.LassoCV and linear_model.MultitaskLassoCV where fitting would fail when using joblib loky backend. #14264 by Jérémie du Boisberranger.

Efficiency Speed up linear_model.MultiTaskLasso, linear_model.MultiTaskLassoCV, linear_model.MultiTaskElasticNet, linear_model.MultiTaskElasticNetCV by avoiding slower BLAS Level 2 calls on small arrays #17021 by Alex Gramfort and Mathurin Massias.

Enhancement metrics.pairwise.pairwise_distances_chunked now allows its reduce_func to not have a return value, enabling in-place operations. #16397 by Joel Nothman.

Fix Fixed a bug in metrics.mean_squared_error to not ignore argument squared when argument multioutput='raw_values'. #16323 by Rushabh Vasani

Fix Fixed a bug in metrics.mutual_info_score where negative scores could be returned. #16362 by Thomas Fan.

Fix Fixed a bug in metrics.confusion_matrix that would raise an error when y_true and y_pred were length zero and labels was not None. In addition, we raise an error when an empty list is given to the labels parameter. #16442 by Kyle Parsons.

API Change Changed the formatting of values in metrics.ConfusionMatrixDisplay.plot and metrics.plot_confusion_matrix to pick the shorter format (either ‘2g’ or ‘d’). #16159 by Rick Mackenbach and Thomas Fan.

API Change From version 0.25, metrics.pairwise.pairwise_distances will no longer automatically compute the VI parameter for Mahalanobis distance and the V parameter for seuclidean distance if Y is passed. The user will be expected to compute this parameter on the training data of their choice and pass it to pairwise_distances. #16993 by Joel Nothman.

Enhancement model_selection.GridSearchCV and model_selection.RandomizedSearchCV yields stack trace information in fit failed warning messages in addition to previously emitted type and details. #15622 by Gregory Morse.

Fix model_selection.cross_val_predict supports method="predict_proba" when y=None. #15918 by Luca Kubin.

Fix model_selection.fit_grid_point is deprecated in 0.23 and will be removed in 0.25. #16401 by Arie Pratama Sutiono

Enhancement multioutput.RegressorChain now supports fit_params for base_estimator during fit. #16111 by Venkatachalam N.

Fix A correctly formatted error message is shown in naive_bayes.CategoricalNB when the number of features in the input differs between predict and fit. #16090 by Madhura Jayaratne.

Efficiency neural_network.MLPClassifier and neural_network.MLPRegressor has reduced memory footprint when using stochastic solvers, 'sgd' or 'adam', and shuffle=True. #14075 by @meyer89.

Fix Increases the numerical stability of the logistic loss function in neural_network.MLPClassifier by clipping the probabilities. #16117 by Thomas Fan.

Enhancement inspection.PartialDependenceDisplay now exposes the deciles lines as attributes so they can be hidden or customized. #15785 by Nicolas Hug

Feature argument drop of preprocessing.OneHotEncoder will now accept value ‘if_binary’ and will drop the first category of each feature with two categories. #16245 by Rushabh Vasani.

Enhancement preprocessing.OneHotEncoder’s drop_idx_ ndarray can now contain None, where drop_idx_[i] = None means that no category is dropped for index i. #16585 by Chiara Marmo.

Enhancement preprocessing.MaxAbsScaler, preprocessing.MinMaxScaler, preprocessing.StandardScaler, preprocessing.PowerTransformer, preprocessing.QuantileTransformer, preprocessing.RobustScaler now supports pandas’ nullable integer dtype with missing values. #16508 by Thomas Fan.

Efficiency preprocessing.OneHotEncoder is now faster at transforming. #15762 by Thomas Fan.

Fix Fix a bug in preprocessing.StandardScaler which was incorrectly computing statistics when calling partial_fit on sparse inputs. #16466 by Guillaume Lemaitre.

Fix Fix a bug in preprocessing.Normalizer with norm=’max’, which was not taking the absolute value of the maximum values before normalizing the vectors. #16632 by Maura Pintor and Battista Biggio.

Fix semi_supervised.LabelSpreading and semi_supervised.LabelPropagation avoids divide by zero warnings when normalizing label_distributions_. #15946 by @ngshya.

Fix Efficiency Improved libsvm and liblinear random number generators used to randomly select coordinates in the coordinate descent algorithms. Platform-dependent C rand() was used, which is only able to generate numbers up to 32767 on windows platform (see this blog post) and also has poor randomization power as suggested by this presentation. It was replaced with C++11 mt19937, a Mersenne Twister that correctly generates 31bits/63bits random numbers on all platforms. In addition, the crude “modulo” postprocessor used to get a random number in a bounded interval was replaced by the tweaked Lemire method as suggested by this blog post. Any model using the svm.libsvm or the svm.liblinear solver, including svm.LinearSVC, svm.LinearSVR, svm.NuSVC, svm.NuSVR, svm.OneClassSVM, svm.SVC, svm.SVR, linear_model.LogisticRegression, is affected. In particular users can expect a better convergence when the number of samples (LibSVM) or the number of features (LibLinear) is large. #13511 by Sylvain Marié.

Fix Fix use of custom kernel not taking float entries such as string kernels in svm.SVC and svm.SVR. Note that custom kennels are now expected to validate their input where they previously received valid numeric arrays. #11296 by Alexandre Gramfort and Georgi Peev.

API Change svm.SVR and svm.OneClassSVM attributes, probA_ and probB_, are now deprecated as they were not useful. #15558 by Thomas Fan.

Fix tree.plot_tree rotate parameter was unused and has been deprecated. #15806 by Chiara Marmo.

Fix Fix support of read-only float32 array input in predict, decision_path and predict_proba methods of tree.DecisionTreeClassifier, tree.ExtraTreeClassifier and ensemble.GradientBoostingClassifier as well as predict method of tree.DecisionTreeRegressor, tree.ExtraTreeRegressor, and ensemble.GradientBoostingRegressor. #16331 by Alexandre Batisse.

Major Feature Estimators can now be displayed with a rich html representation. This can be enabled in Jupyter notebooks by setting display='diagram' in set_config. The raw html can be returned by using utils.estimator_html_repr. #14180 by Thomas Fan.

Enhancement improve error message in utils.validation.column_or_1d. #15926 by Loïc Estève.

Enhancement add warning in utils.check_array for pandas sparse DataFrame. #16021 by Rushabh Vasani.

Enhancement utils.check_array now constructs a sparse matrix from a pandas DataFrame that contains only SparseArray columns. #16728 by Thomas Fan.

Enhancement utils.validation.check_array supports pandas’ nullable integer dtype with missing values when force_all_finite is set to False or 'allow-nan' in which case the data is converted to floating point values where pd.NA values are replaced by np.nan. As a consequence, all sklearn.preprocessing transformers that accept numeric inputs with missing values represented as np.nan now also accepts being directly fed pandas dataframes with pd.Int* or `pd.Uint* typed columns that use pd.NA as a missing value marker. #16508 by Thomas Fan.

API Change Passing classes to utils.estimator_checks.check_estimator and utils.estimator_checks.parametrize_with_checks is now deprecated, and support for classes will be removed in 0.24. Pass instances instead. #17032 by Nicolas Hug.

API Change The private utility _safe_tags in utils.estimator_checks was removed, hence all tags should be obtained through estimator._get_tags(). Note that Mixins like RegressorMixin must come before base classes in the MRO for _get_tags() to work properly. #16950 by Nicolas Hug.

Fix utils.all_estimators now only returns public estimators. #15380 by Thomas Fan.

Major Feature Adds a HTML representation of estimators to be shown in a jupyter notebook or lab. This visualization is acitivated by setting the display option in sklearn.set_config. #14180 by Thomas Fan.

Enhancement scikit-learn now works with mypy without errors. #16726 by Roman Yurchak.

API Change Most estimators now expose a n_features_in_ attribute. This attribute is equal to the number of features passed to the fit method. See SLEP010 for details. #16112 by Nicolas Hug.

API Change Estimators now have a requires_y tags which is False by default except for estimators that inherit from ~sklearn.base.RegressorMixin or ~sklearn.base.ClassifierMixin. This tag is used to ensure that a proper error message is raised when y was expected but None was passed. #16622 by Nicolas Hug.

API Change The default setting print_changed_only has been changed from False to True. This means that the repr of estimators is now more concise and only shows the parameters whose default value has been changed when printing an estimator. You can restore the previous behaviour by using sklearn.set_config(print_changed_only=False). Also, note that it is always possible to quickly inspect the parameters of any estimator using est.get_params(deep=False). #17061 by Nicolas Hug.