Indexed by TopGit from live GitHub metadata: ray-project/tune-sklearn has 468 stars, written primarily in Python. A drop-in replacement for Scikit-Learn’s GridSearchCV / RandomizedSearchCV -- but with cutting edge hyperparameter tuning techniques.
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
WHY NO REVIEW YET
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
Tune-sklearn is a drop-in replacement for Scikit-Learn’s model selection module (GridSearchCV, RandomizedSearchCV) with cutting edge hyperparameter tuning techniques.
⚠️ tune-sklearn is no longer being maintained
The latest release 0.5.0 is the last version of the library that will be released by the Ray team, and it is compatible
with ray>=2.7.x, ray<=2.9.x. The library will not be guaranteed to work with future Ray versions.
The recommended alternative to keep up with the latest version of Ray is to migrate tune-sklearn usage
to the Ray Tune APIs to accomplish the same thing.
Feel free to post an issue on the Ray Github if you run into any issues in migrating.
Features
Here’s what tune-sklearn has to offer:
Consistency with Scikit-Learn API: Change less than 5 lines in a standard Scikit-Learn script to use the API [example].
Modern tuning techniques: tune-sklearn allows you to easily leverage Bayesian Optimization, HyperBand, BOHB, and other optimization techniques by simply toggling a few parameters.
Framework support: tune-sklearn is used primarily for tuning Scikit-Learn models, but it also supports and provides examples for many other frameworks with Scikit-Learn wrappers such as Skorch (Pytorch) [example], KerasClassifier (Keras) [example], and XGBoostClassifier (XGBoost) [example].
Scale up: Tune-sklearn leverages Ray Tune, a library for distributed hyperparameter tuning, to parallelize cross validation on multiple cores and even multiple machines without changing your code.
Check out our API Documentation and Walkthrough (for master branch).
For certain estimators, tune-sklearn can also immediately enable incremental training and early stopping. Such estimators include:
Estimators that implement 'warm_start' (except for ensemble classifiers and decision trees)
Estimators that implement partial fit
XGBoost, LightGBM and CatBoost models (via incremental learning)
To read more about compatible scikit-learn models, see scikit-learn's documentation at section 8.1.1.3.
Early stopping algorithms that can be enabled include HyperBand and Median Stopping (see below for examples).
If the estimator does not support partial_fit, a warning will be shown saying early stopping cannot be done and it will simply run the cross-validation on Ray's parallel back-end.
Apart from early stopping scheduling algorithms, tune-sklearn also supports passing custom stoppers to Ray Tune. These
can be passed via the stopper argument when instantiating TuneSearchCV or TuneGridSearchCV.
See the Ray documentation for an overview of available stoppers.
Examples
TuneGridSearchCV
To start out, it’s as easy as changing our import statement to get Tune’s grid search cross validation interface, and the rest is almost identical!
TuneGridSearchCV accepts dictionaries in the format { param_name: str : distribution: list } or a list of such dictionaries, just like scikit-learn's GridSearchCV. The distribution can also be the output of Ray Tune's tune.grid_search.
# from sklearn.model_selection import GridSearchCV
from tune_sklearn import TuneGridSearchCV
# Other imports
import numpy as np
from sklearn.datasets import make_classification
from sklearn.model_selection import train_test_split
from sklearn.linear_model import SGDClassifier
# Set training and validation sets
X, y = make_classification(n_samples=11000, n_features=1000, n_informative=50, n_redundant=0, n_classes=10, class_sep=2.5)
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=1000)
# Example parameters to tune from SGDClassifier
parameters = {
'alpha': [1e-4, 1e-1, 1],
'epsilon':[0.01, 0.1]
}
tune_search = TuneGridSearchCV(
SGDClassifier(),
parameters,
early_stopping="MedianStoppingRule",
max_iters=10
)
import time # Just to compare fit times
start = time.time()
tune_search.fit(X_train, y_train)
end = time.time()
print("Tune Fit Time:", end - start)
pred = tune_search.predict(X_test)
accuracy = np.count_nonzero(np.array(pred) == np.array(y_test)) / len(pred)
print("Tune Accuracy:", accuracy)
If you'd like to compare fit times with sklearn's GridSearchCV, run the following block of code:
from sklearn.model_selection import GridSearchCV
# n_jobs=-1 enables use of all cores like Tune does
sklearn_search = GridSearchCV(
SGDClassifier(),
parameters,
n_jobs=-1
)
start = time.time()
sklearn_search.fit(X_train, y_train)
end = time.time()
print("Sklearn Fit Time:", end - start)
pred = sklearn_search.predict(X_test)
accuracy = np.count_nonzero(np.array(pred) == np.array(y_test)) / len(pred)
print("Sklearn Accuracy:", accuracy)
TuneSearchCV
TuneSearchCV is an upgraded version of scikit-learn's RandomizedSearchCV.
It also provides a wrapper for several search optimization algorithms from Ray Tune's searchers, which in turn are wrappers for other libraries. The selection of the search algorithm is controlled by the search_optimization parameter. In order to use other algorithms, you need to install the libraries they depend on (pip install column). The search algorithms are as follows:
Algorithm
search_optimization value
Summary
Website
pip install
(Random Search)
"random"
Randomized Search
built-in
SkoptSearch
"bayesian"
Bayesian Optimization
[Scikit-Optimize]
scikit-optimize
HyperOptSearch
"hyperopt"
Tree-Parzen Estimators
[HyperOpt]
hyperopt
TuneBOHB
"bohb"
Bayesian Opt/HyperBand
[BOHB]
hpbandster ConfigSpace
Optuna
"optuna"
Tree-Parzen Estimators
[Optuna]
optuna
All algorithms other than RandomListSearcher accept parameter distributions in the form of dictionaries in the format { param_name: str : distribution: tuple or list }.
Tuples represent real distributions and should be two-element or three-element, in the format (lower_bound: float, upper_bound: float, Optional: "uniform" (default) or "log-uniform"). Lists represent categorical distributions. Ray Tune Search Spaces are also supported and provide a rich set of potential distributions. Search spaces allow for users to specify complex, potentially nested search spaces and parameter distributions. Furthermore, each algorithm also accepts parameters in their own specific format. More information in Tune documentation.
Random Search (default) accepts dictionaries in the format { param_name: str : distribution: list } or a list of such dictionaries, just like scikit-learn's RandomizedSearchCV.
from tune_sklearn import TuneSearchCV
# Other imports
import scipy
from ray import tune
from sklearn.datasets import make_classification
from sklearn.model_selection import train_test_split
from sklearn.linear_model import SGDClassifier
# Set training and validation sets
X, y = make_classification(n_samples=11000, n_features=1000, n_informative=50, n_redundant=0, n_classes=10, class_sep=2.5)
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=1000)
# Example parameter distributions to tune from SGDClassifier
# Note the use of tuples instead if non-random optimization is desired
param_dists = {
'loss': ['squared_hinge', 'hinge'],
'alpha': (1e-4, 1e-1, 'log-uniform'),
'epsilon': (1e-2, 1e-1)
}
bohb_tune_search = TuneSearchCV(SGDClassifier(),
param_distributions=param_dists,
n_trials=2,
max_iters=10,
search_optimization="bohb"
)
bohb_tune_search.fit(X_train, y_train)
# Define the `param_dists using the SearchSpace API
# This allows the specification of sampling from discrete and
# categorical distributions (below for the `learning_rate` scheduler parameter)
param_dists = {
'loss': tune.choice(['squared_hinge', 'hinge']),
'alpha': tune.loguniform(1e-4, 1e-1),
'epsilon': tune.uniform(1e-2, 1e-1),
}
hyperopt_tune_search = TuneSearchCV(SGDClassifier(),
param_distributions=param_dists,
n_trials=2,
early_stopping=True, # uses Async HyperBand if set to True
max_iters=10,
search_optimization="hyperopt"
)
hyperopt_tune_search.fit(X_train, y_train)
Other Machine Learning Libraries and Examples
Tune-sklearn also supports the use of other machine learning libraries such as Pytorch (using Skorch) and Keras. You can find these examples here:
Keras
LightGBM
Sklearn Random Forest
Sklearn Pipeline
Pytorch (Skorch)
XGBoost
Documentation
See the auto-generated docs here.
These are generated by lazydocs and should be updated on every release:
How does ray-project/tune-sklearn compare to other AI Tools projects?
ray-project/tune-sklearn is tracked by TopGit in the AI Tools category, with 468 GitHub stars and written in Python. Browse the AI Tools topic page on TopGit to compare it against similar projects by stars and activity.
Is ray-project/tune-sklearn open source?
Yes — ray-project/tune-sklearn ships under the Apache-2.0 license, which makes its source code freely readable (and, depending on license terms, forkable and reusable). Source: github.com/ray-project/tune-sklearn.
What else is in the AI Tools space?
ray-project/tune-sklearn is tracked by TopGit under the AI Tools category, alongside 5 GitHub-tagged topics. Trending and Topics pages list peer repositories of comparable stars and language.
What is ray-project/tune-sklearn?
ray-project/tune-sklearn (ray-project/tune-sklearn) is a Python project on GitHub. From the project's own README: A drop-in replacement for Scikit-Learn’s GridSearchCV / RandomizedSearchCV -- but with cutting edge hyperparameter tuning techniques.
Where do I read more about ray-project/tune-sklearn?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/ray-project/tune-sklearn is the definitive source.
Why is ray-project/tune-sklearn categorized under AI Tools?
TopGit places ray-project/tune-sklearn in the AI Tools category based on its GitHub topics and description (tagged: "automl", "bayesian-optimization", "gridsearchcv"). Categories are assigned from real repository metadata, not editorial guesswork.
Read full README in the tab above.
Curious whether tune-sklearn is right for you?
Let ChatGPT, Claude, or Perplexity look into it — click below and see what AI actually says about tune-sklearn.