Là một công cụ AI, ray-project/tune-sklearn đã đạt 468 sao trên GitHub, ngôn ngữ Python. A drop-in replacement for Scikit-Learn’s GridSearchCV / RandomizedSearchCV -- but with cutting edge hyperparameter tuning techniques.
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
VÌ SAO CHƯA CÓ REVIEW
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
Tune-sklearn is a drop-in replacement for Scikit-Learn’s model selection module (GridSearchCV, RandomizedSearchCV) with cutting edge hyperparameter tuning techniques.
⚠️ tune-sklearn is no longer being maintained
The latest release 0.5.0 is the last version of the library that will be released by the Ray team, and it is compatible
with ray>=2.7.x, ray<=2.9.x. The library will not be guaranteed to work with future Ray versions.
The recommended alternative to keep up with the latest version of Ray is to migrate tune-sklearn usage
to the Ray Tune APIs to accomplish the same thing.
Feel free to post an issue on the Ray Github if you run into any issues in migrating.
Features
Here’s what tune-sklearn has to offer:
Consistency with Scikit-Learn API: Change less than 5 lines in a standard Scikit-Learn script to use the API [example].
Modern tuning techniques: tune-sklearn allows you to easily leverage Bayesian Optimization, HyperBand, BOHB, and other optimization techniques by simply toggling a few parameters.
Framework support: tune-sklearn is used primarily for tuning Scikit-Learn models, but it also supports and provides examples for many other frameworks with Scikit-Learn wrappers such as Skorch (Pytorch) [example], KerasClassifier (Keras) [example], and XGBoostClassifier (XGBoost) [example].
Scale up: Tune-sklearn leverages Ray Tune, a library for distributed hyperparameter tuning, to parallelize cross validation on multiple cores and even multiple machines without changing your code.
Check out our API Documentation and Walkthrough (for master branch).
For certain estimators, tune-sklearn can also immediately enable incremental training and early stopping. Such estimators include:
Estimators that implement 'warm_start' (except for ensemble classifiers and decision trees)
Estimators that implement partial fit
XGBoost, LightGBM and CatBoost models (via incremental learning)
To read more about compatible scikit-learn models, see scikit-learn's documentation at section 8.1.1.3.
Early stopping algorithms that can be enabled include HyperBand and Median Stopping (see below for examples).
If the estimator does not support partial_fit, a warning will be shown saying early stopping cannot be done and it will simply run the cross-validation on Ray's parallel back-end.
Apart from early stopping scheduling algorithms, tune-sklearn also supports passing custom stoppers to Ray Tune. These
can be passed via the stopper argument when instantiating TuneSearchCV or TuneGridSearchCV.
See the Ray documentation for an overview of available stoppers.
Examples
TuneGridSearchCV
To start out, it’s as easy as changing our import statement to get Tune’s grid search cross validation interface, and the rest is almost identical!
TuneGridSearchCV accepts dictionaries in the format { param_name: str : distribution: list } or a list of such dictionaries, just like scikit-learn's GridSearchCV. The distribution can also be the output of Ray Tune's tune.grid_search.
# from sklearn.model_selection import GridSearchCV
from tune_sklearn import TuneGridSearchCV
# Other imports
import numpy as np
from sklearn.datasets import make_classification
from sklearn.model_selection import train_test_split
from sklearn.linear_model import SGDClassifier
# Set training and validation sets
X, y = make_classification(n_samples=11000, n_features=1000, n_informative=50, n_redundant=0, n_classes=10, class_sep=2.5)
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=1000)
# Example parameters to tune from SGDClassifier
parameters = {
'alpha': [1e-4, 1e-1, 1],
'epsilon':[0.01, 0.1]
}
tune_search = TuneGridSearchCV(
SGDClassifier(),
parameters,
early_stopping="MedianStoppingRule",
max_iters=10
)
import time # Just to compare fit times
start = time.time()
tune_search.fit(X_train, y_train)
end = time.time()
print("Tune Fit Time:", end - start)
pred = tune_search.predict(X_test)
accuracy = np.count_nonzero(np.array(pred) == np.array(y_test)) / len(pred)
print("Tune Accuracy:", accuracy)
If you'd like to compare fit times with sklearn's GridSearchCV, run the following block of code:
from sklearn.model_selection import GridSearchCV
# n_jobs=-1 enables use of all cores like Tune does
sklearn_search = GridSearchCV(
SGDClassifier(),
parameters,
n_jobs=-1
)
start = time.time()
sklearn_search.fit(X_train, y_train)
end = time.time()
print("Sklearn Fit Time:", end - start)
pred = sklearn_search.predict(X_test)
accuracy = np.count_nonzero(np.array(pred) == np.array(y_test)) / len(pred)
print("Sklearn Accuracy:", accuracy)
TuneSearchCV
TuneSearchCV is an upgraded version of scikit-learn's RandomizedSearchCV.
It also provides a wrapper for several search optimization algorithms from Ray Tune's searchers, which in turn are wrappers for other libraries. The selection of the search algorithm is controlled by the search_optimization parameter. In order to use other algorithms, you need to install the libraries they depend on (pip install column). The search algorithms are as follows:
Algorithm
search_optimization value
Summary
Website
pip install
(Random Search)
"random"
Randomized Search
built-in
SkoptSearch
"bayesian"
Bayesian Optimization
[Scikit-Optimize]
scikit-optimize
HyperOptSearch
"hyperopt"
Tree-Parzen Estimators
[HyperOpt]
hyperopt
TuneBOHB
"bohb"
Bayesian Opt/HyperBand
[BOHB]
hpbandster ConfigSpace
Optuna
"optuna"
Tree-Parzen Estimators
[Optuna]
optuna
All algorithms other than RandomListSearcher accept parameter distributions in the form of dictionaries in the format { param_name: str : distribution: tuple or list }.
Tuples represent real distributions and should be two-element or three-element, in the format (lower_bound: float, upper_bound: float, Optional: "uniform" (default) or "log-uniform"). Lists represent categorical distributions. Ray Tune Search Spaces are also supported and provide a rich set of potential distributions. Search spaces allow for users to specify complex, potentially nested search spaces and parameter distributions. Furthermore, each algorithm also accepts parameters in their own specific format. More information in Tune documentation.
Random Search (default) accepts dictionaries in the format { param_name: str : distribution: list } or a list of such dictionaries, just like scikit-learn's RandomizedSearchCV.
from tune_sklearn import TuneSearchCV
# Other imports
import scipy
from ray import tune
from sklearn.datasets import make_classification
from sklearn.model_selection import train_test_split
from sklearn.linear_model import SGDClassifier
# Set training and validation sets
X, y = make_classification(n_samples=11000, n_features=1000, n_informative=50, n_redundant=0, n_classes=10, class_sep=2.5)
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=1000)
# Example parameter distributions to tune from SGDClassifier
# Note the use of tuples instead if non-random optimization is desired
param_dists = {
'loss': ['squared_hinge', 'hinge'],
'alpha': (1e-4, 1e-1, 'log-uniform'),
'epsilon': (1e-2, 1e-1)
}
bohb_tune_search = TuneSearchCV(SGDClassifier(),
param_distributions=param_dists,
n_trials=2,
max_iters=10,
search_optimization="bohb"
)
bohb_tune_search.fit(X_train, y_train)
# Define the `param_dists using the SearchSpace API
# This allows the specification of sampling from discrete and
# categorical distributions (below for the `learning_rate` scheduler parameter)
param_dists = {
'loss': tune.choice(['squared_hinge', 'hinge']),
'alpha': tune.loguniform(1e-4, 1e-1),
'epsilon': tune.uniform(1e-2, 1e-1),
}
hyperopt_tune_search = TuneSearchCV(SGDClassifier(),
param_distributions=param_dists,
n_trials=2,
early_stopping=True, # uses Async HyperBand if set to True
max_iters=10,
search_optimization="hyperopt"
)
hyperopt_tune_search.fit(X_train, y_train)
Other Machine Learning Libraries and Examples
Tune-sklearn also supports the use of other machine learning libraries such as Pytorch (using Skorch) and Keras. You can find these examples here:
Keras
LightGBM
Sklearn Random Forest
Sklearn Pipeline
Pytorch (Skorch)
XGBoost
Documentation
See the auto-generated docs here.
These are generated by lazydocs and should be updated on every release:
ray-project/tune-sklearn thuộc nhóm AI Tools trên TopGit, cùng 5 topic GitHub. Trang Trending và Topics liệt kê các repo cùng số sao và cùng ngôn ngữ để so sánh.
Đọc thêm về ray-project/tune-sklearn ở đâu?
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/ray-project/tune-sklearn là nguồn chính thức.
ray-project/tune-sklearn có phải mã nguồn mở không?
Có — ray-project/tune-sklearn phát hành theo license Apache-2.0, nghĩa là mã nguồn mở để đọc, fork và (tùy license) tái sử dụng. Mã: github.com/ray-project/tune-sklearn.
ray-project/tune-sklearn là gì?
ray-project/tune-sklearn (ray-project/tune-sklearn) là dự án Python trên GitHub. Theo mô tả gốc: A drop-in replacement for Scikit-Learn’s GridSearchCV / RandomizedSearchCV -- but with cutting edge hyperparameter tuning techniques.
ray-project/tune-sklearn so với các dự án AI Tools khác thế nào?
ray-project/tune-sklearn được TopGit xếp vào nhóm AI Tools, với 468 sao GitHub và viết bằng Python. Xem trang chủ đề AI Tools trên TopGit để so sánh với các dự án tương tự theo số sao và mức độ hoạt động.
Vì sao ray-project/tune-sklearn được xếp vào nhóm AI Tools?
TopGit xếp ray-project/tune-sklearn vào nhóm AI Tools dựa trên GitHub topics và mô tả của repo (gắn thẻ: "automl", "bayesian-optimization", "gridsearchcv"). Việc phân loại dựa trên metadata thật của repo, không phải đoán theo cảm tính biên tập.
Đọc đầy đủ README ở tab phía trên.
Chưa chắc tune-sklearn có hợp với bạn?
Để ChatGPT, Claude hoặc Perplexity tìm hiểu giúp — bấm bên dưới và xem AI nói gì về tune-sklearn.