Hyperband
A resource-allocation hyperparameter optimization algorithm based on early stopping. It repeatedly applies successive halving to allocate a limited training budget across many configurations and eliminate poor ones round by round, suiting settings with large hyperparameter spaces and high per-training cost.
Timeline (last 90 days)
The study selected four hyperparameter optimization strategies: genetic algorithm, Hyperband, Optuna, and SMAC3
XGBoost tuned with Hyperband achieved the best performance among all model and optimizer combinations, with a peak F1 score of 96.95%
Hyperband is a resource-allocation-based hyperparameter optimization algorithm based on early stopping, essentially multiple repetitions of the successive halving strategy
The reason Hyperband performs outstandingly on XGBoost is related to its use of an early-stopping mechanism to concentrate the computational budget on promising configurations.
All Facts (4)
The study selected four hyperparameter optimization strategies: genetic algorithm, Hyperband, Optuna, and SMAC3
50%UnverifiedXGBoost tuned with Hyperband achieved the best performance among all model and optimizer combinations, with a peak F1 score of 96.95%
50%UnverifiedHyperband is a resource-allocation-based hyperparameter optimization algorithm based on early stopping, essentially multiple repetitions of the successive halving strategy
50%UnverifiedThe reason Hyperband performs outstandingly on XGBoost is related to its use of an early-stopping mechanism to concentrate the computational budget on promising configurations.
50%