From: Effective hyperparameter optimization using Nelder-Mead method in deep learning
Method | Mean loss | Min loss |
---|---|---|
Random search | 0.001732 (±0.000540) | 0.000984 |
Bayesian optimization | 0.00183 (±0.000547) | 0.001097 |
CMA-ES | 0.001804 (±0.000480) | 0.001249 |
Coordinate-search method | 0.002240 (±0.001448) | 0.000378 |
Nelder-Mead method | 0.000395 (±0.000129) | 0.000245 |
Method | Mean accuracy (%) | Accuracy with min loss (%) |
Random search | 87.93 (±0.24) | 88.21 |
Bayesian optimization | 88.07 (±0.27) | 87.85 |
CMA-ES | 88.20 (±0.38) | 88.55 |
Coordinate-search method | 87.04 (±0.52) | 87.72 |
Nelder-Mead method | 88.38 (±0.47) | 88.83 |