From: Effective hyperparameter optimization using Nelder-Mead method in deep learning
Method | Mean loss | Min loss |
---|---|---|
Random search | 0.035694 (±0.006958) | 0.026563 |
Bayesian optimization | 0.024792 (±0.003076) | 0.020466 |
CMA-ES | 0.031244 (±0.010834) | 0.016952 |
Coordinate-search method | 0.032244 (±0.006109) | 0.024637 |
Nelder-Mead method | 0.015492 (±0.002276) | 0.013556 |
Method | Mean accuracy (%) | Accuracy with min loss (%) |
Random search | 57.18 (±0.96) | 57.90 |
Bayesian optimization | 56.28 (±1.68) | 57.19 |
CMA-ES | 57.17 (±0.80) | 58.19 |
Coordinate-search method | 55.06 (±2.31) | 56.98 |
Nelder-Mead method | 56.72 (±0.50) | 57.42 |