From: Effective hyperparameter optimization using Nelder-Mead method in deep learning
Name
Description
Iteration
20,000
Batch size
50
Learning rate decay policy
Step (gamma=0.1, step size=10000) [29]