Table 4 LeNet hyperparameters
From: Effective hyperparameter optimization using Nelder-Mead method in deep learning
Name | Description | Range |
|---|---|---|
x 1 | Learning rate (\(= 0.1^{x_{1}}\phantom {\dot {i}\!}\)) | [ 1,4] |
x 2 | Momentum (\(= 1 - 0.1^{x_{2}}\phantom {\dot {i}\!}\)) | [ 0.5,2] |
x 3 | L2 weight decay | [ 0.001,0.01] |
\(x_{4}^{*}\) | FC1 units | [ 256,1024] |