klyn.math.nn.optimizers.Adam.Adam
constructor
public Adam(learningRate as Double = 0.001, beta1 as Double = 0.9, beta2 as Double = 0.999, epsilon as Double = 1e-7)
Description

Configures Adam without weight decay or AMSGrad.

Parameters
ParameterDescription
learningRatePositive finite step size.
beta1First-moment decay in [0, 1).
beta2Second-moment decay in [0, 1).
epsilonPositive finite stabilizer, outside the square root.
Throws
  • ValueException for invalid options.
Example

optimizer = Adam<Float>(0.001, epsilon=1e-7)