tf.raw_ops.ApplyAdam

本页内容
Args
Returns

Update '*var' according to the Adam algorithm.

View aliases

Compat aliases for migration

tf.compat.v1.raw_ops.ApplyAdam

tf.raw_ops.ApplyAdam(
    var, m, v, beta1_power, beta2_power, lr, beta1, beta2, epsilon, grad,
    use_locking=False, use_nesterov=False, name=None
)

l r_{t} := learning\_rate * \sqrt{1 - b e t a_{2}^{t}} / (1 - b e t a_{1}^{t})

$lr_t := \text{learning\_rate} * \sqrt{1 - beta_2^t} / (1 - beta_1^t)$

m_{t} := b e t a_{1} * m_{t - 1} + (1 - b e t a_{1}) * g

$m_t := beta_1 * m_{t-1} + (1 - beta_1) * g$

v_{t} := b e t a_{2} * v_{t - 1} + (1 - b e t a_{2}) * g * g

$v_t := beta_2 * v_{t-1} + (1 - beta_2) * g * g$

v a r i a b l e := v a r i a b l e - l r_{t} * m_{t} / (\sqrt{v_{t}} + ϵ)

$variable := variable - lr_t * m_t / (\sqrt{v_t} + \epsilon)$

Args
`var`	A mutable `Tensor`. Must be one of the following types: `float32`, `float64`, `int32`, `uint8`, `int16`, `int8`, `complex64`, `int64`, `qint8`, `quint8`, `qint32`, `bfloat16`, `uint16`, `complex128`, `half`, `uint32`, `uint64`. Should be from a Variable().
`m`	A mutable `Tensor`. Must have the same type as `var`. Should be from a Variable().
`v`	A mutable `Tensor`. Must have the same type as `var`. Should be from a Variable().
`beta1_power`	A `Tensor`. Must have the same type as `var`. Must be a scalar.
`beta2_power`	A `Tensor`. Must have the same type as `var`. Must be a scalar.
`lr`	A `Tensor`. Must have the same type as `var`. Scaling factor. Must be a scalar.
`beta1`	A `Tensor`. Must have the same type as `var`. Momentum factor. Must be a scalar.
`beta2`	A `Tensor`. Must have the same type as `var`. Momentum factor. Must be a scalar.
`epsilon`	A `Tensor`. Must have the same type as `var`. Ridge term. Must be a scalar.
`grad`	A `Tensor`. Must have the same type as `var`. The gradient.
`use_locking`	An optional `bool`. Defaults to `False`. If `True`, updating of the var, m, and v tensors will be protected by a lock; otherwise the behavior is undefined, but may exhibit less contention.
`use_nesterov`	An optional `bool`. Defaults to `False`. If `True`, uses the nesterov update.
`name`	A name for the operation (optional).

Returns
A mutable `Tensor`. Has the same type as `var`.

tf.raw_ops.ApplyAdam

View aliases

Args

Returns