OptimizerWeightStepState

public struct OptimizerWeightStepState

State for a single step of a single weight inside an optimizer.

• globals

  Hyperparameters.

  Declaration

  public let globals: [Tensor<Float>]

• locals

  Temporary values (can only be assigned once).

  Declaration

  public var locals: [Tensor<Float>]

• grad

  The actual derivative of weight wrt to the loss function.

  Declaration

  public var grad: Tensor<Float>

• weight

  The weight being optimized.

  Declaration

  public let weight: Tensor<Float>

• step

  The final output of the optimizer. (should really only be set once). nil means that the weight will not be touched. This will be applied to the true weight at the end: weight += step.

  Declaration

  public var step: Tensor<Float>?

• subscript(_:)

  Declaration

  public subscript(local: LocalAccessor) -> Tensor<Float> { get set }

• subscript(_:)

  Declaration

  public subscript(global: GlobalAccessor) -> Tensor<Float> { get }