Load ADAM embedding parameters with debug support.
An op that loads optimization parameters into HBM for embedding. Must be preceded by a ConfigureTPUEmbeddingHost op that sets up the correct embedding table configuration. For example, this op is used to install parameters that are loaded from a checkpoint before a training loop is executed.
Nested Classes
| class | LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
Optional attributes for
LoadTPUEmbeddingADAMParametersGradAccumDebug
|
|
Public Methods
| static LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
config
(String config)
|
| static LoadTPUEmbeddingADAMParametersGradAccumDebug | |
| static LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
tableId
(Long tableId)
|
| static LoadTPUEmbeddingADAMParametersGradAccumDebug.Options |
tableName
(String tableName)
|
Inherited Methods
Public Methods
public static LoadTPUEmbeddingADAMParametersGradAccumDebug create ( Scope scope, Operand <Float> parameters, Operand <Float> momenta, Operand <Float> velocities, Operand <Float> gradientAccumulators, Long numShards, Long shardId, Options... options)
Factory method to create a class wrapping a new LoadTPUEmbeddingADAMParametersGradAccumDebug operation.
Parameters
| scope | current scope |
|---|---|
| parameters | Value of parameters used in the ADAM optimization algorithm. |
| momenta | Value of momenta used in the ADAM optimization algorithm. |
| velocities | Value of velocities used in the ADAM optimization algorithm. |
| gradientAccumulators | Value of gradient_accumulators used in the ADAM optimization algorithm. |
| options | carries optional attributes values |
Returns
- a new instance of LoadTPUEmbeddingADAMParametersGradAccumDebug