tfm.optimization.LinearWarmup

Linear warmup schedule.

after_warmup_lr_sched tf.keras.optimizers.schedules .LearningRateSchedule or a constant.
warmup_steps Number of the warmup steps.
warmup_learning_rate Initial learning rate for the warmup.
name Optional, name of warmup schedule.

Methods

from_config

Instantiates a LearningRateSchedule from its config.

Args
config Output of get_config().

Returns
A LearningRateSchedule instance.

get_config

View source

__call__

View source

Call self as a function.