tfm.optimization.LinearWarmup

Linear warmup schedule.

View aliases

Main aliases

tfm.optimization.lr_schedule.LinearWarmup

tfm.optimization.LinearWarmup(
    after_warmup_lr_sched: Union[tf.keras.optimizers.schedules.LearningRateSchedule, float],
    warmup_steps: int,
    warmup_learning_rate: float,
    name: Optional[str] = None
)

Args
after_warmup_lr_sched	tf.keras.optimizers.schedules .LearningRateSchedule or a constant.
warmup_steps	Number of the warmup steps.
warmup_learning_rate	Initial learning rate for the warmup.
name	Optional, name of warmup schedule.

Methods

from_config

@classmethod
from_config(
    config
)

Instantiates a LearningRateSchedule from its config.

Args
config	Output of get_config().

Returns
A LearningRateSchedule instance.

get_config

View source

get_config() -> Mapping[str, Any]

__call__

View source

__call__(
    step: int
)

Call self as a function.