TensorFlow 2.0 Beta is available Learn more

tf.contrib.mixed_precision.FixedLossScaleManager

View source on GitHub

Class FixedLossScaleManager

Loss scale manager with a fixed loss scale.

Inherits From: LossScaleManager

The loss scale is not updated for the lifetime of the class.

__init__

View source

__init__(loss_scale)

Creates the fixed loss scale manager.

Args:

  • loss_scale: A Python float. Its ideal value varies depending on models to run. Choosing a too small loss_scale might affect model quality; a too big loss_scale might cause inf or nan. There is no single right loss_scale to apply. There is no harm choosing a relatively big number as long as no nan or inf is encountered in training.

Raises:

  • ValueError: If loss_scale is less than 1.

Methods

get_loss_scale

View source

get_loss_scale()

update_loss_scale

View source

update_loss_scale(finite_grads)