tf.experimental.dtensor.enable_save_as_bf16
Allows float32 DVariables to be checkpointed and restored as bfloat16.
tf.experimental.dtensor.enable_save_as_bf16(
variables: List[tf.Variable
]
)
The method only affects the DVariable part inside the model and leaves
non-DTensor Variables/Tensors untouched.
Args |
variables
|
A list of tf.Variable to be enabled with bfloat16 save/restore.
Only has effect on DTensor Variables as they go through d_variables with
DTensor Specific logis.
|
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license.
Last updated 2024-04-26 UTC.
[null,null,["Last updated 2024-04-26 UTC."],[],[]]