tf.train.experimental.MaxShardSizePolicy

Policy that splits tensors into shards with a max shard size.

Inherits From: ShardingCallback

View aliases

Compat aliases for migration

See Migration guide for more details.

tf.compat.v1.train.experimental.MaxShardSizePolicy

tf.train.experimental.MaxShardSizePolicy(
    max_shard_size: int
)

Shards may exceed the max shard size if they contain 1. a single scalar/string tensor that could not be sliced and exceeds the max shard size or 2. the checkpoint object graph, whose size cannot be calculated when saving.

Attributes
description	Returns a text description of the sharding policy.

Child Classes

class MaxShardSizePartitioner

Methods

__call__

View source

__call__(
    shardable_tensors: Sequence[tf.train.experimental.ShardableTensor]
) -> Sequence[sharding_util.Shard]

Returns a list of shards for the given shardable tensors.