tf.train.experimental.MaxShardSizePolicy.MaxShardSizePartitioner
Stay organized with collections
Save and categorize content based on your preferences.
Partition tensors into shards with a max shard size.
Methods
get_shards
View source
get_shards(
max_shard_size: int,
shardable_tensors: Sequence[tf.train.experimental.ShardableTensor]
) -> Sequence[sharding_util.Shard]
Callback to split tensors into shards with a max shard size.
| Args |
max_shard_size
|
The maximum size of a shard file in bytes.
|
shardable_tensors
|
A list of ShardableTensors.
|
| Returns |
|
List of shard dicts containing tensors.
[ {checkpoint key: {slice_spec: tensor} } ]
|
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license.
Last updated 2026-10-31 UTC.
[null,null,["Last updated 2026-10-31 UTC."],[],[]]