![]() |
Compute the split info on the given files.
tfds.folder_dataset.compute_split_info(
*,
data_dir: tfds.core.PathLike
,
out_dir: Optional[utils.PathLike] = None
) -> List[tfds.core.SplitInfo
]
Compute the split info (num shards, num examples,...) metadata required
by tfds.folder_dataset.write_metadata
.
See documentation for usage: https://www.tensorflow.org/datasets/external_tfrecord
Args | |
---|---|
data_dir
|
Directory containing the .tfrecord files (or similar format)
|
out_dir
|
Output directory on which save the metadata. It should be available from the apache beam workers. If not set, apache beam won't be used (only available with some file formats). |
Returns | |
---|---|
split_infos
|
The list of tfds.core.SplitInfo .
|