Module: tf.data.experimental

Experimental API for building input pipelines.

This module contains experimental Dataset sources and transformations that can be used in conjunction with the tf.data.Dataset API. Note that the tf.data.experimental API is not subject to the same backwards compatibility guarantees as tf.data, but we will provide deprecation advice in advance of removing existing functionality.

See Importing Data for an overview.

Modules

service module: API for using the tf.data service.

Classes

class AutoShardPolicy: Represents the type of auto-sharding to use.

class CheckpointInputPipelineHook: Checkpoints input pipeline state every N steps or seconds.

class CsvDataset: A Dataset comprising lines from one or more CSV files.

class DistributeOptions: Represents options for distributed data processing.

class ExternalStatePolicy: Represents how to handle external state during serialization.

class MapVectorizationOptions: Represents options for the MapVectorization optimization.

class OptimizationOptions: Represents options for dataset optimizations.

class Optional: Represents a value that may or may not be present.

class RandomDataset: A Dataset of pseudorandom values.

class Reducer: A reducer is used for reducing a set of elements.

class SqlDataset: A Dataset consisting of the results from a SQL query.

class StatsAggregator: A stateful resource that aggregates statistics from one or more iterators.

class StatsOptions: Represents options for collecting dataset stats using StatsAggregator.

class TFRecordWriter: Writes a dataset to a TFRecord file.

class ThreadingOptions: Represents options for dataset threading.

Functions

Counter(...): Creates a Dataset that counts from start in steps of size step.

assert_cardinality(...): Asserts the cardinality of the input dataset.

bucket_by_sequence_length(...): A transformation that buckets elements in a Dataset by length.

bytes_produced_stats(...): Records the number of bytes produced by each element of the input dataset.

cardinality(...): Returns the cardinality of dataset, if known.