Join the SIG TFX-Addons community and help make TFX even better!

tfx.orchestration.pipeline.Pipeline

Logical TFX pipeline object.

Pipeline object represents the DAG of TFX components, which can be run using one of the pipeline orchestration systems that TFX supports. For details, please refer to the guide.

pipeline_name Name of the pipeline;
pipeline_root Path to root directory of the pipeline;
metadata_connection_config The config to connect to ML metadata.
components Optional list of components to construct the pipeline.
enable_cache Whether or not cache is enabled for this run.
beam_pipeline_args Pipeline arguments for Beam powered Components.
platform_config Pipeline level platform config, in proto form.
execution_mode The execution mode of the pipeline, can be SYNC or ASYNC.
**kwargs Additional kwargs forwarded as pipeline args.

components A deterministic list of logical components of this pipeline, which are deduped and topologically sorted.
enable_cache Whether or not cache is enabled for this run.
metadata_connection_config The config to connect to ML metadata.
execution_mode Execution mode of the pipeline. Currently only support synchronous execution mode.
beam_pipeline_args Pipeline arguments for Beam powered Components. Use with_beam_pipeline_args to set component level Beam args.
platform_config Pipeline level platform config, in proto form.