tfx.orchestration.pipeline.Pipeline

Logical TFX pipeline object.

pipeline_name Name of the pipeline;
pipeline_root Path to root directory of the pipeline;
metadata_connection_config The config to connect to ML metadata.
components A list of components in the pipeline (optional only for backward compatible purpose to be used with deprecated PipelineDecorator).
enable_cache Whether or not cache is enabled for this run.
beam_pipeline_args Pipeline arguments for Beam powered Components.
**kwargs Additional kwargs forwarded as pipeline args.

pipeline_args Kwargs used to create real pipeline implementation. This is forwarded to PipelineRunners instead of consumed in this class. This should include:

  • pipeline_name: Required. The unique name of this pipeline.
  • pipeline_root: Required. The root of the pipeline outputs.
components Logical components of this pipeline.
pipeline_info An instance of data_types.PipelineInfo that contains basic properties of the pipeline.
enable_cache Whether or not cache is enabled for this run.
metadata_connection_config The config to connect to ML metadata.
beam_pipeline_args Pipeline arguments for Beam powered Components.
additional_pipeline_args Other pipeline args.