Join the SIG TFX-Addons community and help make TFX even better!


Task generator for executing a sync pipeline.

Inherits From: TaskGenerator

Calling generate is not thread-safe. Concurrent calls to generate should be explicitly serialized. Since MLMD may be updated upon call to generate, it's also not safe to call generate on different instances of this class where the instances refer to the same MLMD db and the same pipeline IR.

mlmd_handle A handle to the MLMD db.
pipeline_state Pipeline state.
is_task_id_tracked_fn A callable that returns True if a task_id is tracked by the task queue.
service_job_manager Used for handling service nodes in the pipeline.



View source

Generates tasks for executing the next executable nodes in the pipeline.

The returned tasks must have exec_task populated. List may be empty if no nodes are ready for execution.

A list of tasks to execute.