|View source on GitHub|
Task generator for executing an async pipeline.
tfx.orchestration.metadata.Metadata, pipeline: pipeline_pb2.Pipeline, is_task_id_tracked_fn: Callable[[task_lib.TaskId], bool] )
generate is not thread-safe. Concurrent calls to
be explicitly serialized. Since MLMD may be updated upon call to
it's also not safe to call
generate on different instances of this class
where the instances refer to the same MLMD db and the same pipeline IR.
||A handle to MLMD db.|
||A pipeline IR proto.|
A callable that returns
generate() -> List[
Generates tasks for all executable nodes in the async pipeline.
The returned tasks must have
exec_task populated. List may be empty if no
nodes are ready for execution.