Join the SIG TFX-Addons community and help make TFX even better!

tfx.orchestration.portable.python_executor_operator.PythonExecutorOperator

PythonExecutorOperator handles python class based executor's init and execution.

Inherits From: BaseExecutorOperator

tfx.orchestration.portable.python_executor_operator.PythonExecutorOperator(
    executor_spec: message.Message,
    platform_config: Optional[message.Message] = None
)

executor_spec The specification of how to initialize the executor.
platform_config The specification of how to allocate resource for the executor.

extra_flags Extra flags that will pass to Python executors. It come from two sources in the order:

  1. The extra_flags set in the executor spec.
  2. The flags passed in when starting the program by users or by other systems. The interpretation of these flags relying on the executor implementation.

Methods

run_executor

View source

run_executor(
    execution_info: tfx.orchestration.portable.data_types.ExecutionInfo
) -> execution_result_pb2.ExecutorOutput

Invokers executors given input from the Launcher.

Args
execution_info A wrapper of the details of this execution.

Returns
The output from executor.

SUPPORTED_EXECUTOR_SPEC_TYPE [<class 'tfx.proto.orchestration.executable_spec_pb2.PythonClassExecutableSpec'>]
SUPPORTED_PLATFORM_CONFIG_TYPE []