tfx.components.model_validator.executor.Executor

DEPRECATED: Please use Evaluator instead.

Inherits From: BaseExecutor

tfx.components.model_validator.executor.Executor(
    context: Optional[tfx.components.base.base_executor.BaseExecutor.Context] = None
)

The model validator helps prevent bad models from being pushed to production. It does this by validating exported models against known good models (e.g. the current production model), and marking the exported model as good ("blessing it") only if the exported model's metrics are within predefined thresholds around the good model's metrics.

The model validator will validate tf.serving format exported models produced by the Trainer component. The validator evaluates the models on examples created by the ExampleGen component. The validator will also automatically read data written by the Pusher component regarding the latest pushed models by using ml.metadata to query the previously pushed artifacts.

To include ModelValidator in a TFX pipeline, configure your pipeline similar to https://github.com/tensorflow/tfx/blob/master/tfx/examples/chicago_taxi_pipeline/taxi_pipeline_simple.py#L110

Child Classes

class Context

Methods

Do

View source

Do(
    input_dict: Dict[Text, List[tfx.types.Artifact]],
    output_dict: Dict[Text, List[tfx.types.Artifact]],
    exec_properties: Dict[Text, Any]
) -> None

Validate current model against last blessed model.

Args
input_dict Input dict from input key to a list of Artifacts.

  • examples: examples for eval the model.
  • model: current model for validation.
output_dict Output dict from output key to a list of Artifacts.
  • blessing: model blessing result.
    • exec_properties A dict of execution properties.
  • blessed_model: last blessed model for validation.
  • blessed_model_id: last blessed model id.

    • Returns
    None