tfx.components.infra_validator.model_server_clients.tensorflow_serving_client.TensorFlowServingClient

A model server client for TensorFlow Serving.

Inherits From: BaseModelServerClient

It uses gRPC client to talk to TensorFlow Serving server.

Methods

SendRequests

View source

Send requests to the model server.

Args
requests A list of request protos.

Raises
ValidationFailed If error occurred while sending requests.

WaitUntilModelLoaded

View source

Wait until model is loaded and available.

Args
deadline A deadline time in UTC timestamp (in seconds).
polling_interval_sec GetServingStatus() polling interval.

Raises
DeadlineExceeded When deadline exceeded before model is ready.
ValidationFailed If validation failed explicitly.