Module: tfx_bsl.public.beam.run_inference

Publich API of batch inference.

Modules

model_spec_pb2 module: Generated protocol buffer code.

Functions

RunInference(...): Run inference with a model.

RunInferenceOnKeyedBatches(...): Run inference over pre-batched keyed inputs.

RunInferencePerModel(...): Vectorized variant of RunInference (useful for ensembles).