tfm.vision.models.SegmentationModel

A Segmentation class model.

View aliases

Main aliases

tfm.vision.segmentation_model.SegmentationModel

tfm.vision.models.SegmentationModel(
    backbone: tf.keras.Model,
    decoder: tf.keras.Model,
    head: tf.keras.layers.Layer,
    mask_scoring_head: Optional[tf.keras.layers.Layer] = None,
    **kwargs
)

Input images are passed through backbone first. Decoder network is then applied, and finally, segmentation head is applied on the output of the decoder network. Layers such as ASPP should be part of decoder. Any feature fusion is done as part of the segmentation head (i.e. deeplabv3+ feature fusion is not part of the decoder, instead it is part of the segmentation head). This way, different feature fusion techniques can be combined with different backbones, and decoders.

Args
backbone	a backbone network.
decoder	a decoder network. E.g. FPN.
head	segmentation head.
mask_scoring_head	mask scoring head.
**kwargs	keyword arguments to be passed.

Attributes
checkpoint_items	Returns a dictionary of items to be additionally checkpointed.

Methods

call

View source

call(
    inputs: tf.Tensor, training: bool = None
) -> Dict[str, tf.Tensor]

Calls the model on new inputs and returns the outputs as tensors.

In this case call() just reapplies all ops in the graph to the new inputs (e.g. build a new computational graph from the provided inputs).

Note: This method should not be called directly. It is only meant to be overridden when subclassing tf.keras.Model. To call a model on an input, always use the __call__() method, i.e. model(inputs), which relies on the underlying call() method.

Args
inputs	Input tensor, or dict/list/tuple of input tensors.
training	Boolean or boolean scalar tensor, indicating whether to run the Network in training mode or inference mode.
mask	A mask or list of masks. A mask can be either a boolean tensor or None (no mask). For more details, check the guide here.

Returns
A tensor if there is a single output, or a list of tensors if there are more than one outputs.