tfx.dsl.io.filesystem_registry.FilesystemRegistry

Registry of pluggable filesystem implementations used in TFX components.

tfx.dsl.io.filesystem_registry.FilesystemRegistry()

Methods

get_filesystem_for_path

View source

get_filesystem_for_path(
    path: tfx.dsl.io.fileio.PathType
) -> Type[tfx.dsl.io.filesystem.Filesystem]

Get filesystem plugin for given path.

get_filesystem_for_scheme

View source

get_filesystem_for_scheme(
    scheme: tfx.dsl.io.fileio.PathType
) -> Type[tfx.dsl.io.filesystem.Filesystem]

Get filesystem plugin for given scheme string.

register

View source

register(
    filesystem_cls: Type[tfx.dsl.io.filesystem.Filesystem],
    priority: int,
    use_as_fallback: bool = False
) -> None

Register a filesystem implementation.

Args
filesystem_cls	Subclass of tfx.dsl.io.filesystem.Filesystem.
priority	Integer priority index (lower is more preferred) specifying plugin search order for filesystem schemes supported by the filesystem class.
use_as_fallback	If True, use the given filesystem class to provide fallback access to filesystem not explicitly supported by a registered filesystem plugin.