maha.datasets.functions

Submodules

• maha.datasets.functions.load_fn

Package Contents

Functions

load_dataset()

Loads a dataset.

load_dataset(name: typing_extensions.Literal[names], streaming: typing_extensions.Literal[False] = False) → maha.datasets.templates.Dataset[maha.datasets.templates.Name]

load_dataset(name: typing_extensions.Literal[names], streaming: typing_extensions.Literal[True]) → maha.datasets.templates.IterableDataset[maha.datasets.templates.Name]

Loads a dataset.

Parameters

• name – Name of the dataset.

• streaming (bool, optional) – Whether to return a streaming dataset. If set to True, an IterableDataset is returned instead.

Returns

The loaded dataset.

Return type

Union[Dataset, IterableDataset]

Raises

FileNotFoundError – If the dataset does not exist.