maha.datasets.functions.load_fn

Module Contents

Functions

load_dataset()

Loads a dataset.
load_dataset(name: typing_extensions.Literal[names], streaming: typing_extensions.Literal[False] = False) → maha.datasets.templates.Dataset[maha.datasets.templates.Name][source]
load_dataset(name: typing_extensions.Literal[names], streaming: typing_extensions.Literal[True]) → maha.datasets.templates.IterableDataset[maha.datasets.templates.Name]

Loads a dataset.

Parameters

  • name – Name of the dataset.

  • streaming (bool, optional) – Whether to return a streaming dataset. If set to True, an IterableDataset is returned instead.

Returns

The loaded dataset.

Return type

Union[Dataset, IterableDataset]

Raises

FileNotFoundError – If the dataset does not exist.