maha.datasets.templates.dataset

Module Contents

Classes

Dataset

Base class for all datasets.

IterableDataset

Base class for all datasets that need to be streamed.

class Dataset(path, template, sep='\t')[source]

Bases: Generic[T]

Base class for all datasets.

Parameters
  • path (Union[str, Path]) – Path to the dataset.

  • template (Type) – Template class for the dataset.

  • sep (str, optional) – Separator for the dataset. The default is ” “.

property data(self)[source]
class IterableDataset(path, template, sep='\t')[source]

Bases: Generic[T]

Base class for all datasets that need to be streamed.

Parameters
  • path (Union[str, Path]) – Path to the dataset.

  • template (Type) – Template class for the dataset.

  • sep (str, optional) – Separator for the dataset. The default is ” “.