mindformers.dataset

Dataset module, including common datasets, dataloaders, data augmentations, etc.

Dataset

mindformers.dataset.CausalLanguageModelDataset	Causal Language Model pretrain dataset.
mindformers.dataset.KeyWordGenDataset	Keyword generation dataset.
mindformers.dataset.MultiTurnDataset	Multi-turn dataset.