mindformers.dataset

Dataset module, including common datasets, dataloaders, data augmentations, etc.

Dataset

mindformers.dataset.CausalLanguageModelDataset

Causal Language Model pretrain dataset.

mindformers.dataset.ContrastiveLanguageImagePretrainDataset

CLIP (Contrastive Language Image Pre-training) dataset.

mindformers.dataset.KeyWordGenDataset

Keyword generation dataset.

mindformers.dataset.MultiTurnDataset

Multi-turn dataset.