mindspore.dataset
This module provides APIs to load and process various common datasets such as MNIST, CIFAR-10, CIFAR-100, VOC, COCO, ImageNet, CelebA, CLUE, etc. It also supports datasets in standard format, including MindRecord, TFRecord, Manifest, etc. Users can also define their owndatasets with this module.
Besides, this module provides APIs to sample data while loading.
Please notice that cache is not supported on Windows platform yet. Please do not use it while loading and processing data on Windows.
Vision
A source dataset for reading and parsing CelebA dataset. |
|
A source dataset for reading and parsing Cifar100 dataset. |
|
A source dataset for reading and parsing Cifar10 dataset. |
|
A source dataset for reading and parsing COCO dataset. |
|
A source dataset that reads images from a tree of directories. |
|
A source dataset for reading and parsing the MNIST dataset. |
|
A source dataset for reading and parsing VOC dataset. |
Text
A source dataset that reads and parses CLUE datasets. |
Graph
Reads the graph dataset used for GNN training from the shared file and database. |
Standard Format
A source dataset that reads and parses comma-separated values (CSV) datasets. |
|
A source dataset for reading images from a Manifest file. |
|
A source dataset for reading and parsing MindRecord dataset. |
|
A source dataset that reads and parses datasets stored on disk in text format. |
|
A source dataset for reading and parsing datasets stored on disk in TFData format. |
User Defined
A source dataset that generates data from Python by invoking Python data source each epoch. |
|
Creates a dataset with given data slices, mainly for loading Python data into dataset. |
|
Creates a dataset with filler data provided by user. |
Sampler
A sampler that accesses a shard of the dataset. |
|
Samples K elements for each P class in the dataset. |
|
Samples the elements randomly. |
|
Samples the dataset elements sequentially, same as not having a sampler. |
|
Samples the elements randomly from a sequence of indices. |
|
Samples the elements from a sequence of indices. |
|
Samples the elements from [0, len(weights) - 1] randomly with the given weights (probabilities). |
Others
A client to interface with tensor caching service. |
|
Class to represent a schema of a dataset. |
|
Zip the datasets in the input tuple of datasets. |