mindspore.dataset.text.SPieceTokenizerOutType
- class mindspore.dataset.text.SPieceTokenizerOutType(value)[source]
An enumeration for SPieceTokenizerOutType.
Possible enumeration values are: SPieceTokenizerOutType.STRING, SPieceTokenizerOutType.INT.
SPieceTokenizerOutType.STRING: means output type of SentencePice Tokenizer is string.
SPieceTokenizerOutType.INT: means output type of SentencePice Tokenizer is int.