mindspore.dataset.text.SPieceTokenizerOutType

class mindspore.dataset.text.SPieceTokenizerOutType(value)[source]

An enumeration for SPieceTokenizerOutType.

Possible enumeration values are: SPieceTokenizerOutType.STRING, SPieceTokenizerOutType.INT.

  • SPieceTokenizerOutType.STRING: means output type of SentencePice Tokenizer is string.

  • SPieceTokenizerOutType.INT: means output type of SentencePice Tokenizer is int.