mindspore.dataset.text.JiebaMode

class mindspore.dataset.text.JiebaMode[source]

An enumeration for mindspore.dataset.text.JiebaTokenizer .

Possible enumeration values are: JiebaMode.MIX, JiebaMode.MP, JiebaMode.HMM.

  • JiebaMode.MIX: tokenize with a mix of MPSegment and HMMSegment algorithm.

  • JiebaMode.MP: tokenize with MPSegment algorithm.

  • JiebaMode.HMM: tokenize with Hidden Markov Model Segment algorithm.