Design
Models
API
API Mapping
Migration Guide
Syntax Support
Environment Variables
FAQ
RELEASE NOTES
Model input type for the SentencePiece tokenizer.
Available values are as follows:
SPieceTokenizerLoadType.FILE: Load model from specified file path.
SPieceTokenizerLoadType.MODEL: Load model from specified vocab object.