.. role:: hidden :class: hidden-section .. currentmodule:: mindformers.models.glm2 mindformers.models.glm2.ChatGLM4Tokenizer ========================================= .. image:: https://mindspore-website.obs.cn-north-4.myhuaweicloud.com/website-images/r2.4.0/resource/_static/logo_source_en.svg :target: https://gitee.com/mindspore/mindformers/blob/v1.3.0/mindformers/models/glm2/glm4_tokenizer.py :alt: View Source On Gitee .. autoclass:: ChatGLM4Tokenizer :exclude-members: build_batch_input, build_chat_input, build_inputs_with_special_tokens, build_single_message, convert_special_tokens_to_ids, convert_tokens_to_string, get_vocab, save_vocabulary :members: .. autogenerated from _templates/classtemplate.rst note it does not have :inherited-members: