GLM 5.2 evaluation tokenizer

Tokenizer-only artifact for evaluating cyankiwi/GLM-5.2-AWQ-INT4 with Transformers 4.57.6. tokenizer.json and chat_template.jinja are copied unchanged from model revision 956f4d228e36c95f66a80058fe64b69af67360ca.

The source metadata names the unavailable TokenizersBackend class and stores extra_special_tokens as a list, which Transformers 4.57.6 rejects. This artifact names PreTrainedTokenizerFast and removes that redundant field. The vocabulary and rendered chat templates are unchanged.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for laion/glm-5.2-eval-tokenizer

Base model

zai-org/GLM-5.2
Finetuned
(1)
this model