glm4_9b_PMTP_polydim_einsof / tokenization_chatglm.py

Commit History

10 days ago

  1. Add tokenization_chatglm.py from THUDM/glm-4-9b-chat for custom tokenizer support

    Verified signature
    2ce5f85