Instructions to use jmcinern/qwen_tokenizer_ga_extended with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jmcinern/qwen_tokenizer_ga_extended with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jmcinern/qwen_tokenizer_ga_extended", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload tokenizer
Verified signaturec2e7f56 -
Upload tokenizer
Verified signature598feb6 -
Upload tokenizer
Verified signature20efb86 -
Upload tokenizer
Verified signature0ef65d6
-
Upload tokenizer
Verified signature6cb35e2 -
Upload tokenizer
Verified signature4e9f9cc -
Upload tokenizer
Verified signature5353bf3 -
Upload tokenizer
Verified signature6d2d9eb -
Upload tokenizer
Verified signature5a30c24 -
Upload tokenizer
Verified signature74d3eb5 -
Upload tokenizer
Verified signature5f69e5f -
Upload tokenizer
Verified signature704d038