Instructions to use philschmid/gemma-tokenizer-chatml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use philschmid/gemma-tokenizer-chatml with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("philschmid/gemma-tokenizer-chatml", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download tokenizer.json from philschmid/gemma-tokenizer-chatml: direct link, hf CLI and curl.
- Browser
- Download file 17.5 MB
-
https://huggingface.co/philschmid/gemma-tokenizer-chatml/resolve/refs%2Fpr%2F1/tokenizer.json
- Command line
-
hf download hf://philschmid/gemma-tokenizer-chatml@refs/pr/1/tokenizer.json
-
curl -L -o tokenizer.json https://huggingface.co/philschmid/gemma-tokenizer-chatml/resolve/refs%2Fpr%2F1/tokenizer.json
17.5 MB
- Xet hash:
- 7f1b7749daba2e55c95b122ad55b6448f58f4e04a9af8e15947511576d679b06
- Size of remote file:
- 17.5 MB
- SHA256:
- b13735b02fdd777b6061f19199a5e7f17c7b3c46c6a03248fad249ac0516d06a
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.