Instructions to use philschmid/gemma-tokenizer-chatml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use philschmid/gemma-tokenizer-chatml with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("philschmid/gemma-tokenizer-chatml", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update tokenizer_config.json
Verified signatured481bff -
Update tokenizer_config.json
Verified signature046b3f8 -
Update tokenizer_config.json
Verified signaturebf67051
-
Update README.md
Verified signatured3d9ba2 -
Update README.md
Verified signature631c7b7 -
Upload tokenizer
Verified signature8d260b4 -
initial commit
Verified signatureba26651