Instructions to use BeardedMonster/sabiyarn-3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use BeardedMonster/sabiyarn-3B with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("BeardedMonster/sabiyarn-3B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
SabiYarn 3B tokenizer: 131,072-token byte-level BPE with NFC normalizer, special ids 0-179 unchanged, tokenizer comparison across 73 languages
e7c19f5 verified Download tokenizer.json from BeardedMonster/sabiyarn-3B: direct link, hf CLI and curl.
- Browser
- Download file 9.72 MB
-
https://huggingface.co/BeardedMonster/sabiyarn-3B/resolve/main/tokenizer.json
- Command line
-
hf download hf://BeardedMonster/sabiyarn-3B/tokenizer.json
-
curl -L -o tokenizer.json https://huggingface.co/BeardedMonster/sabiyarn-3B/resolve/main/tokenizer.json
9.72 MB
File too large to display, you can check the raw version instead.