Instructions to use SmallDoge/SmolDoge-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SmallDoge/SmolDoge-tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SmallDoge/SmolDoge-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update tokenizer_config.json
Verified signaturea75e76e
-
Update README.md
Verified signature42631d6 -
Upload 2 files
Verified signature6f8c0b4 -
Delete tokenizer_config.json
Verified signaturee6b9da5 -
Delete tokenizer.json
Verified signatured47244e
-
Upload special_tokens_map.json
Verified signature40c277e -
Delete special_tokens_map.json
Verified signaturec801d67 -
Update tokenizer_config.json
Verified signature7f55784 -
Update tokenizer_config.json
Verified signaturebcb7321 -
Update tokenizer_config.json
Verified signaturef6cabf1
-
Update README.md (#1)
Verified signature- Update README.md (9be385f3e3d80502d651929b534e6d21b977d956)f88466f -
Upload tokenizer
Verified signature5c3cab8 -
initial commit
Verified signaturedec0c2d