Instructions to use SmallDoge/SmolDoge-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SmallDoge/SmolDoge-tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SmallDoge/SmolDoge-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update tokenizer_config.json
Verified signature70d01ff
-
Upload 2 files
Verified signature89945e7 -
Delete tokenizer.json
Verified signatureca60e56 -
Delete tokenizer_config.json
Verified signature69a5631
-
Upload tokenizer.json
Verified signature4bad817 -
Delete tokenizer.json
Verified signature4eb660b -
Update tokenizer_config.json (#2)
Verified signature- Update tokenizer_config.json (a75e76e1262dae2d7a4ca9a5876afee1fb7ad4c1)272d57d
-
Update README.md
Verified signature42631d6 -
Upload 2 files
Verified signature6f8c0b4 -
Delete tokenizer_config.json
Verified signaturee6b9da5 -
Delete tokenizer.json
Verified signatured47244e
-
Upload special_tokens_map.json
Verified signature40c277e -
Delete special_tokens_map.json
Verified signaturec801d67 -
Update tokenizer_config.json
Verified signature7f55784 -
Update tokenizer_config.json
Verified signaturebcb7321 -
Update tokenizer_config.json
Verified signaturef6cabf1
-
Update README.md (#1)
Verified signature- Update README.md (9be385f3e3d80502d651929b534e6d21b977d956)f88466f -
Upload tokenizer
Verified signature5c3cab8 -
initial commit
Verified signaturedec0c2d