Instructions to use ikkiren/research_tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ikkiren/research_tokenizer with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ikkiren/research_tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 7c91dffe442426c592d632b4a1f646f7afae3bed1fe9ee4b0c70af431cb3b9c2
- Size of remote file:
- 14.1 MB
- SHA256:
- d9bec79b7e24f121d0d1acb81a8d5b253784c1348bf15e003423143b65b26821
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.