Instructions to use AlexHung29629/large_spm_tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AlexHung29629/large_spm_tokenizer with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("AlexHung29629/large_spm_tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 159e7052eceddd8d984f2dd264acf41b7e97119909198d9e06e63bedc67ea09a
- Size of remote file:
- 195 MB
- SHA256:
- 27e4f4253a4f609ec057dd26f8b69065c1044155830b158cee3037ab10f2a32e
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.