Instructions to use rushikeshwalode/eng_hindi_tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use rushikeshwalode/eng_hindi_tokenizer with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("rushikeshwalode/eng_hindi_tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download source.spm from rushikeshwalode/eng_hindi_tokenizer: direct link, hf CLI and curl.
- Browser
- Download file 812 kB
-
https://huggingface.co/rushikeshwalode/eng_hindi_tokenizer/resolve/main/source.spm
- Command line
-
hf download hf://rushikeshwalode/eng_hindi_tokenizer/source.spm
-
curl -L -o source.spm https://huggingface.co/rushikeshwalode/eng_hindi_tokenizer/resolve/main/source.spm
812 kB
- Xet hash:
- 0d489b66e29021205ffdb9a02240bea1d4e430f13d8ed6e235f04a03ecf98aca
- Size of remote file:
- 812 kB
- SHA256:
- fd4e951487aed00bae6a6c2ee4ef5d8d1db05fd098b19b608046c9334b58d24d
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.