Instructions to use EmnaBou/TD-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use EmnaBou/TD-tokenizer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="EmnaBou/TD-tokenizer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("EmnaBou/TD-tokenizer") model = AutoModelForTokenClassification.from_pretrained("EmnaBou/TD-tokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download pytorch_model.bin from EmnaBou/TD-tokenizer: direct link, hf CLI and curl.
- Browser
- Download file 436 MB
-
https://huggingface.co/EmnaBou/TD-tokenizer/resolve/main/pytorch_model.bin
- Command line
-
hf download hf://EmnaBou/TD-tokenizer/pytorch_model.bin
-
curl -L -o pytorch_model.bin https://huggingface.co/EmnaBou/TD-tokenizer/resolve/main/pytorch_model.bin
436 MB
- Xet hash:
- 1a26159bfb1b92d8a32b49e1285d86c56a34f6b81a820e8c50c3c8474c7954e1
- Size of remote file:
- 436 MB
- SHA256:
- 6bb57947c055feedfb765d3b82f2ae5efbf7c01be6bc289b9e51968d1bb51920
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.