Instructions to use fxtentacle/tevr-token-entropy-predictor-de with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use fxtentacle/tevr-token-entropy-predictor-de with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("fxtentacle/tevr-token-entropy-predictor-de") model = AutoModelForSeq2SeqLM.from_pretrained("fxtentacle/tevr-token-entropy-predictor-de", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
add citation
40ff292
-
Upload Generate TEVR Tokenizer.ipynb
dbeb0d0 -
Update README.md
b9e6d62 -
Update README.md
b93b4b2 -
Create README.md
81b1588 -
Upload TEVR Explanation.ipynb
d09f022 -
Upload text_tokenizer.py
c2cd532 -
Upload text-tokenizer-de-4l.txt
0788726 -
Upload text-tokenizer-de-4m.txt
d7e3239 -
Upload text-tokenizer-de-4s.txt
3f1ceef -
add model
ddb7756 -
initial commit
1c59a91