Token Classification
Transformers
Safetensors
English
Hebrew
xlm-roberta
code-switching
hebrew
transliteration
romanization
text-to-speech
Eval Results (legacy)
Instructions to use Hebrish/Hebrew-Latin-Token-Classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Hebrish/Hebrew-Latin-Token-Classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="Hebrish/Hebrew-Latin-Token-Classifier")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("Hebrish/Hebrew-Latin-Token-Classifier") model = AutoModelForTokenClassification.from_pretrained("Hebrish/Hebrew-Latin-Token-Classifier", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add base model and licence notices
Browse files
README.md
CHANGED
|
@@ -251,3 +251,11 @@ Code, annotation policy and taxonomy:
|
|
| 251 |
[Hebrish-ASR/Hebrew-Latin-Token-Classifier](https://github.com/Hebrish-ASR/Hebrew-Latin-Token-Classifier).
|
| 252 |
The training script is `training/train.py`, and `eval_results.json` and
|
| 253 |
`test_errors.jsonl` in this repo hold the full test output. Trained 2026-10-15. MIT.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 251 |
[Hebrish-ASR/Hebrew-Latin-Token-Classifier](https://github.com/Hebrish-ASR/Hebrew-Latin-Token-Classifier).
|
| 252 |
The training script is `training/train.py`, and `eval_results.json` and
|
| 253 |
`test_errors.jsonl` in this repo hold the full test output. Trained 2026-10-15. MIT.
|
| 254 |
+
|
| 255 |
+
## Base model and licence notices
|
| 256 |
+
|
| 257 |
+
This model is a fine-tune of [`FacebookAI/xlm-roberta-base`](https://huggingface.co/FacebookAI/xlm-roberta-base), by Facebook AI, licensed under MIT. Hebrish modified the base model by fine-tuning it.
|
| 258 |
+
|
| 259 |
+
The licence stated at the top of this card covers Hebrish's contribution; the base model's licence keeps applying to the base model, and nothing here restricts what that licence allows for it. Terms of use: <https://hebrish.app/terms>.
|
| 260 |
+
|
| 261 |
+
Hebrish is not affiliated with or endorsed by Meta.
|