Instructions to use IndexTeam/Index-Translate-2B-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use IndexTeam/Index-Translate-2B-FP8 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("translation", model="IndexTeam/Index-Translate-2B-FP8")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("IndexTeam/Index-Translate-2B-FP8") model = AutoModelForMultimodalLM.from_pretrained("IndexTeam/Index-Translate-2B-FP8", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download validation.json from IndexTeam/Index-Translate-2B-FP8: direct link, hf CLI and curl.
- Browser
- Download file 680 Bytes
-
https://huggingface.co/IndexTeam/Index-Translate-2B-FP8/resolve/main/validation.json
- Command line
-
hf download hf://IndexTeam/Index-Translate-2B-FP8/validation.json
-
curl -L -o validation.json https://huggingface.co/IndexTeam/Index-Translate-2B-FP8/resolve/main/validation.json
680 Bytes
| { | |
| "bf16": { | |
| "ppl": 3.9104343299977606, | |
| "generations": { | |
| "zh2en": "Artificial intelligence is profoundly changing the way content is created, automating everything from text translation to video dubbing.", | |
| "en2zh": "棕色的狐狸迅速跳过了懒狗,而西班牙的雨则主要落在平原上。" | |
| } | |
| }, | |
| "fp8": { | |
| "ppl": 3.9403369723078265, | |
| "generations": { | |
| "zh2en": "Artificial intelligence is profoundly changing the way content is created, automating everything from text translation to video dubbing.", | |
| "en2zh": "快速奔跑的棕色狐狸跳过了懒惰的狗,而西班牙的雨则主要停留在平原上。" | |
| } | |
| } | |
| } |