Instructions to use IndexTeam/Index-Translate-9B-FP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use IndexTeam/Index-Translate-9B-FP8 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("translation", model="IndexTeam/Index-Translate-9B-FP8")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("IndexTeam/Index-Translate-9B-FP8") model = AutoModelForMultimodalLM.from_pretrained("IndexTeam/Index-Translate-9B-FP8", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 680 Bytes
7f4a7c8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 | {
"bf16": {
"ppl": 2.7721595144348106,
"generations": {
"zh2en": "Artificial intelligence is profoundly transforming the way content is created, enabling automation from text translation to video voice-over.",
"en2zh": "ๆๆท็ๆฃ่ฒ็็ธ่ทณ่ฟๆๆฐ็็๏ผ่่ฅฟ็ญ็็้จไธป่ฆๅ็ๅจๅนณๅไธใ"
}
},
"fp8": {
"ppl": 2.783794829125499,
"generations": {
"zh2en": "Artificial intelligence is profoundly transforming the way content is created, enabling automation from text translation to video voice-over.",
"en2zh": "ๆๆท็ๆฃ่ฒ็็ธ่ทณ่ฟๆๆฐ็็๏ผ่่ฅฟ็ญ็็้จไธป่ฆๅ็ๅจๅนณๅไธใ"
}
}
} |