Instructions to use Reson8/Rumble-2-Flash with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Reson8/Rumble-2-Flash with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="Reson8/Rumble-2-Flash")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Reson8/Rumble-2-Flash") model = AutoModelForMultimodalLM.from_pretrained("Reson8/Rumble-2-Flash", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Shorten return_format comment
Browse files
README.md
CHANGED
|
@@ -81,7 +81,7 @@ inputs = processor.apply_transcription_request(
|
|
| 81 |
|
| 82 |
output = model.generate(**inputs, max_new_tokens=512)
|
| 83 |
generated = output[:, inputs["input_ids"].shape[-1]:]
|
| 84 |
-
# return_format="parsed"
|
| 85 |
print(processor.decode(generated, return_format="transcription_only")[0])
|
| 86 |
```
|
| 87 |
|
|
|
|
| 81 |
|
| 82 |
output = model.generate(**inputs, max_new_tokens=512)
|
| 83 |
generated = output[:, inputs["input_ids"].shape[-1]:]
|
| 84 |
+
# return_format="parsed" if detecting language
|
| 85 |
print(processor.decode(generated, return_format="transcription_only")[0])
|
| 86 |
```
|
| 87 |
|