Instructions to use Reson8/Rumble-2-Flash with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Reson8/Rumble-2-Flash with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="Reson8/Rumble-2-Flash")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Reson8/Rumble-2-Flash") model = AutoModelForMultimodalLM.from_pretrained("Reson8/Rumble-2-Flash", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Simplify Transformers usage snippet
#2
by eustlb HF Staff - opened
apply_transcription_requestloads paths and URLs itself, solibrosais no longer needed.processor.decode(..., return_format="transcription_only")strips thelanguage <Name><asr_text>prefix, whichbatch_decodeprints wheneverlanguageis omitted.device_map="auto"instead of.to("cuda");generatealready runs without gradients, soinference_modeis dropped.
Tested with transformers main: same transcription with language="English" and with auto-detection.
MarktHart changed pull request status to merged
MarktHart deleted the
refs/pr/2 ref