Automatic Speech Recognition
Transformers
Safetensors
VibeVoice
ASR
Transcription
Speech-to-Text
Streaming
Instructions to use microsoft/VibeVoice-ASR-Streaming-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/VibeVoice-ASR-Streaming-7B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="microsoft/VibeVoice-ASR-Streaming-7B")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, VibeVoiceForASRStreamingTraining processor = AutoProcessor.from_pretrained("microsoft/VibeVoice-ASR-Streaming-7B") model = VibeVoiceForASRStreamingTraining.from_pretrained("microsoft/VibeVoice-ASR-Streaming-7B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 2,236 Bytes
c0b4d15 60d858b c0b4d15 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 | ---
language:
- en
- zh
- es
- pt
- de
- ja
- ko
- fr
- ru
- it
license: mit
pipeline_tag: automatic-speech-recognition
tags:
- ASR
- Transcription
- Speech-to-Text
- Streaming
library_name: transformers
---
## VibeVoice-ASR-Streaming-7B
[](https://github.com/microsoft/VibeVoice)
[](https://aka.ms/vibeasr)
**VibeVoice-ASR-Streaming** is a unified streaming ASR model that transcribes **Who (Speaker)** said **What (Content)**, with support for **Customized Hotwords** and **10 languages**.
➡️ **Code:** [microsoft/VibeVoice](https://github.com/microsoft/VibeVoice)<br>
➡️ **Demo:** [VibeVoice-ASR-Streaming](https://aka.ms/vibeasr)<br>
<p align="left">
<img src="figures/VibeVoice_ASR_Streaming_architecture.png" alt="VibeVoice-ASR-Streaming Architecture" height="250px">
</p>
## 🔥 Key Features
- **📝 Streaming Speaker-Attributed Transcription**:
Continuously transcribes **who** said **what** as speech arrives.
- **👤 Customized Hotwords**:
Users can provide customized hotwords, such as names and technical terms, to improve recognition of domain-specific content.
- **🌍 Multilingual Support**:
It supports Chinese, English, French, German, Italian, Japanese, Korean, Portuguese, Russian, and Spanish.
## Technical Report
📄 [VibeVoice-ASR-Streaming Technical Report](https://arxiv.org/abs/2609.02812)
## Evaluation
<p align="center">
<img src="figures/VibeVoice_ASR_Streaming_results.png" alt="VibeVoice-ASR-Streaming Results" width="80%">
</p>
## Installation and Usage
Please refer to the [GitHub repository](https://github.com/microsoft/VibeVoice).
## License
This project is licensed under the MIT License.
## Contact
This project was conducted by members of Microsoft Research. We welcome feedback and collaboration from our audience. If you have suggestions, questions, or observe unexpected/offensive behavior in our technology, please contact us at VibeVoice@microsoft.com.
If the team receives reports of undesired behavior or identifies issues independently, we will update this repository with appropriate mitigations.
|