| --- |
| language: |
| - en |
| - zh |
| - es |
| - pt |
| - de |
| - ja |
| - ko |
| - fr |
| - ru |
| - it |
| license: mit |
| pipeline_tag: automatic-speech-recognition |
| tags: |
| - audio.cpp |
| - gguf |
| - asr |
| - streaming |
| - speaker-attributed-transcription |
| base_model: microsoft/VibeVoice-ASR-Streaming-7B |
| --- |
| |
| # VibeVoice ASR Streaming 7B GGUF for audio.cpp |
|
|
| This repository contains audio.cpp-native GGUF builds of |
| `microsoft/VibeVoice-ASR-Streaming-7B`. |
|
|
| ## Use with audio.cpp |
|
|
| Install the recommended Q8_0 package through the audio.cpp model manager: |
| |
| ```bash |
| python3 tools/model_manager_v2.py install vibevoice_asr_streaming_7b_q8_0 |
| ``` |
| |
| Run offline ASR: |
| |
| ```bash |
| build/debug/bin/audiocpp_cli \ |
| --task asr \ |
| --family vibevoice_asr_streaming \ |
| --model models/VibeVoice-ASR-Streaming-7B-GGUF/vibevoice-asr-streaming-7b-q8_0.gguf \ |
| --backend cuda \ |
| --threads 8 \ |
| --audio input.wav \ |
| --text-out transcript.txt \ |
| --metrics \ |
| --log |
| ``` |
| |
| Run the server with the model loaded: |
| |
| ```json |
| { |
| "host": "127.0.0.1", |
| "port": 8080, |
| "backend": "cuda", |
| "threads": 8, |
| "models": [ |
| { |
| "id": "vibevoice-streaming-7b", |
| "family": "vibevoice_asr_streaming", |
| "path": "models/VibeVoice-ASR-Streaming-7B-GGUF/vibevoice-asr-streaming-7b-q8_0.gguf", |
| "task": "asr", |
| "mode": "streaming" |
| } |
| ] |
| } |
| ``` |
| |
| Then start the server: |
|
|
| ```bash |
| build/debug/bin/audiocpp_server --config server.json --log |
| ``` |
|
|
| For live streaming, send 16 kHz mono signed 16-bit PCM to the live endpoint: |
|
|
| ```bash |
| ffmpeg -hide_banner -loglevel error -i input.wav -f s16le -ac 1 -ar 16000 - \ |
| | curl -N -X POST \ |
| -H 'Content-Type: application/octet-stream' \ |
| -H 'Transfer-Encoding: chunked' \ |
| -H 'Expect:' \ |
| -T - \ |
| 'http://127.0.0.1:8080/v1/audio/transcriptions/live?model=vibevoice-streaming-7b&sample_rate=16000&channels=1&sample_format=s16le' |
| ``` |
|
|
| ## Files |
|
|
| | File | Format | Notes | |
| |---|---|---| |
| | `vibevoice-asr-streaming-7b-bf16.gguf` | BF16 | Highest precision package. | |
| | `vibevoice-asr-streaming-7b-q8_0.gguf` | Q8_0 | Recommended package for audio.cpp. | |
| | `vibevoice-asr-streaming-7b-q4_k.gguf` | Q4_K | Smaller lower-bit package. | |
| |
| Each GGUF is self-contained and embeds the audio.cpp package spec and required |
| sidecars. |
| |
| ## Source and license |
| |
| These GGUF files were converted from the upstream Hugging Face model: |
| |
| - Upstream repository: https://huggingface.co/microsoft/VibeVoice-ASR-Streaming-7B |
| - Pinned upstream revision: `60d858b518b4e19d404af3737f848fc185b30177` |
| - Upstream license: MIT |
| |
| The GGUF conversion preserves the upstream MIT license. See the upstream model |
| card and Microsoft VibeVoice repository for the original model documentation, |
| usage notes, and any responsible-use guidance. |
| |
