Automatic Speech Recognition
GGUF
VibeVoice
ggml
ASR
quantization
cpu-inference
bitnet
conversational
Instructions to use P2Enjoy/VibeVoice-ASR-BitNet-slim with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use P2Enjoy/VibeVoice-ASR-BitNet-slim with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf P2Enjoy/VibeVoice-ASR-BitNet-slim # Run inference directly in the terminal: llama cli -hf P2Enjoy/VibeVoice-ASR-BitNet-slim
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf P2Enjoy/VibeVoice-ASR-BitNet-slim # Run inference directly in the terminal: llama cli -hf P2Enjoy/VibeVoice-ASR-BitNet-slim
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf P2Enjoy/VibeVoice-ASR-BitNet-slim # Run inference directly in the terminal: ./build/bin/llama cli -hf P2Enjoy/VibeVoice-ASR-BitNet-slim
Use Docker
docker model run hf.co/P2Enjoy/VibeVoice-ASR-BitNet-slim
- Llama new
- LM Studio
- Jan
- Ollama
How to use P2Enjoy/VibeVoice-ASR-BitNet-slim with Ollama:
ollama run hf.co/P2Enjoy/VibeVoice-ASR-BitNet-slim
- Unsloth Desktop
- Docker Model Runner
How to use P2Enjoy/VibeVoice-ASR-BitNet-slim with Docker Model Runner:
docker model run hf.co/P2Enjoy/VibeVoice-ASR-BitNet-slim
- Lemonade
How to use P2Enjoy/VibeVoice-ASR-BitNet-slim with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull P2Enjoy/VibeVoice-ASR-BitNet-slim
Run and chat with the model
lemonade run user.VibeVoice-ASR-BitNet-slim-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Commit History
-
Long-form confirmed on a second TED talk: parity with whisper-small
Verified signaturee6ef1e2 -
Final: weights-focused card, real long-form results, documented limits
Verified signature99f8a73 -
Correction: long-form is this model's strength, not its weakness (WER 8.88 vs whisper-small 27.57)
Verified signature3821925 -
Long-form test results: retract unverified single-pass and speaker claims
Verified signature0e5b175 -
Final benchmark table: WER + speed over upstream baseline, all engines
Verified signature93172ec
-
Residual-fusion default: +0.04 WER row, engine ratio ~3.0x upstream
Verified signaturea705b76 -
Accuracy in the open: four-engine WER table incl. whisper; speed as engine ratios
Verified signature6822117 -
Refresh accuracy tables on the current portable build (094b53c): 4/6 languages identical, corpus +0.30; add MLS-FR anchor row and hotword biasing note
Verified signature409d175
-
Final results: same-build WER comparison (corpus 13.65 vs 13.95), deterministic runtime, speed pointer to repo
Verified signaturea1b693b
-
Split responsibilities with the GitHub README: card owns model+WER, repo owns speed+reproduction
Verified signature322679d -
Add measured WER cost of dropping the F16 output projection
Verified signatureaca7ef1 -
Upload vibeasr-vae-encoder-i8_s.gguf with huggingface_hub
Verified signature7e3aa8a -
Upload vibeasr-lm-i2_s-tied.gguf with huggingface_hub
Verified signatureaee35d1 -
Upload vocab.json with huggingface_hub
Verified signature3c54447 -
Upload tokenizer_config.json with huggingface_hub
Verified signature0bd7b3e -
Upload tokenizer.json with huggingface_hub
Verified signaturefbb5202 -
Upload config.json with huggingface_hub
Verified signaturea1d788f -
Upload README.md with huggingface_hub
Verified signature443b385 -
initial commit
Verified signaturedd67234