Instructions to use Thox-ai/ThoxSpeech-ASR-BitNet with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Thox-ai/ThoxSpeech-ASR-BitNet with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K # Run inference directly in the terminal: llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K # Run inference directly in the terminal: llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K # Run inference directly in the terminal: ./build/bin/llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Use Docker
docker model run hf.co/Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
- Llama new
- LM Studio
- Jan
- Ollama
How to use Thox-ai/ThoxSpeech-ASR-BitNet with Ollama:
ollama run hf.co/Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
- Unsloth Desktop
- Docker Model Runner
How to use Thox-ai/ThoxSpeech-ASR-BitNet with Docker Model Runner:
docker model run hf.co/Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
- Lemonade
How to use Thox-ai/ThoxSpeech-ASR-BitNet with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Run and chat with the model
lemonade run user.ThoxSpeech-ASR-BitNet-Q6_K
List all available models
lemonade list
- Atomic Chat
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K# Run inference directly in the terminal:
llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_KBuild from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K# Run inference directly in the terminal:
./build/bin/llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_KUse Docker
docker model run hf.co/Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
ThoxSpeech-ASR-BitNet
CPU Multilingual Speech Recognition (Redistribution) β a verbatim redistribution of a third-party multilingual automatic speech recognition model, mirrored here for CPU-only on-device transcription in the THOX stack
Multilingual ASR, CPU-only Β· 1.58 GB total (I8_S tokenizer 0.65 GB + I2_S / Q6_K decoder 0.92 GB) Β· Verbatim upstream redistribution
Find your model: THOX Model Factory Β· Collection: Research & From-Scratch Models
Your AI. Your Data. Your Rules.β’
Status: VERBATIM REDISTRIBUTION. THOX did not retrain or re-quantize this model; it is mirrored here for CPU-only on-device transcription in the THOX stack, under the upstream MIT license, with credit to the upstream authors (see License).
Summary
ThoxSpeech-ASR-BitNet is a verbatim redistribution of a third-party multilingual automatic speech recognition model, mirrored here for CPU-only on-device transcription in the THOX stack. THOX did not retrain or re-quantize it; credit for the model belongs upstream (see License). Total size 1.58 GB: an I8_S acoustic tokenizer (0.65 GB) plus an I2_S / Q6_K language-model decoder (0.92 GB), in a two-stage architecture.
Highlights
- ThoxSpeech-ASR-BitNet is a verbatim redistribution of a third-party multilingual automatic speech recognition model, mirrored here for CPU-only on-device transcription in the THOX stack.
bash hf download Thox-ai/ThoxSpeech-ASR-BitNet --local-dir ./ThoxSpeech-ASR-BitNet # run with the VibeVoice / BitNet ggml ASR runtime (CPU)Ollama and LM Studio do not support these files; the ternary and non-standard GGUF types need the dedicated ggml ASR runtime.
Specifications
| Base model | microsoft/VibeVoice-ASR-BitNet |
| Parameters | See card body |
| Formats | GGUF: thoxspeech-lm-i2_s-embed-q6_k.gguf, thoxspeech-vae-encoder-i8_s.gguf |
| License | MIT. This repo is a mirror of an upstream MIT-licensed model (Β© Microsoft Corporation); the MIT notice carries forward and THOX claims no authorship of the weights. See the license text for terms. |
| This repository contains | GGUF build(s) in this repo: thoxspeech-lm-i2_s-embed-q6_k.gguf, thoxspeech-vae-encoder-i8_s.gguf |
Files
| File | Size | Purpose |
|---|---|---|
thoxspeech-lm-i2_s-embed-q6_k.gguf |
992,877,600 B | GGUF model build |
thoxspeech-vae-encoder-i8_s.gguf |
703,080,064 B | GGUF model build |
THIRD_PARTY_NOTICES.md |
17,127 B | Documentation |
NOTICE |
4,577 B | Repository file |
.gitattributes |
1,659 B | Repository file |
Run it
hf download Thox-ai/ThoxSpeech-ASR-BitNet --local-dir ./ThoxSpeech-ASR-BitNet
# run with the VibeVoice / BitNet ggml ASR runtime (CPU)
Ollama and LM Studio do not support these files; the ternary and non-standard GGUF types need the dedicated ggml ASR runtime.
Platforms
| Platform / device | Run path |
|---|---|
| Hugging Face | Download the builds listed under Files from this repo (see Run it) |
Intended use
- Multilingual automatic speech recognition on CPU: research and on-device transcription.
- Out of scope: medical, legal, financial, safety-critical, or other high-stakes decisions without human review; unattended control of physical devices without a confirmation step.
Training data and procedure
THOX fine-tune of microsoft/VibeVoice-ASR-BitNet. The corpus and procedure are described in this card as published at release (see Summary and Evaluation); no training beyond what this card describes is claimed for this repository.
Evaluation
Word error rate around 2.41 on LibriSpeech-clean in THOX's internal testing. Accuracy degrades on far-field and overlapping speech. No THOX GATE49 result applies (speech model).
Limitations
- Transcription errors are expected on noisy, far-field, or overlapping speech; verify important transcripts.
- THOX makes no quality claim beyond the measurement above; the model is redistributed as published upstream.
- Behaviour and bias reflect the upstream training data.
Provenance
Published by THOX.ai as Thox-ai/ThoxSpeech-ASR-BitNet. Upstream base: microsoft/VibeVoice-ASR-BitNet. This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure); the technical content is as published at release.
License
MIT. This repo is a mirror of an upstream MIT-licensed model (Β© Microsoft Corporation); the MIT notice carries forward and THOX claims no authorship of the weights. See the license text for terms.
THOX.ai β Your AI. Your Data. Your Rules.β’
Citation
@misc{thoxai2026thoxspeechasrbitnet,
title={ThoxSpeech-ASR-BitNet},
author={THOX.ai},
year={2026},
url={https://huggingface.co/Thox-ai/ThoxSpeech-ASR-BitNet}
}
- Downloads last month
- 78
6-bit
Model tree for Thox-ai/ThoxSpeech-ASR-BitNet
Base model
microsoft/VibeVoice-ASR-BitNet
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K# Run inference directly in the terminal: llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K