How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
# Run inference directly in the terminal:
llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
# Run inference directly in the terminal:
llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
# Run inference directly in the terminal:
./build/bin/llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Use Docker
docker model run hf.co/Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K
Quick Links
The THOX four-device family

ThoxSpeech-ASR-BitNet

CPU Multilingual Speech Recognition (Redistribution) β€” a verbatim redistribution of a third-party multilingual automatic speech recognition model, mirrored here for CPU-only on-device transcription in the THOX stack

Multilingual ASR, CPU-only Β· 1.58 GB total (I8_S tokenizer 0.65 GB + I2_S / Q6_K decoder 0.92 GB) Β· Verbatim upstream redistribution

License Params GGUF Access

Find your model: THOX Model Factory Β· Collection: Research & From-Scratch Models

Back THOX on Kickstarter

Your AI. Your Data. Your Rules.β„’

Status: VERBATIM REDISTRIBUTION. THOX did not retrain or re-quantize this model; it is mirrored here for CPU-only on-device transcription in the THOX stack, under the upstream MIT license, with credit to the upstream authors (see License).

Summary

ThoxSpeech-ASR-BitNet is a verbatim redistribution of a third-party multilingual automatic speech recognition model, mirrored here for CPU-only on-device transcription in the THOX stack. THOX did not retrain or re-quantize it; credit for the model belongs upstream (see License). Total size 1.58 GB: an I8_S acoustic tokenizer (0.65 GB) plus an I2_S / Q6_K language-model decoder (0.92 GB), in a two-stage architecture.

Highlights

  • ThoxSpeech-ASR-BitNet is a verbatim redistribution of a third-party multilingual automatic speech recognition model, mirrored here for CPU-only on-device transcription in the THOX stack.
  • bash hf download Thox-ai/ThoxSpeech-ASR-BitNet --local-dir ./ThoxSpeech-ASR-BitNet # run with the VibeVoice / BitNet ggml ASR runtime (CPU) Ollama and LM Studio do not support these files; the ternary and non-standard GGUF types need the dedicated ggml ASR runtime.

Specifications

Base model microsoft/VibeVoice-ASR-BitNet
Parameters See card body
Formats GGUF: thoxspeech-lm-i2_s-embed-q6_k.gguf, thoxspeech-vae-encoder-i8_s.gguf
License MIT. This repo is a mirror of an upstream MIT-licensed model (Β© Microsoft Corporation); the MIT notice carries forward and THOX claims no authorship of the weights. See the license text for terms.
This repository contains GGUF build(s) in this repo: thoxspeech-lm-i2_s-embed-q6_k.gguf, thoxspeech-vae-encoder-i8_s.gguf

Files

File Size Purpose
thoxspeech-lm-i2_s-embed-q6_k.gguf 992,877,600 B GGUF model build
thoxspeech-vae-encoder-i8_s.gguf 703,080,064 B GGUF model build
THIRD_PARTY_NOTICES.md 17,127 B Documentation
NOTICE 4,577 B Repository file
.gitattributes 1,659 B Repository file

Run it

hf download Thox-ai/ThoxSpeech-ASR-BitNet --local-dir ./ThoxSpeech-ASR-BitNet
# run with the VibeVoice / BitNet ggml ASR runtime (CPU)

Ollama and LM Studio do not support these files; the ternary and non-standard GGUF types need the dedicated ggml ASR runtime.

Platforms

Platform / device Run path
Hugging Face Download the builds listed under Files from this repo (see Run it)

Intended use

  • Multilingual automatic speech recognition on CPU: research and on-device transcription.
  • Out of scope: medical, legal, financial, safety-critical, or other high-stakes decisions without human review; unattended control of physical devices without a confirmation step.

Training data and procedure

THOX fine-tune of microsoft/VibeVoice-ASR-BitNet. The corpus and procedure are described in this card as published at release (see Summary and Evaluation); no training beyond what this card describes is claimed for this repository.

Evaluation

Word error rate around 2.41 on LibriSpeech-clean in THOX's internal testing. Accuracy degrades on far-field and overlapping speech. No THOX GATE49 result applies (speech model).

Limitations

  • Transcription errors are expected on noisy, far-field, or overlapping speech; verify important transcripts.
  • THOX makes no quality claim beyond the measurement above; the model is redistributed as published upstream.
  • Behaviour and bias reflect the upstream training data.

Provenance

Published by THOX.ai as Thox-ai/ThoxSpeech-ASR-BitNet. Upstream base: microsoft/VibeVoice-ASR-BitNet. This card was conformed to THOX Model Card Standard v1.0 on 2026-10-31 (frontmatter, tags, header, files, and section structure); the technical content is as published at release.

License

MIT. This repo is a mirror of an upstream MIT-licensed model (Β© Microsoft Corporation); the MIT notice carries forward and THOX claims no authorship of the weights. See the license text for terms.

THOX.ai β€” Your AI. Your Data. Your Rules.β„’

Citation

@misc{thoxai2026thoxspeechasrbitnet,
      title={ThoxSpeech-ASR-BitNet},
      author={THOX.ai},
      year={2026},
      url={https://huggingface.co/Thox-ai/ThoxSpeech-ASR-BitNet}
}
Downloads last month
78
GGUF
Model size
2B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Thox-ai/ThoxSpeech-ASR-BitNet

Quantized
(6)
this model

Space using Thox-ai/ThoxSpeech-ASR-BitNet 1

Collection including Thox-ai/ThoxSpeech-ASR-BitNet