File size: 2,232 Bytes
1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 f810329 1b14e61 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 | ---
license: apache-2.0
base_model: openai/whisper-small
tags:
- whisper
- automatic-speech-recognition
- ggml
- mobilint
- npu
language:
- en
- zh
- de
- es
- ru
- ko
- fr
- ja
- pt
- tr
- pl
- multilingual
library_name: whisper.cpp
---
# whisper.cpp Models for Mobilint NPU
This repository provides all model files needed to run [whisper.cpp-mblt](https://git.mobilint.com/algorithm-team/integration/whisper.cpp-mblt), the Mobilint NPU-accelerated fork of [whisper.cpp](https://github.com/ggml-org/whisper.cpp).
## Available Files
| Model | File | Size | Description |
|-------|------|------|-------------|
| whisper-small | `ggml-small.bin` | 466 MB | GGML model (tokenizer + weights for CPU fallback) |
| whisper-small | `ggml-small-encoder.mxq` | 93 MB | Mobilint NPU encoder |
| whisper-small | `ggml-small-decoder.mxq` | 159 MB | Mobilint NPU decoder |
## Usage
### NPU Inference (Mobilint)
```bash
# Download all files and run
whisper-cli-mblt \
-m ggml-small.bin \
--mxq-encoder ggml-small-encoder.mxq \
--mxq-decoder ggml-small-decoder.mxq \
-f audio.wav
# Or auto-download from HuggingFace
whisper-cli-mblt -hf mobilint/whisper-small -f audio.wav
```
### CPU Inference (standard whisper.cpp)
The `ggml-small.bin` file is also compatible with standard whisper.cpp for CPU-only inference:
```bash
whisper-cli -m ggml-small.bin -f audio.wav
```
## Model Details
- **Base model**: [openai/whisper-small](https://huggingface.co/openai/whisper-small) (244M parameters)
- **Languages**: 99 languages supported (English, Chinese, German, Spanish, Russian, Korean, French, Japanese, Portuguese, Turkish, Polish, and more)
- **Tasks**: Transcription and translation (to English)
- **NPU pipeline**: Audio → mel spectrogram (CPU) → encoder (NPU, global4) → decoder (NPU, single core, greedy) → text
## Related Repositories
- **[mobilint/whisper-small](https://huggingface.co/mobilint/whisper-small)** — Original Mobilint whisper-small model with config.json and tokenizer files
- **[ggerganov/whisper.cpp](https://huggingface.co/ggerganov/whisper.cpp)** — Upstream GGML models for CPU inference
## License
Apache 2.0 (same as the original OpenAI Whisper model)
|