docs: add install/run instructions (Releases + download script + landing) and q8
Browse files
README.md
CHANGED
|
@@ -21,6 +21,18 @@ pipeline_tag: automatic-speech-recognition
|
|
| 21 |
|
| 22 |
GGUF build of **Fun-ASR-Nano** (SenseVoice SAN-M encoder + adaptor + **Qwen3-0.6B** LLM decoder) for the zero-Python, CPU/edge **[FunASR llama.cpp runtime](https://github.com/FunAudioLLM/Fun-ASR/tree/main/runtime/llama.cpp)** — the accuracy leader (LLM decoder), single C++ binary.
|
| 23 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
## Files
|
| 25 |
| file | size | notes |
|
| 26 |
|---|---|---|
|
|
|
|
| 21 |
|
| 22 |
GGUF build of **Fun-ASR-Nano** (SenseVoice SAN-M encoder + adaptor + **Qwen3-0.6B** LLM decoder) for the zero-Python, CPU/edge **[FunASR llama.cpp runtime](https://github.com/FunAudioLLM/Fun-ASR/tree/main/runtime/llama.cpp)** — the accuracy leader (LLM decoder), single C++ binary.
|
| 23 |
|
| 24 |
+
## Get it running (no Python, no build)
|
| 25 |
+
|
| 26 |
+
These are GGUF weights for the **[FunASR llama.cpp runtime](https://github.com/modelscope/FunASR/tree/main/runtime/llama.cpp)** — a whisper.cpp-style, single self-contained binary for CPU / edge. Grab a prebuilt binary, then fetch this model and run:
|
| 27 |
+
|
| 28 |
+
- **Prebuilt binaries (Linux / macOS / Windows) → [GitHub Releases](https://github.com/modelscope/FunASR/releases)** (tag `runtime-llamacpp-v*`)
|
| 29 |
+
- **One-page quickstart & benchmarks → [funasr.com/llama-cpp](https://www.funasr.com/llama-cpp.html)**
|
| 30 |
+
|
| 31 |
+
```bash
|
| 32 |
+
bash download-funasr-model.sh nano ./gguf
|
| 33 |
+
llama-funasr-cli --enc ./gguf/funasr-encoder-f16.gguf -m ./gguf/qwen3-0.6b-q8_0.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav
|
| 34 |
+
```
|
| 35 |
+
|
| 36 |
## Files
|
| 37 |
| file | size | notes |
|
| 38 |
|---|---|---|
|