Automatic Speech Recognition
RKLLM
GGUF
ASR
rk182x
rockchip
rknpu
llm
qwen
edge-ai
asr
speech-recognition
multilingual
conversational
Instructions to use wardner/Qwen3-ASR with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- RKLLM
How to use wardner/Qwen3-ASR with RKLLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use wardner/Qwen3-ASR with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf wardner/Qwen3-ASR # Run inference directly in the terminal: llama cli -hf wardner/Qwen3-ASR
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf wardner/Qwen3-ASR # Run inference directly in the terminal: llama cli -hf wardner/Qwen3-ASR
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf wardner/Qwen3-ASR # Run inference directly in the terminal: ./build/bin/llama cli -hf wardner/Qwen3-ASR
Use Docker
docker model run hf.co/wardner/Qwen3-ASR
- Llama new
- LM Studio
- Jan
- Ollama
How to use wardner/Qwen3-ASR with Ollama:
ollama run hf.co/wardner/Qwen3-ASR
- Unsloth Desktop
- Pi
How to use wardner/Qwen3-ASR with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf wardner/Qwen3-ASR
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "wardner/Qwen3-ASR" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use wardner/Qwen3-ASR with Docker Model Runner:
docker model run hf.co/wardner/Qwen3-ASR
- Lemonade
How to use wardner/Qwen3-ASR with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull wardner/Qwen3-ASR
Run and chat with the model
lemonade run user.Qwen3-ASR-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use wardner/Qwen3-ASR with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf wardner/Qwen3-ASR
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default wardner/Qwen3-ASR
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use wardner/Qwen3-ASR with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf wardner/Qwen3-ASR
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "wardner/Qwen3-ASR" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 2,131 Bytes
857f342 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 | {
"schema_version": "1.0",
"model_id": "wardner/Qwen3-ASR",
"display_name": "Qwen3-ASR",
"model_type": "ASR",
"chip_label": "RK182x",
"supported_chips": [
"RK182x"
],
"host_platform": "RK3588",
"runtime_type": "rkllm+rknn",
"worker": {
"id": "qwen3-asr",
"label": "[ASR]流式语音识别",
"capability_types": [
"swcap_audio_asr"
],
"spec_factory": "qwen3_asr",
"worker_name": "qwen3-asr",
"model_dir_env": "WDNAI_QWEN3_ASR_DIR",
"model_dir_name": "Qwen3-ASR",
"instance_name": "qwen3-asr",
"available_targets": [
"182x"
],
"memory_estimate_mb": 1600,
"estimated_init_seconds": 25,
"infer_timeout_s": 120,
"display_order": 45
},
"files": [
{
"path": "encoder_online.1828.rknn",
"size": 3126072,
"lfs": true,
"sha256": "35f619da92d245eb1ec63935d8109ea958cabbfb3819ce737d87dc8240609271"
},
{
"path": "encoder_online.weight",
"size": 374837248,
"lfs": true,
"sha256": "52227946cdd4151b4848297db48a97a211b98ecf92114e74d5f7ccaac1732d6d"
},
{
"path": "llm.1828.rknn",
"size": 47478048,
"lfs": true,
"sha256": "b7b0db475dd9e0af86973e938cbf42cf980cd9b5d8b141adf14cfc4c7601e0f8"
},
{
"path": "llm.weight",
"size": 387201536,
"lfs": true,
"sha256": "ce48aa8a2acf98a4802f2b7522087d3b9b9e6fd621705aaa2dddfa69adee967f"
},
{
"path": "llm.embed.bin",
"size": 311164928,
"lfs": true,
"sha256": "e80150119fa5f7e56e85aed64c3a02d5c78eb7a37cfdcb973d0987316f15bee2"
},
{
"path": "llm.tokenizer.gguf",
"size": 5933232,
"lfs": true,
"sha256": "21c9a8e25a0f85215fabb9038ef8976f6110a007be086c23964e16adc8156bce"
},
{
"path": "mel_128_filters.txt",
"size": 668929,
"lfs": false,
"sha256": "5681943997cbab35d2d457724178091831e2c71d0c007c4df3abc673776bc514"
},
{
"path": "qwen3-asr.json",
"size": 1847,
"lfs": false,
"sha256": "9def9fce9b264eedf54af6a726bdab1d68d07ef484aebd6dab6d262daed915db"
}
]
}
|