Automatic Speech Recognition
LiteRT-LM
LiteRT
Chinese
English
Japanese
litertlm
on-device
edge
asr
speech-recognition
streaming
audio
qwen3-asr
Instructions to use mlboydaisuke/Confucius4-R2T2-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use mlboydaisuke/Confucius4-R2T2-LiteRT with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli # A single .litertlm file in the repo is picked automatically; otherwise the CLI asks which one to run # (or pass its name right after the repo id). litert-lm run \ --from-huggingface-repo=mlboydaisuke/Confucius4-R2T2-LiteRT \ --prompt="Write me a poem"
- LiteRT
How to use mlboydaisuke/Confucius4-R2T2-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Add a known runtime issue: the stop token with a zero embedding from the second turn
Browse files
README.md
CHANGED
|
@@ -141,6 +141,10 @@ For the Chinese example clip `raw` is `language Chinese<asr_text>开放时间:
|
|
| 141 |
|
| 142 |
Sample app (Android): [`android/`](https://huggingface.co/mlboydaisuke/Confucius4-R2T2-LiteRT/tree/main/android) — one app for this file and two sibling bundles (Qwen3-ASR-1.7B, Fun-ASR-Nano-2512, Confucius4-R2T2): a model picker, hold-to-talk up to 30 s and three FLEURS clips, with a device check. Galaxy S26, language model and audio encoder on the CPU (4 threads), the 6.4 s English clip in 2.59 s, the 9.7 s Mandarin clip in 3.48 s and the 11.0 s Japanese clip in 3.54 s; a 9 s microphone recording in 3.17 s with no character error, measured by the app's device check on 2026-10-10 (CPU at its full clock).
|
| 143 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 144 |
## License
|
| 145 |
|
| 146 |
This file is a quantized Derivative Work of Confucius4-R2T2 and is distributed under the **NetEase Youdao Model Use License Agreement**. The agreement is included in this repository in English (`MODEL_LICENSE`) and Chinese (`MODEL_LICENSE_zh`); clause 9 makes the Chinese version prevail.
|
|
|
|
| 141 |
|
| 142 |
Sample app (Android): [`android/`](https://huggingface.co/mlboydaisuke/Confucius4-R2T2-LiteRT/tree/main/android) — one app for this file and two sibling bundles (Qwen3-ASR-1.7B, Fun-ASR-Nano-2512, Confucius4-R2T2): a model picker, hold-to-talk up to 30 s and three FLEURS clips, with a device check. Galaxy S26, language model and audio encoder on the CPU (4 threads), the 6.4 s English clip in 2.59 s, the 9.7 s Mandarin clip in 3.48 s and the 11.0 s Japanese clip in 3.54 s; a 9 s microphone recording in 3.17 s with no character error, measured by the app's device check on 2026-10-10 (CPU at its full clock).
|
| 143 |
|
| 144 |
+
## Known runtime issues
|
| 145 |
+
|
| 146 |
+
From the second turn of a conversation on, LiteRT-LM puts the previous answer's stop token into the KV cache with a zero embedding, because this file holds the embedding table in its own section and the decoder takes embeddings, so later answers in a conversation can differ from the answer the model gives to the same messages in one prompt (read in the source of LiteRT-LM 0.16.0 to 0.18.1; measured with 0.18.1 on WeVisOne-VL-2B and Qwen2.5-Coder-1.5B-Instruct, not on this file). One question per conversation avoids it, as does a new conversation that starts with the earlier messages and the new question.
|
| 147 |
+
|
| 148 |
## License
|
| 149 |
|
| 150 |
This file is a quantized Derivative Work of Confucius4-R2T2 and is distributed under the **NetEase Youdao Model Use License Agreement**. The agreement is included in this repository in English (`MODEL_LICENSE`) and Chinese (`MODEL_LICENSE_zh`); clause 9 makes the Chinese version prevail.
|