Update README.md
Browse files
README.md
CHANGED
|
@@ -17,8 +17,8 @@ tags:
|
|
| 17 |
|
| 18 |
**Awaken: An Efficient Training Recipe for Full-Duplex Conversation That Retains Model Ability**
|
| 19 |
|
| 20 |
-
[](https://github.com/
|
| 21 |
-
[](https://github.com/
|
| 22 |
[](https://huggingface.co/openmartdev/awaken-full-duplex)
|
| 23 |
[](https://huggingface.co/FunAudioLLM/Fun-Audio-Chat-8B)
|
| 24 |
|
|
@@ -64,7 +64,7 @@ small amount of such data and keeps its base model's scores.
|
|
| 64 |
on 100,132 records with replay of the interaction data.
|
| 65 |
3. **GRPO**: improves backchannel timing from the model's own samples in conversational windows.
|
| 66 |
|
| 67 |
-
See the [project page](https://github.com/
|
| 68 |
|
| 69 |
## Model Details
|
| 70 |
|
|
@@ -89,8 +89,8 @@ See the [project page](https://github.com/OpenmartAI/awake-audio-chat/blob/main/
|
|
| 89 |
## Installation
|
| 90 |
|
| 91 |
```bash
|
| 92 |
-
git clone https://github.com/
|
| 93 |
-
cd
|
| 94 |
|
| 95 |
# 1. torch + torchaudio for YOUR CUDA driver first (the default PyPI wheel targets the newest
|
| 96 |
# CUDA and will not load on older drivers), e.g. for CUDA 12.8:
|
|
@@ -174,8 +174,17 @@ InteractionBench results and the Fun-Audio-Chat technical report.
|
|
| 174 |
- **Spoken QA**: our rows are means over 3 seeds; Freeze-Omni, Moshi and Fun-Audio-Chat-Duplex-8B
|
| 175 |
are reported scores from Table 7 of the Fun-Audio-Chat technical report.
|
| 176 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 177 |
Because our runs and the published results are scored differently, compare across systems with
|
| 178 |
-
care. Full methodology is on the [project page](https://github.com/
|
| 179 |
|
| 180 |
## Inference Details
|
| 181 |
|
|
@@ -240,7 +249,7 @@ webpage/ project page
|
|
| 240 |
|
| 241 |
## License
|
| 242 |
|
| 243 |
-
The code and model weights are licensed under the [Apache 2.0 License](https://github.com/
|
| 244 |
as the base model [Fun-Audio-Chat-8B](https://huggingface.co/FunAudioLLM/Fun-Audio-Chat-8B).
|
| 245 |
|
| 246 |
## Acknowledgments
|
|
@@ -248,9 +257,9 @@ as the base model [Fun-Audio-Chat-8B](https://huggingface.co/FunAudioLLM/Fun-Aud
|
|
| 248 |
The model architecture is derived from [Fun-Audio-Chat](https://github.com/FunAudioLLM/Fun-Audio-Chat)
|
| 249 |
and the speech codec from [CosyVoice](https://github.com/FunAudioLLM/CosyVoice) (both Apache-2.0);
|
| 250 |
the text backbone is [Qwen3](https://github.com/QwenLM/Qwen3), and the ear follows
|
| 251 |
-
[Whisper](https://github.com/openai/whisper)'s encoder. See [`NOTICE`](https://github.com/
|
| 252 |
|
| 253 |
## Contact
|
| 254 |
|
| 255 |
-
- 🐛 Submit an [Issue](https://github.com/
|
| 256 |
-
- 💡 Submit a [Pull Request](https://github.com/
|
|
|
|
| 17 |
|
| 18 |
**Awaken: An Efficient Training Recipe for Full-Duplex Conversation That Retains Model Ability**
|
| 19 |
|
| 20 |
+
[](https://github.com/avera-labs/AwakenFullDuplex/blob/main/webpage/index.html)
|
| 21 |
+
[](https://github.com/avera-labs/AwakenFullDuplex)
|
| 22 |
[](https://huggingface.co/openmartdev/awaken-full-duplex)
|
| 23 |
[](https://huggingface.co/FunAudioLLM/Fun-Audio-Chat-8B)
|
| 24 |
|
|
|
|
| 64 |
on 100,132 records with replay of the interaction data.
|
| 65 |
3. **GRPO**: improves backchannel timing from the model's own samples in conversational windows.
|
| 66 |
|
| 67 |
+
See the [project page](https://github.com/avera-labs/AwakenFullDuplex/blob/main/webpage/index.html) for the full data composition and training details.
|
| 68 |
|
| 69 |
## Model Details
|
| 70 |
|
|
|
|
| 89 |
## Installation
|
| 90 |
|
| 91 |
```bash
|
| 92 |
+
git clone https://github.com/avera-labs/AwakenFullDuplex
|
| 93 |
+
cd AwakenFullDuplex
|
| 94 |
|
| 95 |
# 1. torch + torchaudio for YOUR CUDA driver first (the default PyPI wheel targets the newest
|
| 96 |
# CUDA and will not load on older drivers), e.g. for CUDA 12.8:
|
|
|
|
| 174 |
- **Spoken QA**: our rows are means over 3 seeds; Freeze-Omni, Moshi and Fun-Audio-Chat-Duplex-8B
|
| 175 |
are reported scores from Table 7 of the Fun-Audio-Chat technical report.
|
| 176 |
|
| 177 |
+
| System | OpenBookQA ↑ |
|
| 178 |
+
|--------|-------------:|
|
| 179 |
+
| Fun-Audio-Chat-8B (half-duplex) | 83.52 |
|
| 180 |
+
| Fun-Audio-Chat-Duplex-8B (reported) | – |
|
| 181 |
+
| Freeze-Omni (reported) | 30.98 |
|
| 182 |
+
| Moshi (reported) | 25.93 |
|
| 183 |
+
| Awaken SFT | 76.2 |
|
| 184 |
+
| **Awaken GRPO** | **75.6** |
|
| 185 |
+
|
| 186 |
Because our runs and the published results are scored differently, compare across systems with
|
| 187 |
+
care. Full methodology is on the [project page](https://github.com/avera-labs/AwakenFullDuplex/blob/main/webpage/index.html).
|
| 188 |
|
| 189 |
## Inference Details
|
| 190 |
|
|
|
|
| 249 |
|
| 250 |
## License
|
| 251 |
|
| 252 |
+
The code and model weights are licensed under the [Apache 2.0 License](https://github.com/avera-labs/AwakenFullDuplex/blob/main/LICENSE), the same license
|
| 253 |
as the base model [Fun-Audio-Chat-8B](https://huggingface.co/FunAudioLLM/Fun-Audio-Chat-8B).
|
| 254 |
|
| 255 |
## Acknowledgments
|
|
|
|
| 257 |
The model architecture is derived from [Fun-Audio-Chat](https://github.com/FunAudioLLM/Fun-Audio-Chat)
|
| 258 |
and the speech codec from [CosyVoice](https://github.com/FunAudioLLM/CosyVoice) (both Apache-2.0);
|
| 259 |
the text backbone is [Qwen3](https://github.com/QwenLM/Qwen3), and the ear follows
|
| 260 |
+
[Whisper](https://github.com/openai/whisper)'s encoder. See [`NOTICE`](https://github.com/avera-labs/AwakenFullDuplex/blob/main/NOTICE).
|
| 261 |
|
| 262 |
## Contact
|
| 263 |
|
| 264 |
+
- 🐛 Submit an [Issue](https://github.com/avera-labs/AwakenFullDuplex/issues)
|
| 265 |
+
- 💡 Submit a [Pull Request](https://github.com/avera-labs/AwakenFullDuplex/pulls)
|