Add the Qwen3.5-9B demo video
Browse filesCo-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LrUG2MPyVgRWHb7y6iKMf4
- .gitattributes +1 -0
- README.md +8 -0
- assets/demo.mp4 +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
assets/demo.mp4 filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -27,6 +27,14 @@ MMFlash draft model for speculative decoding of [`Qwen/Qwen3.8-27B`](https://hug
|
|
| 27 |
|
| 28 |
MMFlash builds on [DFlash](https://github.com/z-lab/dflash) block-diffusion drafting: the draft reads hidden states from five layers of the target and proposes a block of 16 tokens in one forward pass, and the target verifies the block in one forward pass. MMFlash keeps the DFlash architecture and is trained on multimodal data with a loss weighted by per-token visual-grounding (visual-KL) scores.
|
| 29 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
> [!TIP]
|
| 31 |
> Need a drafter for another model? Email us at [fscnkucs@gmail.com](mailto:fscnkucs@gmail.com) and we can help train one. We will keep updating these releases, and a Qwen4 checkpoint is planned.
|
| 32 |
|
|
|
|
| 27 |
|
| 28 |
MMFlash builds on [DFlash](https://github.com/z-lab/dflash) block-diffusion drafting: the draft reads hidden states from five layers of the target and proposes a block of 16 tokens in one forward pass, and the target verifies the block in one forward pass. MMFlash keeps the DFlash architecture and is trained on multimodal data with a loss weighted by per-token visual-grounding (visual-KL) scores.
|
| 29 |
|
| 30 |
+
<div align="center">
|
| 31 |
+
<video autoplay muted loop playsinline controls width="100%">
|
| 32 |
+
<source src="https://huggingface.co/FSCCS/Qwen3.8-27B-MMFlash/resolve/main/assets/demo.mp4" type="video/mp4">
|
| 33 |
+
</video>
|
| 34 |
+
</div>
|
| 35 |
+
|
| 36 |
+
<p align="center"><sub>Qwen3.5-9B on a MathVista question, recorded in real time on one NVIDIA H200 with SGLang (greedy decoding).</sub></p>
|
| 37 |
+
|
| 38 |
> [!TIP]
|
| 39 |
> Need a drafter for another model? Email us at [fscnkucs@gmail.com](mailto:fscnkucs@gmail.com) and we can help train one. We will keep updating these releases, and a Qwen4 checkpoint is planned.
|
| 40 |
|
assets/demo.mp4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ab4f4826ed2dd5e33335ff49c77ed5860f56db1e4479ed5db4c559ba2c32ddf2
|
| 3 |
+
size 2234619
|