High-standard model card (FlashDrive); NVIDIA non-commercial license
Browse files
README.md
CHANGED
|
@@ -1,82 +1,64 @@
|
|
| 1 |
---
|
| 2 |
-
pipeline_tag: robotics
|
| 3 |
-
library_name: transformers
|
| 4 |
license: other
|
|
|
|
|
|
|
|
|
|
| 5 |
language:
|
| 6 |
- en
|
|
|
|
| 7 |
base_model:
|
| 8 |
- z-lab/Alpamayo-R1-10B
|
| 9 |
tags:
|
| 10 |
- flashdrive
|
| 11 |
- dflash
|
| 12 |
- speculative-decoding
|
| 13 |
-
- speculative-decoding-draft
|
| 14 |
- block-diffusion
|
| 15 |
- draft-model
|
| 16 |
- autonomous-driving
|
| 17 |
- vision-language-action
|
| 18 |
---
|
| 19 |
|
| 20 |
-
# Alpamayo
|
| 21 |
-
|
| 22 |
-
[Paper](https://arxiv.org/abs/2602.06036) | [GitHub](https://github.com/z-lab/dflash) | [Blog](https://z-lab.ai/projects/dflash) | [FlashDrive](https://github.com/z-lab/flashdrive)
|
| 23 |
|
| 24 |
-
[DFlash](https://github.com/z-lab/dflash)
|
| 25 |
-
[z-lab/Alpamayo-R1-10B](https://huggingface.co/z-lab/Alpamayo-R1-10B), used by
|
| 26 |
-
[FlashDrive](https://github.com/z-lab/flashdrive) to accelerate the chain-of-causation
|
| 27 |
-
reasoning stage.
|
| 28 |
|
| 29 |
-
DFlash
|
| 30 |
-
the target model verifies each block in a single forward, preserving its output
|
| 31 |
-
distribution. This draft is a 2-layer Qwen3-style network (block size 8) conditioned on
|
| 32 |
-
target hidden states captured from layers 24/30/31/32/34. The repository also ships
|
| 33 |
-
`mask_embedding.pt`, the trained mask-token embedding that FlashDrive appends to the
|
| 34 |
-
target's embedding table.
|
| 35 |
|
| 36 |
-
|
| 37 |
-
automatically, derived from the base repo id by the `-DFlash` suffix.
|
| 38 |
|
| 39 |
-
|
|
|
|
| 40 |
|
| 41 |
-
|
| 42 |
-
the `-PARO` and `-DFlash` companions are derived from it by suffix and fetched automatically:
|
| 43 |
|
| 44 |
```python
|
| 45 |
-
|
| 46 |
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
pred_xyz, pred_rot = model.sample_trajectories_streaming(data)
|
| 50 |
```
|
| 51 |
|
| 52 |
-
|
| 53 |
-
For an end-to-end benchmark on a PhysicalAI-AV clip:
|
| 54 |
-
|
| 55 |
-
```bash
|
| 56 |
-
python scripts/infer.py --model_path z-lab/Alpamayo-R1-10B
|
| 57 |
-
```
|
| 58 |
|
| 59 |
## License
|
| 60 |
|
| 61 |
-
|
| 62 |
-
[non-commercial license](https://huggingface.co/nvidia/Alpamayo-R1-10B/blob/main/LICENSE).
|
| 63 |
-
The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is MIT.
|
| 64 |
|
| 65 |
## Citation
|
| 66 |
|
| 67 |
```bibtex
|
| 68 |
-
@
|
| 69 |
-
title
|
| 70 |
-
author
|
| 71 |
-
|
| 72 |
-
year
|
| 73 |
}
|
| 74 |
```
|
| 75 |
|
| 76 |
```bibtex
|
| 77 |
@article{li2026flashdrive,
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
}
|
| 82 |
```
|
|
|
|
| 1 |
---
|
|
|
|
|
|
|
| 2 |
license: other
|
| 3 |
+
license_name: nvidia-license
|
| 4 |
+
license_link: https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE
|
| 5 |
+
pipeline_tag: robotics
|
| 6 |
language:
|
| 7 |
- en
|
| 8 |
+
inference: false
|
| 9 |
base_model:
|
| 10 |
- z-lab/Alpamayo-R1-10B
|
| 11 |
tags:
|
| 12 |
- flashdrive
|
| 13 |
- dflash
|
| 14 |
- speculative-decoding
|
|
|
|
| 15 |
- block-diffusion
|
| 16 |
- draft-model
|
| 17 |
- autonomous-driving
|
| 18 |
- vision-language-action
|
| 19 |
---
|
| 20 |
|
| 21 |
+
# Alpamayo 1 (R1) — DFlash draft
|
|
|
|
|
|
|
| 22 |
|
| 23 |
+
[Paper](https://arxiv.org/abs/2602.06036) | [DFlash](https://github.com/z-lab/dflash) | [GitHub](https://github.com/z-lab/flashdrive) | [Blog](https://z-lab.ai/projects/flashdrive/) | [Models](https://huggingface.co/collections/z-lab/flashdrive)
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
+
[DFlash](https://github.com/z-lab/dflash) draft model for [z-lab/Alpamayo-R1-10B](https://huggingface.co/z-lab/Alpamayo-R1-10B), used by [FlashDrive](https://github.com/z-lab/flashdrive) to accelerate the chain-of-causation reasoning of [Alpamayo 1 (R1)](https://huggingface.co/nvidia/Alpamayo-R1-10B).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
+
DFlash (ICML 2026) uses a lightweight block-diffusion draft to propose several tokens in parallel; the target verifies each block in a single forward, preserving its output distribution. This draft is a 2-layer Qwen3-style network (block size 8) conditioned on target hidden states from layers 24/30/31/32/34. The repository also ships `mask_embedding.pt`, the trained mask-token embedding FlashDrive appends to the target's embedding table.
|
|
|
|
| 28 |
|
| 29 |
+
> [!NOTE]
|
| 30 |
+
> **Not a standalone language model.** FlashDrive attaches it to the [base checkpoint](https://huggingface.co/z-lab/Alpamayo-R1-10B) automatically — you do not load this repository directly.
|
| 31 |
|
| 32 |
+
## Usage
|
|
|
|
| 33 |
|
| 34 |
```python
|
| 35 |
+
import flashdrive
|
| 36 |
|
| 37 |
+
# from_pretrained fetches this -DFlash checkpoint automatically
|
| 38 |
+
model = flashdrive.from_pretrained("z-lab/Alpamayo-R1-10B")
|
|
|
|
| 39 |
```
|
| 40 |
|
| 41 |
+
See the [base model card](https://huggingface.co/z-lab/Alpamayo-R1-10B) and the [FlashDrive repository](https://github.com/z-lab/flashdrive) for the full pipeline.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
|
| 43 |
## License
|
| 44 |
|
| 45 |
+
This checkpoint is derived from NVIDIA's Alpamayo weights and is governed by the [NVIDIA License](https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE), which permits **non-commercial use only** and extends to derivative works. The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is separately released under the [MIT License](https://github.com/z-lab/flashdrive/blob/main/LICENSE).
|
|
|
|
|
|
|
| 46 |
|
| 47 |
## Citation
|
| 48 |
|
| 49 |
```bibtex
|
| 50 |
+
@inproceedings{chen2026dflash,
|
| 51 |
+
title = {{DFlash: Block Diffusion for Flash Speculative Decoding}},
|
| 52 |
+
author = {Chen, Jian and Liang, Yesheng and Liu, Zhijian},
|
| 53 |
+
booktitle = {International Conference on Machine Learning (ICML)},
|
| 54 |
+
year = {2026}
|
| 55 |
}
|
| 56 |
```
|
| 57 |
|
| 58 |
```bibtex
|
| 59 |
@article{li2026flashdrive,
|
| 60 |
+
title = {{FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving}},
|
| 61 |
+
author = {Li, Zekai and Liang, Yihao and Zhang, Hongfei and Chen, Jian and Liang, Yesheng and Liu, Zhijian},
|
| 62 |
+
year = {2026}
|
| 63 |
}
|
| 64 |
```
|