zhijianliu commited on
Commit
24f136c
·
verified ·
1 Parent(s): 7024652

High-standard model card (FlashDrive); NVIDIA non-commercial license

Browse files
Files changed (1) hide show
  1. README.md +24 -42
README.md CHANGED
@@ -1,82 +1,64 @@
1
  ---
2
- pipeline_tag: robotics
3
- library_name: transformers
4
  license: other
 
 
 
5
  language:
6
  - en
 
7
  base_model:
8
  - z-lab/Alpamayo-R1-10B
9
  tags:
10
  - flashdrive
11
  - dflash
12
  - speculative-decoding
13
- - speculative-decoding-draft
14
  - block-diffusion
15
  - draft-model
16
  - autonomous-driving
17
  - vision-language-action
18
  ---
19
 
20
- # Alpamayo-R1-10B-DFlash
21
-
22
- [Paper](https://arxiv.org/abs/2602.06036) | [GitHub](https://github.com/z-lab/dflash) | [Blog](https://z-lab.ai/projects/dflash) | [FlashDrive](https://github.com/z-lab/flashdrive)
23
 
24
- [DFlash](https://github.com/z-lab/dflash) draft model for
25
- [z-lab/Alpamayo-R1-10B](https://huggingface.co/z-lab/Alpamayo-R1-10B), used by
26
- [FlashDrive](https://github.com/z-lab/flashdrive) to accelerate the chain-of-causation
27
- reasoning stage.
28
 
29
- DFlash uses a lightweight block-diffusion draft to propose multiple tokens in parallel;
30
- the target model verifies each block in a single forward, preserving its output
31
- distribution. This draft is a 2-layer Qwen3-style network (block size 8) conditioned on
32
- target hidden states captured from layers 24/30/31/32/34. The repository also ships
33
- `mask_embedding.pt`, the trained mask-token embedding that FlashDrive appends to the
34
- target's embedding table.
35
 
36
- **This is not a standalone language model.** FlashDrive attaches it to the base checkpoint
37
- automatically, derived from the base repo id by the `-DFlash` suffix.
38
 
39
- ## Quick Start
 
40
 
41
- Install [FlashDrive](https://github.com/z-lab/flashdrive), then load the base checkpoint —
42
- the `-PARO` and `-DFlash` companions are derived from it by suffix and fetched automatically:
43
 
44
  ```python
45
- from flashdrive import load_flashdrive_model
46
 
47
- model = load_flashdrive_model("z-lab/Alpamayo-R1-10B")
48
-
49
- pred_xyz, pred_rot = model.sample_trajectories_streaming(data)
50
  ```
51
 
52
- The first call per stream only prefills the KV cache and returns `(None, None)`.
53
- For an end-to-end benchmark on a PhysicalAI-AV clip:
54
-
55
- ```bash
56
- python scripts/infer.py --model_path z-lab/Alpamayo-R1-10B
57
- ```
58
 
59
  ## License
60
 
61
- These weights are derived from NVIDIA's Alpamayo release and remain governed by its
62
- [non-commercial license](https://huggingface.co/nvidia/Alpamayo-R1-10B/blob/main/LICENSE).
63
- The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is MIT.
64
 
65
  ## Citation
66
 
67
  ```bibtex
68
- @article{chen2026dflash,
69
- title = {{DFlash: Block Diffusion for Flash Speculative Decoding}},
70
- author = {Chen, Jian and Liang, Yesheng and Liu, Zhijian},
71
- journal = {arXiv preprint arXiv:2602.06036},
72
- year = {2026}
73
  }
74
  ```
75
 
76
  ```bibtex
77
  @article{li2026flashdrive,
78
- title={FlashDrive: Flash Vision-Language-Action Inference For Autonomous Driving},
79
- author={Zekai Li, Yihao Liang, Hongfei Zhang, Jian Chen, Yesheng Liang, Zhijian Liu},
80
- year={2026}
81
  }
82
  ```
 
1
  ---
 
 
2
  license: other
3
+ license_name: nvidia-license
4
+ license_link: https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE
5
+ pipeline_tag: robotics
6
  language:
7
  - en
8
+ inference: false
9
  base_model:
10
  - z-lab/Alpamayo-R1-10B
11
  tags:
12
  - flashdrive
13
  - dflash
14
  - speculative-decoding
 
15
  - block-diffusion
16
  - draft-model
17
  - autonomous-driving
18
  - vision-language-action
19
  ---
20
 
21
+ # Alpamayo 1 (R1) — DFlash draft
 
 
22
 
23
+ [Paper](https://arxiv.org/abs/2602.06036) | [DFlash](https://github.com/z-lab/dflash) | [GitHub](https://github.com/z-lab/flashdrive) | [Blog](https://z-lab.ai/projects/flashdrive/) | [Models](https://huggingface.co/collections/z-lab/flashdrive)
 
 
 
24
 
25
+ [DFlash](https://github.com/z-lab/dflash) draft model for [z-lab/Alpamayo-R1-10B](https://huggingface.co/z-lab/Alpamayo-R1-10B), used by [FlashDrive](https://github.com/z-lab/flashdrive) to accelerate the chain-of-causation reasoning of [Alpamayo 1 (R1)](https://huggingface.co/nvidia/Alpamayo-R1-10B).
 
 
 
 
 
26
 
27
+ DFlash (ICML 2026) uses a lightweight block-diffusion draft to propose several tokens in parallel; the target verifies each block in a single forward, preserving its output distribution. This draft is a 2-layer Qwen3-style network (block size 8) conditioned on target hidden states from layers 24/30/31/32/34. The repository also ships `mask_embedding.pt`, the trained mask-token embedding FlashDrive appends to the target's embedding table.
 
28
 
29
+ > [!NOTE]
30
+ > **Not a standalone language model.** FlashDrive attaches it to the [base checkpoint](https://huggingface.co/z-lab/Alpamayo-R1-10B) automatically — you do not load this repository directly.
31
 
32
+ ## Usage
 
33
 
34
  ```python
35
+ import flashdrive
36
 
37
+ # from_pretrained fetches this -DFlash checkpoint automatically
38
+ model = flashdrive.from_pretrained("z-lab/Alpamayo-R1-10B")
 
39
  ```
40
 
41
+ See the [base model card](https://huggingface.co/z-lab/Alpamayo-R1-10B) and the [FlashDrive repository](https://github.com/z-lab/flashdrive) for the full pipeline.
 
 
 
 
 
42
 
43
  ## License
44
 
45
+ This checkpoint is derived from NVIDIA's Alpamayo weights and is governed by the [NVIDIA License](https://huggingface.co/nvidia/Alpamayo-1.5-10B/blob/main/LICENSE), which permits **non-commercial use only** and extends to derivative works. The [FlashDrive](https://github.com/z-lab/flashdrive) inference code is separately released under the [MIT License](https://github.com/z-lab/flashdrive/blob/main/LICENSE).
 
 
46
 
47
  ## Citation
48
 
49
  ```bibtex
50
+ @inproceedings{chen2026dflash,
51
+ title = {{DFlash: Block Diffusion for Flash Speculative Decoding}},
52
+ author = {Chen, Jian and Liang, Yesheng and Liu, Zhijian},
53
+ booktitle = {International Conference on Machine Learning (ICML)},
54
+ year = {2026}
55
  }
56
  ```
57
 
58
  ```bibtex
59
  @article{li2026flashdrive,
60
+ title = {{FlashDrive: Flash Vision-Language-Action Inference for Autonomous Driving}},
61
+ author = {Li, Zekai and Liang, Yihao and Zhang, Hongfei and Chen, Jian and Liang, Yesheng and Liu, Zhijian},
62
+ year = {2026}
63
  }
64
  ```