Model card: INSIGHT Lab affiliations and Colab link
Browse files
README.md
CHANGED
|
@@ -17,13 +17,14 @@ tags:
|
|
| 17 |
|
| 18 |
**On the SPOT: Enhancing Speculative Decoding for Diffusion Language Models via Commit-Order Prediction**
|
| 19 |
|
| 20 |
-
Eliezer Shlomi<sup>1</sup> 路 Eliron Rahimi<sup>1</sup> 路 Avi Mendelson<sup>1</sup> 路 Chaim Baskin<sup>2,3</sup>
|
| 21 |
|
| 22 |
-
<sup>1</sup>Technion - Israel Institute of Technology <sup>2</sup>
|
| 23 |
|
| 24 |
-
[](#citation)
|
| 26 |
[](https://github.com/Eliezer318/SPOT-dLLM)
|
|
|
|
| 27 |
[](https://github.com/Eliezer318/SPOT-dLLM/blob/main/LICENSE)
|
| 28 |
|
| 29 |
</div>
|
|
@@ -60,7 +61,7 @@ The checkpoints are loaded by the decoder in the [GitHub repository](https://git
|
|
| 60 |
git clone https://github.com/Eliezer318/SPOT-dLLM.git && cd SPOT-dLLM
|
| 61 |
pip install torch --index-url https://download.pytorch.org/whl/cu124 # match your driver
|
| 62 |
pip install -r requirements.txt
|
| 63 |
-
huggingface-cli download
|
| 64 |
python run_sweep.py --model sdar --block-length 32 --gen-length 256 --task gsm8k --limit 100 \
|
| 65 |
--temperature 0.0 --verify match --layout concat --cache on --unmasking single --suffix skip \
|
| 66 |
--pad-pieces -1 --draft slot --slot-mode ddtree_b --slot-ckpt drafters/sdar8b_b32.pt \
|
|
|
|
| 17 |
|
| 18 |
**On the SPOT: Enhancing Speculative Decoding for Diffusion Language Models via Commit-Order Prediction**
|
| 19 |
|
| 20 |
+
Eliezer Shlomi<sup>1,2</sup> 路 Eliron Rahimi<sup>1,2</sup> 路 Avi Mendelson<sup>1</sup> 路 Chaim Baskin<sup>2,3</sup>
|
| 21 |
|
| 22 |
+
<sup>1</sup>Technion - Israel Institute of Technology <sup>2</sup>INSIGHT Lab, School of Electrical and Computer Engineering, Ben-Gurion University of the Negev <sup>3</sup>Decart AI
|
| 23 |
|
| 24 |
+
[](https://eliezer318.github.io/SPOT-dLLM/)
|
| 25 |
[](#citation)
|
| 26 |
[](https://github.com/Eliezer318/SPOT-dLLM)
|
| 27 |
+
[](https://colab.research.google.com/github/Eliezer318/SPOT-dLLM/blob/main/colab/spot_quickstart.ipynb)
|
| 28 |
[](https://github.com/Eliezer318/SPOT-dLLM/blob/main/LICENSE)
|
| 29 |
|
| 30 |
</div>
|
|
|
|
| 61 |
git clone https://github.com/Eliezer318/SPOT-dLLM.git && cd SPOT-dLLM
|
| 62 |
pip install torch --index-url https://download.pytorch.org/whl/cu124 # match your driver
|
| 63 |
pip install -r requirements.txt
|
| 64 |
+
huggingface-cli download HF_REPO_ID --local-dir drafters
|
| 65 |
python run_sweep.py --model sdar --block-length 32 --gen-length 256 --task gsm8k --limit 100 \
|
| 66 |
--temperature 0.0 --verify match --layout concat --cache on --unmasking single --suffix skip \
|
| 67 |
--pad-pieces -1 --draft slot --slot-mode ddtree_b --slot-ckpt drafters/sdar8b_b32.pt \
|