Spaces:
Running on Zero
Running on Zero
new model repo name + full MATH-500 numbers in header
Browse files
app.py
CHANGED
|
@@ -9,7 +9,7 @@ import json
|
|
| 9 |
import gradio as gr
|
| 10 |
|
| 11 |
BASE = "Qwen/Qwen3.5-0.8B"
|
| 12 |
-
EDITED = "akhaliq/Qwen3.5-0.8B-
|
| 13 |
INSTRUCTION = "Please reason step by step, and put your final answer within \\boxed{}."
|
| 14 |
|
| 15 |
try:
|
|
@@ -132,11 +132,12 @@ From **["Sparks of Weight Space Programming"](https://rikiyat.github.io/blog/wei
|
|
| 132 |
a frontier LLM read Qwen3.5-0.8B's weights, found a direction that makes it loop until the token
|
| 133 |
limit, and **rewrote 131,072 weights to remove it — no training, no gradients**. The blog post
|
| 134 |
never released the model; this is a bit-exact, hash-verified rebuild
|
| 135 |
-
([akhaliq/Qwen3.5-0.8B-
|
| 136 |
|
| 137 |
**Left: the original model** — watch it circle and repeat. **Right: the edited model** — same
|
| 138 |
-
weights everywhere else, same prompt, same sampling. Verified on MATH-500
|
| 139 |
-
|
|
|
|
| 140 |
|
| 141 |
*Live runs cap the answer length for demo speed (default 4096 tokens; the verification used 32,768).
|
| 142 |
The base model's loop is usually visible within the first ~2,000 tokens. First call may take a
|
|
|
|
| 9 |
import gradio as gr
|
| 10 |
|
| 11 |
BASE = "Qwen/Qwen3.5-0.8B"
|
| 12 |
+
EDITED = "akhaliq/Qwen3.5-0.8B-weight-space-programming"
|
| 13 |
INSTRUCTION = "Please reason step by step, and put your final answer within \\boxed{}."
|
| 14 |
|
| 15 |
try:
|
|
|
|
| 132 |
a frontier LLM read Qwen3.5-0.8B's weights, found a direction that makes it loop until the token
|
| 133 |
limit, and **rewrote 131,072 weights to remove it — no training, no gradients**. The blog post
|
| 134 |
never released the model; this is a bit-exact, hash-verified rebuild
|
| 135 |
+
([akhaliq/Qwen3.5-0.8B-weight-space-programming](https://huggingface.co/akhaliq/Qwen3.5-0.8B-weight-space-programming)).
|
| 136 |
|
| 137 |
**Left: the original model** — watch it circle and repeat. **Right: the edited model** — same
|
| 138 |
+
weights everywhere else, same prompt, same sampling. Verified on the full MATH-500 (500 problems
|
| 139 |
+
× 4 samples): **51.0% accuracy** (post: 48.1) with **31.6%** of answers truncated at the token cap
|
| 140 |
+
(post: 33.1); the base model manages 5% with 95% truncated.
|
| 141 |
|
| 142 |
*Live runs cap the answer length for demo speed (default 4096 tokens; the verification used 32,768).
|
| 143 |
The base model's loop is usually visible within the first ~2,000 tokens. First call may take a
|