akhaliq HF Staff commited on
Commit
56e478e
·
verified ·
1 Parent(s): edbdf0f

new model repo name + full MATH-500 numbers in header

Browse files
Files changed (1) hide show
  1. app.py +5 -4
app.py CHANGED
@@ -9,7 +9,7 @@ import json
9
  import gradio as gr
10
 
11
  BASE = "Qwen/Qwen3.5-0.8B"
12
- EDITED = "akhaliq/Qwen3.5-0.8B-wsp-math-edit"
13
  INSTRUCTION = "Please reason step by step, and put your final answer within \\boxed{}."
14
 
15
  try:
@@ -132,11 +132,12 @@ From **["Sparks of Weight Space Programming"](https://rikiyat.github.io/blog/wei
132
  a frontier LLM read Qwen3.5-0.8B's weights, found a direction that makes it loop until the token
133
  limit, and **rewrote 131,072 weights to remove it — no training, no gradients**. The blog post
134
  never released the model; this is a bit-exact, hash-verified rebuild
135
- ([akhaliq/Qwen3.5-0.8B-wsp-math-edit](https://huggingface.co/akhaliq/Qwen3.5-0.8B-wsp-math-edit)).
136
 
137
  **Left: the original model** — watch it circle and repeat. **Right: the edited model** — same
138
- weights everywhere else, same prompt, same sampling. Verified on MATH-500: 5% → 47% accuracy,
139
- 95% → 29% of answers truncated at the token cap (smoke, 25 problems × 4 samples).
 
140
 
141
  *Live runs cap the answer length for demo speed (default 4096 tokens; the verification used 32,768).
142
  The base model's loop is usually visible within the first ~2,000 tokens. First call may take a
 
9
  import gradio as gr
10
 
11
  BASE = "Qwen/Qwen3.5-0.8B"
12
+ EDITED = "akhaliq/Qwen3.5-0.8B-weight-space-programming"
13
  INSTRUCTION = "Please reason step by step, and put your final answer within \\boxed{}."
14
 
15
  try:
 
132
  a frontier LLM read Qwen3.5-0.8B's weights, found a direction that makes it loop until the token
133
  limit, and **rewrote 131,072 weights to remove it — no training, no gradients**. The blog post
134
  never released the model; this is a bit-exact, hash-verified rebuild
135
+ ([akhaliq/Qwen3.5-0.8B-weight-space-programming](https://huggingface.co/akhaliq/Qwen3.5-0.8B-weight-space-programming)).
136
 
137
  **Left: the original model** — watch it circle and repeat. **Right: the edited model** — same
138
+ weights everywhere else, same prompt, same sampling. Verified on the full MATH-500 (500 problems
139
+ × 4 samples): **51.0% accuracy** (post: 48.1) with **31.6%** of answers truncated at the token cap
140
+ (post: 33.1); the base model manages 5% with 95% truncated.
141
 
142
  *Live runs cap the answer length for demo speed (default 4096 tokens; the verification used 32,768).
143
  The base model's loop is usually visible within the first ~2,000 tokens. First call may take a