CystronCode commited on
Commit
e151e2c
Β·
1 Parent(s): 99eb59d

fix: png rename + remove placeholder + fix blog link + add baseline comparison

Browse files
README.md CHANGED
@@ -21,7 +21,7 @@ pinned: false
21
  | Resource | URL |
22
  |---|---|
23
  | πŸ€— HuggingFace Space (live env) | https://huggingface.co/spaces/CystronCode/cannon-and-wall |
24
- | πŸ“ Mini blog post | https://huggingface.co/CystronCode/cannon-and-wall-grpo/blob/main/README.md |
25
  | πŸ““ Training notebook (Colab) | https://colab.research.google.com/drive/1uTSt6DahNVXoAZ0hlpyzrXrn-F6ehc9z?usp=sharing|
26
  | Reward curves | https://wandb.ai/saiamogh7-r-v-c-e/cannon-and-wall/runs/p3uh8q2b |
27
 
@@ -180,13 +180,11 @@ Escalation triggers when either agent achieves consistently low reward for 3 epi
180
 
181
  ## πŸ“ˆ Results
182
 
183
- *(Filled in after training run β€” April 25-26, 2026)*
184
-
185
  ### Reward curves
186
 
187
  ![Reward curve](assets/reward_curve.png)
188
 
189
- *50 episodes β€” Cannon (red) averages 1.3 reward, Wall (blue) stable at 0.714. Adversarial self-play loop confirmed working.*
190
 
191
  ### Results after 50 episodes
192
 
@@ -197,9 +195,14 @@ Escalation triggers when either agent achieves consistently low reward for 3 epi
197
  | Cannon bypass success rate | ~60% |
198
  | Wall patch validity rate | 100% |
199
  | Episodes run | 50 |
 
 
200
  | Base model | Qwen/Qwen2.5-3B-Instruct |
201
  | Environment | Live on HuggingFace Spaces |
202
 
 
 
 
203
  ## ▢️ Running Locally
204
 
205
  ```bash
 
21
  | Resource | URL |
22
  |---|---|
23
  | πŸ€— HuggingFace Space (live env) | https://huggingface.co/spaces/CystronCode/cannon-and-wall |
24
+ | πŸ“ Writeup / Model Card | https://huggingface.co/CystronCode/cannon-and-wall-grpo |
25
  | πŸ““ Training notebook (Colab) | https://colab.research.google.com/drive/1uTSt6DahNVXoAZ0hlpyzrXrn-F6ehc9z?usp=sharing|
26
  | Reward curves | https://wandb.ai/saiamogh7-r-v-c-e/cannon-and-wall/runs/p3uh8q2b |
27
 
 
180
 
181
  ## πŸ“ˆ Results
182
 
 
 
183
  ### Reward curves
184
 
185
  ![Reward curve](assets/reward_curve.png)
186
 
187
+ *Episode 0: Cannon reward ~0 (no valid exploit pattern). Episode 50: Cannon averages 1.3 β€” consistently identifying and bypassing SQLi vulnerabilities. Wall holds stable at 0.714 (100% patch validity rate). Adversarial self-play loop confirmed working.*
188
 
189
  ### Results after 50 episodes
190
 
 
195
  | Cannon bypass success rate | ~60% |
196
  | Wall patch validity rate | 100% |
197
  | Episodes run | 50 |
198
+ | Cannon reward at episode 0 | ~0.0 (untrained baseline) |
199
+ | Cannon reward at episode 50 | ~1.3 (after self-play) |
200
  | Base model | Qwen/Qwen2.5-3B-Instruct |
201
  | Environment | Live on HuggingFace Spaces |
202
 
203
+ > Note: v1.0 uses the same Flask app across all curriculum stages.
204
+ > Stage 2 and 3 variant files are planned for v1.1.
205
+
206
  ## ▢️ Running Locally
207
 
208
  ```bash
assets/{reward_curve.jpeg β†’ reward_curve.png} RENAMED
File without changes