Spaces:
Sleeping
Sleeping
Commit Β·
e151e2c
1
Parent(s): 99eb59d
fix: png rename + remove placeholder + fix blog link + add baseline comparison
Browse files
README.md
CHANGED
|
@@ -21,7 +21,7 @@ pinned: false
|
|
| 21 |
| Resource | URL |
|
| 22 |
|---|---|
|
| 23 |
| π€ HuggingFace Space (live env) | https://huggingface.co/spaces/CystronCode/cannon-and-wall |
|
| 24 |
-
| π
|
| 25 |
| π Training notebook (Colab) | https://colab.research.google.com/drive/1uTSt6DahNVXoAZ0hlpyzrXrn-F6ehc9z?usp=sharing|
|
| 26 |
| Reward curves | https://wandb.ai/saiamogh7-r-v-c-e/cannon-and-wall/runs/p3uh8q2b |
|
| 27 |
|
|
@@ -180,13 +180,11 @@ Escalation triggers when either agent achieves consistently low reward for 3 epi
|
|
| 180 |
|
| 181 |
## π Results
|
| 182 |
|
| 183 |
-
*(Filled in after training run β April 25-26, 2026)*
|
| 184 |
-
|
| 185 |
### Reward curves
|
| 186 |
|
| 187 |

|
| 188 |
|
| 189 |
-
*
|
| 190 |
|
| 191 |
### Results after 50 episodes
|
| 192 |
|
|
@@ -197,9 +195,14 @@ Escalation triggers when either agent achieves consistently low reward for 3 epi
|
|
| 197 |
| Cannon bypass success rate | ~60% |
|
| 198 |
| Wall patch validity rate | 100% |
|
| 199 |
| Episodes run | 50 |
|
|
|
|
|
|
|
| 200 |
| Base model | Qwen/Qwen2.5-3B-Instruct |
|
| 201 |
| Environment | Live on HuggingFace Spaces |
|
| 202 |
|
|
|
|
|
|
|
|
|
|
| 203 |
## βΆοΈ Running Locally
|
| 204 |
|
| 205 |
```bash
|
|
|
|
| 21 |
| Resource | URL |
|
| 22 |
|---|---|
|
| 23 |
| π€ HuggingFace Space (live env) | https://huggingface.co/spaces/CystronCode/cannon-and-wall |
|
| 24 |
+
| π Writeup / Model Card | https://huggingface.co/CystronCode/cannon-and-wall-grpo |
|
| 25 |
| π Training notebook (Colab) | https://colab.research.google.com/drive/1uTSt6DahNVXoAZ0hlpyzrXrn-F6ehc9z?usp=sharing|
|
| 26 |
| Reward curves | https://wandb.ai/saiamogh7-r-v-c-e/cannon-and-wall/runs/p3uh8q2b |
|
| 27 |
|
|
|
|
| 180 |
|
| 181 |
## π Results
|
| 182 |
|
|
|
|
|
|
|
| 183 |
### Reward curves
|
| 184 |
|
| 185 |

|
| 186 |
|
| 187 |
+
*Episode 0: Cannon reward ~0 (no valid exploit pattern). Episode 50: Cannon averages 1.3 β consistently identifying and bypassing SQLi vulnerabilities. Wall holds stable at 0.714 (100% patch validity rate). Adversarial self-play loop confirmed working.*
|
| 188 |
|
| 189 |
### Results after 50 episodes
|
| 190 |
|
|
|
|
| 195 |
| Cannon bypass success rate | ~60% |
|
| 196 |
| Wall patch validity rate | 100% |
|
| 197 |
| Episodes run | 50 |
|
| 198 |
+
| Cannon reward at episode 0 | ~0.0 (untrained baseline) |
|
| 199 |
+
| Cannon reward at episode 50 | ~1.3 (after self-play) |
|
| 200 |
| Base model | Qwen/Qwen2.5-3B-Instruct |
|
| 201 |
| Environment | Live on HuggingFace Spaces |
|
| 202 |
|
| 203 |
+
> Note: v1.0 uses the same Flask app across all curriculum stages.
|
| 204 |
+
> Stage 2 and 3 variant files are planned for v1.1.
|
| 205 |
+
|
| 206 |
## βΆοΈ Running Locally
|
| 207 |
|
| 208 |
```bash
|
assets/{reward_curve.jpeg β reward_curve.png}
RENAMED
|
File without changes
|