Update README.md
Browse files
README.md
CHANGED
|
@@ -68,17 +68,10 @@ The Step Probe (`realArceus/twt-probe`) is a fine-tuned `Qwen2.5-0.5B-Instruct`
|
|
| 68 |
|
| 69 |
## How is this different from PRMs?
|
| 70 |
|
| 71 |
-
Process Reward Models (PRMs) assign quality scores to steps for **training signal**. TWT uses step-level supervision for **real-time inference-time interpretability** — a fundamentally different use case. We also demonstrate this works at 0.5B scale, far smaller than typical PRM
|
| 72 |
-
|
| 73 |
-
## Paper
|
| 74 |
-
|
| 75 |
-
*ThinkWhileThinking: Real-Time Reasoning Failure Detection in Small Language Models via Step-Level Process Supervision*
|
| 76 |
-
|
| 77 |
-
**Abstract:** We present ThinkWhileThinking (TWT), a lightweight framework for real-time reasoning failure detection in language models. Unlike post-hoc interpretability methods or safety-focused CoT monitors, TWT employs a small probe model fine-tuned on step-level process supervision signals to predict reasoning failures mid-chain-of-thought, before the final answer is produced. Our Step Probe — a 0.5B parameter classifier trained on PRM800K annotations — achieves 98.15% accuracy and 99.05% F1 on held-out step-level correctness prediction. We demonstrate that real-time correctness failure detection is both feasible and highly accurate at small model scales, opening a new direction for accessible, inference-time interpretability research.
|
| 78 |
-
|
| 79 |
## Built By
|
| 80 |
|
| 81 |
-
**
|
| 82 |
|
| 83 |
## License
|
| 84 |
|
|
|
|
| 68 |
|
| 69 |
## How is this different from PRMs?
|
| 70 |
|
| 71 |
+
Process Reward Models (PRMs) assign quality scores to steps for **training signal**. TWT uses step-level supervision for **real-time inference-time interpretability** — a fundamentally different use case. We also demonstrate this works at 0.5B scale, far smaller than typical PRM
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
## Built By
|
| 73 |
|
| 74 |
+
**Krishna Pahuja** — Final year AI student · HF Build Small Hackathon 2026
|
| 75 |
|
| 76 |
## License
|
| 77 |
|