Update links to github.com/LakoreAI/sev
Browse files
README.md
CHANGED
|
@@ -44,7 +44,7 @@ model-index:
|
|
| 44 |
|
| 45 |
A ModernBERT-large decision model fine-tuned on `LocalLLaMA/typed-decisions` with **plain cross-entropy** against the teacher's soft targets, at the documented 1024-token context / 256-token option budget.
|
| 46 |
|
| 47 |
-
It is the best-performing checkpoint from the
|
| 48 |
|
| 49 |
**Test-set results (2,000 decisions, 400 cases):**
|
| 50 |
|
|
@@ -98,7 +98,7 @@ Structured, closed-set probabilistic decisions over short English text: routing,
|
|
| 98 |
This is a custom architecture, not a `transformers` `AutoModel`. Load it with the code from the reproduction repo:
|
| 99 |
|
| 100 |
```bash
|
| 101 |
-
git clone https://github.com/LakoreAI/
|
| 102 |
cd rlcd-reverse-engineering && uv sync
|
| 103 |
```
|
| 104 |
|
|
@@ -166,7 +166,7 @@ This checkpoint is deliberately RL-free. In the accompanying study, adding Laya'
|
|
| 166 |
|
| 167 |
## Links
|
| 168 |
|
| 169 |
-
- Code, configs, and per-run results: [LakoreAI/
|
| 170 |
- All ablation checkpoints and metrics: [minhleduc/rlcd-e2-checkpoints](https://huggingface.co/minhleduc/rlcd-e2-checkpoints)
|
| 171 |
- Base model: [convaiinnovations/laya](https://huggingface.co/convaiinnovations/laya)
|
| 172 |
- Dataset: [LocalLLaMA/typed-decisions](https://huggingface.co/datasets/LocalLLaMA/typed-decisions)
|
|
@@ -178,6 +178,6 @@ This checkpoint is deliberately RL-free. In the accompanying study, adding Laya'
|
|
| 178 |
title = {Dissecting RLCD: What Reinforcement Learning Does (and Doesn't) Do for Calibrated Typed Decisions},
|
| 179 |
author = {Le Duc Minh},
|
| 180 |
year = {2026},
|
| 181 |
-
url = {https://github.com/LakoreAI/
|
| 182 |
}
|
| 183 |
```
|
|
|
|
| 44 |
|
| 45 |
A ModernBERT-large decision model fine-tuned on `LocalLLaMA/typed-decisions` with **plain cross-entropy** against the teacher's soft targets, at the documented 1024-token context / 256-token option budget.
|
| 46 |
|
| 47 |
+
It is the best-performing checkpoint from the **Sev** study (*Dissecting RLCD*), where I took apart the training method behind TypeSafe's Jev and its open reproduction, Laya. The short version of that study: Laya's RL term is a noise-smoothed cross-entropy gradient, and on this benchmark plain CE matches or beats it on every proper score.
|
| 48 |
|
| 49 |
**Test-set results (2,000 decisions, 400 cases):**
|
| 50 |
|
|
|
|
| 98 |
This is a custom architecture, not a `transformers` `AutoModel`. Load it with the code from the reproduction repo:
|
| 99 |
|
| 100 |
```bash
|
| 101 |
+
git clone https://github.com/LakoreAI/sev
|
| 102 |
cd rlcd-reverse-engineering && uv sync
|
| 103 |
```
|
| 104 |
|
|
|
|
| 166 |
|
| 167 |
## Links
|
| 168 |
|
| 169 |
+
- Code, configs, and per-run results: [LakoreAI/sev](https://github.com/LakoreAI/sev)
|
| 170 |
- All ablation checkpoints and metrics: [minhleduc/rlcd-e2-checkpoints](https://huggingface.co/minhleduc/rlcd-e2-checkpoints)
|
| 171 |
- Base model: [convaiinnovations/laya](https://huggingface.co/convaiinnovations/laya)
|
| 172 |
- Dataset: [LocalLLaMA/typed-decisions](https://huggingface.co/datasets/LocalLLaMA/typed-decisions)
|
|
|
|
| 178 |
title = {Dissecting RLCD: What Reinforcement Learning Does (and Doesn't) Do for Calibrated Typed Decisions},
|
| 179 |
author = {Le Duc Minh},
|
| 180 |
year = {2026},
|
| 181 |
+
url = {https://github.com/LakoreAI/sev}
|
| 182 |
}
|
| 183 |
```
|