PEFT
Safetensors
text-to-sql
lora
self-healing
agenttune
HideIron commited on
Commit
dc23dba
·
verified ·
1 Parent(s): c9781c6

model card: final results

Browse files
Files changed (1) hide show
  1. README.md +10 -12
README.md CHANGED
@@ -13,19 +13,17 @@ tags:
13
 
14
  # tiny-aya-global-sql-selfheal (DPO)
15
 
16
- LoRA adapter for **CohereLabs/tiny-aya-global** (3.35B) from a fully automated
17
- self-healing text-to-SQL loop (Lexsi Labs Hackathon, Track 3, PS #8):
18
- failures detected by executing SQL on Spider databases, classified, corrected by
19
- Aya Expanse 32B (fixes verified by execution; healer never sees gold SQL), and
20
- retrained through AgentTune.
 
21
 
22
- **Recipe:** DPO (AgentTune `RetrainConfig`, TRL), LoRA r=16/alpha=32 on all projections, 158 verified pairs, 3 epochs, lr 1e-5, beta 0.1.
23
 
24
- **Result:** Gate split 58.0% vs baseline 62.0% (-4pp, fixed 4 / broke 8); test 44.6% vs 45.6%.
25
- AgentTune's DeploymentGate **blocked deployment** (task accuracy regressed) — the
26
- gate doing exactly what PS #8 requires. Full analysis (likelihood displacement on
27
- minimal-edit SQL pairs + catastrophic forgetting) in the article.
28
 
29
  - Project page + code: https://huggingface.co/spaces/HideIron/selfheal-sql
30
- - All run logs / gate decisions: https://huggingface.co/datasets/HideIron/selfheal-sql-runs
31
- - Training data: 158 execution-verified fix pairs from `heal/baseline-pool600` in the runs repo
 
13
 
14
  # tiny-aya-global-sql-selfheal (DPO)
15
 
16
+ LoRA adapter for CohereLabs/tiny-aya-global (3.35B) from a fully automated
17
+ self-healing text-to-SQL loop (Lexsi Labs Hackathon, Track 3, PS #8). Failures are
18
+ detected by executing the SQL on real Spider databases, classified, corrected by
19
+ Aya Expanse 32B (every fix verified by execution; the healer never sees the gold
20
+ query), and retrained through AgentTune. Deployment is decided by AgentTune's
21
+ DeploymentGate on held-out data.
22
 
23
+ Recipe: DPO (AgentTune RetrainConfig, TRL), LoRA r=16/alpha=32 on all projections, 158 verified pairs, 3 epochs, lr 1e-5, beta 0.1.
24
 
25
+ Result: Gate split 58.0% vs baseline 62.0% (-4pp, fixed 4 / broke 8); test 44.6% vs 45.6%. The DeploymentGate BLOCKED this adapter (task accuracy regressed). The write-up explains why: likelihood displacement on minimal-edit SQL pairs plus catastrophic forgetting.
 
 
 
26
 
27
  - Project page + code: https://huggingface.co/spaces/HideIron/selfheal-sql
28
+ - All run logs and gate decisions: https://huggingface.co/datasets/HideIron/selfheal-sql-runs
29
+ - Training data: 158 execution-verified fix pairs (heal/baseline-pool600 in the runs repo)