Instructions to use HideIron/tiny-aya-global-sql-selfheal with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use HideIron/tiny-aya-global-sql-selfheal with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("CohereLabs/tiny-aya-global") model = PeftModel.from_pretrained(base_model, "HideIron/tiny-aya-global-sql-selfheal") - Notebooks
- Google Colab
- Kaggle
model card: final results
Browse files
README.md
CHANGED
|
@@ -13,19 +13,17 @@ tags:
|
|
| 13 |
|
| 14 |
# tiny-aya-global-sql-selfheal (DPO)
|
| 15 |
|
| 16 |
-
LoRA adapter for
|
| 17 |
-
self-healing text-to-SQL loop (Lexsi Labs Hackathon, Track 3, PS #8)
|
| 18 |
-
|
| 19 |
-
Aya Expanse 32B (
|
| 20 |
-
retrained through AgentTune.
|
|
|
|
| 21 |
|
| 22 |
-
|
| 23 |
|
| 24 |
-
|
| 25 |
-
AgentTune's DeploymentGate **blocked deployment** (task accuracy regressed) — the
|
| 26 |
-
gate doing exactly what PS #8 requires. Full analysis (likelihood displacement on
|
| 27 |
-
minimal-edit SQL pairs + catastrophic forgetting) in the article.
|
| 28 |
|
| 29 |
- Project page + code: https://huggingface.co/spaces/HideIron/selfheal-sql
|
| 30 |
-
- All run logs
|
| 31 |
-
- Training data: 158 execution-verified fix pairs
|
|
|
|
| 13 |
|
| 14 |
# tiny-aya-global-sql-selfheal (DPO)
|
| 15 |
|
| 16 |
+
LoRA adapter for CohereLabs/tiny-aya-global (3.35B) from a fully automated
|
| 17 |
+
self-healing text-to-SQL loop (Lexsi Labs Hackathon, Track 3, PS #8). Failures are
|
| 18 |
+
detected by executing the SQL on real Spider databases, classified, corrected by
|
| 19 |
+
Aya Expanse 32B (every fix verified by execution; the healer never sees the gold
|
| 20 |
+
query), and retrained through AgentTune. Deployment is decided by AgentTune's
|
| 21 |
+
DeploymentGate on held-out data.
|
| 22 |
|
| 23 |
+
Recipe: DPO (AgentTune RetrainConfig, TRL), LoRA r=16/alpha=32 on all projections, 158 verified pairs, 3 epochs, lr 1e-5, beta 0.1.
|
| 24 |
|
| 25 |
+
Result: Gate split 58.0% vs baseline 62.0% (-4pp, fixed 4 / broke 8); test 44.6% vs 45.6%. The DeploymentGate BLOCKED this adapter (task accuracy regressed). The write-up explains why: likelihood displacement on minimal-edit SQL pairs plus catastrophic forgetting.
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
- Project page + code: https://huggingface.co/spaces/HideIron/selfheal-sql
|
| 28 |
+
- All run logs and gate decisions: https://huggingface.co/datasets/HideIron/selfheal-sql-runs
|
| 29 |
+
- Training data: 158 execution-verified fix pairs (heal/baseline-pool600 in the runs repo)
|