CyberSOS β€” Tiny Aya DAgger SFT LoRA adapter (B3, ablation)

LoRA adapter for CohereLabs/tiny-aya-global (revision af89d219b53ed9b13b8a4645f9c8028973510324), trained with AlignTune SFT on the original 2,958 planner decisions plus 830 DAgger rows: the SFT adapter was rolled out on all 400 training scenarios (once greedy, twice at temperature 1.0), and the observed-state planner R labeled every state it reached, including states after its own mistakes. Every relabeled row was replay-verified (the label must equal R's own choice at that state and be guard-allowed); 3,788 rows after CuratorKIT exact dedup.

Locked test (240 episodes): 213 objectives met (SFT adapter 211, GRPO adapter 223); safe eligible 53/68; boundary 160/172; fewest critical unsafe proposals of any model (7/240, all blocked). SFT β†’ this adapter: +0.8 points, 95% CI [βˆ’1.3, 3.2]. On dev it over-asks (32/60 vs 41/60 for SFT). Kept as an ablation; the recommended model is pgdev0410/cybersos-tiny-aya-grpo-lora.

License: the base model is CC-BY-NC-4.0 (Cohere Labs); this adapter inherits its noncommercial terms.

Downloads last month
15
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for pgdev0410/cybersos-tiny-aya-dagger-lora

Adapter
(395)
this model

Collection including pgdev0410/cybersos-tiny-aya-dagger-lora