Add Agron neural-network zoo, optimisers, algorithms, schedulers and unified trainer
Njap-png
a311e94
- Implement 10 architectures (native transformer/MoE/hyper, hybrid/mamba SSM, GRU/LSTM, causal conv, Mixer) with HF-compatible save/load/generate
- Add 16 optimisers (Lion/Muon/Shampoo/Adan/LAMB/Sophia/ScheduleFree/Kahan/...)
- Add 16 composable training algorithms + 8 schedules + 10 training recipes
- New agron_nets.training engine with gradient clipping/accumulation/SAM/EMA/Z-loss/composability
- Wire --arch/--optimizer/--scheduler/--algorithm/--recipe into train_from_scratch.py and train_agron.py
- Upgrade app.py with zoo UI, architecture switching and engine-based training
- Add full test-suite (110 tests) and smoke test across all architectures
19 days ago
Add trained Agron weights (500-step training) + training script
