Apr 2 07:17 Add data, outputs, docs, and notebooks folders geoore +1: Claude Sonnet 4.6 - Track large files (*.pt, *.jsonl, *.arrow, etc.) via git-lfs
- Add training data (raw datasets, processed splits, STEM data)
- Add model checkpoints and GRPO output
- Add docs/ and notebooks/ placeholders
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> 07:07 Add comprehensive README with HuggingFace model card metadata geoore +1: Claude Sonnet 4.6 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> 06:52 Restructure to src/ layout with attention, per-layer MoE, and working chat geoore +1: Claude Sonnet 4.6 - Add GQA + RoPE attention (AttentionLayer) using config's n_heads/n_kv_heads/head_dim
- Wire 28 transformer layers (attention + shared MoE FFN per layer) in forward()
- Fix expert dispatch weight bug (per-token weights, not flattened scalar)
- Fix chat() stub: tokenize with GPT-2, generate, decode new tokens only
- Fix GRPO reward: remove proxy metrics, correctness + CoT bonus only
- Add load balance loss to GRPO train_step to prevent expert collapse
- Fix JSONLibrary recall() write-back and add 1000-entry cap per category
- Add tests/test_core.py with 11 tests covering all core components
- Add .gitignore excluding venv/, outputs/, data/, .vscode/, .claude/
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com> Mar 26 06:42 Upload Shorekeeper model, code, and checkpoints 06:34 Upload Shorekeeper model, code, and checkpoints Mar 17 04:09 initial commit