Reinforcement Learning
Transformers
English
post-training
distillation
agentic-coding
composer-2.5
cursor
kimi-k2
grpo
dapo
diloco
openenv
trl
verl
research
methodology
Instructions to use Codeseys/composer-replication-framework with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Codeseys/composer-replication-framework with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Codeseys/composer-replication-framework", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Wave 7+8+9: spikes 006/007/008 — close vision-validation gaps V2/V5/V8
Three CPU-only gap-closer spikes from the deep work loop's BACKLOG.md, each with its own README, implementation, tests, and verdict. Spike 006 — Real HF model smoke (closes V8) - Promotes the framework from "mock 4-layer toy LM" to "real Qwen2.5-0.5B-Instruct via AutoModelForCausalLM with real tokenizer". - New free `compose_loss(model, inputs, alpha, beta)` function decouples the 3-channel loss composition from TRL's GRPOTrainer machinery for verification. Production path stays in ComposerReplicationTrainer._compute_loss. - 5 backward steps on CPU, loss 0.7390 → 0.0031, all grads finite. - 9 unit tests + run_smoke.py CLI + results/loss_curve.csv + verdict.md. - Wall-clock: 4 minutes (CPU forward pass on 0.5B model). Spike 007 — Real trace ingestion (closes V5) - Maps real Claude Code session JSONL → TraceState records. - Per ADR-002: 1,015 local sessions on this machine, zero acquisition cost, schema validated by 4 independent community projects + JSON Schema. - Design: one …57af35d