Reinforcement Learning
Transformers
English
post-training
distillation
agentic-coding
composer-2.5
cursor
kimi-k2
grpo
dapo
diloco
openenv
trl
verl
research
methodology
Instructions to use Codeseys/composer-replication-framework with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Codeseys/composer-replication-framework with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Codeseys/composer-replication-framework", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Spike v0.0 laydown + spike 001 VALIDATED
Decompose v0.0 into 4 risk-ordered sub-spikes: - 001 teacher-replay-cost (kill-switch, ✅ EXECUTED + VALIDATED in this commit) - 002a trace-collection-trl (planned) - 002b trace-collection-prime-rl (comparison-spike) - 003 dpo-pairs-from-disagreement (planned) - 004 ab-train-grpo-vs-trace-replay-dpo (terminal experiment) Spike 001 result (real, not scaffolding): - 150 teacher API calls (Opus 4.7 + GPT-5 + DeepSeek V4 Pro via OpenRouter) - 50 synthesized agentic-coding states as fixture - 0 errors, total spend $0.98 - Mean per-trace cost: $0.98 (target: <$5) ✅ — 5x headroom - p95 step latency: 20.5s (target: <30s) ✅ - p99 step latency: 23.2s (target: <60s) ✅ - Cost composition: Opus dominates ($0.81 of $0.98); DeepSeek + GPT-5 essentially free This validates the framework's central economic claim. Even ungated (no VOI, no tiered teachers), cost is ~$1/trace not $64/trace. With VOI gating in v0.1 we project ~$0.30/trace. Trace-replay-distillation is economically viable. Files: - spikes…35581fd -
Initial commit: Composer 2.5 Replication Framework — research synthesis
Methodology repo (model type) for an open replication of Cursor's Composer 2.5 (post-trained Kimi K2.5) on any HuggingFace base model. Contents: - README.md (HF model card with frontmatter) - framework/composer-replication-framework.md (master synthesis, 18KB) - research/ (5 deep-dives by 5 different LLM families, ~107KB total) - 01-composer-2.5.md (Gemini 3.1 Pro) - 02-diloco-family.md (DeepSeek V4 Pro) - 03-monarch-torchforge-openenv.md (GPT-5) - 04-verl-trl.md (Sonnet 4.6) - 05-trace-replay-distillation.md (Kimi K2-Thinking) - docs/METHODOLOGY.md (how the synthesis was produced) - docs/HF_REPO_LAYOUT.md (planned multi-repo split) - LICENSE (MIT) Status: pre-spike. No code, no weights, no datasets yet. Trained variants and trace datasets will live in separate repos linked via HF Collection.7165832