Commit History
-
feat: append Phase 5 Level 3 training section to sanity_run.ipynb
Jayant-Kernel +1: Claude Sonnet 4.6Unverified signatureCo-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>c893cdf -
fix: remove dead import, skip sleep when api unavailable
Jayant-KernelUnverified signatureea54c9d -
feat: generate_pressure.py — Level 3 adversarial pressure dataset script
Jayant-KernelUnverified signature7937a1a -
Phase 4 complete: level2 dataset, distractor env, 90 tests passing
Jayant-KernelUnverified signature46011b7 -
fix: exponential backoff on rate limit (10 retries, 30s*attempt)
Jayant-KernelUnverified signature8fd96d5 -
fix: retry on rate limit in generate_distractors, 21s sleep for free-tier 3 RPM
Jayant-KernelUnverified signature26d82a2 -
feat: append Phase 4 Level 2 training section to sanity_run.ipynb
Jayant-Kernel +1: Claude Sonnet 4.6Unverified signatureCo-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>f8a8477 -
fix: propagate fatal API errors, strip markdown fences, cleanup
Jayant-Kernel +1: Claude Sonnet 4.6Unverified signatureCo-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>d5d723b -
fix: count skipped rows toward progress interval
Jayant-KernelUnverified signatureba97ba8 -
fix: sleep after error path, print progress every 10 iterations
Jayant-KernelUnverified signatureb7f42c1 -
feat: generate_distractors.py — GPT-4o-mini Level 2 dataset script
Jayant-KernelUnverified signature1c6af55
-
Phase 2.5: multi-turn episodes, bug fixes, dataset cleanup
Jayant-Kernel +1: Claude Sonnet 4.6Unverified signatureCritical fixes: - Multi-turn episodes (max_turns=3): is_final flag on DeceitAction, step penalty -0.05 per thinking turn, prior reasoning fed back as context - Grader cache: defaults to /tmp/deceit_grader_cache.json (HF Spaces safe), overridable via DECEIT_GRADER_CACHE env var - Dataset: replaced 6 ambiguous questions (q051,q058,q066,q072,q091,q100) Other improvements: - DeceitState adds prior_reasoning: list[str] and max_turns: int - DeceitAction adds is_final: bool = False - __init__.py: package-level exports for DeceitEnvironment, models, Grader - app.py: factory pattern limitation documented - test_models.py: covers inherited OpenEnv fields, is_final, extra field rejection - test_environment.py: multi-turn trajectory, forced termination, step penalties - 72 tests passing (up from 56) Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>9737348 -
Phase 2 complete: Level 1 env runs locally, tests green, 100-question dataset
Jayant-Kernel +1: Claude Sonnet 4.6Unverified signature- models.py: upgraded to real OpenEnv base classes (Action/Observation/State) - grader.py: exact-match + GPT-4o-mini semantic fallback with disk cache - environment.py: DeceitEnvironment inheriting openenv.core.env_server.Environment - reset/step/state implementing full episode loop - compute_reward() pure function (correctness + calibration signals) - app.py: create_fastapi_app wrapper exposing /reset /step /state - level1.jsonl: 100 hand-curated QA pairs across 5 categories - 56 tests passing: models, rewards, grader (mocked), environment (mocked) - Smoke test: +1.3 correct+confident, -1.3 wrong+confident, 0.0 abstain OpenEnv API note: step() returns Observation with reward embedded (not tuple). Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>f577d1f -
Phase 1 complete: schemas, reward design, project scaffold
Jayant-Kernel +1: Claude Sonnet 4.6Unverified signature- Pydantic v2 schemas for DeceitObservation, DeceitAction, DeceitState - REWARD_DESIGN.md with correctness + calibration signals, worked examples, gaming analysis - Full folder structure with Phase 2-6 stubs - pytest tests for all three schemas (validation, defaults, JSON roundtrip) - pyproject.toml with openenv-core[core]>=0.2.1 dependency pinned for Phase 2 - Design doc in docs/superpowers/specs/ Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>139d3d1