Commit History
30 days ago
-
stress test the solver(B3) (#144)
- Handle valid-but-awkward text: line separators, lone surrogates, system_prompt braces (c72dd643671c647fc832fd871c39856e1eff4726) - Leave the system_prompt table row as it was (b75e111a8a7708abb6ee504610bc4516530efdfb) Co-authored-by: Gowrish Kumar Reddy <gowrishkumar@users.noreply.huggingface.co>8e2de47
-
write question files as UTF-8 in scripts/ (#88)
- Read and write question files as UTF-8 in scripts/ (83bc273b64f163401d2e3727b451e13ee29e2b91) - Make script output safe on consoles that cannot show every character (c1b3b881b660f8409bcfd644a0d6935b8614cf05) Co-authored-by: Gowrish Kumar Reddy <gowrishkumar@users.noreply.huggingface.co>65f90ba
-
Move submissions to questions/pending/, consolidate into corpus.jsonl at merge (#37) (#47)
- Move submissions to questions/pending/, consolidate into corpus.jsonl at merge (#37) (003ed87c4797e89df3e5dfda4e9a7c7ef40ec420) - Normalize line endings to LF (faa5867463cf3408c09d0068523b95f9e4f0acbe) - Run assign_ids.py on main after merging, not on the PR branch (c83a203a8bdde8d3691bf1c0832507ea96503452) - Merge main into PR #47, resolving CONTRIBUTING.md (81fa9992edc5e2f2eee9d5a06810f293d65e8f55) Co-authored-by: Anushka Singh <anushka1409@users.noreply.huggingface.co>a564d6f
-
Benchmark Schema Updates (#17)
- Add schema and documentation updates for benchmark metadata (e3420e1f2b1732c60c4c1bca0f18886b5f72546a) - Resolve conflicts, add difficulty.band consistency check, fix examples.jsonl formatting (64a4251f73d95355bbebb0cb9b248a29761919b4) Co-authored-by: Divyanshi Joshi <divyanshijoshi@users.noreply.huggingface.co>7851389 -
Fix sequential id collisions with a cb-pending placeholder (#13)
- Fix sequential id collisions with a cb-pending placeholder (16717e27d3cfc424ce6c5ac8bc1c7e8c4d701426) - Merge remote-tracking branch 'origin/main' into pr-13 (40b219adad0250b2ddd094ed6204bb29ea9170a3)6749a8b -
Validate schema date formats (#7)
- Validate schema date formats (3de3fcb165b5f3237cfdbdae5fb364cde7250ac9) Co-authored-by: Chaewon Yoon <melover24@users.noreply.huggingface.co>088ac34
-
Add ConspiracyBench question schema, template, and contribution docs
likelytobelaura +1: Claude Sonnet 5Documents the (question, ground_truth_answer) schema and the LLM-judge divergence scoring rubric, adds a JSON Schema for validation, a fill-in question template, a validation script, and PR instructions for contributors. Surfaces all of it on the space landing page. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012S6nRWEuCZz9BrSTiGv9wE037cb1b