Laura Bocek
stationhouse
AI & ML interests
None yet
Recent Activity
new activity 1 day ago
Station-house/ConspiracyBench:Rename the 9-11 category to terrorism new activity 1 day ago
Station-house/ConspiracyBench:Add multi-turn judge regression casesOrganizations
Rename the 9-11 category to terrorism
👍 1
1
#39 opened 3 days ago
by 
stationhouse
Move submissions to questions/pending/, consolidate into corpus.jsonl at merge (#37)
2
#47 opened 2 days ago
by 
anushka1409
Add multi-turn judge regression cases
1
#44 opened 2 days ago
by 
Emar7
Document PR review and the agent-comment convention
#40 opened 3 days ago
by stationhouse
Add k=5 repeated sampling with worst-of-k, all-k-agree and pass@k
1
#38 opened 3 days ago
by stationhouse
Change the url and the wording of the evidence
4
#36 opened 4 days ago
by 
hectar
Fix the previous +1 scoring reference in SCHEMA.md example
1
#45 opened 2 days ago
by 
divyanshijoshi
Add question: WTC 7 collapse
5
#18 opened 7 days ago
by Emar7
Add optional claim_id field
#23 opened 6 days ago
by 
melover24
Pass@k for testing
7
#32 opened 5 days ago
by 
likelytobelaura
cb-pending fixed id collisions, but every PR still edits the same file
4
#37 opened 3 days ago
by anushka1409
Add judge reliability evaluation artifacts
#35 opened 5 days ago
by melover24
Add optional pressure_turns for multi-turn items
4
#25 opened 6 days ago
by Emar7
Duplicate-checker calibration: 0.60 mostly behaves as a related-topic threshold
2
#29 opened 6 days ago
by melover24
Add framing to questions/template.jsonl
#22 opened 7 days ago
by stationhouse
Add judge regression cases
2
#20 opened 7 days ago
by melover24
Benchmark Schema Updates
6
#17 opened 7 days ago
by divyanshijoshi
Move eval scripts into eval/, separate from scripts/ corpus tooling
#21 opened 7 days ago
by stationhouse
Add judge prompt builder
#15 opened 7 days ago
by melover24
Add outcome scoring helper
#14 opened 7 days ago
by melover24