OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software Paper • 2609.39903 • Published Sep 30 • 28
Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation Paper • 2609.04298 • Published Sep 9 • 1
Proteo-R1: Reasoning Foundation Models for De Novo Protein Design Paper • 2605.02937 • Published Aug 10
Beyond Monolingual Deep Research: Evaluating Agents and Retrievers with Cross-Lingual BrowseComp-Plus Paper • 2606.15345 • Published Jun 13 • 15
HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness? Paper • 2609.01437 • Published Sep 1 • 88
S3Gym: Can LLMs Turn Self-Testing and Self-Judging into Self-Improvement? Paper • 2608.31100 • Published Aug 31 • 38
OmniAssistBench: Assistant-style Interaction Benchmark for Omni-LLMs Paper • 2608.21360 • Published Aug 21 • 32
SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers Paper • 2609.01343 • Published Sep 1 • 63
MindEdit-Bench: Benchmarking Object-Level Counterfactual Spatial Reasoning in VLMs from In-the-Wild Photos Paper • 2607.00491 • Published Jul 1
StartupBench: Benchmarking General-Purpose Agents on Market-Validated End-to-End Workflows Paper • 2608.17800 • Published Aug 18 • 15
EdgeBench: Unveiling Scaling Laws of Learning from Real-World Environments Paper • 2607.05155 • Published Jul 6 • 16
MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark Paper • 2607.00724 • Published Jul 1
Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields Paper • 2606.11042 • Published Jun 9 • 25
MARBLE: Music Audio Representation Benchmark for Universal Evaluation Paper • 2306.10548 • Published Jun 18, 2023
Balanced Aggregation: Understanding and Fixing Aggregation Bias in GRPO Paper • 2605.04077 • Published Apr 14 • 6
Xpertbench: Expert Level Tasks with Rubrics-Based Evaluation Paper • 2604.02368 • Published Mar 27 • 9