Recursive Environment Scaling for General Long-Horizon Agents
Abstract
Recursive Environment Scaling transforms benchmarks to increase difficulty while preserving objectives, improving both agent evaluation and supervised fine-tuning performance.
We study environment scaling as a way to increase agent-benchmark difficulty while holding core task objectives fixed. Our framework, Recursive Environment Scaling (RES), transforms existing benchmark environments while preserving their objectives and completion requirements. A proposer changes information access, resource relations, and execution dependencies; execution-grounded checks validate the resulting candidate, and accepted changes are inherited across rounds. This produces related environments for paired evaluation and training-trajectory collection. Experiments on 294 initial tasks from three benchmarks show lower task success for all six evaluation models, with decreases of 57.14--77.14 percentage points on Claw-Eval-Live. With equal trajectory counts and identical optimization settings, fine-tuning on RES trajectories outperforms original-trajectory SFT in all nine model--benchmark comparisons by 7.00--14.61 percentage points. Ablations identify recursive inheritance and dependency composition as important contributors to increased difficulty. Together, these results support environment scaling for both agent evaluation and training.
Community
Hi everyone! We introduce Recursive Environment Scaling (RES), a framework that makes existing agent environments more challenging while preserving their core task objectives.
RES recursively transforms information access, resource relations, and execution dependencies, with execution-grounded checks validating each candidate. Across six models and three benchmarks, RES consistently reduces task success. Beyond evaluation, fine-tuning on RES-generated trajectories outperforms original-trajectory SFT in all nine model–benchmark comparisons, with gains of 7.00–14.61 percentage points under matched trajectory counts and optimization settings.
Code will be released at: https://github.com/Glimmerxx/recursive-environment-scaling
We welcome feedback and discussion!
Get this paper in your agent:
hf papers read 2610.16397 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper