Abstract
RSIHub is an open-source framework that standardizes agent-evolution research by providing shared infrastructure for building, comparing, and extending methods with reusable components and consistent evaluation.
Agent-evolution methods use execution feedback to improve prompts, skills, tools, and orchestration, but their implementations often rebuild the same experimental machinery. We present RSIHub, an open-source framework for building, comparing, and extending these methods on shared infrastructure. Recipes compose reusable operators and declare mutable resources; RSIHub supplies execution, evaluation, recovery, and lineage. Researchers can focus on evolution policy while evaluation stays outside the mutable surface and results remain tied to candidates and evaluation conditions. We instantiate AHE, Hyperagents, A-Evolve, and GEPA without modifying the framework core, keeping method-specific logic in recipes and operators. We evaluate them with MiniSWE and Codex on Terminal Bench 2 and τ^3 Banking under fixed model and evaluator configurations. The largest observed overall pass@1 gain is 13.5 percentage points, while method rankings vary across settings and optimization gains do not always transfer to held-out tasks. RSIHub provides a common protocol for comparing evolution policies, inspectable candidate histories, and reusable components for developing new methods.
Community
Hi everyone! We’re sharing RSIHub, an open-source framework for building and comparing agent-evolution methods.
RSIHub lets researchers compose reusable operators to improve agent prompts, skills, tools, and orchestration, while keeping evaluation protected and candidate histories traceable. We implement AHE, Hyperagents, A-Evolve, and GEPA on shared infrastructure and evaluate them with MiniSWE and Codex on Terminal Bench 2 and τ³ Banking.
Our goal is to make agent self-improvement experiments easier to reproduce, compare, and extend. We’d love feedback, contributions, and ideas for new evolution methods and benchmarks!
💻 Code: https://github.com/simple-agent-lab/RSIHub
🌐 Project: https://simpleagentlab.com/rsihub/
Get this paper in your agent:
hf papers read 2610.32253 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper