Which Agent's Skill Should Change? Group-Relative Credit Assignment for Evolving Multi-Agent Teams
Abstract
GRSE improves cooperative language agents by comparing repeated executions to correctly assign behavioral credit to agent-skill pairs, outperforming prior methods on multi-hop reasoning and recovering from harmful skills.
Cooperative language-model agents can improve without weight updates by revising reusable skills, but only if a shared team reward is traced to the responsible agent and skill. Existing methods credit the skills present in each trajectory, yet presence is not responsibility: a harmful skill active in successful runs still earns positive credit. We present GRSE, Group-Relative Skill Evolution, which assigns behavioral credit by comparison: inspired by GRPO, it executes each question several times under the same skill libraries and contrasts the executions to credit agent--skill pairs, with structured diagnosis of failures. On HotpotQA and LoCoMo with two open-weight actors, GRSE outperforms MASkills, the closest prior method, on HotpotQA and every LoCoMo category except open-domain, with the largest gains on multi-hop questions (+6.7 and +3.2 F1). Its gains rest on better-grounded retrieval rather than answers given without evidence, and its learned skills transfer between the multi-hop tasks. GRSE is robust to corrupted libraries: starting from planted harmful skills, it credits every planted skill with the correct sign and recovers the score of a clean library (+6.3 points), whereas MASkills misattributes two and falls below its starting point.
Community
๐ We present GRSE (Group-Relative Skill Evolution), a framework that tackles a fundamental question in multi-agent learning:
When a team succeeds or fails, which agent's skill should actually change?
Instead of rewarding all skills involved in successful trajectories, GRSE performs group-relative credit assignment across multiple executions to identify the skills that truly drive outcomes.
Key highlights:
๐ฏ Assigns credit at the agent-skill level
๐ Identifies causal contributors through trajectory comparison
๐ค Supports continual multi-agent skill evolution
๐ Outperforms existing skill-learning methods on HotpotQA and LoCoMo
๐ก๏ธ Remains robust under noisy and corrupted skill libraries
We believe GRSE is an important step toward scalable and self-improving multi-agent systems.
๐ Paper: https://arxiv.org/abs/2610.27227
๐ป Code: https://github.com/yananma1029/GRSE-Skills
Get this paper in your agent:
hf papers read 2610.27227 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper