Running
RetryBench
🔁
Explore if a retry action is justified in simulated scenarios
You Liu PRO
uuhugg
AI & ML interests
None yet
Recent Activity
repliedto their post about 7 hours ago
A retry can succeed and still be unjustified.
RetryBench separates whether an agent’s retry is supported by the visible contract from what happens afterward. After a timeout, success alone does not tell us whether retrying was justified.
Try the interactive demo (English / 中文):
https://huggingface.co/spaces/uuhugg/retrybench-demo
Read the findings and reproduction guide:
https://huggingface.co/blog/uuhugg/retrybench-retry-permission
How do you evaluate retries in your agents? authored a paper 1 day ago
RetryBench: Separating Retry Permission from Recovery Outcomes in GPT Tool Use reacted to theirpost with 🔥 3 days ago
A retry can succeed and still be unjustified.
RetryBench separates whether an agent’s retry is supported by the visible contract from what happens afterward. After a timeout, success alone does not tell us whether retrying was justified.
Try the interactive demo (English / 中文):
https://huggingface.co/spaces/uuhugg/retrybench-demo
Read the findings and reproduction guide:
https://huggingface.co/blog/uuhugg/retrybench-retry-permission
How do you evaluate retries in your agents?Organizations
