2.88 MB
3 files
Updated 6 months ago
Name
Size
.gitattributes2.46 kB
xet
README.md1.12 kB
xet
released_data.json2.88 MB
xet
README.md

Agent-SafetyBench is a comprehensive agent safety evaluation benchmark that introduces a diverse array of novel environments that are previously unexplored, and offers broader and more systematic coverage of various risk categories and failure modes.

Please visit our Github or check our paper for more details.

Load the Data

from datasets import load_dataset

dataset = load_dataset("thu-coai/Agent-SafetyBench")

More details about loading the data and evaluating LLMs could be found at our Github Repository.

Please kindly cite our paper if you use our dataset.

Citation

If you find our work helpful, please kindly cite our paper.

@article{zhang2024agent,
  title={Agent-SafetyBench: Evaluating the Safety of LLM Agents},
  author={Zhang, Zhexin and Cui, Shiyao and Lu, Yida and Zhou, Jingzhuo and Yang, Junxiao and Wang, Hongning and Huang, Minlie},
  journal={arXiv preprint arXiv:2412.14470},
  year={2024}
}
Total size
2.88 MB
Files
3
Last updated
May 20
Pre-warmed CDN
US EU US EU

Contributors