2.73 MB
7 files
Updated 6 months ago
README.md

CS-Bench is the first benchmark dedicated to evaluating the performance of LLMs in the field of computer science. CS-Bench supports bilingual assessment, encompassing a total of 26 subfields across 4 domains, with a cumulative total of 4838 samples. These samples encompass various task formats including multiple-choice, assertion, fill-in-the-blank, and open-ended questions. Besides, CS-Bench assesses both knowledge-type and higher-order reasoning-type questions, with each reasoning question accompanied by an explanation. To validate the effectiveness of models, we randomly sample 10% of the data for validation, using the remaining 90% for testing. Please visit our Website and GitHub for more details.

Total size
2.73 MB
Files
7
Last updated
May 27
Pre-warmed CDN
US EU US EU

Contributors