Buckets:
2.73 MB
7 files
Updated 6 months ago
Ctrl+K
| Name | Size | Uploaded | Xet hash |
|---|---|---|---|
| CS-Bench | 4 items | ||
| .gitattributes | 2.31 kB xet | b6a9e0dd | |
| README.md | 846 Bytes xet | bbdd1c90 | |
| en_test_100_multiple-choice_case_just_for_display.jsonl | 89.4 kB xet | e73b9444 |
CS-Bench is the first benchmark dedicated to evaluating the performance of LLMs in the field of computer science. CS-Bench supports bilingual assessment, encompassing a total of 26 subfields across 4 domains, with a cumulative total of 4838 samples. These samples encompass various task formats including multiple-choice, assertion, fill-in-the-blank, and open-ended questions. Besides, CS-Bench assesses both knowledge-type and higher-order reasoning-type questions, with each reasoning question accompanied by an explanation. To validate the effectiveness of models, we randomly sample 10% of the data for validation, using the remaining 90% for testing. Please visit our Website and GitHub for more details.
- Total size
- 2.73 MB
- Files
- 7
- Last updated
- May 27
- Pre-warmed CDN
- US EU US EU