Spaces:
Running
Proposal: add TR-Mevzuat-SC (Turkish legislation QA) as a task
Hi, thanks for Cetvel, it is the most complete Turkish evaluation suite I know of.
I'd like to propose an additional task: TR-Mevzuat-SC (https://huggingface.co/datasets/mvdelibas/tr-mevzuat-sc), a Turkish legal question-answering set grounded in single articles of current Turkish legislation. Each item has the article text, four options with a gold letter, a short gold answer with accepted variants and a verbatim supporting quote, so it can run as multiple choice or short answer, closed-book or open-book. It is CC0 and test-only.
It would add a legal-domain task, and the open-book mode measures reading comprehension separately from memorised knowledge. If this fits, I can prepare a PR that follows the format of the existing tasks, as with the Circumflex_TR addition.