team-hakuru-labs / training /data_source.txt
Taficritus's picture
Upload folder using huggingface_hub
2994118 verified
Raw History Blame Contribute Delete
1.75 kB
Source Data for Synthetic Data Generation
=========================================
The synthetic dataset was generated using the official Sri Lankan government Sinhala-medium school textbooks, teacher guides, and past exam materials.
Source Platform:
- GovDoc.lk (Official Government Documents platform of Sri Lanka): https://govdoc.lk/
Closed APIs Used for Generation:
- DeepSeek (Chat & API)
- Claude (Anthropic)
- ChatGPT (OpenAI)
*(Note: In the final scaling phase, an additional 13,021 questions were generated using ChatGPT).*
Textbooks Used (Grades 6–11):
- Sinhala (Grade 6-11)
- Buddhism (Grade 6-11)
- Catholicism (Grade 6-11)
- Christianity (Grade 6-11)
- Islam (Grade 6-9, and Grade 11. Note: Grade 10 book was not used)
- Science (Grade 6-11)
- Civics (Grade 6-11)
- Geography (Grade 6-11)
- History (Grade 6-11)
- Agriculture (Grade 10-11)
- Home Economics (Grade 10-11)
- Accounting and Business Studies (Grade 10-11)
- Communication and Media Studies (Grade 10-11)
- Design and Construction Technology (Grade 10-11)
Teacher Guides Used (Grades 10–13):
- Art (Grade 6-13)
- Physics (Grade 12-13)
- Chemistry (Grade 12-13)
- Biology (Grade 12-13)
- Bio System Technology (Grade 12-13)
- Economics (Grade 12-13)
- Buddhist Civilization (Grade 12-13)
- Political Science (Grade 12-13)
- Geography (Grade 12-13)
- Sinhala (Grade 12-13)
- Business Studies (Grade 12-13)
- Agriculture (Grade 12-13)
- Home Economics (Grade 12-13)
- Oriental Music (Grade 12-13)
- Dancing (Grade 12)
- Drama (Grade 10-12)
The PDFs themselves are not included in this repository to respect copyright and repository size limits, but the generation prompts and a sample of the output are included.