team-qbits-cpt-v3 / README.md
ovinduG's picture
Upload README.md with huggingface_hub
bf7fffd verified
|
Raw History Blame Contribute Delete
571 Bytes
---
license: gemma
language:
- si
base_model: QBitsLK/gemma4-e4b-sinhala-cpt
tags:
- sinhala
- multiple-choice
- sinhalammlu
---
# team-qbits-cpt-v3
**Submitted system** for the ICTer 2026 SinhalaMMLU Shared Task (macro 57.81).
Base: `QBitsLK/gemma4-e4b-sinhala-cpt` (Gemma 4 E4B + Sinhala continued pretraining). LoRA r=32, alpha=32, lr 1e-4, 2 epochs on 21,235 past-paper MCQ examples; checkpoint `final_adapter` (step 1328), merged. 7,996,157,418 parameters.
Inference: per-option log-likelihood under a 5-prompt ensemble. See `SinhalaMMLU-SharedTask/team-qbits`.