| language: | |
| - so | |
| tags: | |
| - somali | |
| - causal-lm | |
| - sft | |
| - conversational | |
| license: apache-2.0 | |
| datasets: | |
| - yacdev/somali-100k-native-conversations | |
| # 🇸🇴 SomaliLM-150M-Instruct (100K SFT) | |
| SomaliLM-150M-Instruct is a lightweight, fluent Somali conversational language model fine-tuned on **100,000 pristine multi-turn native Somali conversations** across 20 real-world domains. | |
| ### 📊 Specifications: | |
| - **Parameters**: ~150 Million | |
| - **Training Dataset**: 100,000 native Somali dialogues (579,556 dialogue turns, 17.5M words) | |
| - **Format**: ChatML (`<|im_start|>user / assistant<|im_end|>`) | |
| - **Loss Strategy**: Assistant Token Masking (100% loss computed on assistant responses) | |
| ### 💬 Prompt Format (ChatML): | |
| ```text | |
| <|im_start|>user | |
| Assalaamu calaykum walaal, sideen ku bilaabaa barashada Python-ka? | |
| <|im_end|> | |
| <|im_start|>assistant | |
| ``` | |