File size: 848 Bytes
678af97 4ad9414 678af97 4ad9414 678af97 4ad9414 678af97 4ad9414 678af97 4ad9414 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | ---
language:
- so
tags:
- somali
- causal-lm
- sft
- conversational
license: apache-2.0
datasets:
- yacdev/somali-100k-native-conversations
---
# 🇸🇴 SomaliLM-150M-Instruct (100K SFT)
SomaliLM-150M-Instruct is a lightweight, fluent Somali conversational language model fine-tuned on **100,000 pristine multi-turn native Somali conversations** across 20 real-world domains.
### 📊 Specifications:
- **Parameters**: ~150 Million
- **Training Dataset**: 100,000 native Somali dialogues (579,556 dialogue turns, 17.5M words)
- **Format**: ChatML (`<|im_start|>user / assistant<|im_end|>`)
- **Loss Strategy**: Assistant Token Masking (100% loss computed on assistant responses)
### 💬 Prompt Format (ChatML):
```text
<|im_start|>user
Assalaamu calaykum walaal, sideen ku bilaabaa barashada Python-ka?
<|im_end|>
<|im_start|>assistant
```
|