๐Ÿง  SomaliLM-150M (Pretrained Foundation Model)

SomaliLM-150M is a compact, high-efficiency 147M parameter LLaMA-based language model pretrained on ~370 Million tokens of high-quality educational data (FineWeb-Edu).

Model Architecture

  • Parameters: 147.28 Million
  • Layers: 12
  • Hidden Dim: 768
  • Heads: 12
  • Vocab Size: 32,000
  • Context Length: 2048 tokens

Try It Live

Use the interactive Inference API widget on the right sidebar!

Downloads last month
75
Safetensors
Model size
0.1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Space using yacdev/SomaliLM-150M-Pretrained 1