KaiLu 2 (933M)

KaiLu 2 is a fast, lightweight language model built from scratch for Apple Silicon (Mac, iPhone, and iPad) using Apple MLX.

It packs 933 million parameters into a tiny 609 MB file that runs completely offline on your device with zero cloud servers and zero subscriptions.


⚡ Highlights

  • 100% From Scratch: Trained from random initialization on Apple Silicon Metal GPUs.
  • Tiny & Lightweight: Only 609 MB on disk, using just 1.15 GB of RAM.
  • Blazing Fast: Streams over 260 tokens per second on Apple Silicon.
  • 100% Offline & Private: Everything stays on your local device.

Downloads last month
-
Safetensors
Model size
0.2B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support