Daniel (Unsloth) PRO
AI & ML interests
None yet
Recent Activity
posted an update about 1 hour ago
Kimi K3 can now be run locally! β¨
The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).
Run on a Mac Studio connected with 128GB RAM device. Kimi K3 is the strongest open model to date.
GGUF: https://huggingface.co/unsloth/Kimi-K3-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k3 new activity about 1 hour ago
unsloth/Kimi-K3-GGUF:Imatrix calibration file new activity about 1 hour ago
unsloth/Kimi-K3-GGUF:Perplexity