view post Post 1884 Kimi K3 can now be run locally! ✨The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).Run on a Mac Studio connected with 128GB RAM device. Kimi K3 is the strongest open model to date.GGUF: unsloth/Kimi-K3-GGUFGuide: https://unsloth.ai/docs/models/kimi-k3 See translation 2 replies · ❤️ 10 10 🔥 6 6 👍 3 3 + Reply
Unsloth Dynamic 2.0 Quants Collection New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance. • 111 items • Updated 1 day ago • 782