Quants123

community
Activity Feed

AI & ML interests

None defined yet.

danielhanchenΒ 
posted an update 2 days ago
view post
Post
4,447
We released DeepSeek-V4.1-Flash-1017 Dynamic v3.1 GGUFs which rank #1 on Terminal Bench, DeepSWE & more on 512K context.

1-bit Unsloth GGUF scores 68.1 on DeepSWE, 72.2 on Terminal-Bench, 52.7 on AutomationBench. >10% ahead of other quants.

GGUF: unsloth/DeepSeek-V4.1-Flash-1017-GGUF
  • 1 reply
Β·
danielhanchenΒ 
posted an update 6 days ago
view post
Post
7,925
Today, we're releasing the highest accuracy Qwen3.8-27B GGUFs!

Our new Dynamic V3.1 GGUFs lead by 5–10% on average across Terminal Bench, DeepSWE & more. We’re working on an even better version for Qwen4.

Run on 12GB RAM setups

GGUF: unsloth/Qwen3.8-27B-GGUF
Blog: https://unsloth.ai/docs/models/qwen3.8
danielhanchenΒ 
posted an update 9 days ago
view post
Post
6,120
Qwen3.8-Flash-Next GGUFs now run faster with less thinking and less token use.

Unsloth Dynamic V3.1 GGUFs bring thinking & token use to match 95% of full precision Qwen3.8-Flash.

Results: 50% fewer tokens + 15% higher accuracy vs same size quants.

GGUF: unsloth/Qwen3.8-Flash-Next-GGUF
Analysis/Guide: https://unsloth.ai/docs/models/qwen3.8-next
  • 3 replies
Β·
danielhanchenΒ 
posted an update 13 days ago
view post
Post
7,462
We’re releasing new Qwen3.8-Flash-Next GGUFs with 15% higher accuracy.

Unsloth Dynamic V3.1 outperforms others by >15% on Terminal Bench, DeepSWE & more benchmarks (256K context).

Run on 32GB+ RAM setups.

GGUF: unsloth/Qwen3.8-Flash-Next-GGUF
Blog: https://unsloth.ai/docs/models/qwen3.8-next
danielhanchenΒ 
posted an update 18 days ago
danielhanchenΒ 
posted an update 19 days ago
danielhanchenΒ 
posted an update 28 days ago
danielhanchenΒ 
posted an update about 1 month ago
view post
Post
5,203
You can now train your own Decision model like Jev locally!

We increased Qwen3.5 0.8B’s aggregate accuracy from 20.7% to 74.3% across 3 decision benchmarks - on just 4GB VRAM.

Turn any LLM like Qwen3.8, Gemma 4 into decision models with our open-source Unsloth repo.

GitHub: https://github.com/unslothai/unsloth
Guide: https://unsloth.ai/docs/basics/train-your-own-decision-model-with-unsloth
  • 5 replies
Β·
danielhanchenΒ 
posted an update about 1 month ago
danielhanchenΒ 
posted an update about 2 months ago
view post
Post
9,216
Unsloth has surpassed 500M model downloads on Hugging Face! πŸ¦₯πŸ€—

Qwen3.8-27B GGUF is already Unsloth’s #1 most-downloaded model ever.

Thanks for all your support! Follow us:
unsloth
  • 1 reply
Β·
danielhanchenΒ 
posted an update about 2 months ago
danielhanchenΒ 
posted an update 2 months ago
danielhanchenΒ 
posted an update 3 months ago
view post
Post
7,598
Introducing Unsloth Desktop πŸ¦₯
The first desktop app to run and train models locally.

β€’ Open-source. Runs on Mac, Windows and Linux
β€’ Supports MLX, diffusion image/video, audio, GGUF
β€’ Connect Claude Code and Codex to local LLMs
β€’ 50% more accurate, self-healing tool calls + sandboxed code exec
β€’ Works for CPU + multiGPU setups - NVIDIA, AMD, Intel, Mac
β€’ Train models 2Γ— faster with 70% less VRAM
β€’ Private web search, deep research, RAG, MCP and exports (NVFP4, GGUF)
β€’ Use Unsloth’s OpenAI-compatible API and cloud models
β€’ Securely deploy LLMs remotely and access anywhere

Unsloth Desktop is now available on http://unsloth.ai
and GitHub.

GitHub: https://github.com/unslothai/unsloth
Blog and Guide: https://unsloth.ai/docs/desktop
  • 6 replies
Β·
danielhanchenΒ 
posted an update 3 months ago
danielhanchenΒ 
posted an update 4 months ago
view post
Post
3,593
We compared 1-bit Kimi K3 to Claude Opus 5 and GPT 5.6. 🀯

We gave 4 models the same prompt: Create a glass aquarium whose side panel develops a visible crack and then bursts...

1-bit Kimi K3 GGUF ran locally on 4x B200s at 36 tok/s.

GGUF: unsloth/Kimi-K3-GGUF
GitHub repo: https://github.com/unslothai/unsloth
  • 1 reply
Β·
danielhanchenΒ 
posted an update 4 months ago
view post
Post
5,799
Kimi K3 can now be run locally! ✨

The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).

Run on a Mac Studio connected with 128GB RAM device. Kimi K3 is the strongest open model to date.

GGUF: unsloth/Kimi-K3-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k3
  • 5 replies
Β·
danielhanchenΒ 
posted an update 4 months ago
view post
Post
6,084
Introducing Unsloth for AMD πŸš€
You can now train & run LLMs on your AMD hardware

β€’ We collaborated with AMD to enable you to train & run 500+ models on AMD GPUs
β€’ Works on Windows, WSL, Linux
β€’ Train Qwen, Gemma on just 3GB VRAM

GitHub: https://github.com/unslothai/unsloth
Blog + Guide: https://unsloth.ai/docs/basics/amd
  • 3 replies
Β·
danielhanchenΒ 
posted an update 4 months ago
danielhanchenΒ 
posted an update 4 months ago
danielhanchenΒ 
posted an update 4 months ago