MLX Quantisations for Qwen 3.8 2B
🏗️ Building on HF
Siddh Jagani
SiddhJagani
AI & ML interests
Building local AI systems, LLM tools, RAG infrastructure, and MLX model deployments.
Recent Activity
liked a model 6 days ago
prithivMLmods/chandra-ocr-2-GGUF liked a model 7 days ago
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF updated a Space about 1 month ago
SiddhJagani/StatsOrganizations
MLX Quantisations for Qwen 3.8 9B
MLX Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 15B • Updated • 22 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 15B • Updated • 28 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3
Text Generation • 15B • Updated • 17 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2
Text Generation • 15B • Updated • 18
MLX Non-Thinking Models
-
SiddhJagani/gpt-oss-20b-no-think-mlx-2Bit
Text Generation • 21B • Updated • 201 • 2 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q3
Text Generation • 21B • Updated • 50 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q4
Text Generation • 21B • Updated • 30 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q6
Text Generation • 21B • Updated • 37
MLX Quantisations for Qwen 3.8 4B
MLX 8B Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 8B • Updated • 28 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 8B • Updated • 27 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q4
Text Generation • 8B • Updated • 24
MLX Based GPT-OSS-Safeguard models
-
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q2
Text Generation • 21B • Updated • 42 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q3
Text Generation • 21B • Updated • 30 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q4
Text Generation • 21B • Updated • 38 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q6
Text Generation • 21B • Updated • 51
MLX Quantisations for Qwen 3.8 2B
MLX Quantisations for Qwen 3.8 4B
MLX Quantisations for Qwen 3.8 9B
MLX 8B Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 8B • Updated • 28 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 8B • Updated • 27 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q4
Text Generation • 8B • Updated • 24
MLX Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 15B • Updated • 22 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 15B • Updated • 28 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3
Text Generation • 15B • Updated • 17 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2
Text Generation • 15B • Updated • 18
MLX Based GPT-OSS-Safeguard models
-
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q2
Text Generation • 21B • Updated • 42 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q3
Text Generation • 21B • Updated • 30 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q4
Text Generation • 21B • Updated • 38 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q6
Text Generation • 21B • Updated • 51
MLX Non-Thinking Models
-
SiddhJagani/gpt-oss-20b-no-think-mlx-2Bit
Text Generation • 21B • Updated • 201 • 2 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q3
Text Generation • 21B • Updated • 50 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q4
Text Generation • 21B • Updated • 30 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q6
Text Generation • 21B • Updated • 37