rdsm/openhands-lm-32b-v0.1-mlx-6bit

The Model rdsm/openhands-lm-32b-v0.1-mlx-6bit was converted to MLX format from all-hands/openhands-lm-32b-v0.1 using mlx-lm version 0.22.2.

Note: Qwen 2.5 0.5b / 1.5b Instruct seems to work fine as draft models.

Downloads last month
18
Safetensors
Model size
33B params
Tensor type
U32
ยท
F16
ยท
MLX
Hardware compatibility
Log In to add your hardware

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for rdsm/openhands-lm-32b-v0.1-mlx-6bit

Base model

Qwen/Qwen2.5-32B
Quantized
(19)
this model