flo5k5/Voxtral-Mini-4B-Realtime-2602-MLX-6bit

Automatic Speech Recognition • 4B • Updated 1 day ago • 8 • 1

Note 6-bit, mlx-audio format. Keeps up with live speech on an M5 Pro (text ~0.1 s behind the voice); same French WER as fp16.

mistralai/Voxtral-Mini-4B-Realtime-2602

Automatic Speech Recognition • 4B • Updated Mar 11 • 2.01M • 1.03k

Note Original streaming model by Mistral AI (Apache 2.0).

flo5k5/Voxtral-Mini-4B-Realtime-2602-MLX-8bit

Automatic Speech Recognition • 4B • Updated 1 day ago • 14

Note 8-bit, mlx-audio format. Keeps up with live speech on an M5 Pro and matches fp16 French WER; 1 GB heavier than the 6-bit.

mlx-community/Voxtral-Mini-4B-Realtime-2602-4bit

Automatic Speech Recognition • 4B • Updated Feb 10 • 1.54k • 17

Note 4-bit, mlx-audio format (lighter, not measured here).

mlx-community/Voxtral-Mini-4B-Realtime-2602-fp16

Automatic Speech Recognition • 4B • Updated Feb 9 • 373 • 3

Note fp16 source of the 6-bit conversion; slower than real time on an M5 Pro (0.47x).