Instructions to use mlx-community/Voxtral-Mini-3B-2507-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Voxtral-Mini-3B-2507-bf16 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/Voxtral-Mini-3B-2507-bf16 --local-dir Voxtral-Mini-3B-2507-bf16
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
mlx-community/Voxtral-Mini-3B-2507-bf16
This model was converted to MLX format from mistralai/Voxtral-Mini-3B-2507 using mlx-audio version 0.2.4.
Refer to the original model card for more details on the model.
Use with mlx
pip install -U mlx-audio
python -m mlx_audio.stt.generate --model mlx-community/Voxtral-Mini-3B-2507-bf16 --audio PATH-TO-AUDIO --verbose
- Downloads last month
- 757
Model size
5B params
Tensor type
F32
ยท
BF16 ยท
Hardware compatibility
Log In to add your hardware
Quantized
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support