Instructions to use mlx-community/firefunction-v2-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/firefunction-v2-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/firefunction-v2-4bit --local-dir firefunction-v2-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
f2dcb0787892dbcab0e13cabc822f6e0c38888f9d12c1f149450ffeba10f56fc
Verified signature308aa23 -
217b5863720470d9b481ea8cd5c870fec711f46588a8f9dd20eb81e2701a10d0
Verified signature3c0cef8 -
86eb4668aa91cb5ff9f82f0df41ceefee6a925dcebe4de09f0dd9290e7f2c1d9
Verified signaturebd1e998 -
5b7be22af2153baacac8681ba482562d365ddfacde9fe8e2a2381fd46ca164a2
Verified signaturee0d084c -
c04b70be13bb04c0b494c5234b458b46e24c9f71867a77de655bc85a9f6940b9
Verified signature08183fc -
1fd7f121700a28cab50461b5de9da769fc89bf10e6deb8ce2528a7744e2853cb
Verified signature966da58 -
8135d81e97c35272e50ad0e6898fc1eb829341a17c176c98e13d8b3ed019cb98
Verified signature4d0b614 -
49c7bada5fcb9b10e5600440b1524994b22a6e58a90caee2ca850009e8d89def
Verified signature356b4d7 -
867cde3d8a4e43d7752bf0820278a6952478771b3081f194033d77397bbeffa1
Verified signaturee2aa1e7
-
initial commit
Verified signaturef2eec85