Instructions to use mlx-community/CausalLM-34b-beta-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/CausalLM-34b-beta-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/CausalLM-34b-beta-4bit --local-dir CausalLM-34b-beta-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- e66e22af8a27555f871c9eefb93537fb4d73d782fd97fe43b05124e1b1487c97 (0a798a9b8b3dcec43b4f3e9b2da03e6396fe578c) - bdde11d573725eaf980e835ba98c639a3d016546056e7c8f120a3914bda91aaf (58d61ded9a3770446495e1d0c42d4792db29a353) - 9462a21c65f000f7512aa297cc1913c405aeab213ec272f97891cac1bc3ba1ad (020810d54f68b78e3dd30d71818626b276ffa17a) - 5b88de5bf9bce3e9ee72b9246dea231b5ebafd049e2bb821557fdfda626a6328 (f3e99240528f1b4c8127268a994616b92ed84ade) - bee386f048e4bb26a89614be34d9a61de73f2184d8066d0775f544a1414cd74c (56094a1ebedba5dbe8de87e4c46fbfa98dfc9925)1a83898