Instructions to use mlx-community/CodeLlama-7b-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/CodeLlama-7b-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("mlx-community/CodeLlama-7b-mlx") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use mlx-community/CodeLlama-7b-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "mlx-community/CodeLlama-7b-mlx" --prompt "Once upon a time"
- Atomic Chat
Commit History
-
License field
8df9efb -
Fix code snippet (#3)
- Fix code snippet (84d31437652a5b2b881f2d7a1c31c8322e2573a8)44c95ab
-
update to new format
8aac52b
-
Update usage instructions (#2)
- Update usage instructions (effcc2d4937955797f4ac5349b6df02aea490ed1)7423696 -
Upload folder using huggingface_hub (#1)
- 2beba7f8fb97273847f514c7e839267b4ffeaf71010f77fdef4bbe58aadea126 (843cee96cffcdb908f31ea84b670efad6976e659) - 28893fc8b6102b0be03e6133425da5cef948d9e51c0983de9e6b5802ad6588d3 (4ac3421e36ce690bf50a1f032faab279ac6b95c3)393de8d -
initial commit
799ebd2