Instructions to use Rafii/f1llama with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use Rafii/f1llama with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("Rafii/f1llama") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use Rafii/f1llama with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "Rafii/f1llama"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "Rafii/f1llama" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Rafii/f1llama", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Commit History
-
Update README.md
Verified signaturee6d4fd8
-
req.txt
a993c22 -
ok
e517f2b -
notebook
853389e -
streamlit
9e67127
-
Upload folder using huggingface_hub (#2)
Verified signature- f280fe7c7067244c506556fb1b296702fcd5079cb8c919226004b6977fb09f86 (d23a87860e384540996f8d72bf914dbfed8d81f9) - 58da5668f2681a10b7b3a5ed2cc7c2df78900131dbc75e2a9e2b84631603d7b0 (a75e61c1bf7404f4116ded5ef23fe0642a5d9ba6) - cff4395f7069271edb4409d258e93938276c373d7897e92bd1a2a2ae0a5010ff (f73ee373d9f7c5904161fa75debc057c873cd953)95abe3b -
changes
052ac5c
-
model
3b73626 -
yes
9890721 -
deleted
0c6a6b9 -
a
40c0be7 -
Track tokenizer.json with Git LFS
65daeee -
d
e39c0a3 -
ad
7576a1a -
added finetuned llama
3b11aa2 -
update
Verified signature804b19f -
initial commit
Verified signaturec45962b