Instructions to use simmo/Llama3.2-pyfim-1B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use simmo/Llama3.2-pyfim-1B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf simmo/Llama3.2-pyfim-1B:Q8_0 # Run inference directly in the terminal: llama cli -hf simmo/Llama3.2-pyfim-1B:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf simmo/Llama3.2-pyfim-1B:Q8_0 # Run inference directly in the terminal: llama cli -hf simmo/Llama3.2-pyfim-1B:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf simmo/Llama3.2-pyfim-1B:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf simmo/Llama3.2-pyfim-1B:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf simmo/Llama3.2-pyfim-1B:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf simmo/Llama3.2-pyfim-1B:Q8_0
Use Docker
docker model run hf.co/simmo/Llama3.2-pyfim-1B:Q8_0
- LM Studio
- Jan
- Ollama
How to use simmo/Llama3.2-pyfim-1B with Ollama:
ollama run hf.co/simmo/Llama3.2-pyfim-1B:Q8_0
- Unsloth Desktop
- Docker Model Runner
How to use simmo/Llama3.2-pyfim-1B with Docker Model Runner:
docker model run hf.co/simmo/Llama3.2-pyfim-1B:Q8_0
- Lemonade
How to use simmo/Llama3.2-pyfim-1B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull simmo/Llama3.2-pyfim-1B:Q8_0
Run and chat with the model
lemonade run user.Llama3.2-pyfim-1B-Q8_0
List all available models
lemonade list
- Atomic Chat
Commit History
-
Upload pyfim-1b-Q8_0.gguf
Verified signaturef55509d
-
Adding filename /home/xmay/pyfim-1B/meta-llama--Llama-3.2-1B-Instruct.pt
Verified signaturebd43e5b -
Adding filename /home/xmay/pyfim-1B/train_params.yaml
Verified signature1ea1186 -
Adding filename /home/xmay/pyfim-1B/model.safetensors
Verified signature58d97d3 -
Adding filename /home/xmay/pyfim-1B/.metadata
Verified signature9208464
-
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct-hf/model.safetensors
Verified signature3717e5e -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/meta-llama--Llama-3.2-1B-Instruct-2.pt
Verified signaturedd66cdc -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-2-step_2500.pt
Verified signature689a574 -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-2-step_2000.pt
Verified signature3791d35 -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-2-step_1500.pt
Verified signature84e2b51 -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-2-step_1000.pt
Verified signature4c7706c -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-2-step_500.pt
Verified signaturec2a4969 -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/meta-llama--Llama-3.2-1B-Instruct-1.pt
Verified signature0c6696e -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-1-step_3000.pt
Verified signaturec9b87db -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-1-step_2500.pt
Verified signaturebe1f41c -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-1-step_2000.pt
Verified signature780705f -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-1-step_1500.pt
Verified signature7fd15a2 -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-1-step_1000.pt
Verified signature5c65dac -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-1-step_500.pt
Verified signature3c5eecf -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/meta-llama--Llama-3.2-1B-Instruct-0.pt
Verified signature2423cc1 -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-0-step_2500.pt
Verified signatureaed6dcb
-
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-0-step_2000.pt
Verified signatureecf7acd -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-0-step_1500.pt
Verified signature260b63f -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-0-step_1000.pt
Verified signaturefbdc27e -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-0-step_500.pt
Verified signaturee212699 -
Adding filename /workspace/model_checkpoints/fine-tuned-meta-llama/Llama-3.2-1B-Instruct/steps/meta-llama--Llama-3.2-1B-Instruct-0-step_500.pt
Verified signature451decd -
Adding filename /workspace/pyfim/tokenizer_config.json
Verified signature2e2ee04 -
Adding filename /workspace/pyfim/special_tokens_map.json
Verified signature398b340 -
Adding filename /workspace/pyfim/tokenizer.json
Verified signature3f301ec -
Adding filename /workspace/pyfim/config.json
Verified signature5f39078 -
Adding filename /workspace/pyfim/generation_config.json
Verified signaturef686d36 -
Adding filename /workspace/pyfim/model.safetensors
Verified signature7d70f4d
-
First model training round
Verified signature6db9dfc -
First model training round
Verified signatureccf2938 -
initial commit
Verified signaturef636561