Instructions to use hs-094/llama3.2-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use hs-094/llama3.2-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf hs-094/llama3.2-models:Q4_0 # Run inference directly in the terminal: llama cli -hf hs-094/llama3.2-models:Q4_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf hs-094/llama3.2-models:Q4_0 # Run inference directly in the terminal: llama cli -hf hs-094/llama3.2-models:Q4_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf hs-094/llama3.2-models:Q4_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf hs-094/llama3.2-models:Q4_0
Use Docker
docker model run hf.co/hs-094/llama3.2-models:Q4_0
- Llama new
- LM Studio
- Jan
- Ollama
How to use hs-094/llama3.2-models with Ollama:
ollama run hf.co/hs-094/llama3.2-models:Q4_0
- Unsloth Desktop
- Docker Model Runner
How to use hs-094/llama3.2-models with Docker Model Runner:
docker model run hf.co/hs-094/llama3.2-models:Q4_0
- Lemonade
How to use hs-094/llama3.2-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull hs-094/llama3.2-models:Q4_0
Run and chat with the model
lemonade run user.llama3.2-models-Q4_0
List all available models
lemonade list
- Atomic Chat
Commit History
-
Delete 1B/fine-tuned/llama-3.2.-pytorch-1b-v0.1/README.md
Verified signaturef80dc6c -
Reorganized File Str
c3ae995 -
Training in progress, step 140
Verified signature2500679 -
Training in progress, step 100
Verified signature53f0f9e -
Training in progress, step 60
Verified signature005c58d -
Training in progress, step 20
Verified signature66bf917 -
Training in progress, step 140
Verified signatured6eacf1 -
Training in progress, step 100
Verified signature02cb56a -
Training in progress, step 60
Verified signature95128a6 -
Training in progress, step 20
Verified signatureef050cc -
Training in progress, step 120
Verified signatureee14888 -
Training in progress, step 80
Verified signature79cb934 -
Training in progress, step 20
Verified signature0391527 -
Training in progress, step 140
Verified signature44d9edd -
Training in progress, step 100
Verified signature3c3e592 -
Training in progress, step 60
Verified signature46c0345 -
Training in progress, step 20
Verified signaturebabe138 -
Training in progress, step 100
Verified signature82b3218 -
Training in progress, step 80
Verified signatureec4519b -
Training in progress, step 60
Verified signatured5b26ad -
Training in progress, step 40
Verified signature2a15ce7 -
Training in progress, step 20
Verified signatured39123c -
Training in progress, step 140
Verified signaturea9962d3 -
Training in progress, step 120
Verified signaturef39271a -
Training in progress, step 100
Verified signaturee1823b4 -
Training in progress, step 60
Verified signature83c2469 -
Training in progress, step 20
Verified signature64e8976 -
Training in progress, step 100
Verified signatureb5140c2 -
Training in progress, step 60
Verified signature7519357 -
Training in progress, step 40
Verified signature022245a -
Training in progress, step 20
Verified signature92c3307 -
Training in progress, step 20
Verified signature790c370 -
Training in progress, step 100
Verified signature54d2604 -
Training in progress, step 60
Verified signature478ee6e -
Training in progress, step 20
Verified signaturecb63c2c -
Training in progress, step 20
Verified signatureb3b5d04
-
Reorganized File Structure
5986e87 -
Upload 3 files
Verified signaturea3a3a27 -
Training in progress, step 20
Verified signature2d748df -
Upload 2 files
Verified signature9b054cd -
Delete 1B
Verified signature71f231b -
Create 1B/
Verified signature4c381fa -
initial commit
Verified signature4d85b43