Instructions to use ataeff/nanollama with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use ataeff/nanollama with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf ataeff/nanollama:F16 # Run inference directly in the terminal: llama cli -hf ataeff/nanollama:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf ataeff/nanollama:F16 # Run inference directly in the terminal: llama cli -hf ataeff/nanollama:F16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf ataeff/nanollama:F16 # Run inference directly in the terminal: ./build/bin/llama cli -hf ataeff/nanollama:F16
Use Docker
docker model run hf.co/ataeff/nanollama:F16
- Llama new
- LM Studio
- Jan
- Ollama
How to use ataeff/nanollama with Ollama:
ollama run hf.co/ataeff/nanollama:F16
- Unsloth Desktop
- Docker Model Runner
How to use ataeff/nanollama with Docker Model Runner:
docker model run hf.co/ataeff/nanollama:F16
- Lemonade
How to use ataeff/nanollama with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ataeff/nanollama:F16
Run and chat with the model
lemonade run user.nanollama-F16
List all available models
lemonade list
- Atomic Chat
Commit History
-
Delete micro/arianna_humanai.txt with huggingface_hub
Verified signaturec36c357 -
Upload micro/arianna_humanai.txt with huggingface_hub
Verified signaturec42c6da -
Upload micro/arianna-merged.pt with huggingface_hub
Verified signaturedc2970b -
Upload micro/arianna-lora-adapter-best.pt with huggingface_hub
Verified signature69206bb -
Upload micro/arianna-lora-adapter.pt with huggingface_hub
Verified signature35a2bbb -
Upload micro/checkpoint_step5000.pt with huggingface_hub
Verified signature7dc8801 -
Upload micro/checkpoint_step35000.pt with huggingface_hub
Verified signaturec0d386f -
Upload micro/checkpoint_step30000.pt with huggingface_hub
Verified signature9eb308a -
Upload micro/checkpoint_step25000.pt with huggingface_hub
Verified signature11aa461 -
Upload micro/checkpoint_step20000.pt with huggingface_hub
Verified signature4c6a771 -
Upload micro/checkpoint_step15000.pt with huggingface_hub
Verified signaturedad0495 -
Upload micro/checkpoint_step10000.pt with huggingface_hub
Verified signaturef851b41 -
Upload micro/tokenizer.model with huggingface_hub
Verified signaturec612f77 -
Upload micro/checkpoint_step40000.pt with huggingface_hub
Verified signatureb6eea2f
-
Upload nano89/leo_humanai.txt with huggingface_hub
Verified signature4c77e8f -
Upload nano89/tokenizer.model with huggingface_hub
Verified signature8b703c3 -
Upload nano89/leo-meta.json with huggingface_hub
Verified signatureed2757e -
Upload nano89/leo-merged.pt with huggingface_hub
Verified signaturee179f8d -
Upload nano89/leo-lora-adapter.pt with huggingface_hub
Verified signature01dba05 -
Upload nano89/checkpoint_step20000.pt with huggingface_hub
Verified signature3eb7378 -
Upload nano89/gamma-leo.npz with huggingface_hub
Verified signature2c5eab7 -
Upload nano89/nano89-leo-f16.gguf with huggingface_hub
Verified signatureecefaca -
Upload nano89/nano89-base-f16.gguf with huggingface_hub
Verified signature8a4b87b -
initial commit
Verified signatureb09ad84