Instructions to use calcuis/gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use calcuis/gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf calcuis/gguf # Run inference directly in the terminal: llama cli -hf calcuis/gguf
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf calcuis/gguf # Run inference directly in the terminal: llama cli -hf calcuis/gguf
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf calcuis/gguf # Run inference directly in the terminal: ./build/bin/llama cli -hf calcuis/gguf
Use Docker
docker model run hf.co/calcuis/gguf
- Llama new
- LM Studio
- Jan
- Ollama
How to use calcuis/gguf with Ollama:
ollama run hf.co/calcuis/gguf
- Unsloth Desktop
- Docker Model Runner
How to use calcuis/gguf with Docker Model Runner:
docker model run hf.co/calcuis/gguf
- Lemonade
How to use calcuis/gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull calcuis/gguf
Run and chat with the model
lemonade run user.gguf-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Commit History
-
Upload deep.gguf with huggingface_hub
Verified signature510a17e
-
Upload phi4.gguf with huggingface_hub
Verified signaturef46196e
-
Upload math2.gguf
Verified signature236095a -
Upload arch.gguf
Verified signature2960215
-
Upload llama3.2.gguf
Verified signature08a0045
-
Upload phi3.5.gguf
Verified signature7cbe1e2
-
Upload bloom.gguf
Verified signature86045fd
-
Upload mamba.gguf
Verified signaturef2dad14
-
Upload claude.gguf
Verified signaturefb515da
-
Upload gemma2.gguf
Verified signature2045a37
-
Upload gpt2.gguf
Verified signature9f6a388 -
Rename gpt2.gguf to gpt.gguf
Verified signature4e9cf17 -
Upload gpt2.gguf
Verified signature77d96d5
-
Upload phi3.gguf
Verified signature40bc2e8
-
Upload llama3.gguf
Verified signature83d990a
-
Upload aquila.gguf
Verified signature2fa4e3a
-
Delete gemma.gguf
Verified signature88f3b35 -
Delete .gitattributes
Verified signature25e5ede -
Upload gemma.gguf
Verified signaturee05c188 -
Upload zephyr.gguf
Verified signaturebcc3b02
-
Upload openchat.gguf
Verified signature04abc94 -
Upload westlake.gguf
Verified signature76c052f -
Upload beagle.gguf
Verified signaturef5785ae -
Upload garrulus.gguf
Verified signature8368c90
-
Delete .gitattributes
Verified signature8e21817 -
Rename mistrals.gguf to trash.gguf
Verified signature4a92ecf -
Upload dolphin.gguf
Verified signature1f5f7e8
-
Delete .gitattributes
Verified signaturec6b6cd9 -
Update .gitattributes
Verified signaturee9e85b1 -
Delete masha.gguf
Verified signature1eed12d -
Delete dolphin.gguf
Verified signature6cb88a3 -
Delete alice.gguf
Verified signature6987c94 -
Upload karen.gguf
Verified signature9febfbc -
Upload mistrals.gguf
Verified signatureecdafa5 -
Upload orca.gguf
Verified signature8d3b541
-
Upload python.gguf
Verified signaturedc32c99 -
Upload 3 files
Verified signature53668e4 -
Upload 2 files
Verified signature0c7ec89 -
Upload guanaco.gguf
Verified signaturee5cb025 -
Upload llama2.gguf
Verified signaturefc2058d -
Upload math.gguf
Verified signature6e0724b
-
Upload samantha.gguf
Verified signature519c20c -
Upload doublee.gguf
Verified signaturea44af91 -
Upload solar.gguf
Verified signature8a66543 -
Upload wizard.gguf
Verified signature7e65efb -
Upload stable.gguf
Verified signature6d06f2d -
Upload tiny2.gguf
Verified signaturef144f7d
-
Upload hermes.gguf
Verified signature9a16f9c -
Upload finance.gguf
Verified signature174b0bc -
Upload dolphin.gguf
Verified signature69046a9