GGUF
Image-Text-to-Text Models
Audio-Text-to-Text
text-to-Text
llama_cpp
any to any
Multimodal AI
video-Text-to-Text
Llama Model Switcher
imatrix
conversational
Instructions to use nzgnzg73/llama_cpp_WebUI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use nzgnzg73/llama_cpp_WebUI with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf nzgnzg73/llama_cpp_WebUI:Q4_K_S # Run inference directly in the terminal: llama cli -hf nzgnzg73/llama_cpp_WebUI:Q4_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf nzgnzg73/llama_cpp_WebUI:Q4_K_S # Run inference directly in the terminal: llama cli -hf nzgnzg73/llama_cpp_WebUI:Q4_K_S
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf nzgnzg73/llama_cpp_WebUI:Q4_K_S # Run inference directly in the terminal: ./build/bin/llama cli -hf nzgnzg73/llama_cpp_WebUI:Q4_K_S
Use Docker
docker model run hf.co/nzgnzg73/llama_cpp_WebUI:Q4_K_S
- Llama new
- LM Studio
- Jan
- Ollama
How to use nzgnzg73/llama_cpp_WebUI with Ollama:
ollama run hf.co/nzgnzg73/llama_cpp_WebUI:Q4_K_S
- Unsloth Desktop
- Docker Model Runner
How to use nzgnzg73/llama_cpp_WebUI with Docker Model Runner:
docker model run hf.co/nzgnzg73/llama_cpp_WebUI:Q4_K_S
- Lemonade
How to use nzgnzg73/llama_cpp_WebUI with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull nzgnzg73/llama_cpp_WebUI:Q4_K_S
Run and chat with the model
lemonade run user.llama_cpp_WebUI-Q4_K_S
List all available models
lemonade list
- Atomic Chat
Commit History
-
Update README.md
Verified signaturedc7e4b4
-
Upload llama-b7541-bin-win-cpu-x64.zip
Verified signaturecc23fbd -
Update README.md
Verified signatureb4cb3bc
-
Update README.md
Verified signature66c32c8 -
Update README.md
Verified signature5a1a4cd -
Upload llama_cpp_WebUI.zip
Verified signature209cc07 -
Delete llama_cpp_WebUI.zip
Verified signature6c0ae62
-
Update README.md
Verified signature7fedc95 -
Update README.md
Verified signature305b851 -
Update README.md
Verified signature9da1b7d -
Delete Image-Text-to-Text Models/GPT OSS 20B/J
Verified signatureefc013c -
Upload 3 files
Verified signature9da4d9d -
Create GPT OSS 20B/J
Verified signature8837169 -
Upload 2 files
Verified signaturee00abe9 -
Upload llama_cpp_WebUI.zip
Verified signature3995bfb -
Delete llama_cpp_WebUI FILE/llama_cpp_WebUI.zip
Verified signature85f4f15 -
Delete llama_cpp_WebUI.zip
Verified signature1bca745 -
Delete Run New FILE Edit....bat
Verified signature2920965 -
Delete llama-b7082-bin-win-cpu-x64.zip
Verified signature7356c6d
-
Upload Run New FILE Edit....bat
Verified signature21010eb -
Update README.md
Verified signature7a6a274 -
Update README.md
Verified signature8a29dab -
Upload llama-b7082-bin-win-cpu-x64.zip
Verified signature7f6470c
-
Upload mmproj-model-f16-27B.gguf
Verified signature1886c31 -
Delete Image-Text-to-Text Models/Qwen3/Qwen2.5-Omni-7B/g
Verified signatureb6bb7da -
Upload Any To Any.png
Verified signature88bac9a -
Create Qwen2.5-Omni-7B/g
Verified signature0137147 -
Update README.md
Verified signature34b84c9 -
Delete Image-Text-to-Text Models/H
Verified signatureccb9646 -
Upload models link.txt
Verified signature69d1d5d -
Upload llama_cpp_WebUI.zip
Verified signatureca28c77 -
Delete llama_cpp_WebUI FILE/ALL Run Models.bat
Verified signature00900db -
Delete llama_cpp_WebUI FILE/Run.BAT
Verified signaturec33d79b -
Delete llama_cpp_WebUI FILE/Image to Text Model Setup Guide (WebUI).txt
Verified signature3ee3862 -
Delete llama_cpp_WebUI FILE/Install tutorial.txt
Verified signature958d1f5 -
Delete llama_cpp_WebUI FILE/run_bat Edit tutorial.txt
Verified signature2ad465d -
Upload llama_cpp_WebUI.zip
Verified signaturea94e202 -
Update README.md
Verified signature8ad9e6c -
Update README.md
Verified signature4e1cfd7 -
Update README.md
Verified signature073ce48
-
Update README.md
Verified signature528aea5 -
Upload 3.png
Verified signaturef91c81c -
Delete Image-Text-to-Text Models/Qwen3/h
Verified signature46df4f7 -
Upload 2.png
Verified signature6f03c0b -
Delete Image-Text-to-Text Models/gemma-3/dd
Verified signature8992db5 -
Upload 1.png
Verified signature0564b7a -
Update README.md
Verified signature799d2d3 -
Upload ALL Run Models.bat
Verified signature8840b23 -
Create Audio-Text-to-Text/g
Verified signaturee6ff01b -
Update README.md
Verified signature57a0195