Instructions to use bradhutchings/Mmojo-Server with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use bradhutchings/Mmojo-Server with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf bradhutchings/Mmojo-Server:Q8_0 # Run inference directly in the terminal: llama cli -hf bradhutchings/Mmojo-Server:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf bradhutchings/Mmojo-Server:Q8_0 # Run inference directly in the terminal: llama cli -hf bradhutchings/Mmojo-Server:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf bradhutchings/Mmojo-Server:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf bradhutchings/Mmojo-Server:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf bradhutchings/Mmojo-Server:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf bradhutchings/Mmojo-Server:Q8_0
Use Docker
docker model run hf.co/bradhutchings/Mmojo-Server:Q8_0
- LM Studio
- Jan
- Ollama
How to use bradhutchings/Mmojo-Server with Ollama:
ollama run hf.co/bradhutchings/Mmojo-Server:Q8_0
- Unsloth Desktop
- Docker Model Runner
How to use bradhutchings/Mmojo-Server with Docker Model Runner:
docker model run hf.co/bradhutchings/Mmojo-Server:Q8_0
- Lemonade
How to use bradhutchings/Mmojo-Server with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull bradhutchings/Mmojo-Server:Q8_0
Run and chat with the model
lemonade run user.Mmojo-Server-Q8_0
List all available models
lemonade list
- Atomic Chat
Commit History
-
2026-07-26 Release. Rebuilt deploy packages.
Verified signatureff185f7 -
2026-07-26 Release. Rebuilt deploy packages.
Verified signature0b78782
-
Rebuilt deploy packages.
Verified signature2f9ff1c
-
Rebuilt deploy packages.
Verified signature48ad7fb
-
2026-07-26 Release.
Verified signature44a0b68
-
Delete deploy/Mmojo-RPC-Server-macos-aarch64-performant-met.zip
Verified signature62dc0fd -
Delete deploy/Mmojo-RPC-Server-macos-aarch64-compatible-met.zip
Verified signatureb52cec2 -
Delete deploy/Mmojo-Server-x86_64-perf-cud.zip
Verified signature18c7b17 -
Delete deploy/Mmojo-Server-x86_64-comp-cud.zip
Verified signature8e16ed6 -
Delete deploy/Mmojo-Server-raspberry-pi-5.zip
Verified signature0f1f37a -
Delete deploy/Mmojo-Server-macos-aarch64-performant-met.zip
Verified signature1b55e26 -
Delete deploy/Mmojo-Server-macos-aarch64-compatible-met.zip
Verified signatureebcde74 -
Delete deploy/Mmojo-Server-aarch64-rpi5.zip
Verified signatured7805c4 -
Delete deploy/Mmojo-Server-aarch64-perf-cud.zip
Verified signature8e2d2e4 -
Delete deploy/Mmojo-Server-aarch64-comp-cud.zip
Verified signature8d7d0f8
-
Upload 2 files
Verified signatureCompatible APEs have Gemma 3 1B Instruct.1f76fc8 -
New versions of Windows, Linux, Mac buids.
Verified signature6c8a47d -
Delete deploy/Mmojo-Server-ape-compatible-linux-macos-gemma-4-12B.zip
Verified signature60e3e40 -
Delete deploy/Mmojo-Server-ape-performant-windows-gemma-3-4B.zip
Verified signaturec4823b5 -
Delete deploy/Mmojo-Server-ape-performant-windows-gemma-4-12B.zip
Verified signature4d05f4d -
Delete deploy/Mmojo-Server-ape-performant-windows-qwen-3.5-9B.zip
Verified signatureb8927ef -
Delete deploy/Mmojo-Server-ape-performant-linux-macos-qwen-3.5-9B.zip
Verified signaturebcfeedc -
Delete deploy/Mmojo-Server-ape-performant-linux-macos-gemma-4-12B.zip
Verified signature8b024a7 -
Delete deploy/Mmojo-Server-ape-performant-linux-macos-gemma-3-4B.zip
Verified signaturec918d32 -
Delete deploy/Mmojo-Server-ape-compatible-windows-qwen-3.5-9B.zip
Verified signature7ada47b -
Delete deploy/Mmojo-Server-ape-compatible-windows-gemma-4-12B.zip
Verified signature16600d9 -
Delete deploy/Mmojo-Server-ape-compatible-windows-gemma-3-4B.zip
Verified signature81e7932 -
Delete deploy/Mmojo-Server-ape-compatible-linux-macos-qwen-3.5-9B.zip
Verified signature9b21cc8 -
Delete deploy/Mmojo-Server-ape-compatible-linux-macos-gemma-3-4B.zip
Verified signatureda3b106
-
Gemma 3 4B APEs
Verified signature6adbbbb -
Qwen3.5 9B APEs
Verified signature4b79147 -
Gemma 4 12B APEs
Verified signature43b30af
-
macOS builds.
Verified signature- Second first-pass of having macOS builds ready to deploy. -Brad3ec6af7 -
Delete deploy/mmojo-server-macos-aarch64-performant-met.zip
Verified signature88c6faa -
Delete deploy/mmojo-server-macos-aarch64-compatible-met.zip
Verified signaturea20dc61 -
Delete deploy/mmojo-rpc-server-macos-aarch64-performant-met.zip
Verified signature070bd67 -
Delete deploy/mmojo-rpc-server-macos-aarch64-compatible-met.zip
Verified signatureae4da40 -
macOS builds.
Verified signatureTesting macOS specific builds and build process. -Brada50691d
-
Upload Mmojo-Server-raspberry-pi-5.zip
Verified signature8f28a8b -
Delete deploy/Mmojo-Server-ape.zip
Verified signature89ce28c -
Delete deploy/Mmojo-Server-ape-performant.zip
Verified signature057d0d2 -
Delete deploy/Mmojo-Server-ape-compatible.zip
Verified signature4f9d9f1
-
APEs with .gguf files.
Verified signature304be6c
-
APEs with .gguf files.
Verified signatureb64ce77 -
2026-03-10 Build.
Verified signaturefa9a68e
-
2026-03-10 Build.
Verified signature144ef96
-
Default configuration.
Verified signature59fdf87
-
Default configuration.
Verified signature978c06d -
Default configuration.
Verified signature5fdd6cd -
Default configuration.
Verified signature3bb13a3