Text Classification
GGUF
English
jev
jev-style
openjev
decision-model
typed-decisions
bonsai
ternary
local-inference
blackwell
conversational
Instructions to use ajh-code/Jev-Bonsai-Compass with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use ajh-code/Jev-Bonsai-Compass with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf ajh-code/Jev-Bonsai-Compass:Q2_0 # Run inference directly in the terminal: llama cli -hf ajh-code/Jev-Bonsai-Compass:Q2_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf ajh-code/Jev-Bonsai-Compass:Q2_0 # Run inference directly in the terminal: llama cli -hf ajh-code/Jev-Bonsai-Compass:Q2_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf ajh-code/Jev-Bonsai-Compass:Q2_0 # Run inference directly in the terminal: ./llama-cli -hf ajh-code/Jev-Bonsai-Compass:Q2_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf ajh-code/Jev-Bonsai-Compass:Q2_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf ajh-code/Jev-Bonsai-Compass:Q2_0
Use Docker
docker model run hf.co/ajh-code/Jev-Bonsai-Compass:Q2_0
- LM Studio
- Jan
- Ollama
How to use ajh-code/Jev-Bonsai-Compass with Ollama:
ollama run hf.co/ajh-code/Jev-Bonsai-Compass:Q2_0
- Unsloth Desktop
- Pi
How to use ajh-code/Jev-Bonsai-Compass with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ajh-code/Jev-Bonsai-Compass:Q2_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "ajh-code/Jev-Bonsai-Compass:Q2_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use ajh-code/Jev-Bonsai-Compass with Docker Model Runner:
docker model run hf.co/ajh-code/Jev-Bonsai-Compass:Q2_0
- Lemonade
How to use ajh-code/Jev-Bonsai-Compass with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull ajh-code/Jev-Bonsai-Compass:Q2_0
Run and chat with the model
lemonade run user.Jev-Bonsai-Compass-Q2_0
List all available models
lemonade list
- Hermes Agent
How to use ajh-code/Jev-Bonsai-Compass with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ajh-code/Jev-Bonsai-Compass:Q2_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default ajh-code/Jev-Bonsai-Compass:Q2_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use ajh-code/Jev-Bonsai-Compass with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf ajh-code/Jev-Bonsai-Compass:Q2_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "ajh-code/Jev-Bonsai-Compass:Q2_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| { | |
| "repository": "https://github.com/PrismML-Eng/llama.cpp", | |
| "embedded_commit": "f0a2b5dc9ea066780b9b410d2c0f95d675859bf7", | |
| "build_number": 10697, | |
| "provenance_limit": "Built from the embedded upstream commit with the local qwen35 patch in native/source/local-qwen35.patch; full native source tree is available upstream at that commit.", | |
| "license": "MIT", | |
| "tested_build": { | |
| "compiler": "GNU12.4.0", | |
| "architecture": "Linux x86_64", | |
| "cuda_architectures": "120a-real", | |
| "GGML_CUDA": true, | |
| "GGML_NATIVE": true, | |
| "GGML_CUDA_NCCL": true | |
| }, | |
| "external_libraries": [ | |
| "libcudart.so.13", | |
| "libcublas.so.13", | |
| "libcuda.so.1", | |
| "libnccl.so.2", | |
| "GNU C/C++ runtime" | |
| ], | |
| "bundled_files": { | |
| "libggml-base.so": { | |
| "bytes": 939104, | |
| "sha256": "bb2e08d6d1d286044e210fccad6b87ad56cab9a905efca8c33493637d02770e4" | |
| }, | |
| "libggml.so": { | |
| "bytes": 55384, | |
| "sha256": "2b8b4cb00d91c894c432744a4e53206b033922949774b2c1fddc82690bfb6c80" | |
| }, | |
| "libggml-cpu.so.0.21.0": { | |
| "bytes": 1421624, | |
| "sha256": "eed2acd145c161a1c902efe435d6879a1aa7481c1ac729b93d8911931d60fc00" | |
| }, | |
| "libggml-cuda.so": { | |
| "bytes": 49193080, | |
| "sha256": "b3be257e214b5d8264a57a56185d9612024ddee7f9bd38662f7e981a596353e1" | |
| }, | |
| "libggml-cpu.so.0": { | |
| "bytes": 1421624, | |
| "sha256": "eed2acd145c161a1c902efe435d6879a1aa7481c1ac729b93d8911931d60fc00" | |
| }, | |
| "libllama-common.so.0": { | |
| "bytes": 5769016, | |
| "sha256": "29149691e8cdba482142e324cb404f8b52fc28addd0f1b3f7d8b164468ca860c" | |
| }, | |
| "libmtmd.so.0.2.0": { | |
| "bytes": 1874536, | |
| "sha256": "022c08839b66df4d936bc7a34f0386706e01aeb07f165a6a572636d5659be97a" | |
| }, | |
| "libllama-server-impl.so": { | |
| "bytes": 6863696, | |
| "sha256": "e22898b4b47edbf8576222ea6fc25841de8ba66d1089bc08984b51dae4918e2a" | |
| }, | |
| "libllama-cli-impl.so": { | |
| "bytes": 235344, | |
| "sha256": "919317105262dcfda2b2a73235b27f435be63f85de672fd3ed0ac6f47c3ae69b" | |
| }, | |
| "libmtmd.so": { | |
| "bytes": 1874536, | |
| "sha256": "022c08839b66df4d936bc7a34f0386706e01aeb07f165a6a572636d5659be97a" | |
| }, | |
| "libggml-cuda.so.0": { | |
| "bytes": 49193080, | |
| "sha256": "b3be257e214b5d8264a57a56185d9612024ddee7f9bd38662f7e981a596353e1" | |
| }, | |
| "libllama-common.so": { | |
| "bytes": 5769016, | |
| "sha256": "29149691e8cdba482142e324cb404f8b52fc28addd0f1b3f7d8b164468ca860c" | |
| }, | |
| "libggml.so.0": { | |
| "bytes": 55384, | |
| "sha256": "2b8b4cb00d91c894c432744a4e53206b033922949774b2c1fddc82690bfb6c80" | |
| }, | |
| "libllama.so.0.2.0": { | |
| "bytes": 4617376, | |
| "sha256": "a38adf43b9dc0e1d86620fa79d94a480f75d59733205cdd8d29281bacb397ba9" | |
| }, | |
| "llama-server": { | |
| "bytes": 18000, | |
| "sha256": "9f89e204f245718c4d3efead026c0b9cedb062e416b3267a9ebaee2328f74328" | |
| }, | |
| "libggml-base.so.0": { | |
| "bytes": 939104, | |
| "sha256": "bb2e08d6d1d286044e210fccad6b87ad56cab9a905efca8c33493637d02770e4" | |
| }, | |
| "libggml.so.0.21.0": { | |
| "bytes": 55384, | |
| "sha256": "2b8b4cb00d91c894c432744a4e53206b033922949774b2c1fddc82690bfb6c80" | |
| }, | |
| "libllama.so.0": { | |
| "bytes": 4617376, | |
| "sha256": "a38adf43b9dc0e1d86620fa79d94a480f75d59733205cdd8d29281bacb397ba9" | |
| }, | |
| "libllama-common.so.0.2.0": { | |
| "bytes": 5769016, | |
| "sha256": "29149691e8cdba482142e324cb404f8b52fc28addd0f1b3f7d8b164468ca860c" | |
| }, | |
| "libllama.so": { | |
| "bytes": 4617376, | |
| "sha256": "a38adf43b9dc0e1d86620fa79d94a480f75d59733205cdd8d29281bacb397ba9" | |
| }, | |
| "libmtmd.so.0": { | |
| "bytes": 1874536, | |
| "sha256": "022c08839b66df4d936bc7a34f0386706e01aeb07f165a6a572636d5659be97a" | |
| }, | |
| "libggml-cuda.so.0.21.0": { | |
| "bytes": 49193080, | |
| "sha256": "b3be257e214b5d8264a57a56185d9612024ddee7f9bd38662f7e981a596353e1" | |
| }, | |
| "libggml-base.so.0.21.0": { | |
| "bytes": 939104, | |
| "sha256": "bb2e08d6d1d286044e210fccad6b87ad56cab9a905efca8c33493637d02770e4" | |
| }, | |
| "libggml-cpu.so": { | |
| "bytes": 1421624, | |
| "sha256": "eed2acd145c161a1c902efe435d6879a1aa7481c1ac729b93d8911931d60fc00" | |
| } | |
| }, | |
| "launch_config": { | |
| "context": 4096, | |
| "parallel": 1, | |
| "reasoning": false, | |
| "cache_prompt": false, | |
| "gpu_layers": 99, | |
| "flash_attention": true | |
| } | |
| } | |