Zero-Shot Classification
Safetensors
GGUF
English
openchoice
decision-model
lora
qwen3.5
cpu
vision
typesafe-compatible
conversational
Instructions to use Lutr0/OpenChoice-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Lutr0/OpenChoice-9B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Lutr0/OpenChoice-9B:Q8_0 # Run inference directly in the terminal: llama cli -hf Lutr0/OpenChoice-9B:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Lutr0/OpenChoice-9B:Q8_0 # Run inference directly in the terminal: llama cli -hf Lutr0/OpenChoice-9B:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Lutr0/OpenChoice-9B:Q8_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf Lutr0/OpenChoice-9B:Q8_0
Use Docker
docker model run hf.co/Lutr0/OpenChoice-9B:Q8_0
- Llama new
- LM Studio
- Jan
- Ollama
How to use Lutr0/OpenChoice-9B with Ollama:
ollama run hf.co/Lutr0/OpenChoice-9B:Q8_0
- Unsloth Desktop
- Pi
How to use Lutr0/OpenChoice-9B with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Lutr0/OpenChoice-9B:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Lutr0/OpenChoice-9B:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Lutr0/OpenChoice-9B with Docker Model Runner:
docker model run hf.co/Lutr0/OpenChoice-9B:Q8_0
- Lemonade
How to use Lutr0/OpenChoice-9B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Lutr0/OpenChoice-9B:Q8_0
Run and chat with the model
lemonade run user.OpenChoice-9B-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use Lutr0/OpenChoice-9B with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Lutr0/OpenChoice-9B:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Lutr0/OpenChoice-9B:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Lutr0/OpenChoice-9B with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Lutr0/OpenChoice-9B:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Lutr0/OpenChoice-9B:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
|
Download adapter/README.md from Lutr0/OpenChoice-9B: direct link, hf CLI and curl.
- Browser
- Download file 1.24 kB
-
https://huggingface.co/Lutr0/OpenChoice-9B/resolve/main/adapter/README.md
- Command line
-
hf download hf://Lutr0/OpenChoice-9B/adapter/README.md
-
curl -L -o README.md https://huggingface.co/Lutr0/OpenChoice-9B/resolve/main/adapter/README.md
1.24 kB
| base_model: Qwen/Qwen3.5-9B | |
| library_name: peft | |
| license: cc-by-sa-4.0 | |
| tags: [lora, decision-model, openchoice] | |
| # OpenChoice-9B decision adapter | |
| Rank-16 LoRA (alpha 32) for the native slot decision reader, based on `Qwen/Qwen3.5-9B` revision `c202236235762e1c871ad0ccb60c8ee5ba337b9a`. The selected adapter was trained for 100 updates on 3,200 rows / 3,234,666 tokens, seed 20260921. | |
| This directory preserves the original adapter weights for fine-tuning and reproducible merging. It is not the serving package by itself. Use the GGUF files, processor, and manifest in the parent directory for CPU inference; use the public source's FINETUNING.md to continue training and export a new GGUF package. | |
| The slot reader produces Choice/Score/Noul probabilities from final-position answer logits without text generation. The parent `heads.safetensors` is empty because this checkpoint has no separate trained classifier head. | |
| See the parent model card, LICENSE, LICENSE-QWEN, and NOTICE for evaluation, limitations, attribution, and the publisher-owned data-rights review. The conservative CC-BY-SA-4.0 weights declaration is not a legal determination that source-data terms have been resolved. Code and Qwen base licensing are separate. | |