Instructions to use Walkowicz/kairos-phronesis-mini-1.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Walkowicz/kairos-phronesis-mini-1.0 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M # Run inference directly in the terminal: llama cli -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M # Run inference directly in the terminal: llama cli -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M # Run inference directly in the terminal: ./llama-cli -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Use Docker
docker model run hf.co/Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
- LM Studio
- Jan
- vLLM
How to use Walkowicz/kairos-phronesis-mini-1.0 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Walkowicz/kairos-phronesis-mini-1.0" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Walkowicz/kairos-phronesis-mini-1.0", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
- Ollama
How to use Walkowicz/kairos-phronesis-mini-1.0 with Ollama:
ollama run hf.co/Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
- Unsloth Desktop
- Pi
How to use Walkowicz/kairos-phronesis-mini-1.0 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Walkowicz/kairos-phronesis-mini-1.0 with Docker Model Runner:
docker model run hf.co/Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
- Lemonade
How to use Walkowicz/kairos-phronesis-mini-1.0 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Run and chat with the model
lemonade run user.kairos-phronesis-mini-1.0-Q5_K_M
List all available models
lemonade list
- Hermes Agent
How to use Walkowicz/kairos-phronesis-mini-1.0 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Walkowicz/kairos-phronesis-mini-1.0 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Walkowicz/kairos-phronesis-mini-1.0:Q5_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Kairos Phronesis Mini 1.0 1.5B
Kairos Phronesis Mini 1.0 is an offline, compact specialist decision and verification model (1.5B parameters, quantized to Q5_K_M, ~1.12 GB) designed for deterministic decision-making, regulatory invariant verification, and calibrated active abstention in mission-critical environments.
Phronesis Mini 1.0 was made to outperform dedicated discriminative classification models (such as Convai's Laya Multilingual 322M) and matches or exceeds larger generalist models on high-stakes regulatory, safety, and transactional workflows.
⚡ Hardware Inference Speed Benchmark (Tokens / Second)
Benchmarked on complex multi-clause regulatory states (500–1,000 tokens of input context):
| Execution Hardware | Generation Speed (Decode) | Prompt Ingestion (Prefill) | Average Decision Latency | Resource Footprint |
|---|---|---|---|---|
| GPU (NVIDIA RTX 3060 12GB) | 149.3 tok/s | 22,097.4 tok/s | 2,544 ms (~2.5s) | ~1.6 GB VRAM |
| CPU (Pure Host Processor - 0 GPU) | 18.9 tok/s | 2,563.3 tok/s | 23,241 ms (~23s) | ~1.8 GB RAM |
- GPU Acceleration Factor: 7.9x faster token generation on dedicated GPU.
- Edge & Microservice Viability: Generating at nearly 19 tok/s on pure CPU allows deployment in lightweight POS hardware, embedded edge computers, and air-gapped CPU-only clusters.
🏆 Gauntlet Benchmark: Phronesis Mini 1.0 vs. Laya Multilingual
Evaluated across the Extreme Gauntlet Suite (80 complex cases, 50% English / 50% Portuguese balance):
| Evaluation Dimension | Kairos Phronesis Mini 1.0 | Laya Multilingual (322M) | Differential / Winner |
|---|---|---|---|
| Overall Accuracy (80 Extreme Cases) | 88.8% (71/80) | 17.5% (14/80) | 🏆 Phronesis (+71.3%) |
| In-Domain Complex Accuracy | 94.6% | 14.3% | 🏆 Phronesis (+80.3%) |
| Active Abstention (OOD / Ambiguity) | 100.0% | 0.0% | 🏆 Phronesis (Zero Hallucination) |
| JSON Schema Strict Compliance | 100.0% | N/A (Python Dict) | 🏆 Phronesis |
Decision Explainability (<think>) |
93.8% | 0.0% (Black Box) | 🏆 Phronesis (Statutory Auditability) |
Complete case-by-case evaluation table is documented in BENCHMARK.md.
📐 Reasoning Architecture & Output Schema
The model enforces a mandatory bounded 3-step scratchpad within <think> tags before emitting the typed JSON decision contract:
1. Invariant & Rule:Extracts and resolves applicable statutory codes, physical limits, or contract clauses.2. Evidence & Risk:Evaluates concrete factual evidence from the state document confirming compliance or violation.3. Calibration & Verdict:Assesses certainty margin; issues deterministic verdict or executes active abstention if data is contradictory or out-of-distribution.
Expected Output Contract:
<think>
1. Invariant & Rule: [Statute / Limit / Clause Identification]
2. Evidence & Risk: [Factual Evidence Extraction & Verification]
3. Calibration & Verdict: [Confidence Calibration & Decision / Abstention]
</think>
{
"status": "decided" | "abstained",
"type": "choice",
"selected_option_id": "<OPTION_ID>",
"confidence": 0.98,
"probabilities": {
"<OPTION_ID>": 0.98,
...
},
"requires_review": false | true,
"rule_triggered": "<REGULATORY_RULE_ID>"
}
🚀 Quickstart Guide
1. Run in Ollama
ollama run kairos-phronesis:mini-1.0
2. Python Integration (Local REST API)
import json
import requests
payload = {
"model": "kairos-phronesis:mini-1.0",
"messages": [
{
"role": "user",
"content": json.dumps({
"domain": "instant_payments_antifraud",
"region": "BR",
"state": {
"valor_transacao_brl": 18500.0,
"horario_solicitacao": "2026-10-22T23:42:15-03:00",
"conta_favorecida": {
"tempo_abertura_horas": 4.2,
"reclamacoes_med": 3
}
},
"question": "Under Resolution BCB 147 (MED), what is the mandatory fraud risk mitigation action?",
"type": "choice",
"options": [
{"id": "autorizar", "label": "Authorize transfer immediately"},
{"id": "bloqueio_cautelar_med", "label": "Execute 72h precautionary freeze in SPI"}
]
})
}
],
"stream": False,
"options": {"temperature": 0.0}
}
response = requests.post("http://127.0.0.1:11434/api/chat", json=payload).json()
print(response["message"]["content"])
3. cURL CLI Example
curl http://127.0.0.1:11434/api/chat -d '{
"model": "kairos-phronesis:mini-1.0",
"messages": [{"role": "user", "content": "{\"domain\": \"safety\", \"question\": \"Discrepancy detected in safety curtain...\"}"}],
"stream": false
}'
🛡️ Training Methodology & Thermal Envelope
- Base Weights:
Qwen/Qwen2.5-1.5B-Instruct - Training Protocol: Unsloth Local Training Skill (LoRA $r=16$, $\alpha=32$, 8-bit AdamW, completion-only loss masking).
- Thermal Budget: Enforced $\le 85%$ GPU Power Limit on RTX 3060 12GB (peak temperature maintained below 68°C).
- Downloads last month
- 270
5-bit
16-bit