Text Classification
Transformers
ONNX
Safetensors
English
modernbert
system-1
decision-model
small-decision-model
intent-routing
agentic-router
ollama
finops
sovereign-ai
focus-1.5
s1sdk
homestead
Eval Results (legacy)
Instructions to use olanigan/HomeRouter-S1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use olanigan/HomeRouter-S1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="olanigan/HomeRouter-S1")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("olanigan/HomeRouter-S1") model = AutoModelForSequenceClassification.from_pretrained("olanigan/HomeRouter-S1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README: streamline benchmarks and quickstarts
Browse files
README.md
CHANGED
|
@@ -69,29 +69,26 @@ model-index:
|
|
| 69 |
|
| 70 |
## ⚡ Executive Summary
|
| 71 |
|
| 72 |
-
Modern AI agent frameworks (Antigravity, Claude Code, Cursor, LangChain) spend
|
| 73 |
|
| 74 |
**`HomeRouter-S1`** is a non-autoregressive, calibrated Small Decision Model (SDM) fine-tuned on 20,582 multi-turn agent execution turns. Built upon ModernBERT and the `LayaForDecision` architecture, it classifies agent tool intents and tier triage in a single forward pass without autoregressive text decoding:
|
| 75 |
|
| 76 |
* **Sub-26ms CPU Latency (ONNX)** / **Sub-43ms Apple Silicon Latency (Ollama Metal)**.
|
| 77 |
-
* **Zero Output Tokens ($N_{\text{out}} = 0$)**:
|
| 78 |
* **100% Strict Enum Guarantee**: 0.00% schema parse errors, eliminating JSON formatting repair loops.
|
| 79 |
-
* **Calibrated Confidence Gating**: Fitted temperature ($T = 1.0618$) achieves $\text{ECE} \le 0.0363$. Applying a threshold of $\tau = 0.90$ escalates ambiguous prompts to
|
| 80 |
-
* **
|
| 81 |
|
| 82 |
---
|
| 83 |
|
| 84 |
## 📊 Dual-Engine Silicon Benchmark
|
| 85 |
|
| 86 |
-
|
| 87 |
|
| 88 |
-
| Model / Architecture | Mode / Runtime | TTFD (P50) | TTFD (P95) | Output Tokens ($N_{\text{out}}$) | Parse Error Rate | Calibrated ECE |
|
| 89 |
-
| :--- | :--- | :--- | :--- | :--- | :--- | :--- |
|
| 90 |
-
| **
|
| 91 |
-
| **
|
| 92 |
-
| **DeepSeek R1** | Cloud API (Reasoning Loop) | 4,200 ms | 8,900 ms | ~1,200 tokens | 0.95% | 0.0910 | +$1,700.00 |
|
| 93 |
-
| **Homestead Native ONNX (CPU)** | **Direct FP32 Forward Pass** | **25.69 ms** | **26.00 ms** | **0 tokens** | **0.00%** | **0.0363** | **$4,500.00 (100%)** |
|
| 94 |
-
| **Ollama MLX (Metal)** | **Native LayaForDecision** | **40.97 ms** | **42.50 ms** | **0 tokens** | **0.00%** | **0.0363** | **$4,500.00 (100%)** |
|
| 95 |
|
| 96 |
---
|
| 97 |
|
|
@@ -168,22 +165,6 @@ ollama create olanigan/HomeRouter-S1 -f ollama_laya/Modelfile
|
|
| 168 |
ollama run olanigan/HomeRouter-S1 "find all *.ts files matching client"
|
| 169 |
```
|
| 170 |
|
| 171 |
-
### 4. TypeScript / Node via `s1sdk`
|
| 172 |
-
```typescript
|
| 173 |
-
import { S1Client } from "@homestead/s1sdk";
|
| 174 |
-
|
| 175 |
-
const s1 = new S1Client();
|
| 176 |
-
const route = await s1.route("Update the database migration script", [
|
| 177 |
-
"edit_file",
|
| 178 |
-
"write",
|
| 179 |
-
"run_command",
|
| 180 |
-
"tier_frontier"
|
| 181 |
-
]);
|
| 182 |
-
|
| 183 |
-
console.log(route.choice); // "edit_file"
|
| 184 |
-
console.log(route.confidence); // 0.9412
|
| 185 |
-
```
|
| 186 |
-
|
| 187 |
---
|
| 188 |
|
| 189 |
## 📦 Package Contents & File Sizes
|
|
|
|
| 69 |
|
| 70 |
## ⚡ Executive Summary
|
| 71 |
|
| 72 |
+
Modern AI agent frameworks (Antigravity, Claude Code, Cursor, LangChain) spend substantial compute budgets and latency classifying routing intents, triaging tool dispatches, or determining next actions.
|
| 73 |
|
| 74 |
**`HomeRouter-S1`** is a non-autoregressive, calibrated Small Decision Model (SDM) fine-tuned on 20,582 multi-turn agent execution turns. Built upon ModernBERT and the `LayaForDecision` architecture, it classifies agent tool intents and tier triage in a single forward pass without autoregressive text decoding:
|
| 75 |
|
| 76 |
* **Sub-26ms CPU Latency (ONNX)** / **Sub-43ms Apple Silicon Latency (Ollama Metal)**.
|
| 77 |
+
* **Zero Output Tokens ($N_{\text{out}} = 0$)**: Evaluates entire decision candidate spaces in a single forward pass, bypassing generative decode loops entirely.
|
| 78 |
* **100% Strict Enum Guarantee**: 0.00% schema parse errors, eliminating JSON formatting repair loops.
|
| 79 |
+
* **Calibrated Confidence Gating**: Fitted temperature ($T = 1.0618$) achieves $\text{ECE} \le 0.0363$. Applying a threshold of $\tau = 0.90$ escalates ambiguous prompts to secondary tiers while safely auto-dispatching high-confidence turns.
|
| 80 |
+
* **Local Silicon Efficiency**: Eliminates external network roundtrips and recurring per-token cloud inference costs.
|
| 81 |
|
| 82 |
---
|
| 83 |
|
| 84 |
## 📊 Dual-Engine Silicon Benchmark
|
| 85 |
|
| 86 |
+
Performance telemetry across local host CPU and Apple Silicon Metal runtimes:
|
| 87 |
|
| 88 |
+
| Model / Architecture | Mode / Runtime | TTFD (P50) | TTFD (P95) | Output Tokens ($N_{\text{out}}$) | Parse Error Rate | Calibrated ECE |
|
| 89 |
+
| :--- | :--- | :--- | :--- | :--- | :--- | :--- |
|
| 90 |
+
| **Homestead Native ONNX (CPU)** | **Direct FP32 Forward Pass** | **25.69 ms** | **26.00 ms** | **0 tokens** | **0.00%** | **0.0363** |
|
| 91 |
+
| **Ollama MLX (Metal)** | **Native LayaForDecision** | **40.97 ms** | **42.50 ms** | **0 tokens** | **0.00%** | **0.0363** |
|
|
|
|
|
|
|
|
|
|
| 92 |
|
| 93 |
---
|
| 94 |
|
|
|
|
| 165 |
ollama run olanigan/HomeRouter-S1 "find all *.ts files matching client"
|
| 166 |
```
|
| 167 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 168 |
---
|
| 169 |
|
| 170 |
## 📦 Package Contents & File Sizes
|