Instructions to use Interchained/imagine-v13 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Interchained/imagine-v13 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Interchained/imagine-v13:Q4_K_M # Run inference directly in the terminal: llama cli -hf Interchained/imagine-v13:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Interchained/imagine-v13:Q4_K_M # Run inference directly in the terminal: llama cli -hf Interchained/imagine-v13:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Interchained/imagine-v13:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Interchained/imagine-v13:Q4_K_M
Use Docker
docker model run hf.co/Interchained/imagine-v13:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Interchained/imagine-v13 with Ollama:
ollama run hf.co/Interchained/imagine-v13:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use Interchained/imagine-v13 with Docker Model Runner:
docker model run hf.co/Interchained/imagine-v13:Q4_K_M
- Lemonade
How to use Interchained/imagine-v13 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Interchained/imagine-v13:Q4_K_M
Run and chat with the model
lemonade run user.imagine-v13-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -142,24 +142,30 @@ A previously reported v12 result of 40/40 on a specific held-out evaluation is *
|
|
| 142 |
- The precise upstream licensing terms and redistribution permissions should be verified before publication. Replace the provisional `license: other` metadata with the correct Hugging Face license identifier or a linked license notice once confirmed.
|
| 143 |
|
| 144 |
## ================ FINAL EVAL ================
|
| 145 |
-
|
| 146 |
-
|
| 147 |
-
|
| 148 |
-
|
| 149 |
-
|
| 150 |
-
|
| 151 |
-
|
| 152 |
-
|
| 153 |
-
|
| 154 |
-
|
| 155 |
-
|
| 156 |
-
|
| 157 |
-
|
| 158 |
-
|
| 159 |
-
|
| 160 |
-
|
| 161 |
-
|
| 162 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 163 |
|
| 164 |
|
| 165 |
## Provenance
|
|
|
|
| 142 |
- The precise upstream licensing terms and redistribution permissions should be verified before publication. Replace the provisional `license: other` metadata with the correct Hugging Face license identifier or a linked license notice once confirmed.
|
| 143 |
|
| 144 |
## ================ FINAL EVAL ================
|
| 145 |
+
|
| 146 |
+
Measured 2026-11-03, after training, on the held-out eval split of the v13 corpus: **310 fixtures** (tool use 55, temporal grounding 15, discrimination 240 = 120 minimal pairs × 2 variants) whose schemas and tables appear **nowhere in training**. Both models were evaluated on identical fixtures, identical decoding (temperature 0, Q4_K_M GGUF, served side by side through the Hearth gateway), under two system-prompt conditions:
|
| 147 |
+
|
| 148 |
+
- **light** — one system line: "You are Imagine, a text-to-SQL assistant built by Interchained."
|
| 149 |
+
- **bare** — no system prompt at all.
|
| 150 |
+
|
| 151 |
+
| Family | v12 light | v12 bare | v13 light | v13 bare |
|
| 152 |
+
|---|---|---|---|---|
|
| 153 |
+
| Tool use (55) | 25/55 (45.5%) | 25/55 (45.5%) | 26/55 (47.3%) | 25/55 (45.5%) |
|
| 154 |
+
| Temporal (15) | 0/15 (0.0%) | 0/15 (0.0%) | 5/15 (33.3%) | 7/15 (46.7%) |
|
| 155 |
+
| Discrimination (240) | 0/240 (0.0%) | 3/240 (1.2%) | 116/240 (48.3%) | 103/240 (42.9%) |
|
| 156 |
+
| **All (310 per condition)** | **25/310 (8.1%)** | **28/310 (9.0%)** | **147/310 (47.4%)** | **135/310 (43.5%)** |
|
| 157 |
+
|
| 158 |
+
**Combined: v12 53/620 (8.5%) — v13 282/620 (45.5%).**
|
| 159 |
+
|
| 160 |
+
Scoring is deterministic and per family: discrimination by response mode (SQL vs single tool call vs tool chain, plus the expected tool name where one applies), tool use by behavior (call the right tool, abstain, clarify, or declare unanswerable), temporal by normalized SQL match against the reference.
|
| 161 |
+
|
| 162 |
+
How to read this, plainly:
|
| 163 |
+
|
| 164 |
+
- The gains are exactly where v13 aimed. Discrimination went from effectively zero to roughly half; temporal grounding went from zero to a third (light) and nearly half (bare). v13's new skills are in the weights, not the prompt: on temporal and discrimination it scores as well or better with **no system prompt** as with one.
|
| 165 |
+
- Tool use is a tie. These fixtures were built for the corpus's native tool-protocol system prompt, which this evaluation deliberately withholds, so both models are understated equally. The comparison is fair; the absolute level is pessimistic.
|
| 166 |
+
- Discrimination at ~45% also means the mode call is still wrong more often than right. v13 is a large, measured improvement over v12 on the families it was built for. It is not a finished model, and this card will not pretend otherwise.
|
| 167 |
+
|
| 168 |
+
Not yet measured for v13: the Tier-0 held-out telemetry suite (v12's 40/40 was on v12's own fixtures and is not a v13 number) and multi-turn behavior. They will be added here when they exist, the same way these were.
|
| 169 |
|
| 170 |
|
| 171 |
## Provenance
|