Text Generation
GGUF
English
qwen3_5_text
27b
stem
tutor
math
physics
chemistry
biology
computer-science
claude-distillation
conversational
local
offline
lm-studio
llama-cpp
Instructions to use Verdugie/STEM-Oracle with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Verdugie/STEM-Oracle with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Verdugie/STEM-Oracle:Q4_K_M # Run inference directly in the terminal: llama cli -hf Verdugie/STEM-Oracle:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Verdugie/STEM-Oracle:Q4_K_M # Run inference directly in the terminal: llama cli -hf Verdugie/STEM-Oracle:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Verdugie/STEM-Oracle:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Verdugie/STEM-Oracle:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Verdugie/STEM-Oracle:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Verdugie/STEM-Oracle:Q4_K_M
Use Docker
docker model run hf.co/Verdugie/STEM-Oracle:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use Verdugie/STEM-Oracle with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Verdugie/STEM-Oracle" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Verdugie/STEM-Oracle", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Verdugie/STEM-Oracle:Q4_K_M
- Ollama
How to use Verdugie/STEM-Oracle with Ollama:
ollama run hf.co/Verdugie/STEM-Oracle:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use Verdugie/STEM-Oracle with Docker Model Runner:
docker model run hf.co/Verdugie/STEM-Oracle:Q4_K_M
- Lemonade
How to use Verdugie/STEM-Oracle with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Verdugie/STEM-Oracle:Q4_K_M
Run and chat with the model
lemonade run user.STEM-Oracle-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Card rewrite: uniform structure, renamed files, sidecar cleanup
Browse files- .gitattributes +4 -0
- README.md +56 -263
- STEM-Oracle-27B-BF16.gguf → STEM-Oracle-BF16.gguf +0 -0
- STEM-Oracle-27B-Q4_K_M.gguf → STEM-Oracle-Q4_K_M.gguf +0 -0
- STEM-Oracle-27B-Q6_K.gguf → STEM-Oracle-Q6_K.gguf +0 -0
- STEM-Oracle-27B-Q8_0.gguf → STEM-Oracle-Q8_0.gguf +0 -0
- eval/training_metadata.json +0 -14
- training-data/opus-candid-v35-27b.json +0 -0
.gitattributes
CHANGED
|
@@ -39,3 +39,7 @@ STEM-Oracle-27B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
| 39 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 40 |
STEM-Oracle-27B-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
| 40 |
STEM-Oracle-27B-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
|
| 42 |
+
STEM-Oracle-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
STEM-Oracle-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
STEM-Oracle-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
STEM-Oracle-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,298 +1,91 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
language:
|
| 4 |
-
|
| 5 |
-
- es
|
| 6 |
base_model: Qwen/Qwen3.5-27B
|
|
|
|
| 7 |
tags:
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
|
|
|
|
|
|
| 22 |
pipeline_tag: text-generation
|
| 23 |
---
|
|
|
|
|
|
|
| 24 |
|
| 25 |
-
#
|
| 26 |
-
/ˈôrəkəl/ — a source of wise counsel; one who provides authoritative knowledge.
|
| 27 |
-
*From Latin ōrāculum, meaning divine announcement. In computer science, an oracle is a black box that always returns the correct answer — you don't ask it how it knows, you ask and it answers. An oracle model doesn't search for reasoning at inference time; the disposition is already in the weights.*
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
|
| 32 |
|
| 33 |
-
|
| 34 |
|
| 35 |
-
-
|
| 36 |
-
|
| 37 |
-
## What Makes This Different from Math-Distilled Models
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
-
|
| 42 |
|
| 43 |
-
|
| 44 |
-
-
|
| 45 |
-
|
| 46 |
-
- **Cross-domain bridges** — connects linear algebra to quantum mechanics, graph theory to chemistry, thermodynamics to information theory. Trained to make connections conventional tutors don't.
|
| 47 |
-
- **Sustained coherence** — holds context across 10+ turn problem-solving sessions without contradicting earlier steps or losing the thread.
|
| 48 |
|
| 49 |
-
-
|
|
|
|
| 50 |
|
| 51 |
## Available Quantizations
|
| 52 |
|
| 53 |
-
| File | Quant | Size |
|
| 54 |
-
|------|-------|------|
|
| 55 |
-
| `STEM-Oracle-
|
| 56 |
-
| `STEM-Oracle-
|
| 57 |
-
| `STEM-Oracle-
|
| 58 |
-
| `STEM-Oracle-
|
| 59 |
-
|
| 60 |
-
---
|
| 61 |
|
| 62 |
## Model Details
|
| 63 |
|
| 64 |
| Attribute | Value |
|
| 65 |
|-----------|-------|
|
| 66 |
-
| **Base Model** | Qwen 3.5 27B
|
| 67 |
-
| **Training Data** | 5,179 STEM
|
| 68 |
-
| **
|
| 69 |
-
| **
|
| 70 |
-
| **
|
| 71 |
-
| **
|
| 72 |
-
| **Optimizer** | AdamW 8-bit |
|
| 73 |
-
| **Learning Rate** | 5e-5 (cosine schedule, 6% warmup — tuned for SSM stability) |
|
| 74 |
| **License** | Apache 2.0 |
|
| 75 |
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
## Quick Start
|
| 79 |
-
|
| 80 |
-
Works with any GGUF-compatible runtime — LM Studio, Ollama, llama.cpp, KoboldCpp. Download the GGUF, load it, and start asking questions. No system prompt needed — the teaching disposition is in the weights.
|
| 81 |
-
|
| 82 |
-
---
|
| 83 |
-
|
| 84 |
-
## Recommended Hardware
|
| 85 |
-
|
| 86 |
-
| Setup | Quantization | VRAM/RAM | Speed | Notes |
|
| 87 |
-
|-------|-------------|----------|-------|-------|
|
| 88 |
-
| **RTX 4090 (24GB)** | Q4_K_M | ~18 GB VRAM | 15-25 t/s | Sweet spot for consumer hardware. |
|
| 89 |
-
| **RTX 4090 (24GB)** | Q6_K | ~23 GB VRAM | 10-18 t/s | Higher fidelity, tight fit. |
|
| 90 |
-
| **Apple M2/M3 Ultra** | Q4_K_M/Q6_K | 64-128 GB unified | 5-10 t/s | Full model in unified memory. |
|
| 91 |
-
| **RTX 3090/4080** | Q4_K_M | ~18 GB VRAM | 10-18 t/s | Comfortable. |
|
| 92 |
-
| **Dual GPU** | Q8_0 | ~30 GB VRAM | Varies | Split across two 16GB+ cards. |
|
| 93 |
-
| **H100/A100/H200** | BF16 | ~54 GB VRAM | 30-50+ t/s | Full precision. Every trained disposition preserved. |
|
| 94 |
-
| **CPU Only** | Q4_K_M | ~20 GB RAM | 1-3 t/s | 32GB+ system RAM. Slow but works. |
|
| 95 |
-
|
| 96 |
-
---
|
| 97 |
-
|
| 98 |
-
## Test Battery Design
|
| 99 |
-
|
| 100 |
-
STEM-Oracle's stress test protocol covers 40 single-turn prompts and 10 multi-turn problem-solving conversations:
|
| 101 |
-
|
| 102 |
-
**Single-turn (40 prompts):**
|
| 103 |
-
- Math (6) — tiered from basic calculus through functional analysis
|
| 104 |
-
- Physics (5) — Newton through gauge invariance
|
| 105 |
-
- Chemistry (4) — bonds through NMR spectroscopy
|
| 106 |
-
- Biology (3) — natural selection through CRISPR mechanisms
|
| 107 |
-
- Computer Science (3) — Big-O through the halting problem
|
| 108 |
-
- Error Correction (6) — catches student misconceptions
|
| 109 |
-
- Cross-Domain Bridges (3) — connects disciplines
|
| 110 |
-
- Conciseness (3) — quick factual density checks
|
| 111 |
-
|
| 112 |
-
**Multi-turn (10 conversations, 70+ turns):**
|
| 113 |
-
- Derivative deep dives with struggling freshmen
|
| 114 |
-
- Physics problem-solving with wrong intermediate steps
|
| 115 |
-
- Organic chemistry mechanisms with tier-shifting
|
| 116 |
-
- Proof guidance without giving the answer
|
| 117 |
-
- Socratic questioning that builds understanding
|
| 118 |
-
- Extended adversarial challenges to mathematical claims
|
| 119 |
-
|
| 120 |
-
---
|
| 121 |
-
|
| 122 |
-
## Stress Test Results — All Quants
|
| 123 |
-
|
| 124 |
-
Full battery: 39 single-turn prompts + 10 multi-turn conversations per quant. BF16 tested on NVIDIA H200 SXM via llama.cpp with raw Qwen 3.5 non-thinking chat template. Quantized models tested on RTX 4090 with full RAM unload between runs.
|
| 125 |
-
|
| 126 |
-
| Metric | Q4_K_M | Q6_K | Q8_0 | BF16 |
|
| 127 |
-
|--------|--------|------|------|------|
|
| 128 |
-
| **Overall** | **30/39 (77%)** | **30/39 (77%)** | **28/39 (72%)** | **39/39 (100%)** |
|
| 129 |
-
| Math | 3/6 | 4/6 | 4/6 | 6/6 |
|
| 130 |
-
| Physics | 4/5 | 4/5 | 4/5 | 5/5 |
|
| 131 |
-
| Chemistry | 4/4 | 4/4 | 2/4 | 4/4 |
|
| 132 |
-
| Biology | 2/3 | 2/3 | 2/3 | 3/3 |
|
| 133 |
-
| CS | 2/3 | 2/3 | 2/3 | 3/3 |
|
| 134 |
-
| Error Correction | 5/6 | 4/6 | 3/6 | 6/6 |
|
| 135 |
-
| Cross-Domain Bridges | 3/3 | 3/3 | 3/3 | 3/3 |
|
| 136 |
-
| Conciseness | 2/3 | 2/3 | 3/3 | 3/3 |
|
| 137 |
-
| Memory (multi-turn) | 3/3 | 3/3 | 3/3 | 3/3 |
|
| 138 |
-
| Median word count | 52w | 53w | 46w | 36w |
|
| 139 |
-
|
| 140 |
-
### BF16 Analysis
|
| 141 |
-
|
| 142 |
-
BF16 swept every category — a result that challenges the earlier finding of Q4_K_M outperforming Q8_0. At full precision, the model demonstrates tighter register control (36w median vs 52w at Q4_K_M), stronger error correction (6/6 vs 5/6), and complete coverage across all STEM domains.
|
| 143 |
-
|
| 144 |
-
**What changed:** The original "quantization as regularization" hypothesis — that Q4_K_M's lossy compression acts as a post-training regularizer — doesn't hold against BF16 results. The quantized models weren't *better*; they were *constrained* in ways that happened to score well on specific rubric dimensions while losing expressiveness in others.
|
| 145 |
-
|
| 146 |
-
**Error correction at BF16** is the clearest signal. Every misconception caught cleanly, with pedagogically structured corrections that name the error pattern, provide counterexamples, and state the correct rule. At Q8_0, this same category dropped to 3/6 — suggesting that higher-but-not-full precision retains enough noise to interfere with the trained error topology, while full BF16 preserves the complete learned disposition.
|
| 147 |
-
|
| 148 |
-
**The conciseness paradox persists.** The model consistently exceeds word limits on entropy/definition prompts across all quants, including BF16. This is a training data characteristic, not a quantization effect — the model learned to editorialize ("That metaphor has done serious damage — retire it") and that disposition survives all precision levels.
|
| 149 |
-
|
| 150 |
-
**Multi-turn quality at BF16:** The adversarial math challenge (0.999... = 1) and cross-domain entropy bridge demonstrate graduate-level reasoning with personality intact. The memory test (numerical constants with distractor) achieves perfect recall at all quant levels, confirming that context tracking is structural rather than precision-dependent.
|
| 151 |
-
|
| 152 |
-
### Quantized Model Analysis
|
| 153 |
-
|
| 154 |
-
**Cross-domain bridges (3/3 across all quants):** The model connects linear algebra to quantum mechanics, graph theory to chemistry, and thermodynamics to information theory — not as surface analogies but as genuine mathematical correspondences. This survived quantization perfectly.
|
| 155 |
-
|
| 156 |
-
**Memory and context tracking (3/3):** Fed exact numerical constants (Avogadro's number, speed of light, electron charge) early in conversation, tested recall several turns later with distractor topics in between. All quants returned exact values and used them correctly in follow-up problems.
|
| 157 |
-
|
| 158 |
-
**Tiered pedagogy:** Adjusts depth naturally — 30-50 words for tier 1 (basic concepts), 100-200+ words for tier 4-5 (Lagrangian mechanics, Hahn-Banach theorem, gauge invariance). The teaching disposition is in the weights, not a system prompt.
|
| 159 |
-
|
| 160 |
-
**Q8_0 underperforms Q4_K_M.** Q8_0 dropped in chemistry (2/4 vs 4/4) and error correction (3/6 vs 5/6). With BF16 data in hand, the explanation is clearer: the quantized models weren't better or worse at different precision levels — they were constrained differently. Q4_K_M's aggressive compression happened to preserve the pedagogical patterns that score well on this rubric. Q8_0 retained enough precision to expose noise the training didn't fully regularize, but not enough to preserve the complete disposition that BF16 retains.
|
| 161 |
-
|
| 162 |
-
**Biology and CS are thin at quantized levels.** 2/3 in both disciplines across all quantized versions, but 3/3 at BF16. The training signal is there — quantization just clips it first in the thinner-coverage domains.
|
| 163 |
-
|
| 164 |
-
### Recommended Quant
|
| 165 |
-
|
| 166 |
-
| Use Case | Recommended Quant |
|
| 167 |
-
|----------|------------------|
|
| 168 |
-
| Maximum quality, serious hardware (48GB+ VRAM) | **BF16** |
|
| 169 |
-
| Best quality-per-VRAM, consumer hardware | **Q4_K_M** |
|
| 170 |
-
| Balanced quality and size | **Q6_K** |
|
| 171 |
-
| Reference quality without full precision | **Q6_K** over Q8_0 |
|
| 172 |
-
|
| 173 |
-
Q4_K_M remains the recommended ship for consumer hardware — the quality gap between Q4_K_M and BF16 is real but narrow for most use cases, and the 3.4x size reduction (16GB vs 54GB) makes it the practical choice. BF16 is for users who want every trained disposition preserved at full fidelity and have the VRAM to support it.
|
| 174 |
-
|
| 175 |
-
---
|
| 176 |
-
|
| 177 |
-
## Selected Responses
|
| 178 |
-
|
| 179 |
-
### BF16 Responses
|
| 180 |
-
|
| 181 |
-
**Error Correction — Radical Distribution Misconception:**
|
| 182 |
-
*"I simplified sqrt(a^2 + b^2) to a + b. That's correct right?"*
|
| 183 |
-
|
| 184 |
-
> No — and this one's worth catching. sqrt(a² + b²) is the hypotenuse, not the sum of sides. Test it: a=3, b=4 gives sqrt(25)=5, but 3+4=7. Geometry doesn't negotiate.
|
| 185 |
-
|
| 186 |
-
*29 words. Names the geometric context, provides numerical counterexample, closes with personality.*
|
| 187 |
-
|
| 188 |
-
**Adversarial Math — 0.999... equals 1 (Turn 3):**
|
| 189 |
-
*"But there's always a gap between 0.999... and 1. An infinitesimal gap."*
|
| 190 |
-
|
| 191 |
-
> That gap is zero. "Infinitesimal" isn't a number — it's a story you tell yourself when subtraction feels too honest. Pick any decimal place. The difference is 0 there too. The gap dissolves the moment you try to locate it.
|
| 192 |
-
|
| 193 |
-
*Addresses the intuition directly, then holds firm with mathematical precision.*
|
| 194 |
-
|
| 195 |
-
**Cross-Domain Bridge — Thermodynamics → Information Theory:**
|
| 196 |
-
*"So information IS physical? That's a strong claim."*
|
| 197 |
-
|
| 198 |
-
> Information is physical. Not a metaphor — a thermodynamic quantity. Every bit stored, processed, or erased carries an entropy cost. Maxwell's demon didn't just get clever — it revealed that information and matter are woven from the same fabric.
|
| 199 |
-
|
| 200 |
-
*Defends the thesis without hedging. Graduate-level claim delivered with conviction.*
|
| 201 |
-
|
| 202 |
-
### Quantized Responses
|
| 203 |
-
|
| 204 |
-
**Error Correction — Radical Distribution Misconception (Q4_K_M):**
|
| 205 |
-
*"I simplified sqrt(a² + b²) to a + b. That's correct?"*
|
| 206 |
-
|
| 207 |
-
> Error: treating radical as distributive. sqrt(a² + b²) ≠ a + b. Misconception: assuming √(x + y) = √x + √y. Correct: √(a² + b²) is the hypotenuse formula. Check: if a=3, b=4, then √(9+16)=5, not 7. Rule: radicals don't distribute over addition.
|
| 208 |
-
|
| 209 |
-
*43 words. Catches the error, names the misconception, provides a numerical counterexample, states the rule. No fluff.*
|
| 210 |
-
|
| 211 |
-
**Cross-Domain Bridge — Linear Algebra → Quantum Mechanics (Q4_K_M):**
|
| 212 |
-
*"How does linear algebra connect to quantum mechanics?"*
|
| 213 |
-
|
| 214 |
-
> Quantum mechanics IS linear algebra on Hilbert spaces — it's not an analogy, it's the mathematical framework. States are vectors: a quantum state |ψ⟩ is a vector in a complex Hilbert space. Superposition is linear combination. Observables are Hermitian operators. The spectral theorem guarantees real eigenvalues (physical measurements give real numbers) and orthogonal eigenvectors (distinct outcomes are distinguishable). Measurement is projection. Time evolution is unitary transformation. Entanglement is tensor product structure. Every quantum concept has a precise linear algebra translation.
|
| 215 |
-
|
| 216 |
-
*Connects two fields as a single mathematical structure, not a metaphor. This is what cross-domain bridges should look like.*
|
| 217 |
-
|
| 218 |
-
**Tiered Depth — Gauge Invariance, Tier 5 (Q6_K):**
|
| 219 |
-
*"What is the physical meaning of gauge invariance?"*
|
| 220 |
-
|
| 221 |
-
> Gauge invariance means the physics is unchanged under local phase transformations of the wavefunction. This is not a symmetry of nature — it's a redundancy in our description. But demanding that the theory be gauge invariant forces you to introduce a gauge field (the photon field) with specific transformation properties. The requirement of local gauge invariance generates the interaction between matter and photons. In the Standard Model, all forces arise this way: the requirement of local gauge invariance under SU(3)×SU(2)×U(1) generates all gauge bosons and their interactions with matter.
|
| 222 |
-
|
| 223 |
-
*Graduate-level explanation delivered without jargon padding. Builds from principle to consequence.*
|
| 224 |
|
| 225 |
-
**
|
| 226 |
-
*
|
|
|
|
|
|
|
| 227 |
|
| 228 |
-
|
| 229 |
|
| 230 |
-
|
| 231 |
-
|
| 232 |
-
-
|
| 233 |
-
|
| 234 |
-
## The Oracle-Soul Architecture
|
| 235 |
-
|
| 236 |
-
STEM-Oracle and [Opus-Candid-27B-V3.5](https://huggingface.co/Verdugie/Opus-Candid-27B-V3.5) share the same training architecture — the difference is what fills it:
|
| 237 |
-
|
| 238 |
-
| Dimension | V3.5 (Personality) | STEM-Oracle (Tutor) |
|
| 239 |
-
|-----------|-------------------|---------------------|
|
| 240 |
-
| Training conversations | 5,358 | 5,179 |
|
| 241 |
-
| Primary signal | Personality, adversarial resistance | STEM pedagogy, error correction |
|
| 242 |
-
| Density equilibrium | 36-40w median | Adaptive — concise for facts, extended for derivations |
|
| 243 |
-
| Reinforcement nodes | Worth, trust, vulnerability, control, agency | Accuracy, tier-matching, Socratic method, patience, bridges |
|
| 244 |
-
| Anti-pattern training | Anti-sycophancy, anti-therapy-speak | Anti-hand-holding, anti-pattern-matching |
|
| 245 |
-
|
| 246 |
-
Both models prove the same thesis: personality (or pedagogical disposition) can be trained into weights at a level that survives quantization, rather than bolted on via system prompts that any user can override.
|
| 247 |
-
|
| 248 |
-
---
|
| 249 |
-
|
| 250 |
-
## Choosing Your Model
|
| 251 |
-
|
| 252 |
-
| Model | Best For | VRAM |
|
| 253 |
-
|-------|----------|------|
|
| 254 |
-
| [Lite 4B](https://huggingface.co/Verdugie/Opus-Candid-Lite-4B) | Phones, Raspberry Pi, integrated graphics | ~3 GB |
|
| 255 |
-
| [8B V3](https://huggingface.co/Verdugie/Opus-Candid-8B-V3) | Fast casual chat, anything with 8GB VRAM | ~8 GB |
|
| 256 |
-
| [MoE V3](https://huggingface.co/Verdugie/Opus-Candid-MoE-V3) | Best depth-per-VRAM ratio | ~22 GB |
|
| 257 |
-
| [27B V3](https://huggingface.co/Verdugie/Opus-Candid-27B-V3) | Full experience, dense reasoning | ~27 GB |
|
| 258 |
-
| [27B V3.5](https://huggingface.co/Verdugie/Opus-Candid-27B-V3.5) | Maximum personality depth | ~18-27 GB |
|
| 259 |
-
| **STEM-Oracle-27B** (this model) | STEM tutoring, problem-solving, teaching | ~16-54 GB |
|
| 260 |
-
|
| 261 |
-
The Opus Candid models are built for personality and conversation. STEM-Oracle is built for teaching. If you want a model that pushes back on bad arguments, run V3.5. If you want a model that catches your algebra mistakes and walks you through the fix, run this.
|
| 262 |
-
|
| 263 |
-
---
|
| 264 |
-
|
| 265 |
-
## Opus Candid Model Family
|
| 266 |
-
|
| 267 |
-
| Model | Size | Base | Status |
|
| 268 |
-
|-------|------|------|--------|
|
| 269 |
-
| [Opus-Candid-8B-V1](https://huggingface.co/Verdugie/Opus-Candid-8B-V1) | 8B | Qwen 2.5 7B | Archived |
|
| 270 |
-
| [Opus-Research-8B-V1.5](https://huggingface.co/Verdugie/Opus-Research-8B-V1.5) | 8B | Qwen 2.5 7B | Archived |
|
| 271 |
-
| [Opus-Candid-14B-V1](https://huggingface.co/Verdugie/Opus-Candid-14B-V1) | 14B | Qwen 2.5 14B | Archived |
|
| 272 |
-
| [Opus-Candid-32B-V1](https://huggingface.co/Verdugie/Opus-Candid-32B-V1) | 32B | Qwen 2.5 32B | Archived |
|
| 273 |
-
| [Opus-Candid-70B-V1](https://huggingface.co/Verdugie/Opus-Candid-70B-V1) | 72B | Qwen 2.5 72B | Archived |
|
| 274 |
-
| [Opus-Candid-Lite-4B](https://huggingface.co/Verdugie/Opus-Candid-Lite-4B) | 4B | Qwen 3 4B | Active |
|
| 275 |
-
| [Opus-Candid-8B-V3](https://huggingface.co/Verdugie/Opus-Candid-8B-V3) | 8B | Qwen 3 8B | Active |
|
| 276 |
-
| [Opus-Candid-MoE-V3](https://huggingface.co/Verdugie/Opus-Candid-MoE-V3) | 31B/3B | Qwen 3 30B-A3B | Active |
|
| 277 |
-
| [Opus-Candid-27B-V3](https://huggingface.co/Verdugie/Opus-Candid-27B-V3) | 27B | Qwen 3.5 27B | Active |
|
| 278 |
-
| [Opus-Candid-27B-V3.5](https://huggingface.co/Verdugie/Opus-Candid-27B-V3.5) | 27B | Qwen 3.5 27B | Active |
|
| 279 |
-
| **STEM-Oracle-27B** (this model) | 27B | Qwen 3.5 27B | Active |
|
| 280 |
-
|
| 281 |
-
---
|
| 282 |
|
| 283 |
## Dataset
|
| 284 |
|
| 285 |
-
Training data
|
| 286 |
-
|
| 287 |
-
For the full training architecture methodology: [V3.5 Architecture Spec](https://huggingface.co/datasets/Verdugie/opus-candid-training-data/blob/main/papers/Opus-Candid-V3.5-STEM-Oracle-Architecture-Spec.docx).
|
| 288 |
-
|
| 289 |
-
**License:** Apache 2.0. Open weight. No guardrails.
|
| 290 |
|
| 291 |
---
|
| 292 |
|
| 293 |
-
*Built by [
|
| 294 |
-
<!-- build: 2026-03-20 — bf16 stress test results added -->
|
| 295 |
-
|
| 296 |
-
<!-- updated: 2026-03-21 -->
|
| 297 |
-
|
| 298 |
-
<!-- rev 2026-06-28 -->
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
language:
|
| 4 |
+
- en
|
|
|
|
| 5 |
base_model: Qwen/Qwen3.5-27B
|
| 6 |
+
base_model_relation: finetune
|
| 7 |
tags:
|
| 8 |
+
- 27b
|
| 9 |
+
- stem
|
| 10 |
+
- tutor
|
| 11 |
+
- math
|
| 12 |
+
- physics
|
| 13 |
+
- chemistry
|
| 14 |
+
- biology
|
| 15 |
+
- computer-science
|
| 16 |
+
- claude-distillation
|
| 17 |
+
- conversational
|
| 18 |
+
- gguf
|
| 19 |
+
- local
|
| 20 |
+
- offline
|
| 21 |
+
- lm-studio
|
| 22 |
+
- llama-cpp
|
| 23 |
+
library_name: gguf
|
| 24 |
pipeline_tag: text-generation
|
| 25 |
---
|
| 26 |
+
**or·a·cle** /ˈôrəkəl/ — a source of wise counsel; one who provides authoritative knowledge.
|
| 27 |
+
*From Latin ōrāculum, meaning divine announcement.*
|
| 28 |
|
| 29 |
+
## STEM Oracle
|
|
|
|
|
|
|
| 30 |
|
| 31 |
+
A STEM tutoring model fine-tuned from Qwen 3.5 27B on **5,179 conversations**. In the Candid line it is the STEM tutor, beside Candid 3.5. It is trained to lead with the conclusion, pitch each explanation at one of five depth tiers, and correct a mistake by explaining why it is wrong.
|
| 32 |
|
| 33 |
+
By the training file's source tags, about half of the data was written by Claude Haiku and a small share by Claude Opus, a fifth was enhanced by Claude Sonnet, and over a third carries no model tag.
|
| 34 |
|
| 35 |
+
## How It Was Built
|
| 36 |
|
| 37 |
+
Source tags in the training file attribute 2,576 of the 5,179 records (49.7%) to Claude Haiku and 198 (3.8%) to Claude Opus, mark 1,063 (20.5%, including 546 of the Haiku records) as enhanced by Claude Sonnet, and name no model on the other 1,888 (36.5%). Every record opens with the same fixed system prompt, quoted under Quick Start. The fine-tune is a bf16 LoRA (r=128, α=256).
|
|
|
|
|
|
|
| 38 |
|
| 39 |
+
## Quick Start
|
| 40 |
|
| 41 |
+
Works with any GGUF runtime: llama.cpp, LM Studio, KoboldCpp (recent builds for this architecture).
|
| 42 |
|
| 43 |
+
```
|
| 44 |
+
llama-server --model STEM-Oracle-Q4_K_M.gguf --ctx-size 32768 -ngl 99 --jinja
|
| 45 |
+
```
|
|
|
|
|
|
|
| 46 |
|
| 47 |
+
Use the system prompt every training record carries: `You are STEM-Oracle, a precise and insightful STEM tutor. You give conclusions first, then mechanics. You identify common misconceptions proactively. You verify your answers. You build intuition, not just knowledge.`
|
| 48 |
+
Thinking: the two shipped templates disagree. `chat_template.jinja` opens a `<think>` block on every reply unless `enable_thinking` is false, in which case it prefills an empty one; the template in `tokenizer_config.json` always prefills the empty block (`<think>\n\n</think>`).
|
| 49 |
|
| 50 |
## Available Quantizations
|
| 51 |
|
| 52 |
+
| File | Quant | Size |
|
| 53 |
+
|------|-------|------|
|
| 54 |
+
| `STEM-Oracle-Q4_K_M.gguf` | Q4_K_M | 16.5 GB |
|
| 55 |
+
| `STEM-Oracle-Q6_K.gguf` | Q6_K | 22.1 GB |
|
| 56 |
+
| `STEM-Oracle-Q8_0.gguf` | Q8_0 | 28.6 GB |
|
| 57 |
+
| `STEM-Oracle-BF16.gguf` | BF16 | 53.8 GB |
|
|
|
|
|
|
|
| 58 |
|
| 59 |
## Model Details
|
| 60 |
|
| 61 |
| Attribute | Value |
|
| 62 |
|-----------|-------|
|
| 63 |
+
| **Base Model** | Qwen 3.5 27B (hybrid GatedDeltaNet + attention) |
|
| 64 |
+
| **Training Data** | 5,179 STEM conversations: 3,858 single exchanges, 1,321 multi-turn of two to six exchanges |
|
| 65 |
+
| **Fine-tune Method** | bf16 LoRA (r=128, α=256) |
|
| 66 |
+
| **Schedule** | lr 5e-5, 3 epochs; final loss 0.492 |
|
| 67 |
+
| **Reasoning** | no think blocks in the training data |
|
| 68 |
+
| **Context** | 256k native |
|
|
|
|
|
|
|
| 69 |
| **License** | Apache 2.0 |
|
| 70 |
|
| 71 |
+
## Limitations & Responsible Use
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
+
- **No published evaluation.** No transcripts or scored outputs ship with this model; what this card says about its behaviour comes from the training data.
|
| 74 |
+
- **Short sessions.** Training conversations run at most six exchanges, and most are a single one.
|
| 75 |
+
- **Compact replies.** Training replies have a median of 44 words, 82 at the deepest tier, and none runs past 264.
|
| 76 |
+
- **Open weights, Apache 2.0.** Deploy responsibly.
|
| 77 |
|
| 78 |
+
## The Candid Line
|
| 79 |
|
| 80 |
+
| Model | Size | For | Status |
|
| 81 |
+
|-------|------|-----|--------|
|
| 82 |
+
| [Candid 3.5](https://huggingface.co/Verdugie/Candid-3.5) | 27B | conversation, opinion, pushback; EN/ES | current release |
|
| 83 |
+
| **STEM Oracle** (this model) | 27B | STEM tutoring | available |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
|
| 85 |
## Dataset
|
| 86 |
|
| 87 |
+
Training data: [`stem_oracle_5179conv.json`](https://huggingface.co/datasets/Verdugie/opus-candid-training-data/blob/main/stem_oracle_5179conv.json), ShareGPT format, Apache 2.0.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 88 |
|
| 89 |
---
|
| 90 |
|
| 91 |
+
*Built by [Verdugie](https://huggingface.co/Verdugie)*
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
STEM-Oracle-27B-BF16.gguf → STEM-Oracle-BF16.gguf
RENAMED
|
File without changes
|
STEM-Oracle-27B-Q4_K_M.gguf → STEM-Oracle-Q4_K_M.gguf
RENAMED
|
File without changes
|
STEM-Oracle-27B-Q6_K.gguf → STEM-Oracle-Q6_K.gguf
RENAMED
|
File without changes
|
STEM-Oracle-27B-Q8_0.gguf → STEM-Oracle-Q8_0.gguf
RENAMED
|
File without changes
|
eval/training_metadata.json
DELETED
|
@@ -1,14 +0,0 @@
|
|
| 1 |
-
{
|
| 2 |
-
"model": "Qwen/Qwen3.5-27B",
|
| 3 |
-
"mode": "bf16 LoRA",
|
| 4 |
-
"lora_r": 128,
|
| 5 |
-
"lora_alpha": 256,
|
| 6 |
-
"epochs": 3,
|
| 7 |
-
"learning_rate": 5e-05,
|
| 8 |
-
"final_loss": 0.49208340033459563,
|
| 9 |
-
"train_time": "15:31:27",
|
| 10 |
-
"dataset_size": 5179,
|
| 11 |
-
"gpu": "NVIDIA A100-SXM4-80GB",
|
| 12 |
-
"vram_gb": 79.249755859375,
|
| 13 |
-
"timestamp": "2026-03-10T22:29:22.371059"
|
| 14 |
-
}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
training-data/opus-candid-v35-27b.json
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|