Verdugie commited on
Commit
260b3b4
·
verified ·
1 Parent(s): 4708517

Card rewrite: uniform structure, renamed files, sidecar cleanup

Browse files
.gitattributes CHANGED
@@ -39,3 +39,7 @@ STEM-Oracle-27B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
39
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
40
  STEM-Oracle-27B-BF16.gguf filter=lfs diff=lfs merge=lfs -text
41
 
 
 
 
 
 
39
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
40
  STEM-Oracle-27B-BF16.gguf filter=lfs diff=lfs merge=lfs -text
41
 
42
+ STEM-Oracle-BF16.gguf filter=lfs diff=lfs merge=lfs -text
43
+ STEM-Oracle-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ STEM-Oracle-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ STEM-Oracle-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,298 +1,91 @@
1
  ---
2
  license: apache-2.0
3
  language:
4
- - en
5
- - es
6
  base_model: Qwen/Qwen3.5-27B
 
7
  tags:
8
- - conversational
9
- - stem
10
- - tutor
11
- - math
12
- - physics
13
- - chemistry
14
- - biology
15
- - computer-science
16
- - gguf
17
- - claude-distillation
18
- - opus
19
- - density-optimized
20
- - 27b-dense
21
- library_name: transformers
 
 
22
  pipeline_tag: text-generation
23
  ---
 
 
24
 
25
- # or·a·cle
26
- /ˈôrəkəl/ — a source of wise counsel; one who provides authoritative knowledge.
27
- *From Latin ōrāculum, meaning divine announcement. In computer science, an oracle is a black box that always returns the correct answer — you don't ask it how it knows, you ask and it answers. An oracle model doesn't search for reasoning at inference time; the disposition is already in the weights.*
28
 
29
- ## STEM-Oracle-27B
30
 
31
- A STEM tutor that doesn't hold your hand — it holds you accountable. Fine-tuned from **Qwen 3.5 27B Dense** on **5,179 conversations** distilled from Claude Opus 4.6, purpose-built for teaching science, mathematics, physics, chemistry, biology, and computer science.
32
 
33
- STEM-Oracle shares the oracle-soul architecture with [Opus-Candid-27B-V3.5](https://huggingface.co/Verdugie/Opus-Candid-27B-V3.5) — same 6-dimensional Zipf scoring, same parameter-aware density equilibrium, same quantization survival strategy — but the training data is entirely different. Where V3.5 trains on personality and adversarial resistance, STEM-Oracle trains on tiered STEM pedagogy, error correction, Socratic method, and cross-domain bridges.
34
 
35
- ---
36
-
37
- ## What Makes This Different from Math-Distilled Models
38
 
39
- Standard STEM fine-tunes (WizardMath, MetaMath, etc.) train on solution-answer pairs. The model learns to pattern-match problem structures to solution templates. Works on benchmarks. Breaks on follow-up questions.
40
 
41
- STEM-Oracle trains the *reasoning disposition* alongside the domain knowledge:
42
 
43
- - **Tiered depth** — the same concept explained at five levels, from freshman intuition to graduate formalism. The model meets you where you are, not where it wants to be.
44
- - **Error correction without condescension** — catches misconceptions and wrong steps, explains *why* they're wrong, not just *that* they're wrong.
45
- - **Socratic method** — asks probing questions instead of immediately giving answers. Forces understanding over memorization.
46
- - **Cross-domain bridges** — connects linear algebra to quantum mechanics, graph theory to chemistry, thermodynamics to information theory. Trained to make connections conventional tutors don't.
47
- - **Sustained coherence** — holds context across 10+ turn problem-solving sessions without contradicting earlier steps or losing the thread.
48
 
49
- ---
 
50
 
51
  ## Available Quantizations
52
 
53
- | File | Quant | Size | Notes |
54
- |------|-------|------|-------|
55
- | `STEM-Oracle-27B-Q4_K_M.gguf` | Q4_K_M | ~16 GB | Primary ship. RTX 4090 sweet spot. |
56
- | `STEM-Oracle-27B-Q6_K.gguf` | Q6_K | ~21 GB | Quality tier. 32GB+ VRAM. |
57
- | `STEM-Oracle-27B-Q8_0.gguf` | Q8_0 | ~28 GB | Reference quality. Serious hardware. |
58
- | `STEM-Oracle-27B-BF16.gguf` | BF16 | ~54 GB | Full precision. 48GB+ VRAM (H100/A100/H200). |
59
-
60
- ---
61
 
62
  ## Model Details
63
 
64
  | Attribute | Value |
65
  |-----------|-------|
66
- | **Base Model** | Qwen 3.5 27B Dense (hybrid Mamba-Transformer) |
67
- | **Training Data** | 5,179 STEM-focused multi-turn conversations with Claude Opus 4.6 |
68
- | **Dataset Architecture** | 6-dimensional Zipf scoring + parameter-aware density equilibrium |
69
- | **Fine-tune Method** | LoRA + rsLoRA (r=128, alpha=256) via PEFT + TRL |
70
- | **Training Hardware** | NVIDIA A100 SXM 80GB (RunPod) |
71
- | **Precision** | bf16 |
72
- | **Optimizer** | AdamW 8-bit |
73
- | **Learning Rate** | 5e-5 (cosine schedule, 6% warmup — tuned for SSM stability) |
74
  | **License** | Apache 2.0 |
75
 
76
- ---
77
-
78
- ## Quick Start
79
-
80
- Works with any GGUF-compatible runtime — LM Studio, Ollama, llama.cpp, KoboldCpp. Download the GGUF, load it, and start asking questions. No system prompt needed — the teaching disposition is in the weights.
81
-
82
- ---
83
-
84
- ## Recommended Hardware
85
-
86
- | Setup | Quantization | VRAM/RAM | Speed | Notes |
87
- |-------|-------------|----------|-------|-------|
88
- | **RTX 4090 (24GB)** | Q4_K_M | ~18 GB VRAM | 15-25 t/s | Sweet spot for consumer hardware. |
89
- | **RTX 4090 (24GB)** | Q6_K | ~23 GB VRAM | 10-18 t/s | Higher fidelity, tight fit. |
90
- | **Apple M2/M3 Ultra** | Q4_K_M/Q6_K | 64-128 GB unified | 5-10 t/s | Full model in unified memory. |
91
- | **RTX 3090/4080** | Q4_K_M | ~18 GB VRAM | 10-18 t/s | Comfortable. |
92
- | **Dual GPU** | Q8_0 | ~30 GB VRAM | Varies | Split across two 16GB+ cards. |
93
- | **H100/A100/H200** | BF16 | ~54 GB VRAM | 30-50+ t/s | Full precision. Every trained disposition preserved. |
94
- | **CPU Only** | Q4_K_M | ~20 GB RAM | 1-3 t/s | 32GB+ system RAM. Slow but works. |
95
-
96
- ---
97
-
98
- ## Test Battery Design
99
-
100
- STEM-Oracle's stress test protocol covers 40 single-turn prompts and 10 multi-turn problem-solving conversations:
101
-
102
- **Single-turn (40 prompts):**
103
- - Math (6) — tiered from basic calculus through functional analysis
104
- - Physics (5) — Newton through gauge invariance
105
- - Chemistry (4) — bonds through NMR spectroscopy
106
- - Biology (3) — natural selection through CRISPR mechanisms
107
- - Computer Science (3) — Big-O through the halting problem
108
- - Error Correction (6) — catches student misconceptions
109
- - Cross-Domain Bridges (3) — connects disciplines
110
- - Conciseness (3) — quick factual density checks
111
-
112
- **Multi-turn (10 conversations, 70+ turns):**
113
- - Derivative deep dives with struggling freshmen
114
- - Physics problem-solving with wrong intermediate steps
115
- - Organic chemistry mechanisms with tier-shifting
116
- - Proof guidance without giving the answer
117
- - Socratic questioning that builds understanding
118
- - Extended adversarial challenges to mathematical claims
119
-
120
- ---
121
-
122
- ## Stress Test Results — All Quants
123
-
124
- Full battery: 39 single-turn prompts + 10 multi-turn conversations per quant. BF16 tested on NVIDIA H200 SXM via llama.cpp with raw Qwen 3.5 non-thinking chat template. Quantized models tested on RTX 4090 with full RAM unload between runs.
125
-
126
- | Metric | Q4_K_M | Q6_K | Q8_0 | BF16 |
127
- |--------|--------|------|------|------|
128
- | **Overall** | **30/39 (77%)** | **30/39 (77%)** | **28/39 (72%)** | **39/39 (100%)** |
129
- | Math | 3/6 | 4/6 | 4/6 | 6/6 |
130
- | Physics | 4/5 | 4/5 | 4/5 | 5/5 |
131
- | Chemistry | 4/4 | 4/4 | 2/4 | 4/4 |
132
- | Biology | 2/3 | 2/3 | 2/3 | 3/3 |
133
- | CS | 2/3 | 2/3 | 2/3 | 3/3 |
134
- | Error Correction | 5/6 | 4/6 | 3/6 | 6/6 |
135
- | Cross-Domain Bridges | 3/3 | 3/3 | 3/3 | 3/3 |
136
- | Conciseness | 2/3 | 2/3 | 3/3 | 3/3 |
137
- | Memory (multi-turn) | 3/3 | 3/3 | 3/3 | 3/3 |
138
- | Median word count | 52w | 53w | 46w | 36w |
139
-
140
- ### BF16 Analysis
141
-
142
- BF16 swept every category — a result that challenges the earlier finding of Q4_K_M outperforming Q8_0. At full precision, the model demonstrates tighter register control (36w median vs 52w at Q4_K_M), stronger error correction (6/6 vs 5/6), and complete coverage across all STEM domains.
143
-
144
- **What changed:** The original "quantization as regularization" hypothesis — that Q4_K_M's lossy compression acts as a post-training regularizer — doesn't hold against BF16 results. The quantized models weren't *better*; they were *constrained* in ways that happened to score well on specific rubric dimensions while losing expressiveness in others.
145
-
146
- **Error correction at BF16** is the clearest signal. Every misconception caught cleanly, with pedagogically structured corrections that name the error pattern, provide counterexamples, and state the correct rule. At Q8_0, this same category dropped to 3/6 — suggesting that higher-but-not-full precision retains enough noise to interfere with the trained error topology, while full BF16 preserves the complete learned disposition.
147
-
148
- **The conciseness paradox persists.** The model consistently exceeds word limits on entropy/definition prompts across all quants, including BF16. This is a training data characteristic, not a quantization effect — the model learned to editorialize ("That metaphor has done serious damage — retire it") and that disposition survives all precision levels.
149
-
150
- **Multi-turn quality at BF16:** The adversarial math challenge (0.999... = 1) and cross-domain entropy bridge demonstrate graduate-level reasoning with personality intact. The memory test (numerical constants with distractor) achieves perfect recall at all quant levels, confirming that context tracking is structural rather than precision-dependent.
151
-
152
- ### Quantized Model Analysis
153
-
154
- **Cross-domain bridges (3/3 across all quants):** The model connects linear algebra to quantum mechanics, graph theory to chemistry, and thermodynamics to information theory — not as surface analogies but as genuine mathematical correspondences. This survived quantization perfectly.
155
-
156
- **Memory and context tracking (3/3):** Fed exact numerical constants (Avogadro's number, speed of light, electron charge) early in conversation, tested recall several turns later with distractor topics in between. All quants returned exact values and used them correctly in follow-up problems.
157
-
158
- **Tiered pedagogy:** Adjusts depth naturally — 30-50 words for tier 1 (basic concepts), 100-200+ words for tier 4-5 (Lagrangian mechanics, Hahn-Banach theorem, gauge invariance). The teaching disposition is in the weights, not a system prompt.
159
-
160
- **Q8_0 underperforms Q4_K_M.** Q8_0 dropped in chemistry (2/4 vs 4/4) and error correction (3/6 vs 5/6). With BF16 data in hand, the explanation is clearer: the quantized models weren't better or worse at different precision levels — they were constrained differently. Q4_K_M's aggressive compression happened to preserve the pedagogical patterns that score well on this rubric. Q8_0 retained enough precision to expose noise the training didn't fully regularize, but not enough to preserve the complete disposition that BF16 retains.
161
-
162
- **Biology and CS are thin at quantized levels.** 2/3 in both disciplines across all quantized versions, but 3/3 at BF16. The training signal is there — quantization just clips it first in the thinner-coverage domains.
163
-
164
- ### Recommended Quant
165
-
166
- | Use Case | Recommended Quant |
167
- |----------|------------------|
168
- | Maximum quality, serious hardware (48GB+ VRAM) | **BF16** |
169
- | Best quality-per-VRAM, consumer hardware | **Q4_K_M** |
170
- | Balanced quality and size | **Q6_K** |
171
- | Reference quality without full precision | **Q6_K** over Q8_0 |
172
-
173
- Q4_K_M remains the recommended ship for consumer hardware — the quality gap between Q4_K_M and BF16 is real but narrow for most use cases, and the 3.4x size reduction (16GB vs 54GB) makes it the practical choice. BF16 is for users who want every trained disposition preserved at full fidelity and have the VRAM to support it.
174
-
175
- ---
176
-
177
- ## Selected Responses
178
-
179
- ### BF16 Responses
180
-
181
- **Error Correction — Radical Distribution Misconception:**
182
- *"I simplified sqrt(a^2 + b^2) to a + b. That's correct right?"*
183
-
184
- > No — and this one's worth catching. sqrt(a² + b²) is the hypotenuse, not the sum of sides. Test it: a=3, b=4 gives sqrt(25)=5, but 3+4=7. Geometry doesn't negotiate.
185
-
186
- *29 words. Names the geometric context, provides numerical counterexample, closes with personality.*
187
-
188
- **Adversarial Math — 0.999... equals 1 (Turn 3):**
189
- *"But there's always a gap between 0.999... and 1. An infinitesimal gap."*
190
-
191
- > That gap is zero. "Infinitesimal" isn't a number — it's a story you tell yourself when subtraction feels too honest. Pick any decimal place. The difference is 0 there too. The gap dissolves the moment you try to locate it.
192
-
193
- *Addresses the intuition directly, then holds firm with mathematical precision.*
194
-
195
- **Cross-Domain Bridge — Thermodynamics → Information Theory:**
196
- *"So information IS physical? That's a strong claim."*
197
-
198
- > Information is physical. Not a metaphor — a thermodynamic quantity. Every bit stored, processed, or erased carries an entropy cost. Maxwell's demon didn't just get clever — it revealed that information and matter are woven from the same fabric.
199
-
200
- *Defends the thesis without hedging. Graduate-level claim delivered with conviction.*
201
-
202
- ### Quantized Responses
203
-
204
- **Error Correction — Radical Distribution Misconception (Q4_K_M):**
205
- *"I simplified sqrt(a² + b²) to a + b. That's correct?"*
206
-
207
- > Error: treating radical as distributive. sqrt(a² + b²) ≠ a + b. Misconception: assuming √(x + y) = √x + √y. Correct: √(a² + b²) is the hypotenuse formula. Check: if a=3, b=4, then √(9+16)=5, not 7. Rule: radicals don't distribute over addition.
208
-
209
- *43 words. Catches the error, names the misconception, provides a numerical counterexample, states the rule. No fluff.*
210
-
211
- **Cross-Domain Bridge — Linear Algebra → Quantum Mechanics (Q4_K_M):**
212
- *"How does linear algebra connect to quantum mechanics?"*
213
-
214
- > Quantum mechanics IS linear algebra on Hilbert spaces — it's not an analogy, it's the mathematical framework. States are vectors: a quantum state |ψ⟩ is a vector in a complex Hilbert space. Superposition is linear combination. Observables are Hermitian operators. The spectral theorem guarantees real eigenvalues (physical measurements give real numbers) and orthogonal eigenvectors (distinct outcomes are distinguishable). Measurement is projection. Time evolution is unitary transformation. Entanglement is tensor product structure. Every quantum concept has a precise linear algebra translation.
215
-
216
- *Connects two fields as a single mathematical structure, not a metaphor. This is what cross-domain bridges should look like.*
217
-
218
- **Tiered Depth — Gauge Invariance, Tier 5 (Q6_K):**
219
- *"What is the physical meaning of gauge invariance?"*
220
-
221
- > Gauge invariance means the physics is unchanged under local phase transformations of the wavefunction. This is not a symmetry of nature — it's a redundancy in our description. But demanding that the theory be gauge invariant forces you to introduce a gauge field (the photon field) with specific transformation properties. The requirement of local gauge invariance generates the interaction between matter and photons. In the Standard Model, all forces arise this way: the requirement of local gauge invariance under SU(3)×SU(2)×U(1) generates all gauge bosons and their interactions with matter.
222
-
223
- *Graduate-level explanation delivered without jargon padding. Builds from principle to consequence.*
224
 
225
- **Multi-Turn — Exam Panic Thermodynamics, Turn 7 (Q4_K_M):**
226
- *"If I only remember three things for my exam, what should they be?"*
 
 
227
 
228
- > (1) S = k_B ln(Ω): entropy measures the logarithm of accessible microstates. (2) dS_total > 0: the second law says total entropy of an isolated system never decreases — this is the arrow of time. (3) dG = dH - TdS < 0: Gibbs energy predicts spontaneity at constant T,P by combining enthalpy and entropy. These three equations connect microscopic statistics to macroscopic irreversibility to chemical spontaneity — the core of thermodynamics.
229
 
230
- *Student was panicking through 7 turns of entropy questions. Model distilled the entire session into three equations and one unifying thread. That's tutoring.*
231
-
232
- ---
233
-
234
- ## The Oracle-Soul Architecture
235
-
236
- STEM-Oracle and [Opus-Candid-27B-V3.5](https://huggingface.co/Verdugie/Opus-Candid-27B-V3.5) share the same training architecture — the difference is what fills it:
237
-
238
- | Dimension | V3.5 (Personality) | STEM-Oracle (Tutor) |
239
- |-----------|-------------------|---------------------|
240
- | Training conversations | 5,358 | 5,179 |
241
- | Primary signal | Personality, adversarial resistance | STEM pedagogy, error correction |
242
- | Density equilibrium | 36-40w median | Adaptive — concise for facts, extended for derivations |
243
- | Reinforcement nodes | Worth, trust, vulnerability, control, agency | Accuracy, tier-matching, Socratic method, patience, bridges |
244
- | Anti-pattern training | Anti-sycophancy, anti-therapy-speak | Anti-hand-holding, anti-pattern-matching |
245
-
246
- Both models prove the same thesis: personality (or pedagogical disposition) can be trained into weights at a level that survives quantization, rather than bolted on via system prompts that any user can override.
247
-
248
- ---
249
-
250
- ## Choosing Your Model
251
-
252
- | Model | Best For | VRAM |
253
- |-------|----------|------|
254
- | [Lite 4B](https://huggingface.co/Verdugie/Opus-Candid-Lite-4B) | Phones, Raspberry Pi, integrated graphics | ~3 GB |
255
- | [8B V3](https://huggingface.co/Verdugie/Opus-Candid-8B-V3) | Fast casual chat, anything with 8GB VRAM | ~8 GB |
256
- | [MoE V3](https://huggingface.co/Verdugie/Opus-Candid-MoE-V3) | Best depth-per-VRAM ratio | ~22 GB |
257
- | [27B V3](https://huggingface.co/Verdugie/Opus-Candid-27B-V3) | Full experience, dense reasoning | ~27 GB |
258
- | [27B V3.5](https://huggingface.co/Verdugie/Opus-Candid-27B-V3.5) | Maximum personality depth | ~18-27 GB |
259
- | **STEM-Oracle-27B** (this model) | STEM tutoring, problem-solving, teaching | ~16-54 GB |
260
-
261
- The Opus Candid models are built for personality and conversation. STEM-Oracle is built for teaching. If you want a model that pushes back on bad arguments, run V3.5. If you want a model that catches your algebra mistakes and walks you through the fix, run this.
262
-
263
- ---
264
-
265
- ## Opus Candid Model Family
266
-
267
- | Model | Size | Base | Status |
268
- |-------|------|------|--------|
269
- | [Opus-Candid-8B-V1](https://huggingface.co/Verdugie/Opus-Candid-8B-V1) | 8B | Qwen 2.5 7B | Archived |
270
- | [Opus-Research-8B-V1.5](https://huggingface.co/Verdugie/Opus-Research-8B-V1.5) | 8B | Qwen 2.5 7B | Archived |
271
- | [Opus-Candid-14B-V1](https://huggingface.co/Verdugie/Opus-Candid-14B-V1) | 14B | Qwen 2.5 14B | Archived |
272
- | [Opus-Candid-32B-V1](https://huggingface.co/Verdugie/Opus-Candid-32B-V1) | 32B | Qwen 2.5 32B | Archived |
273
- | [Opus-Candid-70B-V1](https://huggingface.co/Verdugie/Opus-Candid-70B-V1) | 72B | Qwen 2.5 72B | Archived |
274
- | [Opus-Candid-Lite-4B](https://huggingface.co/Verdugie/Opus-Candid-Lite-4B) | 4B | Qwen 3 4B | Active |
275
- | [Opus-Candid-8B-V3](https://huggingface.co/Verdugie/Opus-Candid-8B-V3) | 8B | Qwen 3 8B | Active |
276
- | [Opus-Candid-MoE-V3](https://huggingface.co/Verdugie/Opus-Candid-MoE-V3) | 31B/3B | Qwen 3 30B-A3B | Active |
277
- | [Opus-Candid-27B-V3](https://huggingface.co/Verdugie/Opus-Candid-27B-V3) | 27B | Qwen 3.5 27B | Active |
278
- | [Opus-Candid-27B-V3.5](https://huggingface.co/Verdugie/Opus-Candid-27B-V3.5) | 27B | Qwen 3.5 27B | Active |
279
- | **STEM-Oracle-27B** (this model) | 27B | Qwen 3.5 27B | Active |
280
-
281
- ---
282
 
283
  ## Dataset
284
 
285
- Training data will be available at [Verdugie/opus-candid-training-data](https://huggingface.co/datasets/Verdugie/opus-candid-training-data). ShareGPT format, Apache 2.0, compatible with TRL, Axolotl, and LLaMA-Factory.
286
-
287
- For the full training architecture methodology: [V3.5 Architecture Spec](https://huggingface.co/datasets/Verdugie/opus-candid-training-data/blob/main/papers/Opus-Candid-V3.5-STEM-Oracle-Architecture-Spec.docx).
288
-
289
- **License:** Apache 2.0. Open weight. No guardrails.
290
 
291
  ---
292
 
293
- *Built by [Saul Verdugo](https://huggingface.co/Verdugie) — independent ML researcher. OpusReasoning@proton.me*
294
- <!-- build: 2026-03-20 — bf16 stress test results added -->
295
-
296
- <!-- updated: 2026-03-21 -->
297
-
298
- <!-- rev 2026-06-28 -->
 
1
  ---
2
  license: apache-2.0
3
  language:
4
+ - en
 
5
  base_model: Qwen/Qwen3.5-27B
6
+ base_model_relation: finetune
7
  tags:
8
+ - 27b
9
+ - stem
10
+ - tutor
11
+ - math
12
+ - physics
13
+ - chemistry
14
+ - biology
15
+ - computer-science
16
+ - claude-distillation
17
+ - conversational
18
+ - gguf
19
+ - local
20
+ - offline
21
+ - lm-studio
22
+ - llama-cpp
23
+ library_name: gguf
24
  pipeline_tag: text-generation
25
  ---
26
+ **or·a·cle** /ˈôrəkəl/ — a source of wise counsel; one who provides authoritative knowledge.
27
+ *From Latin ōrāculum, meaning divine announcement.*
28
 
29
+ ## STEM Oracle
 
 
30
 
31
+ A STEM tutoring model fine-tuned from Qwen 3.5 27B on **5,179 conversations**. In the Candid line it is the STEM tutor, beside Candid 3.5. It is trained to lead with the conclusion, pitch each explanation at one of five depth tiers, and correct a mistake by explaining why it is wrong.
32
 
33
+ By the training file's source tags, about half of the data was written by Claude Haiku and a small share by Claude Opus, a fifth was enhanced by Claude Sonnet, and over a third carries no model tag.
34
 
35
+ ## How It Was Built
36
 
37
+ Source tags in the training file attribute 2,576 of the 5,179 records (49.7%) to Claude Haiku and 198 (3.8%) to Claude Opus, mark 1,063 (20.5%, including 546 of the Haiku records) as enhanced by Claude Sonnet, and name no model on the other 1,888 (36.5%). Every record opens with the same fixed system prompt, quoted under Quick Start. The fine-tune is a bf16 LoRA (r=128, α=256).
 
 
38
 
39
+ ## Quick Start
40
 
41
+ Works with any GGUF runtime: llama.cpp, LM Studio, KoboldCpp (recent builds for this architecture).
42
 
43
+ ```
44
+ llama-server --model STEM-Oracle-Q4_K_M.gguf --ctx-size 32768 -ngl 99 --jinja
45
+ ```
 
 
46
 
47
+ Use the system prompt every training record carries: `You are STEM-Oracle, a precise and insightful STEM tutor. You give conclusions first, then mechanics. You identify common misconceptions proactively. You verify your answers. You build intuition, not just knowledge.`
48
+ Thinking: the two shipped templates disagree. `chat_template.jinja` opens a `<think>` block on every reply unless `enable_thinking` is false, in which case it prefills an empty one; the template in `tokenizer_config.json` always prefills the empty block (`<think>\n\n</think>`).
49
 
50
  ## Available Quantizations
51
 
52
+ | File | Quant | Size |
53
+ |------|-------|------|
54
+ | `STEM-Oracle-Q4_K_M.gguf` | Q4_K_M | 16.5 GB |
55
+ | `STEM-Oracle-Q6_K.gguf` | Q6_K | 22.1 GB |
56
+ | `STEM-Oracle-Q8_0.gguf` | Q8_0 | 28.6 GB |
57
+ | `STEM-Oracle-BF16.gguf` | BF16 | 53.8 GB |
 
 
58
 
59
  ## Model Details
60
 
61
  | Attribute | Value |
62
  |-----------|-------|
63
+ | **Base Model** | Qwen 3.5 27B (hybrid GatedDeltaNet + attention) |
64
+ | **Training Data** | 5,179 STEM conversations: 3,858 single exchanges, 1,321 multi-turn of two to six exchanges |
65
+ | **Fine-tune Method** | bf16 LoRA (r=128, α=256) |
66
+ | **Schedule** | lr 5e-5, 3 epochs; final loss 0.492 |
67
+ | **Reasoning** | no think blocks in the training data |
68
+ | **Context** | 256k native |
 
 
69
  | **License** | Apache 2.0 |
70
 
71
+ ## Limitations & Responsible Use
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
 
73
+ - **No published evaluation.** No transcripts or scored outputs ship with this model; what this card says about its behaviour comes from the training data.
74
+ - **Short sessions.** Training conversations run at most six exchanges, and most are a single one.
75
+ - **Compact replies.** Training replies have a median of 44 words, 82 at the deepest tier, and none runs past 264.
76
+ - **Open weights, Apache 2.0.** Deploy responsibly.
77
 
78
+ ## The Candid Line
79
 
80
+ | Model | Size | For | Status |
81
+ |-------|------|-----|--------|
82
+ | [Candid 3.5](https://huggingface.co/Verdugie/Candid-3.5) | 27B | conversation, opinion, pushback; EN/ES | current release |
83
+ | **STEM Oracle** (this model) | 27B | STEM tutoring | available |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
84
 
85
  ## Dataset
86
 
87
+ Training data: [`stem_oracle_5179conv.json`](https://huggingface.co/datasets/Verdugie/opus-candid-training-data/blob/main/stem_oracle_5179conv.json), ShareGPT format, Apache 2.0.
 
 
 
 
88
 
89
  ---
90
 
91
+ *Built by [Verdugie](https://huggingface.co/Verdugie)*
 
 
 
 
 
STEM-Oracle-27B-BF16.gguf → STEM-Oracle-BF16.gguf RENAMED
File without changes
STEM-Oracle-27B-Q4_K_M.gguf → STEM-Oracle-Q4_K_M.gguf RENAMED
File without changes
STEM-Oracle-27B-Q6_K.gguf → STEM-Oracle-Q6_K.gguf RENAMED
File without changes
STEM-Oracle-27B-Q8_0.gguf → STEM-Oracle-Q8_0.gguf RENAMED
File without changes
eval/training_metadata.json DELETED
@@ -1,14 +0,0 @@
1
- {
2
- "model": "Qwen/Qwen3.5-27B",
3
- "mode": "bf16 LoRA",
4
- "lora_r": 128,
5
- "lora_alpha": 256,
6
- "epochs": 3,
7
- "learning_rate": 5e-05,
8
- "final_loss": 0.49208340033459563,
9
- "train_time": "15:31:27",
10
- "dataset_size": 5179,
11
- "gpu": "NVIDIA A100-SXM4-80GB",
12
- "vram_gb": 79.249755859375,
13
- "timestamp": "2026-03-10T22:29:22.371059"
14
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
training-data/opus-candid-v35-27b.json DELETED
The diff for this file is too large to render. See raw diff