--- license: apache-2.0 language: - en base_model: Qwen/Qwen3.5-27B base_model_relation: finetune tags: - 27b - stem - tutor - math - physics - chemistry - biology - computer-science - claude-distillation - conversational - gguf - local - offline - lm-studio - llama-cpp library_name: gguf pipeline_tag: text-generation --- **or·a·cle** /ˈôrəkəl/ — a source of wise counsel; one who provides authoritative knowledge. *From Latin ōrāculum, meaning divine announcement.* ## STEM Oracle A STEM tutoring model fine-tuned from Qwen 3.5 27B on **5,179 conversations**. In the Candid line it is the STEM tutor, beside Candid 3.5. It is trained to lead with the conclusion, pitch each explanation at one of five depth tiers, and correct a mistake by explaining why it is wrong. By the training file's source tags, about half of the data was written by Claude Haiku and a small share by Claude Opus, a fifth was enhanced by Claude Sonnet, and over a third carries no model tag. ## How It Was Built Source tags in the training file attribute 2,576 of the 5,179 records (49.7%) to Claude Haiku and 198 (3.8%) to Claude Opus, mark 1,063 (20.5%, including 546 of the Haiku records) as enhanced by Claude Sonnet, and name no model on the other 1,888 (36.5%). Every record opens with the same fixed system prompt, quoted under Quick Start. The fine-tune is a bf16 LoRA (r=128, α=256). ## Quick Start Works with any GGUF runtime: llama.cpp, LM Studio, KoboldCpp (recent builds for this architecture). ``` llama-server --model STEM-Oracle-Q4_K_M.gguf --ctx-size 32768 -ngl 99 --jinja ``` Use the system prompt every training record carries: `You are STEM-Oracle, a precise and insightful STEM tutor. You give conclusions first, then mechanics. You identify common misconceptions proactively. You verify your answers. You build intuition, not just knowledge.` Thinking: the two shipped templates disagree. `chat_template.jinja` opens a `` block on every reply unless `enable_thinking` is false, in which case it prefills an empty one; the template in `tokenizer_config.json` always prefills the empty block (`\n\n`). ## Available Quantizations | File | Quant | Size | |------|-------|------| | `STEM-Oracle-Q4_K_M.gguf` | Q4_K_M | 16.5 GB | | `STEM-Oracle-Q6_K.gguf` | Q6_K | 22.1 GB | | `STEM-Oracle-Q8_0.gguf` | Q8_0 | 28.6 GB | | `STEM-Oracle-BF16.gguf` | BF16 | 53.8 GB | ## Model Details | Attribute | Value | |-----------|-------| | **Base Model** | Qwen 3.5 27B (hybrid GatedDeltaNet + attention) | | **Training Data** | 5,179 STEM conversations: 3,858 single exchanges, 1,321 multi-turn of two to six exchanges | | **Fine-tune Method** | bf16 LoRA (r=128, α=256) | | **Schedule** | lr 5e-5, 3 epochs; final loss 0.492 | | **Reasoning** | no think blocks in the training data | | **Context** | 256k native | | **License** | Apache 2.0 | ## Limitations & Responsible Use - **No published evaluation.** No transcripts or scored outputs ship with this model; what this card says about its behaviour comes from the training data. - **Short sessions.** Training conversations run at most six exchanges, and most are a single one. - **Compact replies.** Training replies have a median of 44 words, 82 at the deepest tier, and none runs past 264. - **Open weights, Apache 2.0.** Deploy responsibly. ## The Candid Line | Model | Size | For | Status | |-------|------|-----|--------| | [Candid 3.5](https://huggingface.co/Verdugie/Candid-3.5) | 27B | conversation, opinion, pushback; EN/ES | current release | | **STEM Oracle** (this model) | 27B | STEM tutoring | available | ## Dataset Training data: [`stem_oracle_5179conv.json`](https://huggingface.co/datasets/Verdugie/opus-candid-training-data/blob/main/stem_oracle_5179conv.json), ShareGPT format, Apache 2.0. --- *Built by [Verdugie](https://huggingface.co/Verdugie)*