File size: 2,252 Bytes
45b6ae4 96ad5fe 45b6ae4 296ec82 8fda5b5 296ec82 8fda5b5 296ec82 8fda5b5 296ec82 8fda5b5 296ec82 8fda5b5 45b6ae4 8fda5b5 45b6ae4 8fda5b5 45b6ae4 8fda5b5 45b6ae4 8fda5b5 45b6ae4 8fda5b5 296ec82 8fda5b5 45b6ae4 8fda5b5 45b6ae4 8fda5b5 45b6ae4 8fda5b5 45b6ae4 8fda5b5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 | ---
library_name: transformers
pipeline_tag: text-generation
license: other
license_name: orion-t2-research
tags:
- project-prism
- orion
- orion-t2
- custom-code
- causal-lm
- instruction-tuned
- conversational
base_model: Project-Prism/Orion-Flagship-Mini-Preview
---
# 🔺 Orion T2 Mini SFT
**Orion T2 Mini SFT** is the supervised-fine-tuned assistant variant of Project Prism's experimental Orion T2 architecture.
It starts from the completed Orion T2 Mini base checkpoint and was then trained with response-only SFT on 700,000 examples: 60% general/conversation, 20% math, and 20% code.
## Chat format
Use the bundled Hugging Face chat template. The model was trained with literal text role markers `<|system|>`, `<|user|>`, and `<|assistant|>`. Those markers were **not** added as new tokenizer special tokens.
```python
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
repo = "Project-Prism/Orion-Flagship-Mini-SFT"
tokenizer = AutoTokenizer.from_pretrained(repo, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
repo, trust_remote_code=True, torch_dtype=torch.bfloat16, device_map="auto"
)
messages = [
{"role": "system", "content": "You are Orion, a helpful AI assistant."},
{"role": "user", "content": "Explain why the sky is blue."},
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
with torch.inference_mode():
output = model.generate(**inputs, max_new_tokens=128, temperature=0.7, top_p=0.95, do_sample=True, use_cache=False)
new_tokens = output[0, inputs["input_ids"].shape[1]:]
print(tokenizer.decode(new_tokens, skip_special_tokens=True))
```
## Architecture
Orion T2 Mini has approximately 219M total parameters and combines a 12-stage Universal Cortex, shared sparse Procedure Banks, a sparse Knowledge Vault, explicit Working State, and recurrent late-stage deliberation.
The current Transformers compatibility layer uses `use_cache=False`, so generation recomputes the prefix each token.
## Status
Experimental Project Prism research model. Architecture claims should be judged with matched evaluations rather than assumed from the design alone.
|