Spaces:
Running
Running
File size: 2,128 Bytes
5ef256b 38b1c97 db25714 38b1c97 d248f6e 38b1c97 98efd3a 86255a1 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 | ---
title: README
emoji: 🚀
colorFrom: gray
colorTo: gray
sdk: static
pinned: false
---
# Refract AI Labs
**Refract AI Labs** is an experimental AI research group focused on efficient language-model architectures, compact reasoning systems, and unconventional alternatives to standard dense Transformers.
We build small models, weird architectures, and research prototypes with one main goal:
> **Maximum capability, minimum parameters.**
## News
**28 September 2026** Refract AI is now a seperate group from smilyai!
**29 September 2026** We have collected over 50B tokens in preperation for the Orion-T2.1 Pretraining run.
## Current projects
### Orion / Project Prism
**Orion** is our experimental language-model family exploring:
- explicit temporary working state
- recurrent computation
- parameter reuse
- sparse conditional computation
- compact knowledge and procedure mechanisms
- hybrid base + instruction training
The current public model is:
**Orion Flagship Mini**
A ~219M parameter custom-architecture causal language model and instruction-tuned assistant.
Model:
https://huggingface.co/Refract-Labs/Orion-Flagship-Mini
Base model:
https://huggingface.co/Refract-Labs/Orion-Flagship-Mini-Base
## Research direction
We are especially interested in:
- efficient LLM architectures
- recurrent and iterative reasoning
- alternatives to scaling parameter count
- parameter-efficient computation
- long-context behavior
- model memory and working state
- post-training and hybrid training methods
- small-model capability research
## Philosophy
We like experiments that are:
- measurable
- reproducible
- honest about limitations
- interesting even when they fail
Architecture claims should be tested with controlled comparisons rather than assumed from design alone.
## Open research
Some Refract AI Labs models and code are released publicly for research, experimentation, and community feedback.
Expect prototypes, unfinished ideas, occasional cursed training runs, and hopefully a few genuinely useful discoveries. 🧪
---
Part of the wider **SmilyAI** research ecosystem. (still kinda)
|