Spaces:
Configuration error
Configuration error
Update README.md
Browse files
README.md
CHANGED
|
@@ -2,42 +2,36 @@
|
|
| 2 |
|
| 3 |
**Frontier AI on hardware you own.**
|
| 4 |
|
| 5 |
-
Outlier builds ternary-quantized Mixture-of-Experts language models that run on consumer hardware. Our
|
| 6 |
|
| 7 |
-
|
| 8 |
|
| 9 |
-
|
| 10 |
-
|-------|------|------|---|--------|---------------|
|
| 11 |
-
| **[Outlier-150B](https://huggingface.co/ur-dad-matt/Outlier-150B-V3.2)** | Qwen2.5-72B | **84.49%** | 14,042 | ±0.0029 | ~60 GB |
|
| 12 |
-
| **[Outlier-70B](https://huggingface.co/ur-dad-matt/Outlier-70B-V3.2)** | Qwen2.5-32B | **81.46%** | 14,042 | ±0.0031 | ~25 GB |
|
| 13 |
-
| **[Outlier-40B](https://huggingface.co/ur-dad-matt/Outlier-40B-V3.2)** | Qwen2.5-14B | **77.82%** | 14,042 | ±0.0033 | ~10 GB |
|
| 14 |
-
| **[Outlier-10B](https://huggingface.co/ur-dad-matt/Outlier-10B-V3.2)** | Qwen2.5-7B | **76.19%** | 12,498 | ±0.0037 | ~5 GB |
|
| 15 |
|
| 16 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
| Benchmark | Score | n | stderr |
|
| 21 |
-
|-----------|-------|---|--------|
|
| 22 |
-
| HellaSwag (acc_norm) | 87.43% | 10,042 | ±0.0033 |
|
| 23 |
-
| ARC-Easy (acc) | 85.06% | 2,376 | ±0.0073 |
|
| 24 |
-
| ARC-Challenge (acc_norm) | 61.35% | 1,172 | ±0.0142 |
|
| 25 |
-
| WinoGrande (acc) | 76.72% | 1,267 | ±0.0119 |
|
| 26 |
-
| TruthfulQA-MC2 (acc) | 70.63% | 817 | ±0.0148 |
|
| 27 |
|
| 28 |
## What makes Outlier different
|
| 29 |
|
| 30 |
-
- **Ternary MoE**
|
| 31 |
-
- **
|
| 32 |
-
- **
|
| 33 |
-
- **
|
| 34 |
-
- **Patent pending**
|
| 35 |
-
- **Open source engine**: [outlier-engine](https://github.com/mattkerr09/outlier-engine) — Apache 2.0
|
| 36 |
|
| 37 |
-
##
|
| 38 |
|
| 39 |
-
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
|
| 43 |
-
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
**Frontier AI on hardware you own.**
|
| 4 |
|
| 5 |
+
Outlier builds ternary-quantized Mixture-of-Experts language models that run paged on consumer hardware. Our open-source runtime decouples model size from RAM: a 150-billion-parameter model fits in a 7 GB working set on a Mac Studio M1 Ultra.
|
| 6 |
|
| 7 |
+
The architecture pairs a frozen full-precision base model (the shared expert) with domain-specialized ternary {-1, 0, +1} routed experts at ~1.6 bits per weight. On top of the runtime sits an Alive Model layer — 224 alpha scalars per user that learn from your usage on-device, switch domain profiles in 0.3 ms, and never leave your machine.
|
| 8 |
|
| 9 |
+
## Verified models (V3.2 family)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
+
| Model | MMLU | Working set on Mac Studio | HuggingFace |
|
| 12 |
+
|---|---|---|---|
|
| 13 |
+
| Outlier-150B V3.2 | **84.49%** | ~7 GB paged | [Outlier-150B-V3.2](#) |
|
| 14 |
+
| Outlier-70B V3.2 | **81.46%** | ~5 GB paged | [Outlier-70B-V3.2](#) |
|
| 15 |
+
| Outlier-40B V3.2 | **77.82%** | ~4 GB paged | [Outlier-40B-V3.2](#) |
|
| 16 |
+
| Outlier-10B V3.2 | **76.19%** | ~3 GB paged | [Outlier-10B-V3.2](#) |
|
| 17 |
|
| 18 |
+
*All MMLU scores: lm-evaluation-harness v0.4.9.1, full sample (n ≈ 14,042), 5-shot, bfloat16. Stderr < 0.004 across all four models. Scaling curve: 76.19 → 77.82 → 81.46 → 84.49.*
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
## What makes Outlier different
|
| 21 |
|
| 22 |
+
- **Ternary MoE runtime** — Routed experts at ~1.6 bits/weight, shared expert at full precision. Open-source under Apache 2.0.
|
| 23 |
+
- **Paged inference on Apple Silicon** — Three-tier expert cache (hot/warm/cold) lets a 150B model run in a 7 GB working set on a single Mac Studio. No multi-GPU required.
|
| 24 |
+
- **Alive Model personalization** — 224 alpha scalars per user learn your domain on-device via test-time training. Profile switching in 0.3 ms. Zero cloud dependence.
|
| 25 |
+
- **Single-operator builds** — All four models trained by one person on a single GPU pipeline. Total compute spend under $700.
|
| 26 |
+
- **Patent pending** — Three U.S. provisional applications filed (April 2026), 61 claims covering training, runtime, and adaptation.
|
|
|
|
| 27 |
|
| 28 |
+
## Status
|
| 29 |
|
| 30 |
+
**Pre-launch.** Public release Tuesday April 14, 2026. Models in this org are private until launch.
|
| 31 |
+
|
| 32 |
+
## Links
|
| 33 |
|
| 34 |
+
- **Website:** [outlier.host](https://outlier.host)
|
| 35 |
+
- **Engine:** [github.com/Outlier-host/outlier-engine](https://github.com/Outlier-host/outlier-engine) (Apache 2.0)
|
| 36 |
+
- **Contact:** matt@outlier.host
|
| 37 |
+
- **Built by:** [Matt Kerr](https://linkedin.com/in/mattkerr09) · Kerr & Company LLC · Grand Rapids, MI
|