Update README.md
Browse files
README.md
CHANGED
|
@@ -1,10 +1,98 @@
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
+
emoji: 🏆
|
| 4 |
+
colorFrom: indigo
|
| 5 |
+
colorTo: pink
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
+
thumbnail: >-
|
| 9 |
+
https://cdn-uploads.huggingface.co/production/uploads/6905c926d19f5673e5754b17/FPra8KU5Dq95iVPBgIAfe.jpeg
|
| 10 |
---
|
| 11 |
|
| 12 |
+
<div align="center">
|
| 13 |
+
|
| 14 |
+
<img src="https://faultward-failure.zocomputer.io/cards/fleet.svg" alt="Faultward — fine-tuned OSS models, verified & audited, giant-context" width="720"/>
|
| 15 |
+
|
| 16 |
+
# ⚡ FAULTWARD
|
| 17 |
+
|
| 18 |
+
**We fine-tune open-source models and give them away.**
|
| 19 |
+
*No website. No API to sell. No customers. Just cooked weights on Hugging Face — fast, smart, and free.*
|
| 20 |
+
|
| 21 |
+
`⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟`
|
| 22 |
+
|
| 23 |
+
</div>
|
| 24 |
+
|
| 25 |
+
---
|
| 26 |
+
|
| 27 |
+
## 🩸 Who we are
|
| 28 |
+
|
| 29 |
+
A one-person model lab. We take strong open-source bases — starting with **DavidAU's Qwen3.8-27B Cold Fusion** — and make them **as fast and as smart as possible** with new speed tactics, then release every quant, free, Apache-2.0.
|
| 30 |
+
|
| 31 |
+
That's the whole company. We don't run a website, sell an API, or take clients. We ship models with receipts.
|
| 32 |
+
|
| 33 |
+
## 🎯 Mission
|
| 34 |
+
|
| 35 |
+
> Same brains. More tokens per second. Proven, not vibed.
|
| 36 |
+
|
| 37 |
+
- **Fast** — speculative MTP, NEO-imatrix int4, flash-attention everywhere, reasoning-effort compression. 2.5–4× the tok/s, identical outputs.
|
| 38 |
+
- **Smart** — every release ships a tok/s table **and** a quality A/B against the base. No "smarter than base" claim without a measured A/B.
|
| 39 |
+
- **Open** — all genres, all use cases, all quants, one gloriously cursed card at a time.
|
| 40 |
+
|
| 41 |
+
## 🔥 Flagship
|
| 42 |
+
|
| 43 |
+
<div align="center">
|
| 44 |
+
|
| 45 |
+
<img src="https://faultward-failure.zocomputer.io/cards/qwen3.8-27b-coldfusion.svg" alt="Qwen3.8-27B Cold Fusion — 91 tok/s, 62% MTP acceptance, 262K context" width="720"/>
|
| 46 |
+
|
| 47 |
+
</div>
|
| 48 |
+
|
| 49 |
+
**Qwen3.8-27B Cold Fusion GAIN V1.1 · NEO-MAX · MTP** — DavidAU's six-stage Cold-Fusion + GAIN base, re-quantised NEO-imatrix and sped up. Regular + MTP GGUFs, every quant. Vision-language, three reasoning modes (`xhigh`/`medium`/`low`), 262K context native (→1M extensible).
|
| 50 |
+
|
| 51 |
+
*Live numbers on the banner above update straight from the bench — the card animates inside any Hugging Face or GitHub README with zero JavaScript.*
|
| 52 |
+
|
| 53 |
+
## 🖥️ The Fleet
|
| 54 |
+
|
| 55 |
+
| Node | VRAM | Job |
|
| 56 |
+
|---|---|---|
|
| 57 |
+
| **CMP 170HX** | 64 GB HBM2e (~1.5 TB/s, community-unlocked) | Main cook — QLoRA on 27B, NEO-imatrix, 262K–1M ctx @ q8_0 KV |
|
| 58 |
+
| **2× Titan RTX** | 24 GB each (NVLink 48 GB) | Quant + imatrix workhorse, parallel human eval |
|
| 59 |
+
| **RTX 4060 Laptop** | 8 GB | Kitchen-table testing (not a fleet node) |
|
| 60 |
+
|
| 61 |
+
*Stack:* Ubuntu 22.04 · CUDA 12.x (never 13 — Turing + GA100 are dropped there) · 570+ open-kernel driver (for the 170HX unlock) · llama.cpp (MTP + imatrix) · vLLM on Ampere. 170HX lives on its own pinned host — snapshot + `apt-mark hold`, never shares a driver stack.
|
| 62 |
+
|
| 63 |
+
## 🛠️ How we cook
|
| 64 |
+
|
| 65 |
+
1. **Baseline** the base — fixed prompts, tok/s + a small quality set. Every later number is measured against this.
|
| 66 |
+
2. **Free-lunch config** — flash-attn, `-ctk/-ctv q8_0`, NEO-imatrix int4, tuned low/medium `reasoning_effort`.
|
| 67 |
+
3. **Draft-model speculative** in llama.cpp — pair a Qwen3-0.6B draft with the 27B. Lossless, headline speed-up.
|
| 68 |
+
4. **Stretch: EAGLE-3 head** on vLLM/SGLang — bigger acceptance, same output distribution. The signature move nobody else trains.
|
| 69 |
+
|
| 70 |
+
## 📌 Operating principles
|
| 71 |
+
|
| 72 |
+
1. **Proof before panic.** Measure, don't vibe.
|
| 73 |
+
2. **Prove it's lossless** — or say what the speed cost.
|
| 74 |
+
3. **HF is discovery; our cards do the cooking.**
|
| 75 |
+
4. **Boring-reliable beats clever-fragile.** The 170HX stays pinned.
|
| 76 |
+
5. **Ship the series, not the single.** One legendary model beats twenty random merges.
|
| 77 |
+
|
| 78 |
+
## 🔮 Goals
|
| 79 |
+
|
| 80 |
+
- [x] v1 Cold Fusion pipeline (COLD-FUSION + GAIN stages) on the 170HX
|
| 81 |
+
- [x] NEO-imatrix + MTP quant chain
|
| 82 |
+
- [x] Animated benchmark cards (live, self-updating, embed anywhere)
|
| 83 |
+
- [ ] **EAGLE-3 speculative draft head** — same outputs, ~3× tok/s
|
| 84 |
+
- [ ] Benchmark harness with honest A/B vs base on every release
|
| 85 |
+
- [ ] `faultward.ai` DNS (nice-to-have; the cards don't need it)
|
| 86 |
+
- [ ] **10 public releases**, receipts on every card
|
| 87 |
+
|
| 88 |
+
---
|
| 89 |
+
|
| 90 |
+
<div align="center">
|
| 91 |
+
|
| 92 |
+
<img src="https://faultward-failure.zocomputer.io/cards/fleet.svg" alt="Faultward fleet" width="720"/>
|
| 93 |
+
|
| 94 |
+
<sub><b>Faultward</b> — fine-tuned OSS models · verified · audited · giant-context</sub>
|
| 95 |
+
<br/>
|
| 96 |
+
<sub>⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟ · built on <a href="https://zocomputer.com">Zo</a>, a noble steed for the mind</sub>
|
| 97 |
+
|
| 98 |
+
</div>
|