Zandy-Wandy commited on
Commit
fe57870
·
verified ·
1 Parent(s): 4db7860

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +92 -4
README.md CHANGED
@@ -1,10 +1,98 @@
1
  ---
2
  title: README
3
- emoji: 🐨
4
- colorFrom: yellow
5
- colorTo: green
6
  sdk: static
7
  pinned: false
 
 
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  title: README
3
+ emoji: 🏆
4
+ colorFrom: indigo
5
+ colorTo: pink
6
  sdk: static
7
  pinned: false
8
+ thumbnail: >-
9
+ https://cdn-uploads.huggingface.co/production/uploads/6905c926d19f5673e5754b17/FPra8KU5Dq95iVPBgIAfe.jpeg
10
  ---
11
 
12
+ <div align="center">
13
+
14
+ <img src="https://faultward-failure.zocomputer.io/cards/fleet.svg" alt="Faultward — fine-tuned OSS models, verified & audited, giant-context" width="720"/>
15
+
16
+ # ⚡ FAULTWARD
17
+
18
+ **We fine-tune open-source models and give them away.**
19
+ *No website. No API to sell. No customers. Just cooked weights on Hugging Face — fast, smart, and free.*
20
+
21
+ `⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟`
22
+
23
+ </div>
24
+
25
+ ---
26
+
27
+ ## 🩸 Who we are
28
+
29
+ A one-person model lab. We take strong open-source bases — starting with **DavidAU's Qwen3.8-27B Cold Fusion** — and make them **as fast and as smart as possible** with new speed tactics, then release every quant, free, Apache-2.0.
30
+
31
+ That's the whole company. We don't run a website, sell an API, or take clients. We ship models with receipts.
32
+
33
+ ## 🎯 Mission
34
+
35
+ > Same brains. More tokens per second. Proven, not vibed.
36
+
37
+ - **Fast** — speculative MTP, NEO-imatrix int4, flash-attention everywhere, reasoning-effort compression. 2.5–4× the tok/s, identical outputs.
38
+ - **Smart** — every release ships a tok/s table **and** a quality A/B against the base. No "smarter than base" claim without a measured A/B.
39
+ - **Open** — all genres, all use cases, all quants, one gloriously cursed card at a time.
40
+
41
+ ## 🔥 Flagship
42
+
43
+ <div align="center">
44
+
45
+ <img src="https://faultward-failure.zocomputer.io/cards/qwen3.8-27b-coldfusion.svg" alt="Qwen3.8-27B Cold Fusion — 91 tok/s, 62% MTP acceptance, 262K context" width="720"/>
46
+
47
+ </div>
48
+
49
+ **Qwen3.8-27B Cold Fusion GAIN V1.1 · NEO-MAX · MTP** — DavidAU's six-stage Cold-Fusion + GAIN base, re-quantised NEO-imatrix and sped up. Regular + MTP GGUFs, every quant. Vision-language, three reasoning modes (`xhigh`/`medium`/`low`), 262K context native (→1M extensible).
50
+
51
+ *Live numbers on the banner above update straight from the bench — the card animates inside any Hugging Face or GitHub README with zero JavaScript.*
52
+
53
+ ## 🖥️ The Fleet
54
+
55
+ | Node | VRAM | Job |
56
+ |---|---|---|
57
+ | **CMP 170HX** | 64 GB HBM2e (~1.5 TB/s, community-unlocked) | Main cook — QLoRA on 27B, NEO-imatrix, 262K–1M ctx @ q8_0 KV |
58
+ | **2× Titan RTX** | 24 GB each (NVLink 48 GB) | Quant + imatrix workhorse, parallel human eval |
59
+ | **RTX 4060 Laptop** | 8 GB | Kitchen-table testing (not a fleet node) |
60
+
61
+ *Stack:* Ubuntu 22.04 · CUDA 12.x (never 13 — Turing + GA100 are dropped there) · 570+ open-kernel driver (for the 170HX unlock) · llama.cpp (MTP + imatrix) · vLLM on Ampere. 170HX lives on its own pinned host — snapshot + `apt-mark hold`, never shares a driver stack.
62
+
63
+ ## 🛠️ How we cook
64
+
65
+ 1. **Baseline** the base — fixed prompts, tok/s + a small quality set. Every later number is measured against this.
66
+ 2. **Free-lunch config** — flash-attn, `-ctk/-ctv q8_0`, NEO-imatrix int4, tuned low/medium `reasoning_effort`.
67
+ 3. **Draft-model speculative** in llama.cpp — pair a Qwen3-0.6B draft with the 27B. Lossless, headline speed-up.
68
+ 4. **Stretch: EAGLE-3 head** on vLLM/SGLang — bigger acceptance, same output distribution. The signature move nobody else trains.
69
+
70
+ ## 📌 Operating principles
71
+
72
+ 1. **Proof before panic.** Measure, don't vibe.
73
+ 2. **Prove it's lossless** — or say what the speed cost.
74
+ 3. **HF is discovery; our cards do the cooking.**
75
+ 4. **Boring-reliable beats clever-fragile.** The 170HX stays pinned.
76
+ 5. **Ship the series, not the single.** One legendary model beats twenty random merges.
77
+
78
+ ## 🔮 Goals
79
+
80
+ - [x] v1 Cold Fusion pipeline (COLD-FUSION + GAIN stages) on the 170HX
81
+ - [x] NEO-imatrix + MTP quant chain
82
+ - [x] Animated benchmark cards (live, self-updating, embed anywhere)
83
+ - [ ] **EAGLE-3 speculative draft head** — same outputs, ~3× tok/s
84
+ - [ ] Benchmark harness with honest A/B vs base on every release
85
+ - [ ] `faultward.ai` DNS (nice-to-have; the cards don't need it)
86
+ - [ ] **10 public releases**, receipts on every card
87
+
88
+ ---
89
+
90
+ <div align="center">
91
+
92
+ <img src="https://faultward-failure.zocomputer.io/cards/fleet.svg" alt="Faultward fleet" width="720"/>
93
+
94
+ <sub><b>Faultward</b> — fine-tuned OSS models · verified · audited · giant-context</sub>
95
+ <br/>
96
+ <sub>⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟ · built on <a href="https://zocomputer.com">Zo</a>, a noble steed for the mind</sub>
97
+
98
+ </div>