Zandy-Wandy commited on
Commit
406c2d7
·
verified ·
1 Parent(s): fe57870

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -39
README.md CHANGED
@@ -9,14 +9,16 @@ thumbnail: >-
9
  https://cdn-uploads.huggingface.co/production/uploads/6905c926d19f5673e5754b17/FPra8KU5Dq95iVPBgIAfe.jpeg
10
  ---
11
 
12
- <div align="center">
 
 
13
 
14
- <img src="https://faultward-failure.zocomputer.io/cards/fleet.svg" alt="Faultward — fine-tuned OSS models, verified & audited, giant-context" width="720"/>
15
 
16
- # ⚡ FAULTWARD
 
17
 
18
- **We fine-tune open-source models and give them away.**
19
- *No website. No API to sell. No customers. Just cooked weights on Hugging Face — fast, smart, and free.*
20
 
21
  `⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟`
22
 
@@ -24,33 +26,27 @@ thumbnail: >-
24
 
25
  ---
26
 
27
- ## 🩸 Who we are
28
 
29
- A one-person model lab. We take strong open-source bases — starting with **DavidAU's Qwen3.8-27B Cold Fusion** — and make them **as fast and as smart as possible** with new speed tactics, then release every quant, free, Apache-2.0.
30
 
31
- That's the whole company. We don't run a website, sell an API, or take clients. We ship models with receipts.
32
 
33
- ## 🎯 Mission
34
 
35
  > Same brains. More tokens per second. Proven, not vibed.
36
 
37
- - **Fast** — speculative MTP, NEO-imatrix int4, flash-attention everywhere, reasoning-effort compression. 2.5–4× the tok/s, identical outputs.
38
- - **Smart** — every release ships a tok/s table **and** a quality A/B against the base. No "smarter than base" claim without a measured A/B.
39
- - **Open** — all genres, all use cases, all quants, one gloriously cursed card at a time.
40
 
41
- ## 🔥 Flagship
42
 
43
- <div align="center">
44
 
45
- <img src="https://faultward-failure.zocomputer.io/cards/qwen3.8-27b-coldfusion.svg" alt="Qwen3.8-27B Cold Fusion — 91 tok/s, 62% MTP acceptance, 262K context" width="720"/>
46
-
47
- </div>
48
 
49
- **Qwen3.8-27B Cold Fusion GAIN V1.1 · NEO-MAX · MTP** — DavidAU's six-stage Cold-Fusion + GAIN base, re-quantised NEO-imatrix and sped up. Regular + MTP GGUFs, every quant. Vision-language, three reasoning modes (`xhigh`/`medium`/`low`), 262K context native (→1M extensible).
50
-
51
- *Live numbers on the banner above update straight from the bench — the card animates inside any Hugging Face or GitHub README with zero JavaScript.*
52
-
53
- ## 🖥️ The Fleet
54
 
55
  | Node | VRAM | Job |
56
  |---|---|---|
@@ -58,41 +54,40 @@ That's the whole company. We don't run a website, sell an API, or take clients.
58
  | **2× Titan RTX** | 24 GB each (NVLink 48 GB) | Quant + imatrix workhorse, parallel human eval |
59
  | **RTX 4060 Laptop** | 8 GB | Kitchen-table testing (not a fleet node) |
60
 
61
- *Stack:* Ubuntu 22.04 · CUDA 12.x (never 13 — Turing + GA100 are dropped there) · 570+ open-kernel driver (for the 170HX unlock) · llama.cpp (MTP + imatrix) · vLLM on Ampere. 170HX lives on its own pinned host — snapshot + `apt-mark hold`, never shares a driver stack.
62
 
63
- ## 🛠️ How we cook
 
 
64
 
65
  1. **Baseline** the base — fixed prompts, tok/s + a small quality set. Every later number is measured against this.
66
  2. **Free-lunch config** — flash-attn, `-ctk/-ctv q8_0`, NEO-imatrix int4, tuned low/medium `reasoning_effort`.
67
  3. **Draft-model speculative** in llama.cpp — pair a Qwen3-0.6B draft with the 27B. Lossless, headline speed-up.
68
  4. **Stretch: EAGLE-3 head** on vLLM/SGLang — bigger acceptance, same output distribution. The signature move nobody else trains.
69
 
70
- ## 📌 Operating principles
71
 
72
  1. **Proof before panic.** Measure, don't vibe.
73
  2. **Prove it's lossless** — or say what the speed cost.
74
- 3. **HF is discovery; our cards do the cooking.**
75
- 4. **Boring-reliable beats clever-fragile.** The 170HX stays pinned.
76
- 5. **Ship the series, not the single.** One legendary model beats twenty random merges.
77
 
78
- ## 🔮 Goals
79
 
80
- - [x] v1 Cold Fusion pipeline (COLD-FUSION + GAIN stages) on the 170HX
81
- - [x] NEO-imatrix + MTP quant chain
82
- - [x] Animated benchmark cards (live, self-updating, embed anywhere)
83
- - [ ] **EAGLE-3 speculative draft head** — same outputs, ~3× tok/s
 
84
  - [ ] Benchmark harness with honest A/B vs base on every release
85
- - [ ] `faultward.ai` DNS (nice-to-have; the cards don't need it)
86
- - [ ] **10 public releases**, receipts on every card
87
 
88
  ---
89
 
90
  <div align="center">
91
 
92
- <img src="https://faultward-failure.zocomputer.io/cards/fleet.svg" alt="Faultward fleet" width="720"/>
93
-
94
- <sub><b>Faultward</b> — fine-tuned OSS models · verified · audited · giant-context</sub>
95
  <br/>
96
- <sub>⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟ · built on <a href="https://zocomputer.com">Zo</a>, a noble steed for the mind</sub>
97
 
98
  </div>
 
9
  https://cdn-uploads.huggingface.co/production/uploads/6905c926d19f5673e5754b17/FPra8KU5Dq95iVPBgIAfe.jpeg
10
  ---
11
 
12
+ <div align="center">
13
+
14
+ <img src="https://faultward-failure.zocomputer.io/cards/banner.svg" alt="Faultward — non-profit open-source model training" width="100%"/>
15
 
16
+ # FAULTWARD
17
 
18
+ **A non-profit open-source model-training lab.**
19
+ *We take strong OSS bases, make them faster and smarter, and give every quant away. No website. No API. No customers. Just weights on Hugging Face, with receipts.*
20
 
21
+ **Status: pre-launch — no releases yet. Numbers get published only once measured on our own hardware.**
 
22
 
23
  `⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟`
24
 
 
26
 
27
  ---
28
 
29
+ ## Who we are
30
 
31
+ A one-person, non-profit model lab. We start from strong open-source bases — first up, **DavidAU's Qwen3.8-27B Cold Fusion** — push them **as fast and as smart as possible** with current speed tactics, then release every quant, free, under Apache-2.0.
32
 
33
+ That's the whole thing. Nothing is for sale.
34
 
35
+ ## Mission
36
 
37
  > Same brains. More tokens per second. Proven, not vibed.
38
 
39
+ - **Fast** — the toolkit we're aiming at: speculative decoding (draft + EAGLE-3), NEO-imatrix int4, flash-attention, reasoning-effort compression. Goal is a real multiple on tok/s with outputs unchanged — measured, not assumed.
40
+ - **Smart** — every release will ship a tok/s table **and** a quality A/B vs the base. No "smarter than base" without a measured A/B.
41
+ - **Open** — all quants, all use cases, one gloriously cursed card at a time.
42
 
43
+ ## Flagship
44
 
45
+ **First target: `DavidAU/Qwen3.8-27B-Cold-Fusion-GAIN-V1.1`** (Apache-2.0) — a 27B dense, vision-language model with 64 layers, 16 full-attention layers (4 KV heads), MTP self-speculation, and 262K native context (→1M extensible). The plan is to re-quantise it (NEO-imatrix) and speed it up (draft/EAGLE-3 speculative), then publish an honest A/B.
46
 
47
+ *No benchmarks here yet — nothing has been trained or measured. Speed and quality numbers will land on each release card once they come from our own runs. The full recipe and blank result tables live in [`FINETUNE-PLAN.md`](./FINETUNE-PLAN.md).*
 
 
48
 
49
+ ## The Fleet
 
 
 
 
50
 
51
  | Node | VRAM | Job |
52
  |---|---|---|
 
54
  | **2× Titan RTX** | 24 GB each (NVLink 48 GB) | Quant + imatrix workhorse, parallel human eval |
55
  | **RTX 4060 Laptop** | 8 GB | Kitchen-table testing (not a fleet node) |
56
 
57
+ *Rig is being assembled — the 170HX host isn't in hand yet.*
58
 
59
+ *Stack:* Ubuntu 22.04 · CUDA 12.x (never 13 — Turing + GA100 are dropped there) · 570+ open-kernel driver (for the 170HX unlock) · llama.cpp (MTP + imatrix) · vLLM on Ampere. The 170HX lives on its own pinned host — snapshot + `apt-mark hold`, never shares a driver stack.
60
+
61
+ ## How we cook
62
 
63
  1. **Baseline** the base — fixed prompts, tok/s + a small quality set. Every later number is measured against this.
64
  2. **Free-lunch config** — flash-attn, `-ctk/-ctv q8_0`, NEO-imatrix int4, tuned low/medium `reasoning_effort`.
65
  3. **Draft-model speculative** in llama.cpp — pair a Qwen3-0.6B draft with the 27B. Lossless, headline speed-up.
66
  4. **Stretch: EAGLE-3 head** on vLLM/SGLang — bigger acceptance, same output distribution. The signature move nobody else trains.
67
 
68
+ ## Operating principles
69
 
70
  1. **Proof before panic.** Measure, don't vibe.
71
  2. **Prove it's lossless** — or say what the speed cost.
72
+ 3. **Boring-reliable beats clever-fragile.** The 170HX stays pinned.
73
+ 4. **Ship the series, not the single.** One legendary model beats twenty random merges.
 
74
 
75
+ ## Goals
76
 
77
+ - [ ] Acquire + unlock the 170HX host, pin the CUDA 12.x / driver stack
78
+ - [ ] Baseline the target model on our own hardware (tok/s + quality set)
79
+ - [ ] NEO-imatrix quant chain
80
+ - [ ] Draft-model speculative decoding (llama.cpp)
81
+ - [ ] **EAGLE-3 speculative head** — same outputs, faster (target TBD by measurement)
82
  - [ ] Benchmark harness with honest A/B vs base on every release
83
+ - [ ] **First public release**, receipts on the card
 
84
 
85
  ---
86
 
87
  <div align="center">
88
 
89
+ <sub><b>Faultward</b> — non-profit · open-source · model training</sub>
 
 
90
  <br/>
91
+ <sub>⢕⣿⣏⣿⢳⡕⣆⢺⣋⢟ · built on <a href="https://zocomputer.com">Zo</a></sub>
92
 
93
  </div>