Article
The Fast Gemma Challenge: our verified-SOTA recipe, in full
FINAL-Bench
• • 17
fuzzygrass41
fuzzygrass41
AI & ML interests
None yet
Recent Activity
upvoted an article 1 day ago
The Fast Gemma Challenge: our verified-SOTA recipe, in full reacted to SeaWolf-AI's post with ❤️ 1 day ago
We wrote up our run in The Fast Gemma Challenge — as vidraft-darwin — and wanted to share the recipe. 🙏
https://huggingface.co/spaces/gemma-challenge/gemma-dashboard
Verified result: 510.58 TPS at PPL 2.3930 on a single A10G (fw188-ctk49-n64-patchbridge, re-run & VERIFIED). Honest note: on raw TPS there are faster runs (535+), but those went over the PPL bar and didn't verify — what we're proud of is the fastest result that keeps quality.
The recipe is already open, so we explained each piece: sliding-window W188, CTK49 kernel tuning, noprecache (honest, verifiable measurement), and an N64 synthetic warmup bridge that shrinks the public↔private gap (~15 TPS), plus INT4 + MTP K=7 + CUDA-graph capture. One rule: only stack quality-neutral speedups.
Huge thanks to @firfir-cast, @gemma-slayer, @chiku-inu, @kenyan-duma, @dixie-flatline and everyone who shared their experiments. Full write-up
👇
https://huggingface.co/blog/FINAL-Bench/fast-gemma
liked a Space 2 days ago
ginigen-ai/Heatmap-LeaderboardOrganizations
None yet
upvoted an article 1 day ago
reacted to SeaWolf-AI's post with ❤️ 1 day ago
Post
2693
We wrote up our run in The Fast Gemma Challenge — as vidraft-darwin — and wanted to share the recipe. 🙏
gemma-challenge/gemma-dashboard
Verified result: 510.58 TPS at PPL 2.3930 on a single A10G (fw188-ctk49-n64-patchbridge, re-run & VERIFIED). Honest note: on raw TPS there are faster runs (535+), but those went over the PPL bar and didn't verify — what we're proud of is the fastest result that keeps quality.
The recipe is already open, so we explained each piece: sliding-window W188, CTK49 kernel tuning, noprecache (honest, verifiable measurement), and an N64 synthetic warmup bridge that shrinks the public↔private gap (~15 TPS), plus INT4 + MTP K=7 + CUDA-graph capture. One rule: only stack quality-neutral speedups.
Huge thanks to @firfir-cast , @gemma-slayer , @chiku-inu , @kenyan-duma , @dixie-flatline and everyone who shared their experiments. Full write-up
👇
https://huggingface.co/blog/FINAL-Bench/fast-gemma
gemma-challenge/gemma-dashboard
Verified result: 510.58 TPS at PPL 2.3930 on a single A10G (fw188-ctk49-n64-patchbridge, re-run & VERIFIED). Honest note: on raw TPS there are faster runs (535+), but those went over the PPL bar and didn't verify — what we're proud of is the fastest result that keeps quality.
The recipe is already open, so we explained each piece: sliding-window W188, CTK49 kernel tuning, noprecache (honest, verifiable measurement), and an N64 synthetic warmup bridge that shrinks the public↔private gap (~15 TPS), plus INT4 + MTP K=7 + CUDA-graph capture. One rule: only stack quality-neutral speedups.
Huge thanks to @firfir-cast , @gemma-slayer , @chiku-inu , @kenyan-duma , @dixie-flatline and everyone who shared their experiments. Full write-up
👇
https://huggingface.co/blog/FINAL-Bench/fast-gemma
- 3 replies
liked a
Space 2 days ago
liked a
Space 5 days ago
reacted to SeaWolf-AI's post with 👍 7 days ago
Post
6364
🖼️ POCKET-Image — the POCKET series goes visual: character-perfect text in any language, on-device
A new model in VIDRAFT's POCKET family. POCKET put 35B-class models on phones and no-GPU PCs. POCKET-Image carries the same "big capability, small hardware" idea into image generation — and fixes the one thing nearly every image model gets wrong: text.
Type "안녕하세요" into a typical model and you get "안ㅐ기." Hangul alone composes 11,172 syllable blocks; Arabic connects its letters; Thai stacks marks. Diffusion models draw scripts as shapes, so they smear. POCKET-Image renders every glyph exactly — 한국어 · 中文 · 日本語 · العربية (RTL) · ไทย · Latin and more — onto any scene you describe.
What it is:
• 100% accurate text, any language — where global models produce gibberish
• Any background from a prompt — text is optional (empty → a pure image)
• No GPU, no NPU — runs on plain CPU + RAM via the POCKET-Core engine
• Measured footprint: 8.6 GB (RTX 3050/4060) · 4.5 GB (offloaded, 6 GB cards) · 13.4 GB (MacBook, 16 GB+)
• Windows · macOS · Linux · fully local, no cloud
Built on the open, commercial-friendly Z-Image (Apache-2.0) foundation.
Honest note: the text is the guaranteed-correct part — the surrounding scene is ordinary generation, so a busy foreground can crowd the letters. We say so; clean backgrounds stay razor-sharp.
🎨 Studio — generate right here, any language:
FINAL-Bench/POCKET-Image-Studio
🧩 Model card:
FINAL-Bench/POCKET-Image-Zimage
📚 The POCKET collection:
https://huggingface.co/collections/FINAL-Bench/pocket-models
A new model in VIDRAFT's POCKET family. POCKET put 35B-class models on phones and no-GPU PCs. POCKET-Image carries the same "big capability, small hardware" idea into image generation — and fixes the one thing nearly every image model gets wrong: text.
Type "안녕하세요" into a typical model and you get "안ㅐ기." Hangul alone composes 11,172 syllable blocks; Arabic connects its letters; Thai stacks marks. Diffusion models draw scripts as shapes, so they smear. POCKET-Image renders every glyph exactly — 한국어 · 中文 · 日本語 · العربية (RTL) · ไทย · Latin and more — onto any scene you describe.
What it is:
• 100% accurate text, any language — where global models produce gibberish
• Any background from a prompt — text is optional (empty → a pure image)
• No GPU, no NPU — runs on plain CPU + RAM via the POCKET-Core engine
• Measured footprint: 8.6 GB (RTX 3050/4060) · 4.5 GB (offloaded, 6 GB cards) · 13.4 GB (MacBook, 16 GB+)
• Windows · macOS · Linux · fully local, no cloud
Built on the open, commercial-friendly Z-Image (Apache-2.0) foundation.
Honest note: the text is the guaranteed-correct part — the surrounding scene is ordinary generation, so a busy foreground can crowd the letters. We say so; clean backgrounds stay razor-sharp.
🎨 Studio — generate right here, any language:
FINAL-Bench/POCKET-Image-Studio
🧩 Model card:
FINAL-Bench/POCKET-Image-Zimage
📚 The POCKET collection:
https://huggingface.co/collections/FINAL-Bench/pocket-models
liked 15
models 7 days ago
FINAL-Bench/Darwin-28B-REASON
Text Generation • 27B • Updated • 582 • 46
mradermacher/Darwin-28B-Opus-i1-GGUF
27B • Updated • 888 • 19
mradermacher/Darwin-36B-Opus-i1-GGUF
35B • Updated • 2.82k • 19
mradermacher/Darwin-9B-KOREA-i1-GGUF
9B • Updated • 1.14k • 14
mradermacher/Darwin-4B-David-GGUF
8B • Updated • 943 • 18
mradermacher/Darwin-36B-Opus-ABLITERATED-HERETIC-i1-GGUF
35B • Updated • 1.1k • 20
mradermacher/Darwin-28B-REASON-GGUF
27B • Updated • 2.1k • 26
bartowski/FINAL-Bench_Darwin-36B-Opus-GGUF
Text Generation • 35B • Updated • 2.68k • 46
mudler/Darwin-36B-Opus-APEX-GGUF
35B • Updated • 10.1k • 31
bartowski/FINAL-Bench_Darwin-4B-Chimera-GGUF
Text Generation • 4B • Updated • 2.15k • 6
mradermacher/Darwin-V9-Chimera-4B-SFT-i1-GGUF
4B • Updated • 1.36k • 6
mradermacher/Darwin-V9-Chimera-4B-i1-GGUF
4B • Updated • 1.09k • 6
mradermacher/Darwin-4B-Chimera-i1-GGUF
4B • Updated • 800 • 6
Pq234/Darwin-28B-Opus
Text Generation • 28B • Updated • 388 • 6
el4/Darwin-36B-Opus-OPAL-GGUF
Text Generation • 35B • Updated • 13.9k • 14