philipjohnbasile commited on
Commit
ad6d201
·
verified ·
1 Parent(s): b4dae39

Give the Wisp Fieldbook room to grow

Browse files

Use bounded fit-content sizing to reclaim the model-card right gutter on larger screens, with a full-width mobile fallback. Contain the architecture flower float, restore the two-column runtime comparison, and add an illustrated guide to the twelve trunk layers and shared MTP block. Preserve all scientific text, six original code examples, metadata, links, and thirteen default-open panels. Reviewed the complete sanitized desktop and mobile previews.

Files changed (1) hide show
  1. README.md +22 -3
README.md CHANGED
@@ -13,7 +13,7 @@ library_name: transformers
13
  pipeline_tag: text-generation
14
  ---
15
 
16
- <div id="wisp-experience" style="color:#354b3b;background:#f4f1e8;padding:clamp(18px,3vw,38px);margin:8px 0 0;position:relative;background-image:radial-gradient(#d7dbc9 0.55px,transparent 0.55px);background-size:8px 8px;font-size:15px;line-height:1.8;overflow-wrap:anywhere;"><!-- The Wisp Fieldbook: a native Hugging Face model card. -->
17
  <div class="group" id="wisp-cover" style="color:#263f32;padding:0;margin:0;background:transparent;">
18
  <div style="display:flex;justify-content:space-between;align-items:center;flex-wrap:wrap;gap:12px;padding-bottom:18px;margin-bottom:36px;background:transparent;border-bottom:1px solid #bfccb1;">
19
  <h1 id="wisp-coder-110m" style="font-family:Arial,sans-serif;font-size:13px;font-weight:600;letter-spacing:1.4px;text-transform:uppercase;color:#263f32;margin:0;line-height:1.6;">Wisp Coder 110M</h1>
@@ -27,7 +27,7 @@ pipeline_tag: text-generation
27
  <a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="display:inline-block;color:#fffdf5;padding:13px 19px;text-decoration:none;font-size:14px;font-weight:600;text-decoration-thickness:1px;text-underline-offset:3px;background:#263f32;border-bottom:3px solid #a1b68c;">Enter the playground <span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:translate-x-0.5" style="display:inline-block;">↗</span></a>
28
  <p style="font-size:11px;line-height:1.7;color:#50614e;margin:22px 0 0;">An open research experiment<br/>by Philip John Basile</p>
29
  </div>
30
- <div style="flex:1 1 270px;min-width:0;max-width:100%;padding:12px 8px;background:transparent;">
31
  <img alt="Original painted wildflowers in pink, coral, cobalt and green. They gently turn when you hover over the cover." class="wisp-botanical motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:rotate-6" src="./assets/wisp-wildflowers.png" style="width:100%;max-width:100%;height:auto;object-fit:contain;margin:0;border:0;"/>
32
  <p style="font-family:Georgia,serif;font-style:italic;color:#5d704f;font-size:14px;text-align:right;margin:20px 5px 0;">Small model. Open questions.</p>
33
  </div>
@@ -197,10 +197,29 @@ arithmetic says it cannot be: Qwen2.5-Coder-0.5B saw roughly 5.5 trillion tokens
197
  and Wisp saw 5 billion, three orders of magnitude fewer. If you want the best
198
  completions available at small scale, use Qwen. Use Wisp to study FIM plus native
199
  speculative drafting on Apple Silicon, or how those two interact.</p>
200
- <div class="group" style="margin:0 0 24px;padding:44px 0 0;background:transparent;position:relative;"><span aria-hidden="true" style="position:absolute;left:calc(-1 * clamp(14px,2vw,23px) - 7px);top:43px;color:#ad3f5a;background:#f4f1e8;font-size:14px;line-height:1;">❋</span><img alt="" class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:-rotate-6" src="./assets/wisp-wildflowers.png" style="width:180px;max-width:45%;height:auto;object-fit:contain;float:right;margin:-5px 0 12px 15px;border:0;"/>
201
  <p style="margin:0 0 12px;color:#9f3d58;font-size:10px;letter-spacing:1.6px;text-transform:uppercase;">03 / ARCHITECTURE</p>
202
  <h2 id="architecture" style="font-family:Georgia,serif;font-size:clamp(32px,4.3vw,46px);line-height:1.08;font-weight:400;letter-spacing:-1.6px;color:#263f32;margin:0;padding:0;border:0;scroll-margin-top:24px;">Under the petals.</h2>
203
  </div>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
204
  <div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(min(100%,250px),1fr));gap:14px;margin:24px 0;background:transparent;">
205
  <a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:translate-x-px focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/philipjohnbasile/wisp-coder-110m/blob/main/config.json" style="display:block;padding:10px 0 20px;color:#263f32;text-decoration:none;text-decoration-thickness:1px;text-underline-offset:3px;margin:0;border-bottom:1px solid #bdcdb0;">
206
  <span style="display:block;font-size:10px;letter-spacing:1.4px;color:#50614e;margin-bottom:12px;">ROUTE A / THE TRUNK</span><span style="display:block;font-family:Georgia,serif;font-size:27px;line-height:1.2;color:#263f32;margin-bottom:12px;">An ordinary Llama decoder.</span><span style="display:block;font-size:13px;line-height:1.7;color:#354b3b;">100.7M parameters. Standard Transformers and MLX-LM loading.</span><span style="display:block;font-size:12px;color:#8e3049;margin-top:16px;">Inspect the configuration ↗</span>
 
13
  pipeline_tag: text-generation
14
  ---
15
 
16
+ <div id="wisp-experience" style="color:#354b3b;background:#f4f1e8;padding:clamp(18px,3vw,38px);margin:8px 0 0;position:relative;background-image:radial-gradient(#d7dbc9 0.55px,transparent 0.55px);background-size:8px 8px;font-size:15px;line-height:1.8;overflow-wrap:anywhere;--wisp-gutter:calc(clamp(0px, calc(100vw - 768px), 16px) + clamp(0px, calc(100vw - 1024px), 56px) + clamp(0px, calc(100vw - 1280px), 16px) + clamp(0px, calc(100vw - 1536px), 48px));width:fit-content;min-width:100%;max-width:calc(100% + var(--wisp-gutter));box-sizing:border-box;"><!-- The Wisp Fieldbook: a native Hugging Face model card. -->
17
  <div class="group" id="wisp-cover" style="color:#263f32;padding:0;margin:0;background:transparent;">
18
  <div style="display:flex;justify-content:space-between;align-items:center;flex-wrap:wrap;gap:12px;padding-bottom:18px;margin-bottom:36px;background:transparent;border-bottom:1px solid #bfccb1;">
19
  <h1 id="wisp-coder-110m" style="font-family:Arial,sans-serif;font-size:13px;font-weight:600;letter-spacing:1.4px;text-transform:uppercase;color:#263f32;margin:0;line-height:1.6;">Wisp Coder 110M</h1>
 
27
  <a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="display:inline-block;color:#fffdf5;padding:13px 19px;text-decoration:none;font-size:14px;font-weight:600;text-decoration-thickness:1px;text-underline-offset:3px;background:#263f32;border-bottom:3px solid #a1b68c;">Enter the playground <span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:translate-x-0.5" style="display:inline-block;">↗</span></a>
28
  <p style="font-size:11px;line-height:1.7;color:#50614e;margin:22px 0 0;">An open research experiment<br/>by Philip John Basile</p>
29
  </div>
30
+ <div style="flex:1.15 1 270px;min-width:0;max-width:100%;padding:18px 14px;background:transparent;">
31
  <img alt="Original painted wildflowers in pink, coral, cobalt and green. They gently turn when you hover over the cover." class="wisp-botanical motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:rotate-6" src="./assets/wisp-wildflowers.png" style="width:100%;max-width:100%;height:auto;object-fit:contain;margin:0;border:0;"/>
32
  <p style="font-family:Georgia,serif;font-style:italic;color:#5d704f;font-size:14px;text-align:right;margin:20px 5px 0;">Small model. Open questions.</p>
33
  </div>
 
197
  and Wisp saw 5 billion, three orders of magnitude fewer. If you want the best
198
  completions available at small scale, use Qwen. Use Wisp to study FIM plus native
199
  speculative drafting on Apple Silicon, or how those two interact.</p>
200
+ <div class="group" style="margin:0 0 24px;padding:44px 0 0;background:transparent;position:relative;display:flow-root;"><span aria-hidden="true" style="position:absolute;left:calc(-1 * clamp(14px,2vw,23px) - 7px);top:43px;color:#ad3f5a;background:#f4f1e8;font-size:14px;line-height:1;">❋</span><img alt="" class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:-rotate-6" src="./assets/wisp-wildflowers.png" style="width:180px;max-width:45%;height:auto;object-fit:contain;float:right;margin:-5px 0 12px 15px;border:0;"/>
201
  <p style="margin:0 0 12px;color:#9f3d58;font-size:10px;letter-spacing:1.6px;text-transform:uppercase;">03 / ARCHITECTURE</p>
202
  <h2 id="architecture" style="font-family:Georgia,serif;font-size:clamp(32px,4.3vw,46px);line-height:1.08;font-weight:400;letter-spacing:-1.6px;color:#263f32;margin:0;padding:0;border:0;scroll-margin-top:24px;">Under the petals.</h2>
203
  </div>
204
+ <div id="wisp-anatomy" style="margin:8px 0 30px;padding:0 0 24px;border-bottom:1px solid #bdcdb0;">
205
+ <p style="font-family:Georgia,serif;font-size:21px;color:#354b3b;margin:0 0 22px;">Twelve layers. One shared module. A little further ahead.</p>
206
+ <div style="display:flex;flex-wrap:wrap;align-items:flex-start;gap:28px;">
207
+ <div class="group" style="flex:1.7 1 280px;min-width:0;">
208
+ <div aria-hidden="true" style="display:grid;grid-template-columns:repeat(12,minmax(0,1fr));gap:5px;"><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">01</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">02</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">03</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">04</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">05</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">06</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">07</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">08</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">09</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">10</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">11</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">12</span></div></div>
209
+ <p style="color:#263f32;font-size:12px;margin:15px 0 3px;letter-spacing:1px;">12 TRUNK LAYERS</p>
210
+ <p style="color:#50614e;font-size:12px;line-height:1.7;margin:0;">768 hidden dimensions · 12 attention heads<br/>4 KV heads · SwiGLU 2,048</p>
211
+ </div>
212
+ <div class="group" style="flex:1 1 180px;min-width:0;">
213
+ <div style="display:flex;align-items:center;gap:15px;min-height:92px;">
214
+ <span aria-hidden="true" class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:rotate-6" style="display:flex;align-items:center;justify-content:center;flex:0 0 72px;height:72px;border:1px solid #b3677a;border-radius:50%;font-family:Georgia,serif;font-size:44px;line-height:1;color:#ad3f5a;">1</span>
215
+ <span style="font-family:Georgia,serif;font-size:23px;line-height:1.2;color:#963c54;">Shared.<br/><em>Reused.</em></span>
216
+ </div>
217
+ <p style="color:#963c54;font-size:12px;margin:15px 0 3px;letter-spacing:1px;">1 MTP TRANSFORMER BLOCK</p>
218
+ <p style="color:#50614e;font-size:12px;line-height:1.7;margin:0;">Trained to depth 2.<br/>Applied recursively at inference.</p>
219
+ </div>
220
+ </div>
221
+ <p style="color:#50614e;font-size:12px;line-height:1.7;margin:22px 0 0;">The trunk and MTP module share the LM head. The sidecar requires the explicit MTP runtime below.</p>
222
+ </div>
223
  <div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(min(100%,250px),1fr));gap:14px;margin:24px 0;background:transparent;">
224
  <a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:translate-x-px focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/philipjohnbasile/wisp-coder-110m/blob/main/config.json" style="display:block;padding:10px 0 20px;color:#263f32;text-decoration:none;text-decoration-thickness:1px;text-underline-offset:3px;margin:0;border-bottom:1px solid #bdcdb0;">
225
  <span style="display:block;font-size:10px;letter-spacing:1.4px;color:#50614e;margin-bottom:12px;">ROUTE A / THE TRUNK</span><span style="display:block;font-family:Georgia,serif;font-size:27px;line-height:1.2;color:#263f32;margin-bottom:12px;">An ordinary Llama decoder.</span><span style="display:block;font-size:13px;line-height:1.7;color:#354b3b;">100.7M parameters. Standard Transformers and MLX-LM loading.</span><span style="display:block;font-size:12px;color:#8e3049;margin-top:16px;">Inspect the configuration ↗</span>