philipjohnbasile commited on
Commit
b8df715
·
verified ·
1 Parent(s): 5919d57

Bring the Wisp garden identity to the model card

Browse files

Add a responsive floral introduction, section signposts and footer using the original Wisp Space artwork. Preserve all technical text, code examples, evaluation results, metadata and existing links. Model weights, tokenizer, runtime and evidence files are unchanged. Validated the complete card in Hugging Face Preview and checked mobile layout.

Files changed (4) hide show
  1. .gitattributes +1 -0
  2. README.md +64 -9
  3. assets/ARTWORK.md +19 -0
  4. assets/wisp-wildflowers.png +3 -0
.gitattributes CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  evidence/results/e3_rollout_v3.json filter=lfs diff=lfs merge=lfs -text
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  evidence/results/e3_rollout_v3.json filter=lfs diff=lfs merge=lfs -text
37
+ assets/wisp-wildflowers.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -13,11 +13,31 @@ library_name: transformers
13
  pipeline_tag: text-generation
14
  ---
15
 
16
- # Wisp Coder 110M
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
 
18
  [Explore the model guide](https://huggingface.co/spaces/philipjohnbasile/local-ai-guide) · [All public work](https://huggingface.co/philipjohnbasile)
19
 
20
- ## Start here
 
 
 
21
 
22
  **[Try the interactive CPU demo](https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo)** ·
23
  [Short-hole evaluation](./fim-competitive-v1/FIM_RESULTS.md) ·
@@ -57,6 +77,8 @@ print(tokenizer.decode(output[0], skip_special_tokens=True))
57
 
58
  Review generated code before using it. The demo also provides FIM prompts and displays raw suggestions without executing them. The full training, data-provenance, and evaluation disclosures follow.
59
 
 
 
60
  A small code model built for one job: completing code at the cursor. It targets
61
  editor inline suggestions, but no production-runtime latency claim is made.
62
 
@@ -85,7 +107,10 @@ recursively shared MTP module, plus a paired measurement of how suffix informati
85
  changes draft acceptance. A targeted search found no exact prior measurement, but
86
  that is not proof of absence. No exclusivity or first-of-its-kind claim is made.
87
 
88
- ## What it is not
 
 
 
89
 
90
  It is not a chat model, an instruction-following model, or an agent. It completes
91
  text. Asking it to refactor a module produces nonsense.
@@ -96,7 +121,10 @@ and Wisp saw 5 billion, three orders of magnitude fewer. If you want the best
96
  completions available at small scale, use Qwen. Use Wisp to study FIM plus native
97
  speculative drafting on Apple Silicon, or how those two interact.
98
 
99
- ## Architecture
 
 
 
100
 
101
  | | |
102
  |---|---|
@@ -122,7 +150,10 @@ logit delta 2.16e-3 and argmax agreement 1.0000 against the MLX original on the
122
  same tokens, which pins the RoPE convention, the RMSNorm epsilon, and the grouped
123
  query head order.
124
 
125
- ## Training data
 
 
 
126
 
127
  The configured target mixture was 92 percent code from
128
  `bigcode/starcoderdata` and 8 percent `HuggingFaceFW/fineweb-edu`. This is a
@@ -148,7 +179,10 @@ raw-row manifest and cannot prove exact original example boundaries.
148
  The Apache 2.0 metadata describes the released Wisp artifact. It does not
149
  override training-source terms or licenses applicable to generated code.
150
 
151
- ## Usage
 
 
 
152
 
153
  Plain completion:
154
 
@@ -196,7 +230,10 @@ while leaving a larger model as the chat and agent backend. Target-runtime batch
196
  latency and editor user experience have not yet been measured, so this is not a
197
  sub-100 ms claim.
198
 
199
- ## Evaluation
 
 
 
200
 
201
  ### Registered final results
202
 
@@ -235,7 +272,10 @@ overfit on 100k tokens), because two near-uniform distributions agree trivially.
235
  Those are pilot diagnostics, not run 1 results. Any final acceptance number
236
  without its exact initialized floor beside it is uninterpretable.
237
 
238
- ## Limitations
 
 
 
239
 
240
  - 5B training tokens. Small, and it shows on unfamiliar APIs, which it will
241
  hallucinate confidently.
@@ -261,7 +301,10 @@ without its exact initialized floor beside it is uninterpretable.
261
  no production-runtime MTP latency or speedup is claimed.
262
  - Trained and evaluated on one machine, one seed, one run.
263
 
264
- ## Citation
 
 
 
265
 
266
  ```bibtex
267
  @software{wisp_coder,
@@ -270,3 +313,15 @@ without its exact initialized floor beside it is uninterpretable.
270
  url = {https://huggingface.co/philipjohnbasile/wisp-coder-110m}
271
  }
272
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  pipeline_tag: text-generation
14
  ---
15
 
16
+ <!-- Wisp's floral identity, shared with the interactive Space. -->
17
+ <div style="background-color:#f4f1e8;background-image:radial-gradient(#d7d7c7 0.65px,transparent 0.65px);background-size:7px 7px;color:#263f32;border:1px solid #cbd0bf;padding:clamp(22px,4vw,38px);margin:8px 0 24px;">
18
+ <div style="display:flex;align-items:center;flex-wrap:wrap;gap:20px;">
19
+ <div style="flex:1 1 250px;min-width:0;">
20
+ <h1 id="wisp-coder-110m" style="font-family:Arial,sans-serif;font-size:13px;font-weight:600;letter-spacing:2px;text-transform:uppercase;color:#263f32;margin:0 0 24px;line-height:1.6;">❋ Wisp Coder 110M</h1>
21
+ <p style="font-family:Georgia,serif;font-size:clamp(48px,7vw,84px);font-weight:400;letter-spacing:-4px;line-height:0.98;color:#263f32;margin:0 0 24px;">Code,<br><em style="color:#ad3f5a;">in bloom.</em></p>
22
+ <p style="font-family:Georgia,serif;font-size:19px;line-height:1.5;color:#3b5041;margin:0 0 24px;max-width:340px;">A small model. A little curiosity.<br>Room for ideas to grow.</p>
23
+ <a href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="display:inline-block;background:#263f32;color:#fffdf5;padding:13px 20px;text-decoration:none;font-size:15px;font-weight:600;border:1px solid #263f32;box-shadow:4px 4px 0 #ccd4bc;">Try Wisp Coder ↗</a>
24
+ <p style="font-size:12px;line-height:1.6;color:#50614e;margin:22px 0 0;">An open research experiment<br>by Philip John Basile</p>
25
+ </div>
26
+ <img src="./assets/wisp-wildflowers.png" alt="Loose painted wildflowers in pink, coral, cobalt and green, the original artwork from the Wisp demo." style="flex:1 1 270px;width:45%;min-width:0;max-width:100%;height:auto;object-fit:contain;margin:0;" />
27
+ </div>
28
+ <div style="display:flex;flex-wrap:wrap;gap:10px 28px;border-top:1px solid #cbd0bf;margin-top:30px;padding-top:18px;font-size:12px;line-height:1.7;color:#40563e;">
29
+ <span><strong style="color:#263f32;">100.7M</strong> trunk parameters</span><span><strong style="color:#263f32;">108.2M</strong> with MTP</span><span><strong style="color:#263f32;">2,048</strong> token context</span>
30
+ </div>
31
+ </div>
32
+
33
+ <p style="font-size:13px;line-height:2;">FIELD NOTES &nbsp; / &nbsp; <a href="#start-here">Start here</a> &nbsp; · &nbsp; <a href="#architecture">Architecture</a> &nbsp; · &nbsp; <a href="#usage">Usage</a> &nbsp; · &nbsp; <a href="#evaluation">Evidence</a> &nbsp; · &nbsp; <a href="#limitations">Limits</a></p>
34
 
35
  [Explore the model guide](https://huggingface.co/spaces/philipjohnbasile/local-ai-guide) · [All public work](https://huggingface.co/philipjohnbasile)
36
 
37
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#f4f1e8;border-left:3px solid #ad3f5a;">
38
+ <p style="margin:0 0 6px;color:#ad3f5a;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">01 / A place to begin.</p>
39
+ <h2 id="start-here" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#263f32;margin:0;padding:0;border:0;">Start here</h2>
40
+ </div>
41
 
42
  **[Try the interactive CPU demo](https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo)** ·
43
  [Short-hole evaluation](./fim-competitive-v1/FIM_RESULTS.md) ·
 
77
 
78
  Review generated code before using it. The demo also provides FIM prompts and displays raw suggestions without executing them. The full training, data-provenance, and evaluation disclosures follow.
79
 
80
+ ### The idea
81
+
82
  A small code model built for one job: completing code at the cursor. It targets
83
  editor inline suggestions, but no production-runtime latency claim is made.
84
 
 
107
  changes draft acceptance. A targeted search found no exact prior measurement, but
108
  that is not proof of absence. No exclusivity or first-of-its-kind claim is made.
109
 
110
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#f4f1e8;border-left:3px solid #ad3f5a;">
111
+ <p style="margin:0 0 6px;color:#ad3f5a;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">02 / Set expectations.</p>
112
+ <h2 id="what-it-is-not" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#263f32;margin:0;padding:0;border:0;">What it is not</h2>
113
+ </div>
114
 
115
  It is not a chat model, an instruction-following model, or an agent. It completes
116
  text. Asking it to refactor a module produces nonsense.
 
121
  completions available at small scale, use Qwen. Use Wisp to study FIM plus native
122
  speculative drafting on Apple Silicon, or how those two interact.
123
 
124
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#f4f1e8;border-left:3px solid #ad3f5a;">
125
+ <p style="margin:0 0 6px;color:#ad3f5a;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">03 / Under the petals.</p>
126
+ <h2 id="architecture" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#263f32;margin:0;padding:0;border:0;">Architecture</h2>
127
+ </div>
128
 
129
  | | |
130
  |---|---|
 
150
  same tokens, which pins the RoPE convention, the RMSNorm epsilon, and the grouped
151
  query head order.
152
 
153
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#f4f1e8;border-left:3px solid #ad3f5a;">
154
+ <p style="margin:0 0 6px;color:#ad3f5a;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">04 / Where it grew.</p>
155
+ <h2 id="training-data" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#263f32;margin:0;padding:0;border:0;">Training data</h2>
156
+ </div>
157
 
158
  The configured target mixture was 92 percent code from
159
  `bigcode/starcoderdata` and 8 percent `HuggingFaceFW/fineweb-edu`. This is a
 
179
  The Apache 2.0 metadata describes the released Wisp artifact. It does not
180
  override training-source terms or licenses applicable to generated code.
181
 
182
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#f4f1e8;border-left:3px solid #ad3f5a;">
183
+ <p style="margin:0 0 6px;color:#ad3f5a;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">05 / Give it a few lines.</p>
184
+ <h2 id="usage" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#263f32;margin:0;padding:0;border:0;">Usage</h2>
185
+ </div>
186
 
187
  Plain completion:
188
 
 
230
  latency and editor user experience have not yet been measured, so this is not a
231
  sub-100 ms claim.
232
 
233
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#263f32;border-left:3px solid #f3a4b8;">
234
+ <p style="margin:0 0 6px;color:#f3a4b8;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">06 / Follow the evidence.</p>
235
+ <h2 id="evaluation" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#f8f3e7;margin:0;padding:0;border:0;">Evaluation</h2>
236
+ </div>
237
 
238
  ### Registered final results
239
 
 
272
  Those are pilot diagnostics, not run 1 results. Any final acceptance number
273
  without its exact initialized floor beside it is uninterpretable.
274
 
275
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#f4f1e8;border-left:3px solid #ad3f5a;">
276
+ <p style="margin:0 0 6px;color:#ad3f5a;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">07 / Still growing.</p>
277
+ <h2 id="limitations" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#263f32;margin:0;padding:0;border:0;">Limitations</h2>
278
+ </div>
279
 
280
  - 5B training tokens. Small, and it shows on unfamiliar APIs, which it will
281
  hallucinate confidently.
 
301
  no production-runtime MTP latency or speedup is claimed.
302
  - Trained and evaluated on one machine, one seed, one run.
303
 
304
+ <div style="margin:38px 0 22px;padding:20px 24px;background:#f4f1e8;border-left:3px solid #ad3f5a;">
305
+ <p style="margin:0 0 6px;color:#ad3f5a;font-size:11px;letter-spacing:1.8px;text-transform:uppercase;">08 / Keep the trail.</p>
306
+ <h2 id="citation" style="font-family:Georgia,serif;font-size:30px;line-height:1.2;font-weight:400;letter-spacing:-0.6px;color:#263f32;margin:0;padding:0;border:0;">Citation</h2>
307
+ </div>
308
 
309
  ```bibtex
310
  @software{wisp_coder,
 
313
  url = {https://huggingface.co/philipjohnbasile/wisp-coder-110m}
314
  }
315
  ```
316
+
317
+
318
+ <div style="background:#f4f1e8;border-top:1px solid #cbd0bf;margin-top:36px;padding:24px;display:flex;align-items:center;flex-wrap:wrap;gap:18px;color:#263f32;">
319
+ <img src="./assets/wisp-wildflowers.png" alt="" style="flex:0 1 180px;width:180px;max-width:100%;height:auto;object-fit:contain;margin:0;" />
320
+ <div style="flex:1 1 210px;min-width:0;">
321
+ <p style="font-size:11px;letter-spacing:1.5px;color:#50614e;margin:0 0 8px;">SMALL MODEL. OPEN QUESTIONS.</p>
322
+ <p style="font-family:Georgia,serif;font-size:42px;letter-spacing:-2px;line-height:1.15;color:#263f32;margin:0 0 12px;">Stay <em style="color:#ad3f5a;">curious.</em></p>
323
+ <p style="font-size:14px;line-height:1.8;margin:0;"><a href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="color:#8e3049;">Return to the garden ↗</a> &nbsp; · &nbsp; <a href="https://huggingface.co/philipjohnbasile" style="color:#263f32;">More from Philip</a></p>
324
+ </div>
325
+ </div>
326
+
327
+ <sub>Original AI-generated floral artwork shared with the Wisp demo. [Artwork notes](./assets/ARTWORK.md).</sub>
assets/ARTWORK.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Wisp model card artwork
2
+
3
+ This card reuses the original transparent wildflower illustration created for the Wisp Coder demo. The artwork is AI-generated, inspired by the user-provided Michael De Feo / The Flower Guy reference. It is not the artist's work or an endorsement.
4
+
5
+ The image is displayed in full using natural proportions; no flowers are cropped. The model card uses text and HTML layout rather than embedding technical content in an image.
6
+
7
+ ## Source
8
+
9
+ https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo
10
+
11
+
12
+
13
+ `wisp-wildflowers.png` is the final 1536×1024 RGBA hero and footer illustration,
14
+ generated with the same built-in tool. Its alpha channel was verified; roughly
15
+ 44% of its pixels are fully transparent.
16
+
17
+ ### Generation prompt
18
+
19
+ Create a new original editorial artwork for an expressive code playground website. Inspired by Michael De Feo / The Flower Guy's layered, gestural floral interventions. Landscape 1536x1024, REAL TRANSPARENT background (alpha), no canvas rectangle, no text, no letters, no signature, no frame, no people. Airy asymmetrical cloud of large and small painted flowers and winding stems, concentrated on the right two thirds, drifting down into lower left, with generous transparent spaces between stems. Loose flat five- and six-petal forms, interrupted looping outlines and quickly daubed irregular petals; raw acrylic, gouache and oil-stick marks with thin paint drips. More abstract and graphic than realistic botanical illustration. Hot coral and pink, ultramarine, rich emerald, acid yellow touches, powder blue and deep wine. Some outlined flowers with transparent interiors, some thickly painted solid petals, lively mismatched scales. Rough playful hand-painted energy, complex layered marks but a legible open silhouette at website size. It should feel like paint blooming across the website's underlying paper and typography, not a bouquet in a vase, not a greeting card, not a stock watercolor illustration. Transparent background throughout the negative space. Make the outer edges organic, with sparse little painted marks extending beyond the main flowers.
assets/wisp-wildflowers.png ADDED

Git LFS Details

  • SHA256: 067a09a9294d43be52bce108aea46ffa959db22bbbc39f00d3d6bd7e31c05e5c
  • Pointer size: 132 Bytes
  • Size of remote file: 2.57 MB