Text Generation
Transformers
Safetensors
MLX
code
llama
fill-in-the-middle
multi-token-prediction
speculative-decoding
apple-silicon
text-generation-inference
Instructions to use philipjohnbasile/wisp-coder-110m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use philipjohnbasile/wisp-coder-110m with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="philipjohnbasile/wisp-coder-110m")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("philipjohnbasile/wisp-coder-110m") model = AutoModelForCausalLM.from_pretrained("philipjohnbasile/wisp-coder-110m", device_map="auto") - MLX
How to use philipjohnbasile/wisp-coder-110m with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("philipjohnbasile/wisp-coder-110m") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- vLLM
How to use philipjohnbasile/wisp-coder-110m with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "philipjohnbasile/wisp-coder-110m" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "philipjohnbasile/wisp-coder-110m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/philipjohnbasile/wisp-coder-110m
- SGLang
How to use philipjohnbasile/wisp-coder-110m with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "philipjohnbasile/wisp-coder-110m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "philipjohnbasile/wisp-coder-110m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "philipjohnbasile/wisp-coder-110m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "philipjohnbasile/wisp-coder-110m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - MLX LM
How to use philipjohnbasile/wisp-coder-110m with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "philipjohnbasile/wisp-coder-110m" --prompt "Once upon a time"
- Docker Model Runner
How to use philipjohnbasile/wisp-coder-110m with Docker Model Runner:
docker model run hf.co/philipjohnbasile/wisp-coder-110m
- Atomic Chat
Open all Fieldbook panels by default
Browse filesDefault all 13 details panels to open. Remove exclusive grouping from the three FIM panels so they can stay open together, and update the expansion hints. Each panel can still be collapsed individually.
README.md
CHANGED
|
@@ -61,9 +61,9 @@ pipeline_tag: text-generation
|
|
| 61 |
<div id="wisp-cursor" style="background:#263f32;color:#f7f2e6;padding:24px;margin:26px 0;border:1px solid #46614a;">
|
| 62 |
<p style="font-size:11px;letter-spacing:1.6px;color:#e8bcd0;margin:0 0 9px;">ANATOMY OF A GAP</p>
|
| 63 |
<h3 style="font-family:Georgia,serif;font-weight:400;font-size:32px;line-height:1.2;color:#f7f2e6;margin:0 0 12px;">A little room <em style="color:#f3a4b8;">for possibility.</em></h3>
|
| 64 |
-
<p style="font-size:13px;line-height:1.7;color:#dae1cd;margin:0 0 20px;">
|
| 65 |
<div style="display:flex;align-items:flex-start;flex-wrap:wrap;gap:10px;">
|
| 66 |
-
<details id="wisp-prefix"
|
| 67 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:16px;">
|
| 68 |
<span style="display:block;font-size:10px;letter-spacing:1px;color:#dae1cd;margin:0 0 10px;">YOU PROVIDE</span>
|
| 69 |
<span style="display:flex;align-items:center;justify-content:space-between;font-family:Georgia,serif;font-size:24px;color:#f7f2e6;margin:0 0 6px;">Prefix<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="display:inline-block;font-family:Arial,sans-serif;font-size:18px;">β</span></span>
|
|
@@ -71,7 +71,7 @@ pipeline_tag: text-generation
|
|
| 71 |
</summary>
|
| 72 |
<div style="border-top:1px dashed #80917a;padding:16px;"><p style="font-size:13px;line-height:1.7;color:#f7f2e6;margin:0 0 12px;">The source context before the missing span.</p><code style="display:block;overflow-wrap:anywhere;white-space:normal;background:#203328;color:#f7f2e6;font-size:11px;padding:7px;"><|fim_prefix|></code></div>
|
| 73 |
</details>
|
| 74 |
-
<details id="wisp-middle"
|
| 75 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:16px;">
|
| 76 |
<span style="display:block;font-size:10px;letter-spacing:1px;color:#592d39;margin:0 0 10px;">WISP SUGGESTS</span>
|
| 77 |
<span style="display:flex;align-items:center;justify-content:space-between;font-family:Georgia,serif;font-size:24px;color:#49252e;margin:0 0 6px;">Middle<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="display:inline-block;font-family:Arial,sans-serif;font-size:18px;">β</span></span>
|
|
@@ -79,7 +79,7 @@ pipeline_tag: text-generation
|
|
| 79 |
</summary>
|
| 80 |
<div style="border-top:1px dashed #ad6d80;padding:16px;"><p style="font-size:13px;line-height:1.7;color:#49252e;margin:0 0 12px;">The model predicts this span using both sides of the gap. Review its suggestion before use.</p><code style="display:block;overflow-wrap:anywhere;white-space:normal;background:#f8d5df;color:#49252e;font-size:11px;padding:7px;"><|fim_middle|></code></div>
|
| 81 |
</details>
|
| 82 |
-
<details id="wisp-suffix"
|
| 83 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:16px;">
|
| 84 |
<span style="display:block;font-size:10px;letter-spacing:1px;color:#dae1cd;margin:0 0 10px;">YOU PROVIDE</span>
|
| 85 |
<span style="display:flex;align-items:center;justify-content:space-between;font-family:Georgia,serif;font-size:24px;color:#f7f2e6;margin:0 0 6px;">Suffix<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="display:inline-block;font-family:Arial,sans-serif;font-size:18px;">β</span></span>
|
|
@@ -91,37 +91,37 @@ pipeline_tag: text-generation
|
|
| 91 |
<p style="font-size:13px;line-height:1.7;color:#dae1cd;margin:18px 0 0;">Provide the code on both sides of a gap. Wisp predicts the middle. <a href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="color:#f3b7ca;text-decoration:underline;">Explore it in the playground β</a></p>
|
| 92 |
</div>
|
| 93 |
|
| 94 |
-
<p style="font-size:12px;letter-spacing:1px;margin:26px 0 14px;">THE SPECIMEN NOTES /
|
| 95 |
<div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(min(100%,250px),1fr));align-items:start;gap:14px;margin:0 0 30px;">
|
| 96 |
-
<details id="wisp-note-1" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#f4f1e8;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 97 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 98 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">PURPOSE<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 99 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What is it for?</span>
|
| 100 |
</summary>
|
| 101 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">Research on code completion, fill-in-the-middle (FIM), and native multi-token prediction (MTP).</p></div>
|
| 102 |
</details>
|
| 103 |
-
<details id="wisp-note-2" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#ecefdf;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 104 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 105 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">FROM STEP ZERO<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 106 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What did I build?</span>
|
| 107 |
</summary>
|
| 108 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">Philip John Basile's model trained from step zero: 100.7M trunk parameters, 108.2M including the MTP module.</p></div>
|
| 109 |
</details>
|
| 110 |
-
<details id="wisp-note-3" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#f4f1e8;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 111 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 112 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">RUNTIME<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 113 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What runs it?</span>
|
| 114 |
</summary>
|
| 115 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">The trunk uses standard Transformers or MLX-LM. MTP requires the explicit packaged MLX reference runtime; generic loaders do not activate the sidecar.</p></div>
|
| 116 |
</details>
|
| 117 |
-
<details id="wisp-note-4" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#f4f1e8;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 118 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 119 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">RECENT CHECK<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 120 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What was checked recently?</span>
|
| 121 |
</summary>
|
| 122 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">CPU float32 completions with PyTorch 2.13.0 and Transformers 5.14.1 on 2026-09-10. These are functional smokes, not a coding-quality or latency benchmark.</p></div>
|
| 123 |
</details>
|
| 124 |
-
<details id="wisp-note-5" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#ecefdf;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 125 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 126 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">WEIGHT SIZE<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 127 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">How much memory?</span>
|
|
@@ -265,7 +265,7 @@ clauses remain applicable. FineWeb-Edu is ODC-By 1.0 and remains subject to
|
|
| 265 |
Common Crawl terms. Run 1 retained no row-level source manifest, so no per-file
|
| 266 |
licensing or attribution guarantee is made.
|
| 267 |
|
| 268 |
-
<details class="group" style="border:1px solid #829471;margin:20px 0;padding:0;">
|
| 269 |
<summary class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;padding:16px 20px;background:#ecefdf;color:#263f32;font-family:Georgia,serif;font-size:20px;">Open the training-data provenance notes</summary>
|
| 270 |
<div style="padding:4px 20px 16px;">
|
| 271 |
|
|
@@ -379,7 +379,7 @@ sub-100 ms claim.
|
|
| 379 |
|
| 380 |
Validation intervals measure Monte Carlo uncertainty from the frozen random-window sampler. Acceptance and rollout intervals resample paired target documents. They do not measure training-run or model uncertainty. Null and negative outcomes are retained rather than filtered from the release.
|
| 381 |
|
| 382 |
-
<details class="group" style="border:1px solid #829471;margin:20px 0;padding:0;">
|
| 383 |
<summary class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;padding:16px 20px;background:#ecefdf;color:#263f32;font-family:Georgia,serif;font-size:20px;">Read the sampler, replay and provenance notes</summary>
|
| 384 |
<div style="padding:4px 20px 16px;">
|
| 385 |
|
|
|
|
| 61 |
<div id="wisp-cursor" style="background:#263f32;color:#f7f2e6;padding:24px;margin:26px 0;border:1px solid #46614a;">
|
| 62 |
<p style="font-size:11px;letter-spacing:1.6px;color:#e8bcd0;margin:0 0 9px;">ANATOMY OF A GAP</p>
|
| 63 |
<h3 style="font-family:Georgia,serif;font-weight:400;font-size:32px;line-height:1.2;color:#f7f2e6;margin:0 0 12px;">A little room <em style="color:#f3a4b8;">for possibility.</em></h3>
|
| 64 |
+
<p style="font-size:13px;line-height:1.7;color:#dae1cd;margin:0 0 20px;">Explore each piece of the prompt. Collapse any panel to focus your view.</p>
|
| 65 |
<div style="display:flex;align-items:flex-start;flex-wrap:wrap;gap:10px;">
|
| 66 |
+
<details open id="wisp-prefix" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="flex:1 1 150px;min-width:0;border:1px solid #80917a;background:#2b4436;color:#f7f2e6;">
|
| 67 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:16px;">
|
| 68 |
<span style="display:block;font-size:10px;letter-spacing:1px;color:#dae1cd;margin:0 0 10px;">YOU PROVIDE</span>
|
| 69 |
<span style="display:flex;align-items:center;justify-content:space-between;font-family:Georgia,serif;font-size:24px;color:#f7f2e6;margin:0 0 6px;">Prefix<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="display:inline-block;font-family:Arial,sans-serif;font-size:18px;">β</span></span>
|
|
|
|
| 71 |
</summary>
|
| 72 |
<div style="border-top:1px dashed #80917a;padding:16px;"><p style="font-size:13px;line-height:1.7;color:#f7f2e6;margin:0 0 12px;">The source context before the missing span.</p><code style="display:block;overflow-wrap:anywhere;white-space:normal;background:#203328;color:#f7f2e6;font-size:11px;padding:7px;"><|fim_prefix|></code></div>
|
| 73 |
</details>
|
| 74 |
+
<details open id="wisp-middle" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="flex:1 1 150px;min-width:0;border:1px solid #ad6d80;background:#f1aec0;color:#49252e;">
|
| 75 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:16px;">
|
| 76 |
<span style="display:block;font-size:10px;letter-spacing:1px;color:#592d39;margin:0 0 10px;">WISP SUGGESTS</span>
|
| 77 |
<span style="display:flex;align-items:center;justify-content:space-between;font-family:Georgia,serif;font-size:24px;color:#49252e;margin:0 0 6px;">Middle<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="display:inline-block;font-family:Arial,sans-serif;font-size:18px;">β</span></span>
|
|
|
|
| 79 |
</summary>
|
| 80 |
<div style="border-top:1px dashed #ad6d80;padding:16px;"><p style="font-size:13px;line-height:1.7;color:#49252e;margin:0 0 12px;">The model predicts this span using both sides of the gap. Review its suggestion before use.</p><code style="display:block;overflow-wrap:anywhere;white-space:normal;background:#f8d5df;color:#49252e;font-size:11px;padding:7px;"><|fim_middle|></code></div>
|
| 81 |
</details>
|
| 82 |
+
<details open id="wisp-suffix" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="flex:1 1 150px;min-width:0;border:1px solid #80917a;background:#2b4436;color:#f7f2e6;">
|
| 83 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:16px;">
|
| 84 |
<span style="display:block;font-size:10px;letter-spacing:1px;color:#dae1cd;margin:0 0 10px;">YOU PROVIDE</span>
|
| 85 |
<span style="display:flex;align-items:center;justify-content:space-between;font-family:Georgia,serif;font-size:24px;color:#f7f2e6;margin:0 0 6px;">Suffix<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="display:inline-block;font-family:Arial,sans-serif;font-size:18px;">β</span></span>
|
|
|
|
| 91 |
<p style="font-size:13px;line-height:1.7;color:#dae1cd;margin:18px 0 0;">Provide the code on both sides of a gap. Wisp predicts the middle. <a href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="color:#f3b7ca;text-decoration:underline;">Explore it in the playground β</a></p>
|
| 92 |
</div>
|
| 93 |
|
| 94 |
+
<p style="font-size:12px;letter-spacing:1px;margin:26px 0 14px;">THE SPECIMEN NOTES / COLLAPSE ANY NOTE TO FOCUS</p>
|
| 95 |
<div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(min(100%,250px),1fr));align-items:start;gap:14px;margin:0 0 30px;">
|
| 96 |
+
<details open id="wisp-note-1" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#f4f1e8;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 97 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 98 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">PURPOSE<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 99 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What is it for?</span>
|
| 100 |
</summary>
|
| 101 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">Research on code completion, fill-in-the-middle (FIM), and native multi-token prediction (MTP).</p></div>
|
| 102 |
</details>
|
| 103 |
+
<details open id="wisp-note-2" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#ecefdf;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 104 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 105 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">FROM STEP ZERO<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 106 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What did I build?</span>
|
| 107 |
</summary>
|
| 108 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">Philip John Basile's model trained from step zero: 100.7M trunk parameters, 108.2M including the MTP module.</p></div>
|
| 109 |
</details>
|
| 110 |
+
<details open id="wisp-note-3" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#f4f1e8;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 111 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 112 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">RUNTIME<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 113 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What runs it?</span>
|
| 114 |
</summary>
|
| 115 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">The trunk uses standard Transformers or MLX-LM. MTP requires the explicit packaged MLX reference runtime; generic loaders do not activate the sidecar.</p></div>
|
| 116 |
</details>
|
| 117 |
+
<details open id="wisp-note-4" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#f4f1e8;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 118 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 119 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">RECENT CHECK<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 120 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">What was checked recently?</span>
|
| 121 |
</summary>
|
| 122 |
<div style="padding:0 22px 22px;"><p style="font-size:14px;line-height:1.7;color:#354b3b;margin:0;border-top:1px dashed #aebaa0;padding-top:15px;">CPU float32 completions with PyTorch 2.13.0 and Transformers 5.14.1 on 2026-09-10. These are functional smokes, not a coding-quality or latency benchmark.</p></div>
|
| 123 |
</details>
|
| 124 |
+
<details open id="wisp-note-5" class="group motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%]" style="background:#ecefdf;border:1px solid #cbd0bf;color:#263f32;box-shadow:3px 3px 0 rgba(132,150,111,0.16);">
|
| 125 |
<summary class="focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;list-style:none;padding:22px;">
|
| 126 |
<span style="display:flex;justify-content:space-between;align-items:center;font-size:10px;letter-spacing:1.6px;color:#8e3049;margin:0 0 12px;">WEIGHT SIZE<span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-open:rotate-180" style="font-size:17px;display:inline-block;">β</span></span>
|
| 127 |
<span style="display:block;font-family:Georgia,serif;font-size:24px;font-weight:400;line-height:1.2;color:#263f32;">How much memory?</span>
|
|
|
|
| 265 |
Common Crawl terms. Run 1 retained no row-level source manifest, so no per-file
|
| 266 |
licensing or attribution guarantee is made.
|
| 267 |
|
| 268 |
+
<details open class="group" style="border:1px solid #829471;margin:20px 0;padding:0;">
|
| 269 |
<summary class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;padding:16px 20px;background:#ecefdf;color:#263f32;font-family:Georgia,serif;font-size:20px;">Open the training-data provenance notes</summary>
|
| 270 |
<div style="padding:4px 20px 16px;">
|
| 271 |
|
|
|
|
| 379 |
|
| 380 |
Validation intervals measure Monte Carlo uncertainty from the frozen random-window sampler. Acceptance and rollout intervals resample paired target documents. They do not measure training-run or model uncertainty. Null and negative outcomes are retained rather than filtered from the release.
|
| 381 |
|
| 382 |
+
<details open class="group" style="border:1px solid #829471;margin:20px 0;padding:0;">
|
| 383 |
<summary class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" style="cursor:pointer;padding:16px 20px;background:#ecefdf;color:#263f32;font-family:Georgia,serif;font-size:20px;">Read the sampler, replay and provenance notes</summary>
|
| 384 |
<div style="padding:4px 20px 16px;">
|
| 385 |
|