Instructions to use philipjohnbasile/wisp-coder-110m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use philipjohnbasile/wisp-coder-110m with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="philipjohnbasile/wisp-coder-110m")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("philipjohnbasile/wisp-coder-110m") model = AutoModelForCausalLM.from_pretrained("philipjohnbasile/wisp-coder-110m", device_map="auto") - MLX
How to use philipjohnbasile/wisp-coder-110m with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("philipjohnbasile/wisp-coder-110m") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- vLLM
How to use philipjohnbasile/wisp-coder-110m with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "philipjohnbasile/wisp-coder-110m" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "philipjohnbasile/wisp-coder-110m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/philipjohnbasile/wisp-coder-110m
- SGLang
How to use philipjohnbasile/wisp-coder-110m with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "philipjohnbasile/wisp-coder-110m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "philipjohnbasile/wisp-coder-110m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "philipjohnbasile/wisp-coder-110m" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "philipjohnbasile/wisp-coder-110m", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - MLX LM
How to use philipjohnbasile/wisp-coder-110m with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "philipjohnbasile/wisp-coder-110m" --prompt "Once upon a time"
- Docker Model Runner
How to use philipjohnbasile/wisp-coder-110m with Docker Model Runner:
docker model run hf.co/philipjohnbasile/wisp-coder-110m
- Atomic Chat
Give the Wisp Fieldbook room to grow
Browse filesUse bounded fit-content sizing to reclaim the model-card right gutter on larger screens, with a full-width mobile fallback. Contain the architecture flower float, restore the two-column runtime comparison, and add an illustrated guide to the twelve trunk layers and shared MTP block. Preserve all scientific text, six original code examples, metadata, links, and thirteen default-open panels. Reviewed the complete sanitized desktop and mobile previews.
|
@@ -13,7 +13,7 @@ library_name: transformers
|
|
| 13 |
pipeline_tag: text-generation
|
| 14 |
---
|
| 15 |
|
| 16 |
-
<div id="wisp-experience" style="color:#354b3b;background:#f4f1e8;padding:clamp(18px,3vw,38px);margin:8px 0 0;position:relative;background-image:radial-gradient(#d7dbc9 0.55px,transparent 0.55px);background-size:8px 8px;font-size:15px;line-height:1.8;overflow-wrap:anywhere;"><!-- The Wisp Fieldbook: a native Hugging Face model card. -->
|
| 17 |
<div class="group" id="wisp-cover" style="color:#263f32;padding:0;margin:0;background:transparent;">
|
| 18 |
<div style="display:flex;justify-content:space-between;align-items:center;flex-wrap:wrap;gap:12px;padding-bottom:18px;margin-bottom:36px;background:transparent;border-bottom:1px solid #bfccb1;">
|
| 19 |
<h1 id="wisp-coder-110m" style="font-family:Arial,sans-serif;font-size:13px;font-weight:600;letter-spacing:1.4px;text-transform:uppercase;color:#263f32;margin:0;line-height:1.6;">Wisp Coder 110M</h1>
|
|
@@ -27,7 +27,7 @@ pipeline_tag: text-generation
|
|
| 27 |
<a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="display:inline-block;color:#fffdf5;padding:13px 19px;text-decoration:none;font-size:14px;font-weight:600;text-decoration-thickness:1px;text-underline-offset:3px;background:#263f32;border-bottom:3px solid #a1b68c;">Enter the playground <span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:translate-x-0.5" style="display:inline-block;">↗</span></a>
|
| 28 |
<p style="font-size:11px;line-height:1.7;color:#50614e;margin:22px 0 0;">An open research experiment<br/>by Philip John Basile</p>
|
| 29 |
</div>
|
| 30 |
-
<div style="flex:1 1 270px;min-width:0;max-width:100%;padding:
|
| 31 |
<img alt="Original painted wildflowers in pink, coral, cobalt and green. They gently turn when you hover over the cover." class="wisp-botanical motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:rotate-6" src="./assets/wisp-wildflowers.png" style="width:100%;max-width:100%;height:auto;object-fit:contain;margin:0;border:0;"/>
|
| 32 |
<p style="font-family:Georgia,serif;font-style:italic;color:#5d704f;font-size:14px;text-align:right;margin:20px 5px 0;">Small model. Open questions.</p>
|
| 33 |
</div>
|
|
@@ -197,10 +197,29 @@ arithmetic says it cannot be: Qwen2.5-Coder-0.5B saw roughly 5.5 trillion tokens
|
|
| 197 |
and Wisp saw 5 billion, three orders of magnitude fewer. If you want the best
|
| 198 |
completions available at small scale, use Qwen. Use Wisp to study FIM plus native
|
| 199 |
speculative drafting on Apple Silicon, or how those two interact.</p>
|
| 200 |
-
<div class="group" style="margin:0 0 24px;padding:44px 0 0;background:transparent;position:relative;"><span aria-hidden="true" style="position:absolute;left:calc(-1 * clamp(14px,2vw,23px) - 7px);top:43px;color:#ad3f5a;background:#f4f1e8;font-size:14px;line-height:1;">❋</span><img alt="" class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:-rotate-6" src="./assets/wisp-wildflowers.png" style="width:180px;max-width:45%;height:auto;object-fit:contain;float:right;margin:-5px 0 12px 15px;border:0;"/>
|
| 201 |
<p style="margin:0 0 12px;color:#9f3d58;font-size:10px;letter-spacing:1.6px;text-transform:uppercase;">03 / ARCHITECTURE</p>
|
| 202 |
<h2 id="architecture" style="font-family:Georgia,serif;font-size:clamp(32px,4.3vw,46px);line-height:1.08;font-weight:400;letter-spacing:-1.6px;color:#263f32;margin:0;padding:0;border:0;scroll-margin-top:24px;">Under the petals.</h2>
|
| 203 |
</div>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 204 |
<div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(min(100%,250px),1fr));gap:14px;margin:24px 0;background:transparent;">
|
| 205 |
<a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:translate-x-px focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/philipjohnbasile/wisp-coder-110m/blob/main/config.json" style="display:block;padding:10px 0 20px;color:#263f32;text-decoration:none;text-decoration-thickness:1px;text-underline-offset:3px;margin:0;border-bottom:1px solid #bdcdb0;">
|
| 206 |
<span style="display:block;font-size:10px;letter-spacing:1.4px;color:#50614e;margin-bottom:12px;">ROUTE A / THE TRUNK</span><span style="display:block;font-family:Georgia,serif;font-size:27px;line-height:1.2;color:#263f32;margin-bottom:12px;">An ordinary Llama decoder.</span><span style="display:block;font-size:13px;line-height:1.7;color:#354b3b;">100.7M parameters. Standard Transformers and MLX-LM loading.</span><span style="display:block;font-size:12px;color:#8e3049;margin-top:16px;">Inspect the configuration ↗</span>
|
|
|
|
| 13 |
pipeline_tag: text-generation
|
| 14 |
---
|
| 15 |
|
| 16 |
+
<div id="wisp-experience" style="color:#354b3b;background:#f4f1e8;padding:clamp(18px,3vw,38px);margin:8px 0 0;position:relative;background-image:radial-gradient(#d7dbc9 0.55px,transparent 0.55px);background-size:8px 8px;font-size:15px;line-height:1.8;overflow-wrap:anywhere;--wisp-gutter:calc(clamp(0px, calc(100vw - 768px), 16px) + clamp(0px, calc(100vw - 1024px), 56px) + clamp(0px, calc(100vw - 1280px), 16px) + clamp(0px, calc(100vw - 1536px), 48px));width:fit-content;min-width:100%;max-width:calc(100% + var(--wisp-gutter));box-sizing:border-box;"><!-- The Wisp Fieldbook: a native Hugging Face model card. -->
|
| 17 |
<div class="group" id="wisp-cover" style="color:#263f32;padding:0;margin:0;background:transparent;">
|
| 18 |
<div style="display:flex;justify-content:space-between;align-items:center;flex-wrap:wrap;gap:12px;padding-bottom:18px;margin-bottom:36px;background:transparent;border-bottom:1px solid #bfccb1;">
|
| 19 |
<h1 id="wisp-coder-110m" style="font-family:Arial,sans-serif;font-size:13px;font-weight:600;letter-spacing:1.4px;text-transform:uppercase;color:#263f32;margin:0;line-height:1.6;">Wisp Coder 110M</h1>
|
|
|
|
| 27 |
<a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:scale-[1.01] hover:brightness-[102%] focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/spaces/philipjohnbasile/wisp-coder-demo" style="display:inline-block;color:#fffdf5;padding:13px 19px;text-decoration:none;font-size:14px;font-weight:600;text-decoration-thickness:1px;text-underline-offset:3px;background:#263f32;border-bottom:3px solid #a1b68c;">Enter the playground <span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:translate-x-0.5" style="display:inline-block;">↗</span></a>
|
| 28 |
<p style="font-size:11px;line-height:1.7;color:#50614e;margin:22px 0 0;">An open research experiment<br/>by Philip John Basile</p>
|
| 29 |
</div>
|
| 30 |
+
<div style="flex:1.15 1 270px;min-width:0;max-width:100%;padding:18px 14px;background:transparent;">
|
| 31 |
<img alt="Original painted wildflowers in pink, coral, cobalt and green. They gently turn when you hover over the cover." class="wisp-botanical motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:rotate-6" src="./assets/wisp-wildflowers.png" style="width:100%;max-width:100%;height:auto;object-fit:contain;margin:0;border:0;"/>
|
| 32 |
<p style="font-family:Georgia,serif;font-style:italic;color:#5d704f;font-size:14px;text-align:right;margin:20px 5px 0;">Small model. Open questions.</p>
|
| 33 |
</div>
|
|
|
|
| 197 |
and Wisp saw 5 billion, three orders of magnitude fewer. If you want the best
|
| 198 |
completions available at small scale, use Qwen. Use Wisp to study FIM plus native
|
| 199 |
speculative drafting on Apple Silicon, or how those two interact.</p>
|
| 200 |
+
<div class="group" style="margin:0 0 24px;padding:44px 0 0;background:transparent;position:relative;display:flow-root;"><span aria-hidden="true" style="position:absolute;left:calc(-1 * clamp(14px,2vw,23px) - 7px);top:43px;color:#ad3f5a;background:#f4f1e8;font-size:14px;line-height:1;">❋</span><img alt="" class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:scale-105 group-hover:-rotate-6" src="./assets/wisp-wildflowers.png" style="width:180px;max-width:45%;height:auto;object-fit:contain;float:right;margin:-5px 0 12px 15px;border:0;"/>
|
| 201 |
<p style="margin:0 0 12px;color:#9f3d58;font-size:10px;letter-spacing:1.6px;text-transform:uppercase;">03 / ARCHITECTURE</p>
|
| 202 |
<h2 id="architecture" style="font-family:Georgia,serif;font-size:clamp(32px,4.3vw,46px);line-height:1.08;font-weight:400;letter-spacing:-1.6px;color:#263f32;margin:0;padding:0;border:0;scroll-margin-top:24px;">Under the petals.</h2>
|
| 203 |
</div>
|
| 204 |
+
<div id="wisp-anatomy" style="margin:8px 0 30px;padding:0 0 24px;border-bottom:1px solid #bdcdb0;">
|
| 205 |
+
<p style="font-family:Georgia,serif;font-size:21px;color:#354b3b;margin:0 0 22px;">Twelve layers. One shared module. A little further ahead.</p>
|
| 206 |
+
<div style="display:flex;flex-wrap:wrap;align-items:flex-start;gap:28px;">
|
| 207 |
+
<div class="group" style="flex:1.7 1 280px;min-width:0;">
|
| 208 |
+
<div aria-hidden="true" style="display:grid;grid-template-columns:repeat(12,minmax(0,1fr));gap:5px;"><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">01</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">02</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">03</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">04</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">05</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">06</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">07</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">08</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">09</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">10</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#dfe6d5;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">11</span></div><div style="min-width:0;text-align:center;"><span class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:-translate-y-px" style="display:block;height:72px;border:1px solid #9db18f;border-radius:22px 22px 3px 3px;background:#bccdab;"></span><span style="display:block;color:#536747;font-size:9px;margin-top:7px;">12</span></div></div>
|
| 209 |
+
<p style="color:#263f32;font-size:12px;margin:15px 0 3px;letter-spacing:1px;">12 TRUNK LAYERS</p>
|
| 210 |
+
<p style="color:#50614e;font-size:12px;line-height:1.7;margin:0;">768 hidden dimensions · 12 attention heads<br/>4 KV heads · SwiGLU 2,048</p>
|
| 211 |
+
</div>
|
| 212 |
+
<div class="group" style="flex:1 1 180px;min-width:0;">
|
| 213 |
+
<div style="display:flex;align-items:center;gap:15px;min-height:92px;">
|
| 214 |
+
<span aria-hidden="true" class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] group-hover:rotate-6" style="display:flex;align-items:center;justify-content:center;flex:0 0 72px;height:72px;border:1px solid #b3677a;border-radius:50%;font-family:Georgia,serif;font-size:44px;line-height:1;color:#ad3f5a;">1</span>
|
| 215 |
+
<span style="font-family:Georgia,serif;font-size:23px;line-height:1.2;color:#963c54;">Shared.<br/><em>Reused.</em></span>
|
| 216 |
+
</div>
|
| 217 |
+
<p style="color:#963c54;font-size:12px;margin:15px 0 3px;letter-spacing:1px;">1 MTP TRANSFORMER BLOCK</p>
|
| 218 |
+
<p style="color:#50614e;font-size:12px;line-height:1.7;margin:0;">Trained to depth 2.<br/>Applied recursively at inference.</p>
|
| 219 |
+
</div>
|
| 220 |
+
</div>
|
| 221 |
+
<p style="color:#50614e;font-size:12px;line-height:1.7;margin:22px 0 0;">The trunk and MTP module share the LM head. The sidecar requires the explicit MTP runtime below.</p>
|
| 222 |
+
</div>
|
| 223 |
<div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(min(100%,250px),1fr));gap:14px;margin:24px 0;background:transparent;">
|
| 224 |
<a class="motion-safe:transition-transform motion-safe:duration-[400ms] motion-safe:[transition-timing-function:ease] hover:translate-x-px focus-visible:outline-2 focus-visible:outline-offset-2 focus-visible:outline-blue-500" href="https://huggingface.co/philipjohnbasile/wisp-coder-110m/blob/main/config.json" style="display:block;padding:10px 0 20px;color:#263f32;text-decoration:none;text-decoration-thickness:1px;text-underline-offset:3px;margin:0;border-bottom:1px solid #bdcdb0;">
|
| 225 |
<span style="display:block;font-size:10px;letter-spacing:1.4px;color:#50614e;margin-bottom:12px;">ROUTE A / THE TRUNK</span><span style="display:block;font-family:Georgia,serif;font-size:27px;line-height:1.2;color:#263f32;margin-bottom:12px;">An ordinary Llama decoder.</span><span style="display:block;font-size:13px;line-height:1.7;color:#354b3b;">100.7M parameters. Standard Transformers and MLX-LM loading.</span><span style="display:block;font-size:12px;color:#8e3049;margin-top:16px;">Inspect the configuration ↗</span>
|