minaiml - PYTHAI delivery layer: what runs on a laptop and a phone
Browse files- README.md +24 -5
- index.html +53 -18
README.md
CHANGED
|
@@ -1,10 +1,29 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: minaiml
|
| 3 |
+
emoji: 📱
|
| 4 |
+
colorFrom: gray
|
| 5 |
+
colorTo: yellow
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
+
short_description: delivery software for models on laptops and phones
|
| 9 |
---
|
| 10 |
|
| 11 |
+
<p><b><a href="https://github.com/minaiml" target="_blank" rel="noopener">minaiml</a></b> (say it <i>minimal</i>) is <b><a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>'s delivery layer: the software that runs reasonable-sized models on hardware you already own. A mixture-of-experts model is mostly idle — a router wakes a handful of experts per token and leaves the rest on disk. Delivery is the art of exploiting that.</p>
|
| 12 |
+
|
| 13 |
+
<table>
|
| 14 |
+
<tr><th align="left">device</th><th align="left">model</th><th align="left">tok/s</th><th align="left">resident</th><th align="left">engine</th></tr>
|
| 15 |
+
<tr><td>MacBook Pro M3 Max, 48 GB</td><td>Qwen3.5-397B-A17B</td><td>4.36</td><td>~6 GB of 209 GB</td><td><a href="https://github.com/minaiml/flash-moe" target="_blank" rel="noopener">flash-moe</a></td></tr>
|
| 16 |
+
<tr><td>iPhone 17</td><td>Qwen3.5-35B-A3B</td><td>11</td><td>1.4 GB of 13 GB</td><td><a href="https://github.com/minaiml/Flash-iOS" target="_blank" rel="noopener">Flash-iOS</a></td></tr>
|
| 17 |
+
<tr><td>Raspberry Pi 5, 8 GB</td><td>DeepSeek-V4-Flash</td><td>—</td><td>—</td><td><a href="https://github.com/minaiml/flash-pi-dsv4" target="_blank" rel="noopener">flash-pi-dsv4</a></td></tr>
|
| 18 |
+
<tr><td>2-core CPU VPS, no GPU</td><td><a href="https://huggingface.co/PYTHAI/mindXtrain39" target="_blank" rel="noopener">mindXtrain39</a>, 135M dense</td><td>0.19</td><td>—</td><td>Ollama</td></tr>
|
| 19 |
+
</table>
|
| 20 |
+
|
| 21 |
+
<p>The slowest row is ours, and it stays: a 135-million-parameter dense model runs three hundred times slower than a 397-billion-parameter sparse one. <b>Sparsity, not size, decides what a small machine can run.</b></p>
|
| 22 |
+
|
| 23 |
+
<p><b>The catalogue lives on GitHub</b> — <a href="https://github.com/minaiml" target="_blank" rel="noopener">github.com/minaiml</a>: laptop engines, MoE streaming, phone and edge runtimes, browser targets, cluster inference, on-device speech and adaptation. Every fork carries a <code>FORK.json</code> recording upstream, the commit we pinned, the date and the licence — including the four that declare no licence upstream and are therefore never redistributed.</p>
|
| 24 |
+
|
| 25 |
+
<p><b>The models are at <a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>, licence-pinned at a commit: <a href="https://huggingface.co/PYTHAI/Qwen3.8-27B-fork" target="_blank" rel="noopener">Qwen3.8</a> · <a href="https://huggingface.co/PYTHAI/GLM-5.3-Flash-fork" target="_blank" rel="noopener">GLM-5.3-Flash</a> · <a href="https://huggingface.co/PYTHAI/Kimi-K3-fork" target="_blank" rel="noopener">Kimi K3</a> · <a href="https://huggingface.co/PYTHAI/granite-4.2-8b-fork" target="_blank" rel="noopener">Granite 4.2</a>. Delivery software here, weights there.</p>
|
| 26 |
+
|
| 27 |
+
<p><b>Elsewhere:</b> <a href="https://pythai.net" target="_blank" rel="noopener">pythai.net</a> · <a href="https://mindx.pythai.net" target="_blank" rel="noopener">mindx.pythai.net</a> · <a href="https://huggingface.co/spaces/PYTHAI/mindX" target="_blank" rel="noopener">mindX, live</a>. Built by <a href="https://github.com/Professor-Codephreak" target="_blank" rel="noopener">Professor Codephreak</a>.</p>
|
| 28 |
+
|
| 29 |
+
<p>Intelligence doesn't require a data center. It requires knowing which parameters are awake.</p>
|
index.html
CHANGED
|
@@ -1,19 +1,54 @@
|
|
| 1 |
-
<!
|
| 2 |
-
<html>
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
</html>
|
|
|
|
| 1 |
+
<!DOCTYPE html>
|
| 2 |
+
<html lang="en">
|
| 3 |
+
<head>
|
| 4 |
+
<meta charset="utf-8">
|
| 5 |
+
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 6 |
+
<title>minaiml</title>
|
| 7 |
+
<meta name="description" content="minaiml — delivery software for reasonable-sized models on laptops and smartphones.">
|
| 8 |
+
<base target="_blank">
|
| 9 |
+
<style>
|
| 10 |
+
:root { --bg:#07090a; --panel:#0e1211; --line:rgba(232,230,223,.08); --text:#e8e6df; --text2:#a3ada7; --gold:#d6b25e; }
|
| 11 |
+
* { box-sizing: border-box; }
|
| 12 |
+
body { margin:0; background:var(--bg); color:var(--text2); font:16px/1.65 ui-sans-serif, system-ui, -apple-system, "Segoe UI", sans-serif; }
|
| 13 |
+
main { max-width: 820px; margin: 0 auto; padding: 48px 16px 64px; }
|
| 14 |
+
h1 { color:var(--text); font-size:2.2rem; line-height:1.1; margin:0 0 6px; letter-spacing:-.02em; }
|
| 15 |
+
.say { font: .8rem ui-monospace, Menlo, monospace; color:var(--gold); letter-spacing:.12em; text-transform:uppercase; margin:0 0 28px; }
|
| 16 |
+
p { margin: 0 0 18px; }
|
| 17 |
+
b { color: var(--text); font-weight: 600; }
|
| 18 |
+
a { color: var(--gold); text-decoration: none; }
|
| 19 |
+
a:hover { text-decoration: underline; }
|
| 20 |
+
code { font: .86em ui-monospace, Menlo, monospace; }
|
| 21 |
+
.scroll { overflow-x: auto; border: 1px solid var(--line); border-radius: 10px; margin: 8px 0 26px; }
|
| 22 |
+
table { border-collapse: collapse; width: 100%; font-size: .92rem; }
|
| 23 |
+
th, td { text-align: left; padding: 10px 14px; border-bottom: 1px solid var(--line); vertical-align: top; }
|
| 24 |
+
tr:last-child td { border-bottom: 0; }
|
| 25 |
+
th { font: .72rem ui-monospace, Menlo, monospace; letter-spacing: .12em; text-transform: uppercase; color: #6d7771; background: var(--panel); }
|
| 26 |
+
td:first-child { white-space: nowrap; }
|
| 27 |
+
</style>
|
| 28 |
+
</head>
|
| 29 |
+
<body>
|
| 30 |
+
<main>
|
| 31 |
+
<h1>minaiml</h1>
|
| 32 |
+
<p class="say">min ai ml — models on hardware you own</p>
|
| 33 |
+
<p><b><a href="https://github.com/minaiml" target="_blank" rel="noopener">minaiml</a></b> (say it <i>minimal</i>) is <b><a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>'s delivery layer: the software that runs reasonable-sized models on hardware you already own. A mixture-of-experts model is mostly idle — a router wakes a handful of experts per token and leaves the rest on disk. Delivery is the art of exploiting that.</p>
|
| 34 |
+
|
| 35 |
+
<div class="scroll"><table>
|
| 36 |
+
<tr><th align="left">device</th><th align="left">model</th><th align="left">tok/s</th><th align="left">resident</th><th align="left">engine</th></tr>
|
| 37 |
+
<tr><td>MacBook Pro M3 Max, 48 GB</td><td>Qwen3.5-397B-A17B</td><td>4.36</td><td>~6 GB of 209 GB</td><td><a href="https://github.com/minaiml/flash-moe" target="_blank" rel="noopener">flash-moe</a></td></tr>
|
| 38 |
+
<tr><td>iPhone 17</td><td>Qwen3.5-35B-A3B</td><td>11</td><td>1.4 GB of 13 GB</td><td><a href="https://github.com/minaiml/Flash-iOS" target="_blank" rel="noopener">Flash-iOS</a></td></tr>
|
| 39 |
+
<tr><td>Raspberry Pi 5, 8 GB</td><td>DeepSeek-V4-Flash</td><td>—</td><td>—</td><td><a href="https://github.com/minaiml/flash-pi-dsv4" target="_blank" rel="noopener">flash-pi-dsv4</a></td></tr>
|
| 40 |
+
<tr><td>2-core CPU VPS, no GPU</td><td><a href="https://huggingface.co/PYTHAI/mindXtrain39" target="_blank" rel="noopener">mindXtrain39</a>, 135M dense</td><td>0.19</td><td>—</td><td>Ollama</td></tr>
|
| 41 |
+
</table></div>
|
| 42 |
+
|
| 43 |
+
<p>The slowest row is ours, and it stays: a 135-million-parameter dense model runs three hundred times slower than a 397-billion-parameter sparse one. <b>Sparsity, not size, decides what a small machine can run.</b></p>
|
| 44 |
+
|
| 45 |
+
<p><b>The catalogue lives on GitHub</b> — <a href="https://github.com/minaiml" target="_blank" rel="noopener">github.com/minaiml</a>: laptop engines, MoE streaming, phone and edge runtimes, browser targets, cluster inference, on-device speech and adaptation. Every fork carries a <code>FORK.json</code> recording upstream, the commit we pinned, the date and the licence — including the four that declare no licence upstream and are therefore never redistributed.</p>
|
| 46 |
+
|
| 47 |
+
<p><b>The models are at <a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>, licence-pinned at a commit: <a href="https://huggingface.co/PYTHAI/Qwen3.8-27B-fork" target="_blank" rel="noopener">Qwen3.8</a> · <a href="https://huggingface.co/PYTHAI/GLM-5.3-Flash-fork" target="_blank" rel="noopener">GLM-5.3-Flash</a> · <a href="https://huggingface.co/PYTHAI/Kimi-K3-fork" target="_blank" rel="noopener">Kimi K3</a> · <a href="https://huggingface.co/PYTHAI/granite-4.2-8b-fork" target="_blank" rel="noopener">Granite 4.2</a>. Delivery software here, weights there.</p>
|
| 48 |
+
|
| 49 |
+
<p><b>Elsewhere:</b> <a href="https://pythai.net" target="_blank" rel="noopener">pythai.net</a> · <a href="https://mindx.pythai.net" target="_blank" rel="noopener">mindx.pythai.net</a> · <a href="https://huggingface.co/spaces/PYTHAI/mindX" target="_blank" rel="noopener">mindX, live</a>. Built by <a href="https://github.com/Professor-Codephreak" target="_blank" rel="noopener">Professor Codephreak</a>.</p>
|
| 50 |
+
|
| 51 |
+
<p>Intelligence doesn't require a data center. It requires knowing which parameters are awake.</p>
|
| 52 |
+
</main>
|
| 53 |
+
</body>
|
| 54 |
</html>
|