Gregory-L commited on
Commit
dbd1080
·
verified ·
1 Parent(s): b40282f

minaiml - PYTHAI delivery layer: what runs on a laptop and a phone

Browse files
Files changed (2) hide show
  1. README.md +24 -5
  2. index.html +53 -18
README.md CHANGED
@@ -1,10 +1,29 @@
1
  ---
2
- title: Minaiml
3
- emoji: 📈
4
- colorFrom: blue
5
- colorTo: indigo
6
  sdk: static
7
  pinned: false
 
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: minaiml
3
+ emoji: 📱
4
+ colorFrom: gray
5
+ colorTo: yellow
6
  sdk: static
7
  pinned: false
8
+ short_description: delivery software for models on laptops and phones
9
  ---
10
 
11
+ <p><b><a href="https://github.com/minaiml" target="_blank" rel="noopener">minaiml</a></b> (say it <i>minimal</i>) is <b><a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>'s delivery layer: the software that runs reasonable-sized models on hardware you already own. A mixture-of-experts model is mostly idle — a router wakes a handful of experts per token and leaves the rest on disk. Delivery is the art of exploiting that.</p>
12
+
13
+ <table>
14
+ <tr><th align="left">device</th><th align="left">model</th><th align="left">tok/s</th><th align="left">resident</th><th align="left">engine</th></tr>
15
+ <tr><td>MacBook Pro M3 Max, 48&nbsp;GB</td><td>Qwen3.5-397B-A17B</td><td>4.36</td><td>~6&nbsp;GB of 209&nbsp;GB</td><td><a href="https://github.com/minaiml/flash-moe" target="_blank" rel="noopener">flash-moe</a></td></tr>
16
+ <tr><td>iPhone 17</td><td>Qwen3.5-35B-A3B</td><td>11</td><td>1.4&nbsp;GB of 13&nbsp;GB</td><td><a href="https://github.com/minaiml/Flash-iOS" target="_blank" rel="noopener">Flash-iOS</a></td></tr>
17
+ <tr><td>Raspberry Pi 5, 8&nbsp;GB</td><td>DeepSeek-V4-Flash</td><td>&mdash;</td><td>&mdash;</td><td><a href="https://github.com/minaiml/flash-pi-dsv4" target="_blank" rel="noopener">flash-pi-dsv4</a></td></tr>
18
+ <tr><td>2-core CPU VPS, no GPU</td><td><a href="https://huggingface.co/PYTHAI/mindXtrain39" target="_blank" rel="noopener">mindXtrain39</a>, 135M dense</td><td>0.19</td><td>&mdash;</td><td>Ollama</td></tr>
19
+ </table>
20
+
21
+ <p>The slowest row is ours, and it stays: a 135-million-parameter dense model runs three hundred times slower than a 397-billion-parameter sparse one. <b>Sparsity, not size, decides what a small machine can run.</b></p>
22
+
23
+ <p><b>The catalogue lives on GitHub</b> — <a href="https://github.com/minaiml" target="_blank" rel="noopener">github.com/minaiml</a>: laptop engines, MoE streaming, phone and edge runtimes, browser targets, cluster inference, on-device speech and adaptation. Every fork carries a <code>FORK.json</code> recording upstream, the commit we pinned, the date and the licence — including the four that declare no licence upstream and are therefore never redistributed.</p>
24
+
25
+ <p><b>The models are at <a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>, licence-pinned at a commit: <a href="https://huggingface.co/PYTHAI/Qwen3.8-27B-fork" target="_blank" rel="noopener">Qwen3.8</a> · <a href="https://huggingface.co/PYTHAI/GLM-5.3-Flash-fork" target="_blank" rel="noopener">GLM-5.3-Flash</a> · <a href="https://huggingface.co/PYTHAI/Kimi-K3-fork" target="_blank" rel="noopener">Kimi K3</a> · <a href="https://huggingface.co/PYTHAI/granite-4.2-8b-fork" target="_blank" rel="noopener">Granite 4.2</a>. Delivery software here, weights there.</p>
26
+
27
+ <p><b>Elsewhere:</b> <a href="https://pythai.net" target="_blank" rel="noopener">pythai.net</a> · <a href="https://mindx.pythai.net" target="_blank" rel="noopener">mindx.pythai.net</a> · <a href="https://huggingface.co/spaces/PYTHAI/mindX" target="_blank" rel="noopener">mindX, live</a>. Built by <a href="https://github.com/Professor-Codephreak" target="_blank" rel="noopener">Professor Codephreak</a>.</p>
28
+
29
+ <p>Intelligence doesn't require a data center. It requires knowing which parameters are awake.</p>
index.html CHANGED
@@ -1,19 +1,54 @@
1
- <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  </html>
 
1
+ <!DOCTYPE html>
2
+ <html lang="en">
3
+ <head>
4
+ <meta charset="utf-8">
5
+ <meta name="viewport" content="width=device-width, initial-scale=1">
6
+ <title>minaiml</title>
7
+ <meta name="description" content="minaiml — delivery software for reasonable-sized models on laptops and smartphones.">
8
+ <base target="_blank">
9
+ <style>
10
+ :root { --bg:#07090a; --panel:#0e1211; --line:rgba(232,230,223,.08); --text:#e8e6df; --text2:#a3ada7; --gold:#d6b25e; }
11
+ * { box-sizing: border-box; }
12
+ body { margin:0; background:var(--bg); color:var(--text2); font:16px/1.65 ui-sans-serif, system-ui, -apple-system, "Segoe UI", sans-serif; }
13
+ main { max-width: 820px; margin: 0 auto; padding: 48px 16px 64px; }
14
+ h1 { color:var(--text); font-size:2.2rem; line-height:1.1; margin:0 0 6px; letter-spacing:-.02em; }
15
+ .say { font: .8rem ui-monospace, Menlo, monospace; color:var(--gold); letter-spacing:.12em; text-transform:uppercase; margin:0 0 28px; }
16
+ p { margin: 0 0 18px; }
17
+ b { color: var(--text); font-weight: 600; }
18
+ a { color: var(--gold); text-decoration: none; }
19
+ a:hover { text-decoration: underline; }
20
+ code { font: .86em ui-monospace, Menlo, monospace; }
21
+ .scroll { overflow-x: auto; border: 1px solid var(--line); border-radius: 10px; margin: 8px 0 26px; }
22
+ table { border-collapse: collapse; width: 100%; font-size: .92rem; }
23
+ th, td { text-align: left; padding: 10px 14px; border-bottom: 1px solid var(--line); vertical-align: top; }
24
+ tr:last-child td { border-bottom: 0; }
25
+ th { font: .72rem ui-monospace, Menlo, monospace; letter-spacing: .12em; text-transform: uppercase; color: #6d7771; background: var(--panel); }
26
+ td:first-child { white-space: nowrap; }
27
+ </style>
28
+ </head>
29
+ <body>
30
+ <main>
31
+ <h1>minaiml</h1>
32
+ <p class="say">min ai ml — models on hardware you own</p>
33
+ <p><b><a href="https://github.com/minaiml" target="_blank" rel="noopener">minaiml</a></b> (say it <i>minimal</i>) is <b><a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>'s delivery layer: the software that runs reasonable-sized models on hardware you already own. A mixture-of-experts model is mostly idle — a router wakes a handful of experts per token and leaves the rest on disk. Delivery is the art of exploiting that.</p>
34
+
35
+ <div class="scroll"><table>
36
+ <tr><th align="left">device</th><th align="left">model</th><th align="left">tok/s</th><th align="left">resident</th><th align="left">engine</th></tr>
37
+ <tr><td>MacBook Pro M3 Max, 48&nbsp;GB</td><td>Qwen3.5-397B-A17B</td><td>4.36</td><td>~6&nbsp;GB of 209&nbsp;GB</td><td><a href="https://github.com/minaiml/flash-moe" target="_blank" rel="noopener">flash-moe</a></td></tr>
38
+ <tr><td>iPhone 17</td><td>Qwen3.5-35B-A3B</td><td>11</td><td>1.4&nbsp;GB of 13&nbsp;GB</td><td><a href="https://github.com/minaiml/Flash-iOS" target="_blank" rel="noopener">Flash-iOS</a></td></tr>
39
+ <tr><td>Raspberry Pi 5, 8&nbsp;GB</td><td>DeepSeek-V4-Flash</td><td>&mdash;</td><td>&mdash;</td><td><a href="https://github.com/minaiml/flash-pi-dsv4" target="_blank" rel="noopener">flash-pi-dsv4</a></td></tr>
40
+ <tr><td>2-core CPU VPS, no GPU</td><td><a href="https://huggingface.co/PYTHAI/mindXtrain39" target="_blank" rel="noopener">mindXtrain39</a>, 135M dense</td><td>0.19</td><td>&mdash;</td><td>Ollama</td></tr>
41
+ </table></div>
42
+
43
+ <p>The slowest row is ours, and it stays: a 135-million-parameter dense model runs three hundred times slower than a 397-billion-parameter sparse one. <b>Sparsity, not size, decides what a small machine can run.</b></p>
44
+
45
+ <p><b>The catalogue lives on GitHub</b> — <a href="https://github.com/minaiml" target="_blank" rel="noopener">github.com/minaiml</a>: laptop engines, MoE streaming, phone and edge runtimes, browser targets, cluster inference, on-device speech and adaptation. Every fork carries a <code>FORK.json</code> recording upstream, the commit we pinned, the date and the licence — including the four that declare no licence upstream and are therefore never redistributed.</p>
46
+
47
+ <p><b>The models are at <a href="https://huggingface.co/PYTHAI" target="_blank" rel="noopener">PYTHAI</a></b>, licence-pinned at a commit: <a href="https://huggingface.co/PYTHAI/Qwen3.8-27B-fork" target="_blank" rel="noopener">Qwen3.8</a> · <a href="https://huggingface.co/PYTHAI/GLM-5.3-Flash-fork" target="_blank" rel="noopener">GLM-5.3-Flash</a> · <a href="https://huggingface.co/PYTHAI/Kimi-K3-fork" target="_blank" rel="noopener">Kimi K3</a> · <a href="https://huggingface.co/PYTHAI/granite-4.2-8b-fork" target="_blank" rel="noopener">Granite 4.2</a>. Delivery software here, weights there.</p>
48
+
49
+ <p><b>Elsewhere:</b> <a href="https://pythai.net" target="_blank" rel="noopener">pythai.net</a> · <a href="https://mindx.pythai.net" target="_blank" rel="noopener">mindx.pythai.net</a> · <a href="https://huggingface.co/spaces/PYTHAI/mindX" target="_blank" rel="noopener">mindX, live</a>. Built by <a href="https://github.com/Professor-Codephreak" target="_blank" rel="noopener">Professor Codephreak</a>.</p>
50
+
51
+ <p>Intelligence doesn't require a data center. It requires knowing which parameters are awake.</p>
52
+ </main>
53
+ </body>
54
  </html>