wbit5 commited on
Commit
9e8a37f
Β·
verified Β·
1 Parent(s): f0c89ea

publish from LatentPortPort 206520f

Browse files
Files changed (3) hide show
  1. README.md +69 -18
  2. index.html +0 -19
  3. style.css +0 -28
README.md CHANGED
@@ -7,31 +7,82 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- # agentic-underground
11
 
12
- **Open, reproducible work on language-model inference β€” weights published beside the code that
13
- made them and the measurements that justify them.**
14
 
15
- ## What we publish
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  | | |
18
- |---|---|
19
- | **[PrattleNot](https://github.com/agentic-underground/PrattleNot)** | A reproduction of **LatentPort** (arXiv:2609.25053v1): a small model reads the prompt, a fitted bridge translates its memory, and a larger model answers from it β€” sooner. Rust, natively and in WebAssembly. [Try it in your browser](https://agentic-underground.github.io/PrattleNot/). |
20
- | **[smollm2-135m-to-360m-bridge](https://huggingface.co/agentic-underground/smollm2-135m-to-360m-bridge)** | The bridge from SmolLM2-135M-Instruct to SmolLM2-360M-Instruct, with the paper's one-token handoff and learned correction: **1.87Γ—** sooner to the first token, in the browser. |
 
 
21
 
22
- More bridges follow as their pairs are fitted, one repository per pair.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
 
24
  ## How we publish
25
 
26
- - **Reproducible.** Every number on a card links to the method and the harness that produced it, so
27
- you can measure it again on your own hardware.
28
- - **Pinned.** Our pages fetch weights by commit, never by `main`, so a later upload cannot change what
29
- a published result measured.
30
- - **Our own work only.** We host what we fitted. Base models are fetched from their publishers and
31
  linked, never mirrored.
32
- - **Attributed.** PrattleNot is a derivative work of [LatentPort](https://latentport.com/) by
33
- Simon Villani ([source](https://github.com/LatentPort/latentport), Apache-2.0). Our releases are
34
- Apache-2.0 with a NOTICE, as upstream's are.
 
 
 
 
 
 
35
 
36
- Questions and corrections are welcome β€” open a discussion on the repository concerned, or an issue
37
- on [PrattleNot](https://github.com/agentic-underground/PrattleNot/issues).
 
7
  pinned: false
8
  ---
9
 
10
+ <div align="center">
11
 
12
+ # πŸ›Έ agentic-underground
 
13
 
14
+ **Open tools and research for building software with AI agents** β€”
15
+ disciplined workflows, safety, token efficiency, and reproducible model research.
16
+
17
+ <a href="https://huggingface.co/collections/agentic-underground/prattlenot-6af7ac5e95e0fc80de563d61"><img alt="Collection: PrattleNot" src="https://img.shields.io/badge/collection-PrattleNot-6366f1"></a>
18
+ <a href="https://agentic-underground.github.io/PrattleNot/"><img alt="Live demo in your browser" src="https://img.shields.io/badge/demo-runs%20in%20your%20browser-a855f7"></a>
19
+ <a href="https://github.com/agentic-underground"><img alt="Source on GitHub" src="https://img.shields.io/badge/source-GitHub-24292f?logo=github"></a>
20
+ <a href="https://huggingface.co/papers/2609.25053"><img alt="Paper: arXiv 2609.25053" src="https://img.shields.io/badge/paper-arXiv%202609.25053-b31b1b"></a>
21
+
22
+ </div>
23
+
24
+ ---
25
+
26
+ ## On the Hub: the PrattleNot family
27
+
28
+ **PrattleNot** reproduces [**LatentPort**](https://huggingface.co/papers/2609.25053), Simon Villani's method for
29
+ handing a conversation from one language model to another *through its memory*. A small model reads
30
+ the prompt; a fitted **bridge** translates its key/value cache into the memory a larger model would
31
+ have built; the larger model answers from it β€” **without reading the prompt itself**, so its first
32
+ token arrives sooner.
33
+
34
+ What we publish here are the **bridges**: the fitted weights that make that handoff work between a
35
+ specific pair of models. Everything is gathered in the
36
+ **[PrattleNot collection β†’](https://huggingface.co/collections/agentic-underground/prattlenot-6af7ac5e95e0fc80de563d61)**
37
+
38
+ ### ✨ Featured β€” [`smollm2-135m-to-360m-bridge`](https://huggingface.co/agentic-underground/smollm2-135m-to-360m-bridge)
39
+
40
+ SmolLM2-135M reads; SmolLM2-360M, almost three times larger, answers. Two models with different
41
+ shapes, bridged with the paper's **one-token handoff** and its learned correction.
42
 
43
  | | |
44
+ |:--|:--|
45
+ | ⚑ **Time to first token** | **1.87Γ—** sooner (95% CI 1.83–1.91), in WebAssembly, on a CPU |
46
+ | πŸͺ™ **Bridge tokens** | **1** β€” the 360M reads one token of the prompt itself |
47
+ | 🎯 **Held-out questions** | **6 of 7** correct β€” as many as the 360M reading everything |
48
+ | πŸ” **Fidelity (NCR)** | **0.930** β€” the paper's corrected bridge on its own pair: 0.918 |
49
 
50
+ ▢️ **[Try it in your browser](https://agentic-underground.github.io/PrattleNot/)** β€” both models and the
51
+ bridge download once and run locally. Turn the bridge on, ask anything, and watch the counters show
52
+ who read what.
53
+
54
+ ### πŸ“ The reproduction behind it
55
+
56
+ Before carrying the method to new models, we reproduced LatentPort's own **4B β†’ 27B** pair on two
57
+ RTX 3090s with upstream's timing code and statistic: **1.36Γ—** sooner at 128 prompt tokens, rising to
58
+ **2.94Γ—** at ~2K and **3.39Γ—** at ~16K. The full tables, every run, and a step-by-step guide to
59
+ repeat them are in the [PrattleNot repository](https://github.com/agentic-underground/PrattleNot).
60
+
61
+ ### 🧭 Coming next
62
+
63
+ **Qwen3-0.6B β†’ Qwen3-1.7B** β€” a second model family, and the real test of whether the bridge
64
+ carries. Each new pair gets its own repository here and joins the collection when its weights are
65
+ fitted and measured.
66
+
67
+ ---
68
 
69
  ## How we publish
70
 
71
+ - πŸ”¬ **Reproducible** β€” every number on a card links to the method and the harness that produced it,
72
+ so you can measure it again on your own hardware.
73
+ - πŸ“Œ **Pinned** β€” our pages fetch weights by commit, never by `main`, so a later upload cannot change
74
+ what a published result measured.
75
+ - 🧩 **Our own work only** β€” we host what we fitted. Base models stay with their publishers and are
76
  linked, never mirrored.
77
+ - πŸ™ **Attributed** β€” PrattleNot is a derivative work of [LatentPort](https://latentport.com/) by
78
+ Simon Villani ([source](https://github.com/LatentPort/latentport), Apache-2.0). Our bridges are
79
+ Apache-2.0.
80
+
81
+ ## Elsewhere
82
+
83
+ The **source** for everything here, and our other tools for building software with agents (Claude
84
+ Code plugins, a static auditor for agent skills, a token-aware scheduler), live on
85
+ **[GitHub β†’ agentic-underground](https://github.com/agentic-underground)**.
86
 
87
+ Questions and corrections are welcome: open a discussion on the model concerned, or an
88
+ [issue on PrattleNot](https://github.com/agentic-underground/PrattleNot/issues).
index.html DELETED
@@ -1,19 +0,0 @@
1
- <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
19
- </html>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
style.css DELETED
@@ -1,28 +0,0 @@
1
- body {
2
- padding: 2rem;
3
- font-family: -apple-system, BlinkMacSystemFont, "Arial", sans-serif;
4
- }
5
-
6
- h1 {
7
- font-size: 16px;
8
- margin-top: 0;
9
- }
10
-
11
- p {
12
- color: rgb(107, 114, 128);
13
- font-size: 15px;
14
- margin-bottom: 10px;
15
- margin-top: 5px;
16
- }
17
-
18
- .card {
19
- max-width: 620px;
20
- margin: 0 auto;
21
- padding: 16px;
22
- border: 1px solid lightgray;
23
- border-radius: 16px;
24
- }
25
-
26
- .card p:last-child {
27
- margin-bottom: 0;
28
- }