docs(org-card): v0.6.16 + 20 PPL-verified (19 transformer + 1 SSM) + Mamba 1.0059x
Browse files
README.md
CHANGED
|
@@ -20,15 +20,15 @@ pinned: false
|
|
| 20 |
|
| 21 |
---
|
| 22 |
|
| 23 |
-
## v0.6.
|
| 24 |
|
| 25 |
-
Only `pip install ultracompress` (v0.6.
|
| 26 |
|
| 27 |
---
|
| 28 |
|
| 29 |
## Product 1: UltraCompress
|
| 30 |
|
| 31 |
-
Production-grade lossless 5-bit transformer compression across 22 shipped architectures (
|
| 32 |
|
| 33 |
### Tightest verified PPL ratios at 5 bpw
|
| 34 |
*(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30-50; seed = 42)*
|
|
@@ -47,10 +47,10 @@ Production-grade lossless 5-bit transformer compression across 22 shipped archit
|
|
| 47 |
| OLMo-2-0425-1B | 1B | dense | **1.0073×** | |
|
| 48 |
| SmolLM2-1.7B-Instruct | 1.7B | dense | **1.0075×** | |
|
| 49 |
| SmolLM2-1.7B | 1.7B | dense | **1.0085×** | |
|
| 50 |
-
| Mamba-2.8B | 2.8B | SSM |
|
| 51 |
| Llama-3.1-8B | 8B | dense | **1.0125×** | |
|
| 52 |
|
| 53 |
-
22 architectures shipped,
|
| 54 |
|
| 55 |
### Try UltraCompress (3 commands)
|
| 56 |
|
|
|
|
| 20 |
|
| 21 |
---
|
| 22 |
|
| 23 |
+
## v0.6.16 current — minimal clean release
|
| 24 |
|
| 25 |
+
Only `pip install ultracompress` (v0.6.16) is on PyPI. The package is the minimal SHA-256 verifier; codec internals are patent-protected and not shipped in the public package. Prior dev releases were retired during the 2026-05-18 cleanup. Mistral-7B-v0.3 hits 1.00548× — a strong dense 7B-class lossless 5-bit result.
|
| 26 |
|
| 27 |
---
|
| 28 |
|
| 29 |
## Product 1: UltraCompress
|
| 30 |
|
| 31 |
+
Production-grade lossless 5-bit transformer compression across 22 shipped architectures (20 PPL-verified: 19 transformer + 1 SSM with comparator-note caveat), dense + Mixture-of-Experts + state-space, 0.6B to 405B parameters. Mathematically lossless customer-side reconstruction: SHA-256 over reconstructed tensor bytes matches the reference manifest, verified by `uc verify`.
|
| 32 |
|
| 33 |
### Tightest verified PPL ratios at 5 bpw
|
| 34 |
*(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30-50; seed = 42)*
|
|
|
|
| 47 |
| OLMo-2-0425-1B | 1B | dense | **1.0073×** | |
|
| 48 |
| SmolLM2-1.7B-Instruct | 1.7B | dense | **1.0075×** | |
|
| 49 |
| SmolLM2-1.7B | 1.7B | dense | **1.0085×** | |
|
| 50 |
+
| Mamba-2.8B | 2.8B | SSM | **1.0059×** | state-space model (comparator-note caveat: GSQ-only, no V18-C overlay) |
|
| 51 |
| Llama-3.1-8B | 8B | dense | **1.0125×** | |
|
| 52 |
|
| 53 |
+
22 architectures shipped, 20 PPL-verified end-to-end (19 transformer + 1 SSM with comparator-note caveat). Full matrix below + at github.com/sipsalabs/ultracompress.
|
| 54 |
|
| 55 |
### Try UltraCompress (3 commands)
|
| 56 |
|