sip786 commited on
Commit
fb55e36
Β·
verified Β·
1 Parent(s): af628b7

Parent-company refresh: Two products live (UltraCompress + Sipsa Inference) + CaaS + v0.6.9 + Mistral 1.00548x + scrub stale HN banner

Browse files
Files changed (1) hide show
  1. README.md +114 -71
README.md CHANGED
@@ -1,71 +1,114 @@
1
- ---
2
- title: Sipsa Labs
3
- emoji: 🧊
4
- colorFrom: indigo
5
- colorTo: blue
6
- sdk: static
7
- pinned: false
8
- ---
9
-
10
- # Sipsa Labs, Inc.
11
-
12
- > Sipsa Labs is an **experimental and deep tech-and-software lab**. We invent and ship across the full breadth of tech and software β€” deep research, runtime systems, novel substrates, infrastructure, hardware-adjacent stacks, and software products that don't fit anywhere else yet. **UltraCompress** β€” lossless 5-bit transformer compression β€” is our first flagship publicly-shipped product. More products in flight.
13
- >
14
- > ---
15
- >
16
- > ## 2026-05-11 β€” 22 architectures verified at 5 bpw, three new sub-1.005Γ— records this week
17
- >
18
- > > **Live on Hacker News today:** https://news.ycombinator.com/item?id=48099107
19
- >
20
- > Production-grade lossless 5-bit transformer compression across 22 architectures, dense + Mixture-of-Experts + state-space (Mamba), 0.6B to 405B parameters. Mathematically lossless customer-side reconstruction: SHA-256 over reconstructed tensor bytes matches the trainer'''s measurement, verified by `uc verify`.
21
- >
22
- > ### Tightest verified PPL ratios at 5 bpw
23
- > *(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30-50; seed = 42)*
24
- >
25
- > | Model | Params | Type | **PPL ratio** | Notes |
26
- > |---|---:|:---|---:|:---|
27
- > | Phi-3-mini-4k-instruct | 3.8B | dense | **1.00262Γ—** | seq_len=128 caveat |
28
- > | **Mixtral-8x7B** | 47B | MoE | **1.00368Γ—** | tightest MoE result |
29
- > | Qwen3-1.7B-Base | 1.7B | dense | **1.00401Γ—** | small-decoder record |
30
- > | Qwen3-14B | 14B | dense | **1.00403Γ—** | 14B-class record |
31
- > | Yi-1.5-9B | 8.8B | dense | **1.00414Γ—** | >8B record |
32
- > | Qwen3-8B | 8B | dense | **1.00440Γ—** | 8B-class record |
33
- > | **Mistral-7B-v0.3** | 7B | dense | **1.00548Γ—** | NEW this week β€” 9.16Γ— tighter than prior |
34
- > | Phi-3-mini-4k | 3.8B | dense | **1.00624Γ—** | cross-arch confirm at seq=1024 |
35
- > | **Hermes-3-Llama-3.1-405B** | 405B | dense | **1.0066Γ—** | largest dense 5-bit lossless on the Hub |
36
- > | Qwen3-0.6B | 0.6B | dense | **1.0069Γ—** | |
37
- > | OLMo-2-0425-1B | 1B | dense | **1.0073Γ—** | |
38
- > | SmolLM2-1.7B-Instruct | 1.7B | dense | **1.0075Γ—** | |
39
- > | SmolLM2-1.7B | 1.7B | dense | **1.0085Γ—** | |
40
- > | Mamba-2.8B | 2.8B | SSM | **1.0119Γ—** | first published 5-bit lossless on a state-space model |
41
- > | Llama-3.1-8B | 8B | dense | **1.0125Γ—** | standard eval |
42
- >
43
- > ### Quick start (3 commands, no GPU required for verify)
44
- >
45
- > ```
46
- > pip install ultracompress
47
- > hf download SipsaLabs/qwen3-8b-uc-v3-bpw5 --local-dir ./qwen3-8b
48
- > uc bench ./qwen3-8b
49
- > ```
50
- >
51
- > ### Inference API
52
- >
53
- > `api.sipsalabs.com` API is in private beta, OpenAI-compatible:
54
- >
55
- > ```
56
- > export OPENAI_BASE_URL=https://api.sipsalabs.com/v1
57
- > # The official `openai` SDK works unchanged.
58
- > ```
59
- >
60
- > Pricing tiers + Compression-as-a-Service contracts at https://sipsalabs.com/pricing.
61
- >
62
- > ### License + IP
63
- >
64
- > - PyPI `ultracompress` v0.6+ under **BUSL-1.1** with Additional Use Grant β€” free for sub-$1M ARR companies + research + individuals. Auto-converts to Apache 2.0 four years after each release.
65
- > - v0.5.x stays Apache-2.0 forever on `legacy/0.5.x`.
66
- > - Two USPTO provisionals filed 2026-04-25: **64/049,511** + **64/049,517**.
67
- >
68
- > Commercial inquiries: founder@sipsalabs.com
69
- >
70
- > Public verifier dashboard: https://sipsalabs.com/inference
71
- > Selective Disclosure Charter β€” what we publish vs what we keep internal: see github.com/sipsalabs/ultracompress
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: Sipsa Labs
3
+ emoji: 🧊
4
+ colorFrom: indigo
5
+ colorTo: blue
6
+ sdk: static
7
+ pinned: false
8
+ ---
9
+
10
+ # Sipsa Labs
11
+
12
+ > **Sipsa Labs** is an experimental and deep tech-and-software company. We invent and ship across the full breadth of tech and software.
13
+ >
14
+ > **Two products live today:**
15
+ >
16
+ > 1. **UltraCompress** β€” lossless 5-bit transformer compression. Flagship. `pip install ultracompress`.
17
+ > 2. **Sipsa Inference** β€” OpenAI-compatible serving API for our compressed weights. `https://api.sipsalabs.com/v1`. Pro $99/mo + Team $499/mo.
18
+ >
19
+ > **Compression-as-a-Service** engagements are open ($5K Phase 0 POC). More products in flight β€” we don't pre-announce.
20
+
21
+ ---
22
+
23
+ ## v0.6.9 shipped 2026-05-15 β€” security release + new Mistral 7B record
24
+
25
+ `pip install --upgrade ultracompress` β€” RCE-class fix on `torch.load()` paths + MANIFEST-scrubbed sdist. v0.6.7 + v0.6.8 yanked from PyPI. Drop-in replacement, no code changes required.
26
+
27
+ **Mistral-7B-v0.3 hits 1.00548Γ—** β€” tightest dense 7B-class lossless 5-bit number on the public HF Hub.
28
+
29
+ ---
30
+
31
+ ## Product 1: UltraCompress
32
+
33
+ Production-grade lossless 5-bit transformer compression across 22 architectures, dense + Mixture-of-Experts + state-space, 0.6B to 405B parameters. Mathematically lossless customer-side reconstruction: SHA-256 over reconstructed tensor bytes matches the trainer's measurement, verified by `uc verify`.
34
+
35
+ ### Tightest verified PPL ratios at 5 bpw
36
+ *(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30-50; seed = 42)*
37
+
38
+ | Model | Params | Type | **PPL ratio** | Notes |
39
+ |---|---:|:---|---:|:---|
40
+ | **Mixtral-8x7B** | 47B | MoE | **1.00368Γ—** | tightest MoE result |
41
+ | Qwen3-1.7B-Base | 1.7B | dense | **1.00401Γ—** | small-decoder record |
42
+ | Qwen3-14B | 14B | dense | **1.00403Γ—** | 14B-class record |
43
+ | Yi-1.5-9B | 8.8B | dense | **1.00414Γ—** | >8B record |
44
+ | Qwen3-8B | 8B | dense | **1.00440Γ—** | 8B-class record |
45
+ | **Mistral-7B-v0.3** | 7B | dense | **1.00548Γ—** | NEW β€” tightest dense 7B-class on the public Hub |
46
+ | Phi-3-mini-4k | 3.8B | dense | **1.00624Γ—** | cross-arch confirm |
47
+ | **Hermes-3-Llama-3.1-405B** | 405B | dense | **1.0066Γ—** | first 405B-class lossless on a single 32 GB consumer GPU |
48
+ | Qwen3-0.6B | 0.6B | dense | **1.0069Γ—** | |
49
+ | OLMo-2-0425-1B | 1B | dense | **1.0073Γ—** | |
50
+ | SmolLM2-1.7B-Instruct | 1.7B | dense | **1.0075Γ—** | |
51
+ | SmolLM2-1.7B | 1.7B | dense | **1.0085Γ—** | |
52
+ | Mamba-2.8B | 2.8B | SSM | **1.0119Γ—** | first published 5-bit lossless on a state-space model |
53
+ | Llama-3.1-8B | 8B | dense | **1.0125Γ—** | |
54
+
55
+ 22 architectures end-to-end. Full matrix below + at github.com/sipsalabs/ultracompress.
56
+
57
+ ### Try UltraCompress (3 commands)
58
+
59
+ ```bash
60
+ pip install ultracompress
61
+ hf download SipsaLabs/qwen3-1.7b-base-uc-v3-bpw5 --local-dir ./pack
62
+ uc verify ./pack
63
+ ```
64
+
65
+ Expected: `VERIFY: PASS β€” bit-identical reconstruction guaranteed.`
66
+
67
+ ---
68
+
69
+ ## Product 2: Sipsa Inference
70
+
71
+ OpenAI-compatible inference API serving our compressed weights. Drop-in replacement for OpenAI's `base_url` β€” same `openai` Python SDK works unchanged.
72
+
73
+ ```bash
74
+ export OPENAI_BASE_URL=https://api.sipsalabs.com/v1
75
+ curl $OPENAI_BASE_URL/models
76
+ ```
77
+
78
+ 22 models live in the catalog with `sipsa-*` prefix (e.g. `model="sipsa-hermes-3-llama-3.1-405b"`). Backed by dual RTX 5090 over Cloudflare Tunnel.
79
+
80
+ **Pricing**: Free $5 credit on signup (no card). **Pro $99/mo** (600 RPM, $100 included credit). **Team $499/mo** (2400 RPM, $500 included credit). Full pricing + bill estimator at sipsalabs.com/pricing.
81
+
82
+ ---
83
+
84
+ ## Service: Compression-as-a-Service (CaaS)
85
+
86
+ Bring a model, we deliver a verified-lossless 5-bit pack you can run on your hardware. **Phase 0 POC is $5K / 5 business days / customer-picked model**. Day 7 deliverable is a pack you self-verify with `uc verify` + benchmark with `uc bench`. Acceptance gate: `uc verify PASS` + PPL ratio within 1.5% on your eval set.
87
+
88
+ Email founder@sipsalabs.com.
89
+
90
+ ---
91
+
92
+ ## Why this matters
93
+
94
+ Defense / FDA-regulated healthcare / SR 11-7 model validation / frontier lab red-team eval β€” places where "good enough on MMLU" isn't enough. Bit-identical reconstruction is the actual reason to talk to us in those settings. As a side-effect of the streaming compression path, it lets us put a 405B-parameter model through a single 32 GB consumer GPU without renting an H100 cluster.
95
+
96
+ ---
97
+
98
+ ## License + IP
99
+
100
+ - **PyPI v0.6+** under BUSL-1.1 with **Additional Use Grant**: free for sub-$1M ARR companies, research, and individuals. Auto-converts to Apache 2.0 four years after each release.
101
+ - **v0.5.x** stays under Apache-2.0 forever on the `legacy/0.5.x` branch.
102
+ - Codec internals patent-protected. Continuations through 2027.
103
+
104
+ ---
105
+
106
+ ## Contact
107
+
108
+ - **Commercial / Phase 0 POC** β†’ founder@sipsalabs.com
109
+ - **Patents / licensing** β†’ legal@sipsalabs.com
110
+ - **Press / media** β†’ press@sipsalabs.com
111
+ - **Security disclosure** β†’ security@sipsalabs.com
112
+ - **General** β†’ hello@sipsalabs.com
113
+
114
+ [sipsalabs.com](https://sipsalabs.com) Β· [GitHub](https://github.com/sipsalabs) Β· [PyPI](https://pypi.org/project/ultracompress/) Β· [Pricing](https://sipsalabs.com/pricing)