sip786 commited on
Commit
1ea034a
Β·
verified Β·
1 Parent(s): d110182

Refresh org card: two-tier framing, 23 verified (22 PPL + 1 ViT), v0.6.27, clean encoding, drop stale/banned terms

Browse files
Files changed (1) hide show
  1. README.md +44 -46
README.md CHANGED
@@ -1,4 +1,4 @@
1
- ο»Ώ---
2
  title: README
3
  emoji: 🧊
4
  colorFrom: indigo
@@ -8,48 +8,50 @@ pinned: false
8
  ---
9
  # Sipsa Labs
10
 
11
- > **Sipsa Labs** is an experimental and deep tech-and-software company. We invent and ship across the full breadth of tech and software.
12
  >
13
  > **Two products live today:**
14
  >
15
- > 1. **UltraCompress** Ò€” lossless 5-bit transformer compression. Flagship. `pip install ultracompress`.
16
- > 2. **Sipsa Inference** Ò€” OpenAI-compatible serving API for our compressed weights. `https://api.sipsalabs.com/v1`. Pro $99/mo + Team $499/mo.
17
  >
18
- > **Compression-as-a-Service** engagements are open ($5K Phase 0 POC). More products in flight Ò€” we don't pre-announce.
19
 
20
  ---
21
 
22
- ## v0.6.22 current Ò€” minimal clean release
23
 
24
- Only `pip install ultracompress` (v0.6.22) is on PyPI. The package is the minimal SHA-256 verifier; codec internals are patent-protected and not shipped in the public package. Prior dev releases were retired during the 2026-05-18 cleanup. Mistral-7B-v0.3 hits 1.00548Γƒβ€” Ò€” a strong dense 7B-class lossless 5-bit result.
25
 
26
  ---
27
 
28
  ## Product 1: UltraCompress
29
 
30
- Production-grade lossless 5-bit transformer compression across 22 shipped architectures (20 PPL-verified: 19 transformer + 1 SSM with comparator-note caveat), dense + Mixture-of-Experts + state-space, 0.6B to 405B parameters. Mathematically lossless customer-side reconstruction: SHA-256 over reconstructed tensor bytes matches the reference manifest, verified by `uc verify`.
 
 
 
 
 
31
 
32
- ### Tightest verified PPL ratios at 5 bpw
33
- *(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30-50; seed = 42)*
34
 
35
- | Model | Params | Type | **PPL ratio** | Notes |
 
 
36
  |---|---:|:---|---:|:---|
37
- | **Mixtral-8x7B** | 47B | MoE | **1.00368Γƒβ€”** | tightest MoE result |
38
- | Qwen3-1.7B-Base | 1.7B | dense | **1.00401Γƒβ€”** | small-decoder record |
39
- | Qwen3-14B | 14B | dense | **1.00403Γƒβ€”** | 14B-class record |
40
- | Yi-1.5-9B | 8.8B | dense | **1.00414Γƒβ€”** | >8B record |
41
- | Qwen3-8B | 8B | dense | **1.00440Γƒβ€”** | 8B-class record |
42
- | **Mistral-7B-v0.3** | 7B | dense | **1.00548Γƒβ€”** | NEW Ò€” a strong dense 7B-class result |
43
- | Phi-3-mini-4k | 3.8B | dense | **1.00262Γƒβ€”** | tightest dense ratio (seq_len=128 caveat) |
44
- | **Hermes-3-Llama-3.1-405B** | 405B | dense | **1.0066Γƒβ€”** | 405B-class lossless on a single 32 GB consumer GPU |
45
- | Qwen3-0.6B | 0.6B | dense | **1.0069Γƒβ€”** | |
46
- | OLMo-2-0425-1B | 1B | dense | **1.0073Γƒβ€”** | |
47
- | SmolLM2-1.7B-Instruct | 1.7B | dense | **1.0075Γƒβ€”** | |
48
- | SmolLM2-1.7B | 1.7B | dense | **1.0085Γƒβ€”** | |
49
- | Mamba-2.8B | 2.8B | SSM | **1.0059Γƒβ€”** | state-space model (uses SSM-compatible comparator; canonical transformer streaming reconstruction is architecture-incompatible with SSMs) |
50
- | Llama-3.1-8B | 8B | dense | **1.0125Γƒβ€”** | |
51
-
52
- 22 architectures shipped, 20 PPL-verified end-to-end (19 transformer + 1 SSM with comparator-note caveat). Full matrix below + at github.com/sipsalabs/ultracompress.
53
 
54
  ### Try UltraCompress (3 commands)
55
 
@@ -59,53 +61,49 @@ hf download SipsaLabs/qwen3-1.7b-base-uc-v3-bpw5 --local-dir ./pack
59
  uc verify ./pack
60
  ```
61
 
62
- Expected: `VERIFY: PASS Ò€” bit-identical reconstruction guaranteed.`
63
 
64
  ---
65
 
66
  ## Product 2: Sipsa Inference
67
 
68
- OpenAI-compatible inference API serving our compressed weights. Drop-in replacement for OpenAI's `base_url` Ò€” same `openai` Python SDK works unchanged.
69
 
70
  ```bash
71
  export OPENAI_BASE_URL=https://api.sipsalabs.com/v1
72
  curl $OPENAI_BASE_URL/models
73
  ```
74
 
75
- 22 models live in the catalog with `sipsa-*` prefix (e.g. `model="sipsa-hermes-3-llama-3.1-405b"`). Backed by dual RTX 5090 over Cloudflare Tunnel.
76
-
77
- **Pricing**: Free $5 credit on signup (no card). **Pro $99/mo** (600 RPM, $100 included credit). **Team $499/mo** (2400 RPM, $500 included credit). Full pricing + bill estimator at sipsalabs.com/pricing.
78
 
79
  ---
80
 
81
- ## Service: Compression-as-a-Service (CaaS)
82
-
83
- Bring a model, we deliver a verified-lossless 5-bit pack you can run on your hardware. **Phase 0 POC is $5K / 5 business days / customer-picked model**. Day 7 deliverable is a pack you self-verify with `uc verify` + benchmark with `uc bench`. Acceptance gate: `uc verify PASS` + PPL ratio within 1.5% on your eval set.
84
 
85
- Email founder@sipsalabs.com.
86
 
87
  ---
88
 
89
  ## Why this matters
90
 
91
- Defense / FDA-regulated healthcare / SR 11-7 model validation / frontier lab red-team eval Ò€” places where "good enough on MMLU" isn't enough. Bit-identical reconstruction is the actual reason to talk to us in those settings. As a side-effect of the streaming compression path, it lets us put a 405B-parameter model through a single 32 GB consumer GPU without renting an H100 cluster.
92
 
93
  ---
94
 
95
  ## License + IP
96
 
97
- - **PyPI v0.6+** under BUSL-1.1 with **Additional Use Grant**: free for sub-$1M ARR companies, research, and individuals. Auto-converts to Apache 2.0 four years after each release.
98
- - **v0.5.x** stays under Apache-2.0 forever on the `legacy/0.5.x` branch.
99
- - Codec internals patent-protected. Continuations through 2027.
100
 
101
  ---
102
 
103
  ## Contact
104
 
105
- - **Commercial / Phase 0 POC** Ò†’ founder@sipsalabs.com
106
- - **Patents / licensing** Ò†’ legal@sipsalabs.com
107
- - **Press / media** Ò†’ press@sipsalabs.com
108
- - **Security disclosure** Ò†’ security@sipsalabs.com
109
- - **General** Ò†’ hello@sipsalabs.com
110
 
111
- [sipsalabs.com](https://sipsalabs.com) · [GitHub](https://github.com/sipsalabs) · [PyPI](https://pypi.org/project/ultracompress/) · [Pricing](https://sipsalabs.com/pricing)
 
1
+ ---
2
  title: README
3
  emoji: 🧊
4
  colorFrom: indigo
 
8
  ---
9
  # Sipsa Labs
10
 
11
+ > **Sipsa Labs** is a deep-tech company that invents and ships across the breadth of AI infrastructure.
12
  >
13
  > **Two products live today:**
14
  >
15
+ > 1. **UltraCompress** β€” near-lossless 5-bit transformer compression (plus a genuinely lossless archival tier), with SHA-256-verifiable reconstruction. Flagship. `pip install ultracompress`.
16
+ > 2. **Sipsa Inference** β€” an OpenAI-compatible serving API for our compressed weights at `https://api.sipsalabs.com/v1`.
17
  >
18
+ > Phase 0 POC engagements are open (scoped, customer-picked model). More in flight β€” we don't pre-announce.
19
 
20
  ---
21
 
22
+ ## Current release β€” v0.6.27 (minimal, clean)
23
 
24
+ Only `pip install ultracompress` (v0.6.27) is on PyPI: a minimal SHA-256 verifier. Codec internals are patent-protected and are not shipped in the public package.
25
 
26
  ---
27
 
28
  ## Product 1: UltraCompress
29
 
30
+ **Two tiers, both with reproducible, SHA-256-verifiable reconstruction:**
31
+
32
+ - A **genuinely lossless archival tier** β€” reconstructs the original weights bit-for-bit (~1.3–1.6Γ— smaller) for exact storage and hand-off.
33
+ - A **near-lossless 5-bit tier** β€” ~1% perplexity vs bf16 (lossy), ~3Γ— smaller, for running frontier-scale models on small GPUs.
34
+
35
+ **23 architectures verified**: 22 PPL-verified end-to-end (21 transformer β€” 17 dense + 4 MoE β€” plus 1 SSM with a comparator-note caveat) and 1 Vision Transformer cosine-verified (DINOv2-Large). Dense + MoE + SSM + ViT, 0.6B to 405B. `uc verify` checks SHA-256 over the reconstructed tensor bytes against the reference manifest.
36
 
37
+ ### Verified 5-bit PPL ratios (sample)
 
38
 
39
+ *(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30–50; seed = 42)*
40
+
41
+ | Model | Params | Type | PPL ratio | Notes |
42
  |---|---:|:---|---:|:---|
43
+ | **Mixtral-8x7B** | 47B | MoE | **1.00368Γ—** | tightest MoE result |
44
+ | Qwen3-1.7B-Base | 1.7B | dense | **1.00401Γ—** | small-decoder record |
45
+ | Qwen3-14B | 14B | dense | **1.00403Γ—** | 14B-class record |
46
+ | Yi-1.5-9B | 8.8B | dense | **1.00414Γ—** | >8B record |
47
+ | Qwen3-8B | 8B | dense | **1.00440Γ—** | 8B-class record |
48
+ | Mistral-7B-v0.3 | 7B | dense | **1.00548Γ—** | strong dense 7B-class result |
49
+ | Phi-3-mini-4k | 3.8B | dense | **1.00262Γ—** | tightest dense ratio (seq_len=128 caveat) |
50
+ | **Hermes-3-Llama-3.1-405B** | 405B | dense | **1.0066Γ—** | 405B-class near-lossless on a single 32 GB GPU (streamed from disk) |
51
+ | Mamba-2.8B | 2.8B | SSM | **1.0059Γ—** | state-space model β€” SSM-compatible comparator (the canonical transformer pipeline is architecture-incompatible with SSMs) |
52
+ | Llama-3.1-8B | 8B | dense | **1.0125Γ—** | honest worst case (pipeline-specific floor, not architectural) |
53
+
54
+ Full matrix at [github.com/sipsalabs/ultracompress](https://github.com/sipsalabs/ultracompress).
 
 
 
 
55
 
56
  ### Try UltraCompress (3 commands)
57
 
 
61
  uc verify ./pack
62
  ```
63
 
64
+ Expected: `VERIFY: PASS β€” bit-identical reconstruction.`
65
 
66
  ---
67
 
68
  ## Product 2: Sipsa Inference
69
 
70
+ OpenAI-compatible inference API serving our compressed weights β€” a drop-in `base_url` swap; the `openai` Python SDK works unchanged.
71
 
72
  ```bash
73
  export OPENAI_BASE_URL=https://api.sipsalabs.com/v1
74
  curl $OPENAI_BASE_URL/models
75
  ```
76
 
77
+ 23 models live in the catalog with the `sipsa-*` prefix (e.g. `model="sipsa-hermes-3-llama-3.1-405b"`). **Free $5 credit on signup (no card).** Full pricing and a bill estimator at [sipsalabs.com/pricing](https://sipsalabs.com/pricing).
 
 
78
 
79
  ---
80
 
81
+ ## Service: Compression-as-a-Service
 
 
82
 
83
+ Bring a model; we deliver a verified 5-bit pack you run on your own hardware. Phase 0 POC is a scoped, customer-picked-model engagement with a self-verifiable (`uc verify`) deliverable and a PPL-ratio acceptance gate. Email founder@sipsalabs.com or see [sipsalabs.com/poc](https://sipsalabs.com/poc).
84
 
85
  ---
86
 
87
  ## Why this matters
88
 
89
+ Defense, FDA-regulated healthcare, SR 11-7 model validation, frontier-lab red-team eval β€” settings where "good enough on a benchmark" isn't enough. **SHA-256-verifiable reconstruction** β€” proving that what runs in production is exactly the validated artifact β€” is the reason to talk to us there. As a side effect, the streaming reconstruction path runs a 405B-parameter model through a single 32 GB consumer GPU.
90
 
91
  ---
92
 
93
  ## License + IP
94
 
95
+ - **PyPI v0.6+** under BUSL-1.1 with an **Additional Use Grant**: free for sub-$1M-ARR companies, research, and individuals. Auto-converts to Apache 2.0 four years after each release.
96
+ - **v0.5.x** stays Apache-2.0 on the `legacy/0.5.x` branch.
97
+ - Codec internals are patent-protected (continuations pending).
98
 
99
  ---
100
 
101
  ## Contact
102
 
103
+ - **Commercial / Phase 0 POC** β†’ founder@sipsalabs.com
104
+ - **Patents / licensing** β†’ legal@sipsalabs.com
105
+ - **Press / media** β†’ press@sipsalabs.com
106
+ - **Security disclosure** β†’ security@sipsalabs.com
107
+ - **General** β†’ hello@sipsalabs.com
108
 
109
+ [sipsalabs.com](https://sipsalabs.com) Β· [GitHub](https://github.com/sipsalabs) Β· [PyPI](https://pypi.org/project/ultracompress/) Β· [Pricing](https://sipsalabs.com/pricing)