Refresh org card: two-tier framing, 23 verified (22 PPL + 1 ViT), v0.6.27, clean encoding, drop stale/banned terms
Browse files
README.md
CHANGED
|
@@ -1,4 +1,4 @@
|
|
| 1 |
-
|
| 2 |
title: README
|
| 3 |
emoji: π§
|
| 4 |
colorFrom: indigo
|
|
@@ -8,48 +8,50 @@ pinned: false
|
|
| 8 |
---
|
| 9 |
# Sipsa Labs
|
| 10 |
|
| 11 |
-
> **Sipsa Labs** is
|
| 12 |
>
|
| 13 |
> **Two products live today:**
|
| 14 |
>
|
| 15 |
-
> 1. **UltraCompress**
|
| 16 |
-
> 2. **Sipsa Inference**
|
| 17 |
>
|
| 18 |
-
>
|
| 19 |
|
| 20 |
---
|
| 21 |
|
| 22 |
-
## v0.6.
|
| 23 |
|
| 24 |
-
Only `pip install ultracompress` (v0.6.
|
| 25 |
|
| 26 |
---
|
| 27 |
|
| 28 |
## Product 1: UltraCompress
|
| 29 |
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
-
###
|
| 33 |
-
*(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30-50; seed = 42)*
|
| 34 |
|
| 35 |
-
|
|
|
|
|
|
|
| 36 |
|---|---:|:---|---:|:---|
|
| 37 |
-
| **Mixtral-8x7B** | 47B | MoE | **1.
|
| 38 |
-
| Qwen3-1.7B-Base | 1.7B | dense | **1.
|
| 39 |
-
| Qwen3-14B | 14B | dense | **1.
|
| 40 |
-
| Yi-1.5-9B | 8.8B | dense | **1.
|
| 41 |
-
| Qwen3-8B | 8B | dense | **1.
|
| 42 |
-
|
|
| 43 |
-
| Phi-3-mini-4k | 3.8B | dense | **1.
|
| 44 |
-
| **Hermes-3-Llama-3.1-405B** | 405B | dense | **1.
|
| 45 |
-
|
|
| 46 |
-
|
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
| Mamba-2.8B | 2.8B | SSM | **1.0059Γβ** | state-space model (uses SSM-compatible comparator; canonical transformer streaming reconstruction is architecture-incompatible with SSMs) |
|
| 50 |
-
| Llama-3.1-8B | 8B | dense | **1.0125Γβ** | |
|
| 51 |
-
|
| 52 |
-
22 architectures shipped, 20 PPL-verified end-to-end (19 transformer + 1 SSM with comparator-note caveat). Full matrix below + at github.com/sipsalabs/ultracompress.
|
| 53 |
|
| 54 |
### Try UltraCompress (3 commands)
|
| 55 |
|
|
@@ -59,53 +61,49 @@ hf download SipsaLabs/qwen3-1.7b-base-uc-v3-bpw5 --local-dir ./pack
|
|
| 59 |
uc verify ./pack
|
| 60 |
```
|
| 61 |
|
| 62 |
-
Expected: `VERIFY: PASS
|
| 63 |
|
| 64 |
---
|
| 65 |
|
| 66 |
## Product 2: Sipsa Inference
|
| 67 |
|
| 68 |
-
OpenAI-compatible inference API serving our compressed weights
|
| 69 |
|
| 70 |
```bash
|
| 71 |
export OPENAI_BASE_URL=https://api.sipsalabs.com/v1
|
| 72 |
curl $OPENAI_BASE_URL/models
|
| 73 |
```
|
| 74 |
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
**Pricing**: Free $5 credit on signup (no card). **Pro $99/mo** (600 RPM, $100 included credit). **Team $499/mo** (2400 RPM, $500 included credit). Full pricing + bill estimator at sipsalabs.com/pricing.
|
| 78 |
|
| 79 |
---
|
| 80 |
|
| 81 |
-
## Service: Compression-as-a-Service
|
| 82 |
-
|
| 83 |
-
Bring a model, we deliver a verified-lossless 5-bit pack you can run on your hardware. **Phase 0 POC is $5K / 5 business days / customer-picked model**. Day 7 deliverable is a pack you self-verify with `uc verify` + benchmark with `uc bench`. Acceptance gate: `uc verify PASS` + PPL ratio within 1.5% on your eval set.
|
| 84 |
|
| 85 |
-
Email founder@sipsalabs.com.
|
| 86 |
|
| 87 |
---
|
| 88 |
|
| 89 |
## Why this matters
|
| 90 |
|
| 91 |
-
Defense
|
| 92 |
|
| 93 |
---
|
| 94 |
|
| 95 |
## License + IP
|
| 96 |
|
| 97 |
-
- **PyPI v0.6+** under BUSL-1.1 with **Additional Use Grant**: free for sub-$1M
|
| 98 |
-
- **v0.5.x** stays
|
| 99 |
-
- Codec internals patent-protected
|
| 100 |
|
| 101 |
---
|
| 102 |
|
| 103 |
## Contact
|
| 104 |
|
| 105 |
-
- **Commercial / Phase 0 POC**
|
| 106 |
-
- **Patents / licensing**
|
| 107 |
-
- **Press / media**
|
| 108 |
-
- **Security disclosure**
|
| 109 |
-
- **General**
|
| 110 |
|
| 111 |
-
[sipsalabs.com](https://sipsalabs.com)
|
|
|
|
| 1 |
+
---
|
| 2 |
title: README
|
| 3 |
emoji: π§
|
| 4 |
colorFrom: indigo
|
|
|
|
| 8 |
---
|
| 9 |
# Sipsa Labs
|
| 10 |
|
| 11 |
+
> **Sipsa Labs** is a deep-tech company that invents and ships across the breadth of AI infrastructure.
|
| 12 |
>
|
| 13 |
> **Two products live today:**
|
| 14 |
>
|
| 15 |
+
> 1. **UltraCompress** β near-lossless 5-bit transformer compression (plus a genuinely lossless archival tier), with SHA-256-verifiable reconstruction. Flagship. `pip install ultracompress`.
|
| 16 |
+
> 2. **Sipsa Inference** β an OpenAI-compatible serving API for our compressed weights at `https://api.sipsalabs.com/v1`.
|
| 17 |
>
|
| 18 |
+
> Phase 0 POC engagements are open (scoped, customer-picked model). More in flight β we don't pre-announce.
|
| 19 |
|
| 20 |
---
|
| 21 |
|
| 22 |
+
## Current release β v0.6.27 (minimal, clean)
|
| 23 |
|
| 24 |
+
Only `pip install ultracompress` (v0.6.27) is on PyPI: a minimal SHA-256 verifier. Codec internals are patent-protected and are not shipped in the public package.
|
| 25 |
|
| 26 |
---
|
| 27 |
|
| 28 |
## Product 1: UltraCompress
|
| 29 |
|
| 30 |
+
**Two tiers, both with reproducible, SHA-256-verifiable reconstruction:**
|
| 31 |
+
|
| 32 |
+
- A **genuinely lossless archival tier** β reconstructs the original weights bit-for-bit (~1.3β1.6Γ smaller) for exact storage and hand-off.
|
| 33 |
+
- A **near-lossless 5-bit tier** β ~1% perplexity vs bf16 (lossy), ~3Γ smaller, for running frontier-scale models on small GPUs.
|
| 34 |
+
|
| 35 |
+
**23 architectures verified**: 22 PPL-verified end-to-end (21 transformer β 17 dense + 4 MoE β plus 1 SSM with a comparator-note caveat) and 1 Vision Transformer cosine-verified (DINOv2-Large). Dense + MoE + SSM + ViT, 0.6B to 405B. `uc verify` checks SHA-256 over the reconstructed tensor bytes against the reference manifest.
|
| 36 |
|
| 37 |
+
### Verified 5-bit PPL ratios (sample)
|
|
|
|
| 38 |
|
| 39 |
+
*(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30β50; seed = 42)*
|
| 40 |
+
|
| 41 |
+
| Model | Params | Type | PPL ratio | Notes |
|
| 42 |
|---|---:|:---|---:|:---|
|
| 43 |
+
| **Mixtral-8x7B** | 47B | MoE | **1.00368Γ** | tightest MoE result |
|
| 44 |
+
| Qwen3-1.7B-Base | 1.7B | dense | **1.00401Γ** | small-decoder record |
|
| 45 |
+
| Qwen3-14B | 14B | dense | **1.00403Γ** | 14B-class record |
|
| 46 |
+
| Yi-1.5-9B | 8.8B | dense | **1.00414Γ** | >8B record |
|
| 47 |
+
| Qwen3-8B | 8B | dense | **1.00440Γ** | 8B-class record |
|
| 48 |
+
| Mistral-7B-v0.3 | 7B | dense | **1.00548Γ** | strong dense 7B-class result |
|
| 49 |
+
| Phi-3-mini-4k | 3.8B | dense | **1.00262Γ** | tightest dense ratio (seq_len=128 caveat) |
|
| 50 |
+
| **Hermes-3-Llama-3.1-405B** | 405B | dense | **1.0066Γ** | 405B-class near-lossless on a single 32 GB GPU (streamed from disk) |
|
| 51 |
+
| Mamba-2.8B | 2.8B | SSM | **1.0059Γ** | state-space model β SSM-compatible comparator (the canonical transformer pipeline is architecture-incompatible with SSMs) |
|
| 52 |
+
| Llama-3.1-8B | 8B | dense | **1.0125Γ** | honest worst case (pipeline-specific floor, not architectural) |
|
| 53 |
+
|
| 54 |
+
Full matrix at [github.com/sipsalabs/ultracompress](https://github.com/sipsalabs/ultracompress).
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
|
| 56 |
### Try UltraCompress (3 commands)
|
| 57 |
|
|
|
|
| 61 |
uc verify ./pack
|
| 62 |
```
|
| 63 |
|
| 64 |
+
Expected: `VERIFY: PASS β bit-identical reconstruction.`
|
| 65 |
|
| 66 |
---
|
| 67 |
|
| 68 |
## Product 2: Sipsa Inference
|
| 69 |
|
| 70 |
+
OpenAI-compatible inference API serving our compressed weights β a drop-in `base_url` swap; the `openai` Python SDK works unchanged.
|
| 71 |
|
| 72 |
```bash
|
| 73 |
export OPENAI_BASE_URL=https://api.sipsalabs.com/v1
|
| 74 |
curl $OPENAI_BASE_URL/models
|
| 75 |
```
|
| 76 |
|
| 77 |
+
23 models live in the catalog with the `sipsa-*` prefix (e.g. `model="sipsa-hermes-3-llama-3.1-405b"`). **Free $5 credit on signup (no card).** Full pricing and a bill estimator at [sipsalabs.com/pricing](https://sipsalabs.com/pricing).
|
|
|
|
|
|
|
| 78 |
|
| 79 |
---
|
| 80 |
|
| 81 |
+
## Service: Compression-as-a-Service
|
|
|
|
|
|
|
| 82 |
|
| 83 |
+
Bring a model; we deliver a verified 5-bit pack you run on your own hardware. Phase 0 POC is a scoped, customer-picked-model engagement with a self-verifiable (`uc verify`) deliverable and a PPL-ratio acceptance gate. Email founder@sipsalabs.com or see [sipsalabs.com/poc](https://sipsalabs.com/poc).
|
| 84 |
|
| 85 |
---
|
| 86 |
|
| 87 |
## Why this matters
|
| 88 |
|
| 89 |
+
Defense, FDA-regulated healthcare, SR 11-7 model validation, frontier-lab red-team eval β settings where "good enough on a benchmark" isn't enough. **SHA-256-verifiable reconstruction** β proving that what runs in production is exactly the validated artifact β is the reason to talk to us there. As a side effect, the streaming reconstruction path runs a 405B-parameter model through a single 32 GB consumer GPU.
|
| 90 |
|
| 91 |
---
|
| 92 |
|
| 93 |
## License + IP
|
| 94 |
|
| 95 |
+
- **PyPI v0.6+** under BUSL-1.1 with an **Additional Use Grant**: free for sub-$1M-ARR companies, research, and individuals. Auto-converts to Apache 2.0 four years after each release.
|
| 96 |
+
- **v0.5.x** stays Apache-2.0 on the `legacy/0.5.x` branch.
|
| 97 |
+
- Codec internals are patent-protected (continuations pending).
|
| 98 |
|
| 99 |
---
|
| 100 |
|
| 101 |
## Contact
|
| 102 |
|
| 103 |
+
- **Commercial / Phase 0 POC** β founder@sipsalabs.com
|
| 104 |
+
- **Patents / licensing** β legal@sipsalabs.com
|
| 105 |
+
- **Press / media** β press@sipsalabs.com
|
| 106 |
+
- **Security disclosure** β security@sipsalabs.com
|
| 107 |
+
- **General** β hello@sipsalabs.com
|
| 108 |
|
| 109 |
+
[sipsalabs.com](https://sipsalabs.com) Β· [GitHub](https://github.com/sipsalabs) Β· [PyPI](https://pypi.org/project/ultracompress/) Β· [Pricing](https://sipsalabs.com/pricing)
|