Parent-company refresh: Two products live (UltraCompress + Sipsa Inference) + CaaS + v0.6.9 + Mistral 1.00548x + scrub stale HN banner
Browse files
README.md
CHANGED
|
@@ -1,71 +1,114 @@
|
|
| 1 |
-
---
|
| 2 |
-
title: Sipsa Labs
|
| 3 |
-
emoji: π§
|
| 4 |
-
colorFrom: indigo
|
| 5 |
-
colorTo: blue
|
| 6 |
-
sdk: static
|
| 7 |
-
pinned: false
|
| 8 |
-
---
|
| 9 |
-
|
| 10 |
-
# Sipsa Labs
|
| 11 |
-
|
| 12 |
-
> Sipsa Labs is an
|
| 13 |
-
>
|
| 14 |
-
>
|
| 15 |
-
>
|
| 16 |
-
>
|
| 17 |
-
>
|
| 18 |
-
>
|
| 19 |
-
>
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: Sipsa Labs
|
| 3 |
+
emoji: π§
|
| 4 |
+
colorFrom: indigo
|
| 5 |
+
colorTo: blue
|
| 6 |
+
sdk: static
|
| 7 |
+
pinned: false
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# Sipsa Labs
|
| 11 |
+
|
| 12 |
+
> **Sipsa Labs** is an experimental and deep tech-and-software company. We invent and ship across the full breadth of tech and software.
|
| 13 |
+
>
|
| 14 |
+
> **Two products live today:**
|
| 15 |
+
>
|
| 16 |
+
> 1. **UltraCompress** β lossless 5-bit transformer compression. Flagship. `pip install ultracompress`.
|
| 17 |
+
> 2. **Sipsa Inference** β OpenAI-compatible serving API for our compressed weights. `https://api.sipsalabs.com/v1`. Pro $99/mo + Team $499/mo.
|
| 18 |
+
>
|
| 19 |
+
> **Compression-as-a-Service** engagements are open ($5K Phase 0 POC). More products in flight β we don't pre-announce.
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
## v0.6.9 shipped 2026-05-15 β security release + new Mistral 7B record
|
| 24 |
+
|
| 25 |
+
`pip install --upgrade ultracompress` β RCE-class fix on `torch.load()` paths + MANIFEST-scrubbed sdist. v0.6.7 + v0.6.8 yanked from PyPI. Drop-in replacement, no code changes required.
|
| 26 |
+
|
| 27 |
+
**Mistral-7B-v0.3 hits 1.00548Γ** β tightest dense 7B-class lossless 5-bit number on the public HF Hub.
|
| 28 |
+
|
| 29 |
+
---
|
| 30 |
+
|
| 31 |
+
## Product 1: UltraCompress
|
| 32 |
+
|
| 33 |
+
Production-grade lossless 5-bit transformer compression across 22 architectures, dense + Mixture-of-Experts + state-space, 0.6B to 405B parameters. Mathematically lossless customer-side reconstruction: SHA-256 over reconstructed tensor bytes matches the trainer's measurement, verified by `uc verify`.
|
| 34 |
+
|
| 35 |
+
### Tightest verified PPL ratios at 5 bpw
|
| 36 |
+
*(perplexity ratio = compressed PPL / bf16 baseline PPL; FineWeb-edu held-out tail; seq_len = 1024; n = 30-50; seed = 42)*
|
| 37 |
+
|
| 38 |
+
| Model | Params | Type | **PPL ratio** | Notes |
|
| 39 |
+
|---|---:|:---|---:|:---|
|
| 40 |
+
| **Mixtral-8x7B** | 47B | MoE | **1.00368Γ** | tightest MoE result |
|
| 41 |
+
| Qwen3-1.7B-Base | 1.7B | dense | **1.00401Γ** | small-decoder record |
|
| 42 |
+
| Qwen3-14B | 14B | dense | **1.00403Γ** | 14B-class record |
|
| 43 |
+
| Yi-1.5-9B | 8.8B | dense | **1.00414Γ** | >8B record |
|
| 44 |
+
| Qwen3-8B | 8B | dense | **1.00440Γ** | 8B-class record |
|
| 45 |
+
| **Mistral-7B-v0.3** | 7B | dense | **1.00548Γ** | NEW β tightest dense 7B-class on the public Hub |
|
| 46 |
+
| Phi-3-mini-4k | 3.8B | dense | **1.00624Γ** | cross-arch confirm |
|
| 47 |
+
| **Hermes-3-Llama-3.1-405B** | 405B | dense | **1.0066Γ** | first 405B-class lossless on a single 32 GB consumer GPU |
|
| 48 |
+
| Qwen3-0.6B | 0.6B | dense | **1.0069Γ** | |
|
| 49 |
+
| OLMo-2-0425-1B | 1B | dense | **1.0073Γ** | |
|
| 50 |
+
| SmolLM2-1.7B-Instruct | 1.7B | dense | **1.0075Γ** | |
|
| 51 |
+
| SmolLM2-1.7B | 1.7B | dense | **1.0085Γ** | |
|
| 52 |
+
| Mamba-2.8B | 2.8B | SSM | **1.0119Γ** | first published 5-bit lossless on a state-space model |
|
| 53 |
+
| Llama-3.1-8B | 8B | dense | **1.0125Γ** | |
|
| 54 |
+
|
| 55 |
+
22 architectures end-to-end. Full matrix below + at github.com/sipsalabs/ultracompress.
|
| 56 |
+
|
| 57 |
+
### Try UltraCompress (3 commands)
|
| 58 |
+
|
| 59 |
+
```bash
|
| 60 |
+
pip install ultracompress
|
| 61 |
+
hf download SipsaLabs/qwen3-1.7b-base-uc-v3-bpw5 --local-dir ./pack
|
| 62 |
+
uc verify ./pack
|
| 63 |
+
```
|
| 64 |
+
|
| 65 |
+
Expected: `VERIFY: PASS β bit-identical reconstruction guaranteed.`
|
| 66 |
+
|
| 67 |
+
---
|
| 68 |
+
|
| 69 |
+
## Product 2: Sipsa Inference
|
| 70 |
+
|
| 71 |
+
OpenAI-compatible inference API serving our compressed weights. Drop-in replacement for OpenAI's `base_url` β same `openai` Python SDK works unchanged.
|
| 72 |
+
|
| 73 |
+
```bash
|
| 74 |
+
export OPENAI_BASE_URL=https://api.sipsalabs.com/v1
|
| 75 |
+
curl $OPENAI_BASE_URL/models
|
| 76 |
+
```
|
| 77 |
+
|
| 78 |
+
22 models live in the catalog with `sipsa-*` prefix (e.g. `model="sipsa-hermes-3-llama-3.1-405b"`). Backed by dual RTX 5090 over Cloudflare Tunnel.
|
| 79 |
+
|
| 80 |
+
**Pricing**: Free $5 credit on signup (no card). **Pro $99/mo** (600 RPM, $100 included credit). **Team $499/mo** (2400 RPM, $500 included credit). Full pricing + bill estimator at sipsalabs.com/pricing.
|
| 81 |
+
|
| 82 |
+
---
|
| 83 |
+
|
| 84 |
+
## Service: Compression-as-a-Service (CaaS)
|
| 85 |
+
|
| 86 |
+
Bring a model, we deliver a verified-lossless 5-bit pack you can run on your hardware. **Phase 0 POC is $5K / 5 business days / customer-picked model**. Day 7 deliverable is a pack you self-verify with `uc verify` + benchmark with `uc bench`. Acceptance gate: `uc verify PASS` + PPL ratio within 1.5% on your eval set.
|
| 87 |
+
|
| 88 |
+
Email founder@sipsalabs.com.
|
| 89 |
+
|
| 90 |
+
---
|
| 91 |
+
|
| 92 |
+
## Why this matters
|
| 93 |
+
|
| 94 |
+
Defense / FDA-regulated healthcare / SR 11-7 model validation / frontier lab red-team eval β places where "good enough on MMLU" isn't enough. Bit-identical reconstruction is the actual reason to talk to us in those settings. As a side-effect of the streaming compression path, it lets us put a 405B-parameter model through a single 32 GB consumer GPU without renting an H100 cluster.
|
| 95 |
+
|
| 96 |
+
---
|
| 97 |
+
|
| 98 |
+
## License + IP
|
| 99 |
+
|
| 100 |
+
- **PyPI v0.6+** under BUSL-1.1 with **Additional Use Grant**: free for sub-$1M ARR companies, research, and individuals. Auto-converts to Apache 2.0 four years after each release.
|
| 101 |
+
- **v0.5.x** stays under Apache-2.0 forever on the `legacy/0.5.x` branch.
|
| 102 |
+
- Codec internals patent-protected. Continuations through 2027.
|
| 103 |
+
|
| 104 |
+
---
|
| 105 |
+
|
| 106 |
+
## Contact
|
| 107 |
+
|
| 108 |
+
- **Commercial / Phase 0 POC** β founder@sipsalabs.com
|
| 109 |
+
- **Patents / licensing** β legal@sipsalabs.com
|
| 110 |
+
- **Press / media** β press@sipsalabs.com
|
| 111 |
+
- **Security disclosure** β security@sipsalabs.com
|
| 112 |
+
- **General** β hello@sipsalabs.com
|
| 113 |
+
|
| 114 |
+
[sipsalabs.com](https://sipsalabs.com) Β· [GitHub](https://github.com/sipsalabs) Β· [PyPI](https://pypi.org/project/ultracompress/) Β· [Pricing](https://sipsalabs.com/pricing)
|