Update README.md
Browse files
README.md
CHANGED
|
@@ -5,53 +5,79 @@ license_link: LICENSE
|
|
| 5 |
tags:
|
| 6 |
- runtime
|
| 7 |
- llama.cpp
|
|
|
|
|
|
|
| 8 |
- tts
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
- openbloom
|
| 10 |
---
|
| 11 |
|
| 12 |
# OpenBloom Runtime Releases
|
| 13 |
|
| 14 |
-
This repository hosts **OpenBloom's self-built runtime artifacts** —
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
*runtime tooling* that serves open-weight models locally, hash-pinned
|
| 18 |
-
and verified on every download.
|
| 19 |
|
| 20 |
-
|
|
|
|
| 21 |
|
| 22 |
-
|
| 23 |
-
inference runtime.
|
| 24 |
|
| 25 |
-
|
|
| 26 |
|---|---|---|
|
| 27 |
-
| `llama-
|
| 28 |
-
| `
|
| 29 |
-
| `
|
|
|
|
| 30 |
|
| 31 |
-
|
| 32 |
-
downloader, and you can verify it yourself:
|
| 33 |
|
| 34 |
-
|
| 35 |
-
sha256
|
|
|
|
| 36 |
|
| 37 |
-
|
| 38 |
-
|
|
|
|
|
|
|
| 39 |
|
| 40 |
-
#
|
|
|
|
|
|
|
| 41 |
|
| 42 |
-
KrisKross
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
belongs to them. OpenBloom Labs produces the compiled bundle and
|
| 46 |
-
publishes it for the OpenBloom installer.
|
| 47 |
|
| 48 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 49 |
|
| 50 |
-
|
| 51 |
-
**unauthenticated**, this is a requirement of the OpenBloom
|
| 52 |
-
downloader.
|
| 53 |
-
- Every artifact is content-addressed: the consuming installer pins a
|
| 54 |
-
sha256 and fails closed on any drift.
|
| 55 |
-
- Never gate this repository, and never rewrite a published version
|
| 56 |
-
in place — publish a new versioned path instead.
|
| 57 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
tags:
|
| 6 |
- runtime
|
| 7 |
- llama.cpp
|
| 8 |
+
- llama-server
|
| 9 |
+
- stable-diffusion.cpp
|
| 10 |
- tts
|
| 11 |
+
- text-to-image
|
| 12 |
+
- image-generation
|
| 13 |
+
- gguf
|
| 14 |
+
- on-device
|
| 15 |
- openbloom
|
| 16 |
---
|
| 17 |
|
| 18 |
# OpenBloom Runtime Releases
|
| 19 |
|
| 20 |
+
This repository hosts **OpenBloom's self-built runtime artifacts** — the engines, bundles and
|
| 21 |
+
converted weights that the OpenBloom desktop application provisions at install time. Every
|
| 22 |
+
artifact is hash-pinned by the OpenBloom downloader and verified fail-closed on every download.
|
|
|
|
|
|
|
| 23 |
|
| 24 |
+
**This repository contains no third-party model weights** — with one exception: the MOSS-TTS-Realtime
|
| 25 |
+
GGUF conversion, which is OpenBloom's own quantization of the Apache-2.0 MOSS-TTS model.
|
| 26 |
|
| 27 |
+
## Contents
|
|
|
|
| 28 |
|
| 29 |
+
| Family | Path | What it is |
|
| 30 |
|---|---|---|
|
| 31 |
+
| **llama-server** | `llama-server/b12110/` | Our CUDA 12.8 build of [llama.cpp](https://github.com/ggml-org/llama.cpp) `b12110` (v0.9.0), merged with its cudart bundle as one flat artifact. The chat + ASR sidecar. |
|
| 32 |
+
| **sd-server** | `sd-server/5dcfa79/` | Our CPU build of [stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp) at commit `5dcfa79` (`master-1104-5dcfa79`). The image-generation sidecar: SD/SDXL/Flux-class diffusion models served over a loopback HTTP API. |
|
| 33 |
+
| **KrisKross** | `kriskross/1.0.0 … 2.1.1/` | OpenBloom's build of the MOSS-TTS inference runtime: the OpenMOSS llama.cpp fork + the MOSS Audio Tokenizer (ONNX). CPU and CUDA 12 variants. |
|
| 34 |
+
| **moss-models** | `moss-models/2.0.0/` | Our GGUF (Q4_K_M) conversion of MOSS-TTS-Realtime 2.0.0, for the KrisKross runtime. |
|
| 35 |
|
| 36 |
+
## Verify before use
|
|
|
|
| 37 |
|
| 38 |
+
Every bundle ships a `MANIFEST.json` (the sha256 of each component) and every family's versions
|
| 39 |
+
carry a `SHA256SUMS` file. The consuming installer pins a sha256 and fails closed on any drift —
|
| 40 |
+
you can verify the same way:
|
| 41 |
|
| 42 |
+
```
|
| 43 |
+
# llama-server (CUDA 12.8, b12110)
|
| 44 |
+
llama-server/b12110/llama-server-b12110-linux-amd64-cuda12.tar.gz
|
| 45 |
+
sha256: 546dab15b51f86a43edd6452a8025e6fba425522102dbb6267cb1a376f7ad8dc
|
| 46 |
|
| 47 |
+
# sd-server (CPU, stable-diffusion.cpp 5dcfa79)
|
| 48 |
+
sd-server/5dcfa79/sd-server-5dcfa79-linux-amd64-cpu.tar.gz
|
| 49 |
+
sha256: a836547d079fb9c3236d3a6b8344fb93f431a478eb7fe8ba4daf54bfc00c8719
|
| 50 |
|
| 51 |
+
# KrisKross (latest, 2.1.1, CPU)
|
| 52 |
+
kriskross/2.1.1/kriskross-2.1.1-linux-amd64.tar.zst
|
| 53 |
+
sha256: f2d499917de99eadb856b104f51439544e15fc63a72d273489ecccf1bdc0d4fa
|
|
|
|
|
|
|
| 54 |
|
| 55 |
+
# MOSS-TTS-Realtime (our Q4_K_M conversion)
|
| 56 |
+
moss-models/2.0.0/moss-tts-realtime-q4_k_m.gguf
|
| 57 |
+
sha256: ccd2ab76524affbc3a33a54f56224e24eabb008e73dd2b4142e8bf48cf492ed6
|
| 58 |
+
```
|
| 59 |
+
|
| 60 |
+
## Upstream attribution & licenses
|
| 61 |
+
|
| 62 |
+
| Artifact | Built from | License |
|
| 63 |
+
|---|---|---|
|
| 64 |
+
| `llama-server` b12110 | [ggml-org/llama.cpp](https://github.com/ggml-org/llama.cpp) at tag `b12110` | MIT (© The ggml authors) |
|
| 65 |
+
| `sd-server` 5dcfa79 | [leejet/stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp) at commit `5dcfa79` | MIT |
|
| 66 |
+
| `llama-moss-tts` / `llama-moss-tts-realtime` | [OpenBloom/llama.cpp](https://codeberg.org/OpenBloom/llama.cpp) at tag `openbloom-realtime-e1` (the OpenMOSS fork) | MIT |
|
| 67 |
+
| `tokenizer.json` | [OpenMOSS-Team/MOSS-TTS](https://huggingface.co/OpenMOSS-Team/MOSS-TTS) | Apache-2.0 |
|
| 68 |
+
| `MOSS-Audio-Tokenizer-ONNX` | [OpenMOSS-Team/MOSS-Audio-Tokenizer-ONNX](https://huggingface.co/OpenMOSS-Team/MOSS-Audio-Tokenizer-ONNX) | Apache-2.0 |
|
| 69 |
+
| `moss-tts-realtime-q4_k_m.gguf` | [OpenMOSS/MOSS-TTS](https://github.com/OpenMOSS/MOSS-TTS) 2.0.0, quantized by OpenBloom | Apache-2.0 (inherited) |
|
| 70 |
+
|
| 71 |
+
KrisKross is OpenBloom's *build* of components authored by the OpenMOSS team and contributors;
|
| 72 |
+
all credit for the upstream llama.cpp fork, the MOSS-TTS models and the MOSS Audio Tokenizer
|
| 73 |
+
belongs to them. The sd-server build serves models published by their own authors under their
|
| 74 |
+
own licenses — the models are never hosted here.
|
| 75 |
|
| 76 |
+
## Integrity policy
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 77 |
|
| 78 |
+
- Every artifact in this repository is public and fetchable **unauthenticated** — this is a
|
| 79 |
+
requirement of the OpenBloom downloader.
|
| 80 |
+
- Every artifact is content-addressed: the consuming installer pins a sha256 and fails closed
|
| 81 |
+
on any drift.
|
| 82 |
+
- Never gate this repository, and never rewrite a published version in place — publish a new
|
| 83 |
+
versioned path instead.
|