Introduce Zeraix projects, resources, and published progress
Browse files
README.md
CHANGED
|
@@ -1,10 +1,62 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
colorTo: green
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
|
|
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: Zeraix
|
| 3 |
+
emoji: ⚡
|
| 4 |
+
colorFrom: gray
|
| 5 |
colorTo: green
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
+
short_description: Imparo inference engine and Zeraix AI workspace
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# Zeraix
|
| 12 |
+
|
| 13 |
+
**LLM inference that fits your hardware. AI tools built around your work.**
|
| 14 |
+
|
| 15 |
+
We build open-source software to make LLMs more useful on the hardware people already own — from the inference runtime to the everyday workspace.
|
| 16 |
+
|
| 17 |
+
[Website](https://www.zeraix.com) · [GitHub](https://github.com/zeraix) · [X / Twitter](https://twitter.com/ZeraixAI)
|
| 18 |
+
|
| 19 |
+
## Imparo — the inference engine
|
| 20 |
+
|
| 21 |
+
[Imparo](https://github.com/zeraix/imparo) is a hardware- and workload-adaptive LLM inference engine built in Rust.
|
| 22 |
+
|
| 23 |
+
- **Less execution overhead:** measured tuning and workload-aware execution, with Metal megakernel decode on supported paths.
|
| 24 |
+
- **Reusable context:** matching prefixes and shared paged state reduce repeated prefill work across conversations and agents.
|
| 25 |
+
- **Persistent state:** retained KV and recurrent state support resuming and branching long conversations and tool loops.
|
| 26 |
+
- **Measured improvements:** performance work is paired with output and state-transition checks.
|
| 27 |
+
|
| 28 |
+
Apple Silicon with Metal is the primary development and validation path. Other backend/model combinations remain qualification-specific. Context reuse does not imply concurrent decoding or continuous batching.
|
| 29 |
+
|
| 30 |
+
[Source & Quick Start](https://github.com/zeraix/imparo#quick-start) · [Performance](https://github.com/zeraix/imparo#performance) · [Contribute](https://github.com/zeraix/imparo#contributing)
|
| 31 |
+
|
| 32 |
+
## Zeraix — the AI workspace
|
| 33 |
+
|
| 34 |
+
[Zeraix](https://github.com/zeraix/zeraix) brings models, conversations, agents, files, and tools into an open-source desktop workspace, with local inference and optional cloud providers.
|
| 35 |
+
|
| 36 |
+
The desktop application and Imparo are separate projects. The current desktop release uses its documented llama.cpp-based runtimes; Imparo is not its default bundled engine.
|
| 37 |
+
|
| 38 |
+
[Download Zeraix](https://github.com/zeraix/zeraix/releases) · [Source & Docs](https://github.com/zeraix/zeraix)
|
| 39 |
+
|
| 40 |
+
## On Hugging Face
|
| 41 |
+
|
| 42 |
+
| Repository | Purpose |
|
| 43 |
+
| --- | --- |
|
| 44 |
+
| [imparo-benchmarks](https://huggingface.co/datasets/Zeraix/imparo-benchmarks) | Published inference benchmark results and measurement notes. |
|
| 45 |
+
| [llama-builds](https://huggingface.co/Zeraix/llama-builds) | Runtime and sandbox assets consumed by the Zeraix application. |
|
| 46 |
+
| [llama-seeds](https://huggingface.co/Zeraix/llama-seeds) | Version-matched prefix-cache seeds and auxiliary drafter assets for Zeraix. |
|
| 47 |
+
|
| 48 |
+
The two application asset repositories keep their existing download paths. They are not general-purpose standalone chat models or Imparo source mirrors.
|
| 49 |
+
|
| 50 |
+
## Recent updates
|
| 51 |
+
|
| 52 |
+
- **2026-09-10:** Imparo extended validation to Apple M4 Pro, reproducing optimization benefits demonstrated on M3 Pro. The published four-engine numerical table currently covers M3 Pro.
|
| 53 |
+
- **2026-09-09:** Zeraix 2.0 released.
|
| 54 |
+
- **2026-09-07:** Imparo published Metal megakernel decode and interleaved M3 Pro comparisons with llama.cpp, oMLX, and rapid-mlx.
|
| 55 |
+
|
| 56 |
+
## Build with us
|
| 57 |
+
|
| 58 |
+
We welcome contributions to model support, kernels, hardware validation, state management, benchmarks, integrations, and documentation. For performance changes, include a reproducible baseline and correctness checks.
|
| 59 |
+
|
| 60 |
+
[Imparo issues](https://github.com/zeraix/imparo/issues) · [Zeraix issues](https://github.com/zeraix/zeraix/issues) · [Contact](mailto:emma@zeraix.com)
|
| 61 |
+
|
| 62 |
+
Project source licenses and third-party artifact licenses are documented in their respective repositories. Model weights and upstream runtime components retain their own terms.
|