File size: 3,630 Bytes
161434b 4bbb465 161434b 4bbb465 161434b 4bbb465 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 | ---
title: Zeraix
emoji: ⚡
colorFrom: gray
colorTo: green
sdk: static
pinned: false
short_description: Imparo inference engine and Zeraix AI workspace
---
# Zeraix
**LLM inference that fits your hardware. AI tools built around your work.**
We build open-source software to make LLMs more useful on the hardware people already own — from the inference runtime to the everyday workspace.
[Website](https://www.zeraix.com) · [GitHub](https://github.com/zeraix) · [X / Twitter](https://twitter.com/ZeraixAI)
## Imparo — the inference engine
[Imparo](https://github.com/zeraix/imparo) is a hardware- and workload-adaptive LLM inference engine built in Rust.
- **Less execution overhead:** measured tuning and workload-aware execution, with Metal megakernel decode on supported paths.
- **Reusable context:** matching prefixes and shared paged state reduce repeated prefill work across conversations and agents.
- **Persistent state:** retained KV and recurrent state support resuming and branching long conversations and tool loops.
- **Measured improvements:** performance work is paired with output and state-transition checks.
Apple Silicon with Metal is the primary development and validation path. Other backend/model combinations remain qualification-specific. Context reuse does not imply concurrent decoding or continuous batching.
[Source & Quick Start](https://github.com/zeraix/imparo#quick-start) · [Performance](https://github.com/zeraix/imparo#performance) · [Contribute](https://github.com/zeraix/imparo#contributing)
## Zeraix — the AI workspace
[Zeraix](https://github.com/zeraix/zeraix) brings models, conversations, agents, files, and tools into an open-source desktop workspace, with local inference and optional cloud providers.
The desktop application and Imparo are separate projects. The current desktop release uses its documented llama.cpp-based runtimes; Imparo is not its default bundled engine.
[Download Zeraix](https://github.com/zeraix/zeraix/releases) · [Source & Docs](https://github.com/zeraix/zeraix)
## On Hugging Face
| Repository | Purpose |
| --- | --- |
| [imparo-benchmarks](https://huggingface.co/datasets/Zeraix/imparo-benchmarks) | Published inference benchmark results and measurement notes. |
| [llama-builds](https://huggingface.co/Zeraix/llama-builds) | Runtime and sandbox assets consumed by the Zeraix application. |
| [llama-seeds](https://huggingface.co/Zeraix/llama-seeds) | Version-matched prefix-cache seeds and auxiliary drafter assets for Zeraix. |
The two application asset repositories keep their existing download paths. They are not general-purpose standalone chat models or Imparo source mirrors.
## Recent updates
- **2026-09-10:** Imparo extended validation to Apple M4 Pro, reproducing optimization benefits demonstrated on M3 Pro. The published four-engine numerical table currently covers M3 Pro.
- **2026-09-09:** Zeraix 2.0 released.
- **2026-09-07:** Imparo published Metal megakernel decode and interleaved M3 Pro comparisons with llama.cpp, oMLX, and rapid-mlx.
## Build with us
We welcome contributions to model support, kernels, hardware validation, state management, benchmarks, integrations, and documentation. For performance changes, include a reproducible baseline and correctness checks.
[Imparo issues](https://github.com/zeraix/imparo/issues) · [Zeraix issues](https://github.com/zeraix/zeraix/issues) · [Contact](mailto:emma@zeraix.com)
Project source licenses and third-party artifact licenses are documented in their respective repositories. Model weights and upstream runtime components retain their own terms.
|