--- title: Zeraix emoji: ⚡ colorFrom: gray colorTo: green sdk: static pinned: false short_description: Imparo inference engine and Zeraix AI workspace --- # Zeraix **LLM inference that fits your hardware. AI tools built around your work.** We build open-source software to make LLMs more useful on the hardware people already own — from the inference runtime to the everyday workspace. [Website](https://www.zeraix.com) · [GitHub](https://github.com/zeraix) · [X / Twitter](https://twitter.com/ZeraixAI) ## Imparo — the inference engine [Imparo](https://github.com/zeraix/imparo) is a hardware- and workload-adaptive LLM inference engine built in Rust. - **Less execution overhead:** measured tuning and workload-aware execution, with Metal megakernel decode on supported paths. - **Reusable context:** matching prefixes and shared paged state reduce repeated prefill work across conversations and agents. - **Persistent state:** retained KV and recurrent state support resuming and branching long conversations and tool loops. - **Measured improvements:** performance work is paired with output and state-transition checks. Apple Silicon with Metal is the primary development and validation path. Other backend/model combinations remain qualification-specific. Context reuse does not imply concurrent decoding or continuous batching. [Source & Quick Start](https://github.com/zeraix/imparo#quick-start) · [Performance](https://github.com/zeraix/imparo#performance) · [Contribute](https://github.com/zeraix/imparo#contributing) ## Zeraix — the AI workspace [Zeraix](https://github.com/zeraix/zeraix) brings models, conversations, agents, files, and tools into an open-source desktop workspace, with local inference and optional cloud providers. The desktop application and Imparo are separate projects. The current desktop release uses its documented llama.cpp-based runtimes; Imparo is not its default bundled engine. [Download Zeraix](https://github.com/zeraix/zeraix/releases) · [Source & Docs](https://github.com/zeraix/zeraix) ## On Hugging Face | Repository | Purpose | | --- | --- | | [imparo-benchmarks](https://huggingface.co/datasets/Zeraix/imparo-benchmarks) | Published inference benchmark results and measurement notes. | | [llama-builds](https://huggingface.co/Zeraix/llama-builds) | Runtime and sandbox assets consumed by the Zeraix application. | | [llama-seeds](https://huggingface.co/Zeraix/llama-seeds) | Version-matched prefix-cache seeds and auxiliary drafter assets for Zeraix. | The two application asset repositories keep their existing download paths. They are not general-purpose standalone chat models or Imparo source mirrors. ## Recent updates - **2026-09-10:** Imparo extended validation to Apple M4 Pro, reproducing optimization benefits demonstrated on M3 Pro. The published four-engine numerical table currently covers M3 Pro. - **2026-09-09:** Zeraix 2.0 released. - **2026-09-07:** Imparo published Metal megakernel decode and interleaved M3 Pro comparisons with llama.cpp, oMLX, and rapid-mlx. ## Build with us We welcome contributions to model support, kernels, hardware validation, state management, benchmarks, integrations, and documentation. For performance changes, include a reproducible baseline and correctness checks. [Imparo issues](https://github.com/zeraix/imparo/issues) · [Zeraix issues](https://github.com/zeraix/zeraix/issues) · [Contact](mailto:emma@zeraix.com) Project source licenses and third-party artifact licenses are documented in their respective repositories. Model weights and upstream runtime components retain their own terms.