fergusss1 commited on
Commit
4bbb465
·
verified ·
1 Parent(s): 161434b

Introduce Zeraix projects, resources, and published progress

Browse files
Files changed (1) hide show
  1. README.md +56 -4
README.md CHANGED
@@ -1,10 +1,62 @@
1
  ---
2
- title: README
3
- emoji: 🐢
4
- colorFrom: indigo
5
  colorTo: green
6
  sdk: static
7
  pinned: false
 
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Zeraix
3
+ emoji: ⚡
4
+ colorFrom: gray
5
  colorTo: green
6
  sdk: static
7
  pinned: false
8
+ short_description: Imparo inference engine and Zeraix AI workspace
9
  ---
10
 
11
+ # Zeraix
12
+
13
+ **LLM inference that fits your hardware. AI tools built around your work.**
14
+
15
+ We build open-source software to make LLMs more useful on the hardware people already own — from the inference runtime to the everyday workspace.
16
+
17
+ [Website](https://www.zeraix.com) · [GitHub](https://github.com/zeraix) · [X / Twitter](https://twitter.com/ZeraixAI)
18
+
19
+ ## Imparo — the inference engine
20
+
21
+ [Imparo](https://github.com/zeraix/imparo) is a hardware- and workload-adaptive LLM inference engine built in Rust.
22
+
23
+ - **Less execution overhead:** measured tuning and workload-aware execution, with Metal megakernel decode on supported paths.
24
+ - **Reusable context:** matching prefixes and shared paged state reduce repeated prefill work across conversations and agents.
25
+ - **Persistent state:** retained KV and recurrent state support resuming and branching long conversations and tool loops.
26
+ - **Measured improvements:** performance work is paired with output and state-transition checks.
27
+
28
+ Apple Silicon with Metal is the primary development and validation path. Other backend/model combinations remain qualification-specific. Context reuse does not imply concurrent decoding or continuous batching.
29
+
30
+ [Source & Quick Start](https://github.com/zeraix/imparo#quick-start) · [Performance](https://github.com/zeraix/imparo#performance) · [Contribute](https://github.com/zeraix/imparo#contributing)
31
+
32
+ ## Zeraix — the AI workspace
33
+
34
+ [Zeraix](https://github.com/zeraix/zeraix) brings models, conversations, agents, files, and tools into an open-source desktop workspace, with local inference and optional cloud providers.
35
+
36
+ The desktop application and Imparo are separate projects. The current desktop release uses its documented llama.cpp-based runtimes; Imparo is not its default bundled engine.
37
+
38
+ [Download Zeraix](https://github.com/zeraix/zeraix/releases) · [Source & Docs](https://github.com/zeraix/zeraix)
39
+
40
+ ## On Hugging Face
41
+
42
+ | Repository | Purpose |
43
+ | --- | --- |
44
+ | [imparo-benchmarks](https://huggingface.co/datasets/Zeraix/imparo-benchmarks) | Published inference benchmark results and measurement notes. |
45
+ | [llama-builds](https://huggingface.co/Zeraix/llama-builds) | Runtime and sandbox assets consumed by the Zeraix application. |
46
+ | [llama-seeds](https://huggingface.co/Zeraix/llama-seeds) | Version-matched prefix-cache seeds and auxiliary drafter assets for Zeraix. |
47
+
48
+ The two application asset repositories keep their existing download paths. They are not general-purpose standalone chat models or Imparo source mirrors.
49
+
50
+ ## Recent updates
51
+
52
+ - **2026-09-10:** Imparo extended validation to Apple M4 Pro, reproducing optimization benefits demonstrated on M3 Pro. The published four-engine numerical table currently covers M3 Pro.
53
+ - **2026-09-09:** Zeraix 2.0 released.
54
+ - **2026-09-07:** Imparo published Metal megakernel decode and interleaved M3 Pro comparisons with llama.cpp, oMLX, and rapid-mlx.
55
+
56
+ ## Build with us
57
+
58
+ We welcome contributions to model support, kernels, hardware validation, state management, benchmarks, integrations, and documentation. For performance changes, include a reproducible baseline and correctness checks.
59
+
60
+ [Imparo issues](https://github.com/zeraix/imparo/issues) · [Zeraix issues](https://github.com/zeraix/zeraix/issues) · [Contact](mailto:emma@zeraix.com)
61
+
62
+ Project source licenses and third-party artifact licenses are documented in their respective repositories. Model weights and upstream runtime components retain their own terms.