Post
139
Athanor Lite -- free desktop app for running local models without the setup headache
Most tools in the local AI space assume you already know your way around quantization formats, context windows, and VRAM budgets. Athanor Lite is built for the people who just want to try a model without reading a wiki first.
It scans your hardware, shows you exactly which models fit your GPU, and handles download through inference. One app, no terminal, no config files. Uses llama.cpp under the hood, wrapped in a Tauri + Rust + React desktop app.
What it does:
Hardware detection (GPU architecture, VRAM, RAM, disk)
Model catalog with fit verdicts based on your actual specs
Ollama library import (zero-copy via hardlinks)
Real-time inference HUD (tok/s, GPU %, VRAM, temperature)
Workspace system for different model/task contexts
Zero telemetry, zero accounts, zero cloud
Windows for now, Mac is next. Free and open source.
GitHub: https://github.com/BBALabs/athanor-lite
Download: https://github.com/BBALabs/athanor-lite/releases/latest
Product page: https://bbasecure.com/athanor.html
Most tools in the local AI space assume you already know your way around quantization formats, context windows, and VRAM budgets. Athanor Lite is built for the people who just want to try a model without reading a wiki first.
It scans your hardware, shows you exactly which models fit your GPU, and handles download through inference. One app, no terminal, no config files. Uses llama.cpp under the hood, wrapped in a Tauri + Rust + React desktop app.
What it does:
Hardware detection (GPU architecture, VRAM, RAM, disk)
Model catalog with fit verdicts based on your actual specs
Ollama library import (zero-copy via hardlinks)
Real-time inference HUD (tok/s, GPU %, VRAM, temperature)
Workspace system for different model/task contexts
Zero telemetry, zero accounts, zero cloud
Windows for now, Mac is next. Free and open source.
GitHub: https://github.com/BBALabs/athanor-lite
Download: https://github.com/BBALabs/athanor-lite/releases/latest
Product page: https://bbasecure.com/athanor.html
- 3 replies