LayerStream — Edge Out-of-Core LLM Benchmarks Collection Bare-metal Orin Nano benchmarks, interactive Space, and tested models for layerstream-plugin (zero-patch llama.cpp NVMe & MoE streaming). • 8 items • Updated about 3 hours ago
Running Edge & Local LLM Pareto Explorer ⚡ GGUF KL-divergence, tok/s, Joules/tok & 8 GiB Edge KV sizer
Running Edge & Local LLM Pareto Explorer ⚡ GGUF KL-divergence, tok/s, Joules/tok & 8 GiB Edge KV sizer