Running 1 mini-infer - PagedAttention KV-Cache & Prefix Studio π Interactive GPU PagedAttention block pool & prefix cache.
Running 1 sched-sim - LLM Serving Scheduler & Gantt Studio β± Discrete-event LLM scheduler simulator & Gantt player.
Running 1 QuantBench - Sub-Byte LLM Quantization Studio π¬ Sub-byte quantization Pareto frontier & BitNet packer.
Running 1 infersize - LLM VRAM Capacity Planning CAD β‘ Pre-flight LLM VRAM sizing CAD & cloud TCO planner.
Running 1 RunsOnMine - Consumer Silicon LLM Serving Registry β‘ Empirical consumer GPU serving benchmarks on Dual T4 & 3050.