inference: Qwen3.5 support (VL unwrap, Gated-DeltaNet LoRA targets, linear_attn walk) f91a401 verified guychuk commited on 20 days ago
Phase A serving speedup: zero-copy state-cache expand (no deepcopy per decision) 5c02833 verified guychuk commited on 21 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) 3ca765b verified guychuk commited on 21 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) 5f6812f verified guychuk commited on 21 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) 5ca406a verified guychuk commited on 21 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) 68ae554 verified guychuk commited on 21 days ago
inference/README.md: mention typical-medium alongside small/preview 396f68e verified guychuk commited on 22 days ago
Add inference/: minimal self-contained Typical inference package 002c12c verified guychuk commited on 22 days ago