inference: Qwen3.5 support (VL unwrap, Gated-DeltaNet LoRA targets, linear_attn walk) 5924223 verified guychuk commited on 13 days ago
Phase A serving speedup: zero-copy state-cache expand (no deepcopy per decision) dd605dc verified guychuk commited on 14 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) f902f39 verified guychuk commited on 14 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) 46b0675 verified guychuk commited on 14 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) c552a5b verified guychuk commited on 14 days ago
Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py) a9b9a8e verified guychuk commited on 14 days ago
typical-medium (tm1b): weights, evals, inference package, manifest 970f2df verified guychuk commited on 15 days ago
Add inference/README.md (shared package doc, mentions all three releases) 3559cba verified guychuk commited on 15 days ago