typical-medium / inference

Commit History

inference: Qwen3.5 support (VL unwrap, Gated-DeltaNet LoRA targets, linear_attn walk)
5924223
verified

guychuk commited on

Phase A serving speedup: zero-copy state-cache expand (no deepcopy per decision)
dd605dc
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
f902f39
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
46b0675
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
c552a5b
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
a9b9a8e
verified

guychuk commited on

typical-medium (tm1b): weights, evals, inference package, manifest
970f2df
verified

guychuk commited on

Add inference/README.md (shared package doc, mentions all three releases)
3559cba
verified

guychuk commited on