Hugging Face's logo

OzLabs
/
typical-small-preview

Text Classification
PyTorch
decision-model
system-one
calibrated-probabilities
typed-decisions
jev-like
Model card Files
xet
 Community
typical-small-preview / inference /typical /native.py

Commit History

  1. Phase A serving speedup: zero-copy state-cache expand (no deepcopy per decision)

    guychuk
    Verified signature
    3617254

  2. Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)

    guychuk
    Verified signature
    61830b8

  1. Add inference/: minimal self-contained Typical inference package

    guychuk
    Verified signature
    ac4bc1e