Commit History

Card: decode speed after the attention change
2ab6895
verified

alexwengg commited on

Decoder: concatenate attention scores instead of K/V (no per-layer cache copy, ~17% faster decode, same output)
51046f0
verified

alexwengg commited on

Unlimited-OCR Core ML: fp16 page encoder + int8 stateful multi-page decoder
9921f1f
verified

alexwengg commited on

initial commit
90fa493
verified

alexwengg commited on