Spaces:

Duplicated from Leon4gr45/gemma-inference

Leon4gr45
/

agent-inference

Paused

App Files Files Community

agent-inference / __pycache__

19.9 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

Leon4gr45's picture

v2.0: single-instance CPU proxy, native OpenAI tools+streaming, flash-attn+q4_0 KV, all-cores

e24791f verified about 1 month ago

app.cpython-313.pyc

19.9 kB
v2.0: single-instance CPU proxy, native OpenAI tools+streaming, flash-attn+q4_0 KV, all-cores about 1 month ago