Spaces:

Steven10429
/

apply_lora_and_quantize

Paused

App Files Files Community

apply_lora_and_quantize / llama.cpp /examples /parallel /README.md

Steven10429's picture

llama.cpp

61b850a over 1 year ago

|

History Blame Contribute Delete

93 Bytes

A newer version of the Gradio SDK is available: 6.24.0

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel