Fetching metadata from the HF Docker repository...
-
some experimental
-
fix flash attention
-
max optimisation
-
optimised cpu
-
minor fixes
-
experimental boosting changes
-
remove parallel support for faster inference
-
Fix llama-server startup and enable LangSearch via shell tool
-
Optimize inference performance: add continuous-batching, NO_WARMUP support, improve thread/batch recommendations
-
Add LangSearch web search tool for small model knowledge augmentation
-
Add REASONING env toggle for llama-server reasoning mode
-
Add optimized llama.cpp CPU inference backend
-
initial commit