Fetching metadata from the HF Docker repository...
-
Update start.sh
-
add mmproj vision support
-
increase batch size
-
bring verbosity back
-
some experimental
-
increase batch size
-
bring back flash attention
-
experimental flash attention
-
fix verbose
-
fix balanced profile
-
fix balanced profile
-
update batch size
-
fix flash attention
-
max optimisation
-
optimised cpu
-
minor fixes
-
experimental boosting changes
-
remove parallel support for faster inference
-
Fix llama-server startup and enable LangSearch via shell tool
-
Optimize inference performance: add continuous-batching, NO_WARMUP support, improve thread/batch recommendations
-
Update start.sh
-
Add REASONING env toggle for llama-server reasoning mode
-
Save models using repo filename, set MODEL_PATH from marker, ensure HF xet log dirs writable
-
Auto-tune ctx-size, batch and cache types for low-memory (<=16GB) Spaces; export CACHE_TYPE_{K,V}
-
Add QUANT_PREFERENCE and PERF_PROFILE (low_latency/balanced/throughput) with server defaults
-
Add startup phase logs and avoid recursive permission setup
-
Support CONTEXT_LENGTH env var (default 4096) for ctx-size
-
Add optimized llama.cpp CPU inference backend
