Spaces:
Sleeping
Sleeping
Commit History
5 days ago
-
fix security volnurabilities
Dmitry Beresnev70dee29
6 days ago
-
fix other security volnurabilities
Dmitry Beresnev6dc320d -
fix critical secutity issues
Dmitry Beresnev6471a06
-
Add inference metrics + bench script, tune threads/batch for 2-vCPU HF Space, backoff on readiness polling
Dmitry Beresnev27c1c3c
-
Enforce max_tokens upstream, prune request registry, reap dead workers,
Dmitry Beresnevfork-safe spawn, honor keep-alive, auth on /slots and /metrics, loopback worker bind, /health readiness probe, port reuse, CAS cancellation, socket timeouts, accurate Retry-After, etc30c6ca2
-
fix exceptions
Dmitry Beresnevdc32982
-
fix error format wrapping now applies to /v1/chat/completions and generation stats
Dmitry Beresnev470e737 -
add token generation speed to ui
Dmitry Beresneve8080f5 -
fix request parsing
Dmitry Beresnev3634ca6
-
Log detailed error bodies for UI failures
Dmitry Beresnev7caa6ba -
Fix 400 for llama.cpp web UI completion requests
Dmitry Beresnev677456b -
Fix web UI chat by adding buffered SSE fallback
Dmitry Beresnev6379bd0 -
Fix Docker build for modular llm-manager
Dmitry Beresnev58d70b1 -
fix build bugs
Dmitry Beresnevacdc6c1 -
Refactor the C++ LLM manager into modular components, moves Python modules under python/, and keeps the current control-plane behavior intact. The C++ server now has clearer separation for config, model lifecycle, runtime services, request parsing, HTTP helpers, and server routing, while Docker build/runtime paths were updated to compile multiple C++ files and load Python code from the new package folder
Dmitry Beresnev332826f
-
add auth, token policy, queue scheduler, and cancel flow, etc
Dmitry Beresnevd9ce859
-
add new endpoint to cancel all processing prompts
Dmitry Beresnev8ef326a
-
fix encoding
Dmitry Beresnevd211568
-
fix proxied response in llm manager
Dmitry Beresnev53e9f39 -
fix routing in llm manager
Dmitry Beresneva4ee76d -
add cpp server
Dmitry Beresnevfc0860f