Enforce max_tokens upstream, prune request registry, reap dead workers,

Refactor the C++ LLM manager into modular components, moves Python modules under python/, and keeps the current control-plane behavior intact. The C++ server now has clearer separation for config, model lifecycle, runtime services, request parsing, HTTP helpers, and server routing, while Docker build/runtime paths were updated to compile multiple C++ files and load Python code from the new package folder

add auth, token policy, queue scheduler, and cancel flow, etc

add new endpoint to cancel all processing prompts

fix encoding

fix proxied response in llm manager

fix routing in llm manager

add cpp server