AGI / cpp

Commit History

5 days ago

  1. fix security volnurabilities

    Dmitry Beresnev
    70dee29

6 days ago

  1. fix other security volnurabilities

    Dmitry Beresnev
    6dc320d
  2. fix critical secutity issues

    Dmitry Beresnev
    6471a06

  1. Add inference metrics + bench script, tune threads/batch for 2-vCPU HF Space, backoff on readiness polling

    Dmitry Beresnev
    27c1c3c

  1. Enforce max_tokens upstream, prune request registry, reap dead workers,⁠

    Dmitry Beresnev
    30c6ca2

  1. fix exceptions

    Dmitry Beresnev
    dc32982

  1. fix error format wrapping now applies to /v1/chat/completions and generation stats

    Dmitry Beresnev
    470e737
  2. add token generation speed to ui

    Dmitry Beresnev
    e8080f5
  3. fix request parsing

    Dmitry Beresnev
    3634ca6

  1. Log detailed error bodies for UI failures

    Dmitry Beresnev
    7caa6ba
  2. Fix 400 for llama.cpp web UI completion requests

    Dmitry Beresnev
    677456b
  3. Fix web UI chat by adding buffered SSE fallback

    Dmitry Beresnev
    6379bd0
  4. Fix Docker build for modular llm-manager

    Dmitry Beresnev
    58d70b1
  5. fix build bugs

    Dmitry Beresnev
    acdc6c1
  6. Refactor the C++ LLM manager into modular components, moves Python modules under python/, and keeps the current control-plane behavior intact. The C++ server now has clearer separation for config, model lifecycle, runtime services, request parsing, HTTP helpers, and server routing, while Docker build/runtime paths were updated to compile multiple C++ files and load Python code from the new package folder

    Dmitry Beresnev
    332826f

  1. add auth, token policy, queue scheduler, and cancel flow, etc

    Dmitry Beresnev
    d9ce859

  1. add new endpoint to cancel all processing prompts

    Dmitry Beresnev
    8ef326a

  1. fix encoding

    Dmitry Beresnev
    d211568

  1. fix proxied response in llm manager

    Dmitry Beresnev
    53e9f39
  2. fix routing in llm manager

    Dmitry Beresnev
    a4ee76d
  3. add cpp server

    Dmitry Beresnev
    fc0860f