Spaces:
Running
Running
Commit History
-
feat(security): add Modal DeBERTa injection classifier deployment
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>2dc5235 -
feat: infrastructure sprint — vLLM/Modal, Helm, Terraform (#8)
Jane Yeung +1: Claude Opus 4.6 (1M context)* feat: add SelfHostedProvider for OpenAI-compatible endpoints (vLLM, TGI, Ollama) - SelfHostedProvider targets any /v1/chat/completions endpoint via httpx - Config schema extended: provider.selfhosted.{base_url, model_name, api_key, timeout_seconds} - Env var fallback: MODAL_VLLM_URL, SELFHOSTED_MODEL, MODAL_AUTH_TOKEN - Lazy tool-calling detection via startup probe; prompt-based fallback for models that don't support function calling - True streaming via httpx.AsyncClient.stream() + aiter_lines() - 25 tests covering factory, complete, tool detection, prompt fallback, retry/timeout, env vars, streaming, format_tools - YAML configs for local (docker-compose) and Modal (serverless) deployments Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * fix: address review findings on SelfHostedProvider - selfhosted_local.yaml: vLLM port changed from 8000 to 8001 to avoid collision with FastAPI app (which also serves on 8000) - docker-compose.vllm.yml: host port upda…a9d4375