Spaces:
Runtime error
Runtime error
Commit History
-
fix: fall back when preloaded models are missing
2f6b4a0 -
feat: add dual-model inference runtime
3f9808f -
feat: add embedded llama.cpp and Modal LLM runtimes
Select mock, external, or embedded llama.cpp inference at startup; bundle the pinned server-cuda-b9049 image for GPU Spaces, add a Modal deployment, local CUDA Compose support, health reporting, tests, and deployment documentation. Implemented collaboratively with OpenAI Codex. Co-authored-by: OpenAI Codex <codex@openai.com>f0013ff