Spaces:
Paused
Paused
Commit History
-
Fix: download GGUF eagerly at container boot, outside the @spaces.GPU lease (was burning GPU-seconds on a 6-7min network download, causing the lease to be reclaimed mid-download with no error surfaced)
Verified signaturedb2d88c -
Real fix: preload nvidia-*-cu12 pip packages' shared libraries via ctypes before llama_cpp import (libcudart.so.12 not found on ZeroGPU worker, confirmed via real runtime logs)
Verified signature312640e -
Real fix: restore demo.launch() as entrypoint (required for ZeroGPU detection), expose /generate via Gradio's native api_name mechanism instead of a custom FastAPI route
Verified signature89b4e16 -
Fix /generate route being shadowed by Gradio's own catch-all -- mount Gradio at /ui instead of adding routes post-hoc to demo.app
Verified signature83e90ad -
Switch to Gradio SDK -- ZeroGPU only works with Gradio SDK, not Docker/FastAPI
Verified signature00bec90 -
chatPDB API: FastAPI + llama-cpp-python ZeroGPU backend, Q4_K_M GGUF
Verified signature5be713f -
initial commit
Verified signature26cc93e