Spaces:

Dellboy
/

chatpdb-api

Sleeping

Ctrl+K

1 contributor

Fix: download GGUF eagerly at container boot, outside the @spaces.GPU lease (was burning GPU-seconds on a 6-7min network download, causing the lease to be reclaimed mid-download with no error surfaced)

db2d88c verified 11 days ago

__pycache__
Real fix: restore demo.launch() as entrypoint (required for ZeroGPU detection), expose /generate via Gradio's native api_name mechanism instead of a custom FastAPI route 11 days ago
.gitattributes

1.52 kB
initial commit 11 days ago
README.md

543 Bytes
Switch to Gradio SDK -- ZeroGPU only works with Gradio SDK, not Docker/FastAPI 11 days ago
app.py

7.75 kB
Fix: download GGUF eagerly at container boot, outside the @spaces.GPU lease (was burning GPU-seconds on a 6-7min network download, causing the lease to be reclaimed mid-download with no error surfaced) 11 days ago
requirements.txt

167 Bytes
Real fix: preload nvidia-*-cu12 pip packages' shared libraries via ctypes before llama_cpp import (libcudart.so.12 not found on ZeroGPU worker, confirmed via real runtime logs) 11 days ago