Commit History

Fix: download GGUF eagerly at container boot, outside the @spaces.GPU lease (was burning GPU-seconds on a 6-7min network download, causing the lease to be reclaimed mid-download with no error surfaced)
db2d88c
verified

Dellboy commited on

Real fix: preload nvidia-*-cu12 pip packages' shared libraries via ctypes before llama_cpp import (libcudart.so.12 not found on ZeroGPU worker, confirmed via real runtime logs)
312640e
verified

Dellboy commited on

Real fix: restore demo.launch() as entrypoint (required for ZeroGPU detection), expose /generate via Gradio's native api_name mechanism instead of a custom FastAPI route
89b4e16
verified

Dellboy commited on

Fix /generate route being shadowed by Gradio's own catch-all -- mount Gradio at /ui instead of adding routes post-hoc to demo.app
83e90ad
verified

Dellboy commited on

Switch to Gradio SDK -- ZeroGPU only works with Gradio SDK, not Docker/FastAPI
00bec90
verified

Dellboy commited on

chatPDB API: FastAPI + llama-cpp-python ZeroGPU backend, Q4_K_M GGUF
5be713f
verified

Dellboy commited on

initial commit
26cc93e
verified

Dellboy commited on