Spaces:
Paused
Paused
Commit History
-
fix: only import node-llama-cpp if needed and skip for huggingchat image
72db8f3
-
fix: build local llama (#1805)
Unverified signature* fix: build local llama * fix: node build local * fix: docker build * feat: use group for CI? * fix: github actionsf8f7cda
-
feat: allow storing env variable in DB (#1802)
Unverified signature* feat(config): wip, make config controllable from DB, public side for now * fix: build * feat(config): add config manager env var toggle * wip: make backend config use config manager * fix: typechecks * fix: circular import * refactor: init hook sveltekit * fix: disable config manager during tests * refactor: use enum for semaphore, move delete from auto after 60s to separate `deleteAt` field * feat: config manager checks for updates on requests * fix: config script exit * fix: remove top-level awaits * fix: script await * feat: filter config keys based on public environment variables for more security * fix: change import to type for public environment variables48059af
-
fix: lint
64682dd -
fix: docker image llama.cpp error catching
65e6be3 -
fix: build llama.cpp locally in dockerfile (#1788)
Unverified signature* fix: build llama.cpp locally in dockerfile * fix: build for good * refactor: move model folder to /data/modelsffc89fe
-
feat: add a local endpoint type for inference directly from chat-ui (#1778)
Unverified signature* feat: add a local endpoint type running llama.cpp from chat-ui * fix: build image * fix: lock file * wip: try to make it more reliable * feat: load chat template from .gguf file * feat: load gguf models from `models/` folder * fix: default config * feat: make endpoint use chatSession instead of completion * refactor: improve exit handling, exit immediately on second sinal * fix: various fixes to improve reliability when calling multiple models at once * docs: add instructions for adding .gguf files to the models directoryde36cdc