Spaces:
Runtime error
Runtime error
Commit History
-
feat: add a local endpoint type for inference directly from chat-ui (#1778)
Unverified signature* feat: add a local endpoint type running llama.cpp from chat-ui * fix: build image * fix: lock file * wip: try to make it more reliable * feat: load chat template from .gguf file * feat: load gguf models from `models/` folder * fix: default config * feat: make endpoint use chatSession instead of completion * refactor: improve exit handling, exit immediately on second sinal * fix: various fixes to improve reliability when calling multiple models at once * docs: add instructions for adding .gguf files to the models directoryde36cdc
-
Major bump to sveltekit & node-adapter versions (#1395)
Unverified signature* version bump * sveltekit2 bump * formatting * fix imports * fix deps * minor bump on chat-ui itself * better error logging * bump svelte-check version06feee8
-
feat: allow disabling metrics server, consolidate exit handlers (#1201)
Liam Dyer +1: nsarrazin Unverified signature* feat: allow disabling metrics server, consolidate exit handlers * Make server off by default, enable in prods, update docs accordingly --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>dc1fb76