Spaces:
Paused
Paused
Commit History
-
feat: add a local endpoint type for inference directly from chat-ui (#1778)
Unverified signature* feat: add a local endpoint type running llama.cpp from chat-ui * fix: build image * fix: lock file * wip: try to make it more reliable * feat: load chat template from .gguf file * feat: load gguf models from `models/` folder * fix: default config * feat: make endpoint use chatSession instead of completion * refactor: improve exit handling, exit immediately on second sinal * fix: various fixes to improve reliability when calling multiple models at once * docs: add instructions for adding .gguf files to the models directoryde36cdc
-
fix: trigger redeploy
73268d4 -
fix: give more buffer to reasoning
8ce2fb0
-
feat: improve task model tool calling (#1755)
Unverified signature* feat: improve task model tool calling * feat(prod): add tokenizer for Hermes-3-Llama-3.1-8B to task configurationd37f9ca
-
fix: improve tasks performance
28b6d44
-
feat(tasks): use tools for tasks if available (#1749)
Unverified signature* feat(tasks): use tools for web search query if available * feat(websearch): improve query generation with error handling and logging * feat(tools): implement generic tool output extraction utility This commit adds a new `getToolOutput` utility to standardize tool interaction across different tasks like title generation, reasoning summary, and web search query generation. The utility supports extracting tool outputs using a consistent approach, with fallback mechanisms and error handling.6655689
-
fix: catch errors more gracefully in reasoning specific calls
c024800
-
feat: UI for advanced reasoning models (#1605)
Unverified signature* feat: add a reasoning dropdown for CoT models * feat: add status updates * fix: various cleanups - pass content & status to result dropdown - dont store streaming updates in db - make status generation non blocking * fix: make sure not to push reasoning token stream to db * feat: add time indicator and make the ui match websearch * fix: change in status update & promptbf75aa7