Spaces:
Paused
Paused
Commit History
-
add logs
1c78f33
-
fix: remove quotes from search query to prevent exact match search (#1834)
Unverified signaturefix: remove quotes from search query to prevent exact match search when running locally using serper Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>3f26498
-
feat: allow storing env variable in DB (#1802)
Unverified signature* feat(config): wip, make config controllable from DB, public side for now * fix: build * feat(config): add config manager env var toggle * wip: make backend config use config manager * fix: typechecks * fix: circular import * refactor: init hook sveltekit * fix: disable config manager during tests * refactor: use enum for semaphore, move delete from auto after 60s to separate `deleteAt` field * feat: config manager checks for updates on requests * fix: config script exit * fix: remove top-level awaits * fix: script await * feat: filter config keys based on public environment variables for more security * fix: change import to type for public environment variables48059af
-
feat: add a local endpoint type for inference directly from chat-ui (#1778)
Unverified signature* feat: add a local endpoint type running llama.cpp from chat-ui * fix: build image * fix: lock file * wip: try to make it more reliable * feat: load chat template from .gguf file * feat: load gguf models from `models/` folder * fix: default config * feat: make endpoint use chatSession instead of completion * refactor: improve exit handling, exit immediately on second sinal * fix: various fixes to improve reliability when calling multiple models at once * docs: add instructions for adding .gguf files to the models directoryde36cdc
-
fix: improve tasks performance
28b6d44
-
feat(model): configure Llama-3.1-8B-Instruct with OpenAI-compatible endpoint
55ff303 -
feat(tasks): use tools for tasks if available (#1749)
Unverified signature* feat(tasks): use tools for web search query if available * feat(websearch): improve query generation with error handling and logging * feat(tools): implement generic tool output extraction utility This commit adds a new `getToolOutput` utility to standardize tool interaction across different tasks like title generation, reasoning summary, and web search query generation. The utility supports extracting tool outputs using a consistent approach, with fallback mechanisms and error handling.6655689
-
chores(svelte): migration to svelte 5 (#1685)
Unverified signature* chores(svelte): migration to svelte 5 * chores(svelte5): remove preventDefault & stopPropagation legacy handlers * chores(deps): version bumps * fix: closing modal works properly * fix: messagte loading reactivity * fix: loading indicator * fix: conversation list reactivity * fix: bug on tool logo rendering * fix: infinite loading circular dep * feat: hide new chat button on new chats * fix: move apply directive to main.css * fix: remove legacy syntax in `TokensCounter.svelte` * fix: replace legacy `run` with Svelte 5 `$effect` in NavMenu * fix: replace legacy `run` with Svelte 5 `$effect` in ScrollToPreviousBtn * fix: migrate `settings/[modelId]` page to Svelte 5 syntax * fix: replace legacy `run` with Svelte 5 `$effect` in ToolUpdate component * fix: migrate ToolEdit component to Svelte 5 syntax * fix: simplify login required handling in ChatInputa1a6daf
-
feat(websearch): skip pages that dont return success (#1639)
Unverified signature514377e
-
feat: improve tool calling & add tools to qwen 2.5 72b (#1615)
Unverified signature* fix: clean up tool calling more inline with latest changes in transformers lib and adds tool calling to qwen 2.5 72b * fix: add more field name options * fix: make tool calls a bit more robust642ce40
-
feat: UI for advanced reasoning models (#1605)
Unverified signature* feat: add a reasoning dropdown for CoT models * feat: add status updates * fix: various cleanups - pass content & status to result dropdown - dont store streaming updates in db - make status generation non blocking * fix: make sure not to push reasoning token stream to db * feat: add time indicator and make the ui match websearch * fix: change in status update & promptbf75aa7
-
fix(websearch): block protocols on playwright (#1579)
Unverified signature* fix(websearch): block protocols on playwright * fix: only allow https54e4da8
-
Configurable websearch timeout (#1427)
ABarLTUnverified signatureMade playwright websearch timeout value configurable through an env variablef98c542
-
Websearch using Bing API (#1420)
Unverified signature* feat: bing search enabled * lint * feat: bing url hardcoded * lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>037df62
-
fix(logs): better error logging
Unverified signatureee5c213
-
fix(playwright): only create adblocker if flag is true
Unverified signature911e941
-
feat: playwright-adblocked toggle #1298 (#1301)
Unverified signature* feat: playwright-adblocked toggle * lint * Update src/lib/server/websearch/scrape/playwright.ts Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> * replace regex with equality check --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>99e8e46
-
feat: allow disabling metrics server, consolidate exit handlers (#1201)
Liam Dyer +1: nsarrazinUnverified signature* feat: allow disabling metrics server, consolidate exit handlers * Make server off by default, enable in prods, update docs accordingly --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>dc1fb76
-
fix(scrape parser): Cannot read properties of 'undefined' during page parsing (#1274)
Unverified signaturefix(scrape parser): Cannot read properties of undefined (reading percentageTextShare) during page parsing Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>21054cc
-
Refactor logger error messages for consistency. (#1257)
Denzel MendezUnverified signaturedc98038
-
Handle errors gracefully in building PlaywrightBlocker (#1248)
Unverified signature83ccdd6
-
Fix error logging (#1228)
Unverified signatureLogging was switched to Pino. For error logging, Pino wants the object first, and then the string message. For example see this thread: https://github.com/pinojs/pino/issues/6737dd92b8
-
Add support for SearchApi API (#1196)
SebastjanPrachovskijUnverified signature* Add SearchApi integration * Remove isURLc7a65c3
-
Reduce message update size returned by websearch (#1179)
Unverified signature* Reduce message update size returned by websearch * lint * Update src/lib/migrations/routines/06-trim-message-updates.ts Co-authored-by: Liam Dyer <liamcdyer@gmail.com> * clean up types * clean up migrations --------- Co-authored-by: Liam Dyer <liamcdyer@gmail.com>5459f31 -
Log parsing failures, drop from UI (#1189)
Liam DyerUnverified signaturefeat: log parsing failures, drop from UI76a7af0
-
Fix Playwright leak and use multiple contexts (#1187)
Liam Dyer +1: nsarrazinUnverified signature* fix: playwright leak and use multiple contexts * lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>aee936e -
Add metrics for models, tools, websearch (#1186)
Unverified signature* Add custom metrics for messages and conversations * lint * Add metrics for - model health - tools - websearch * Add time window & age buckets to summaries * Increase max age for tool use duration --------- Co-authored-by: antoniora <antonio.ramos@adyen.com>6e18e46
-
Always close playwright page (#1171)
Liam Dyer +1: nsarrazinUnverified signaturefix: always close playwright page Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>853f8fc
-
Clear playwright singleton on close (#1170)
Liam DyerUnverified signature* fix: clear playwright singleton on close * chore: spelling mistake2a6e267
-
Function calling (#996)
Unverified signature* Initial work on function calling * wip * Add websearch as a tool * lint * smol * Move tools to their own files * directly answer check * Add text2img tool * group tool calls together * show retry even if no message * fix trailing urls * Add image popup * format * wip * clean-up * better loading indicator * text colors * extra example to summarize * switch default model * Add fetchUrl tool * wip * Add latest gradio * fix types * version bump sharp * Basic tools menu * working menu * fix menu positioning * deps fix * add deps * cleanup * more cleanup * cleanup * package cleanups * moar cleanup * ui update * Update ChatMessage.svelte * upgrade gradio dep * lint * refactor and pass results to cohere * feat: code interpreter tool * fix: add e2b dependency * feat: working TGI endpoint with tool results * feat: allow image model to expand to 90dvw * fix: dont block on title gen * bump sharp * misc cleanup * fix url fetcher, adjust tool typing *…564e576
-
Generic Multimodal Support Fixed (#1147)
Liam Dyer +2: nsarrazin, MishigUnverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * fix: TGI endpoints expecting multimodal --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>5b1a9aa
-
Revert "Generic Multimodal Support" (#1146)
MishigUnverified signatureRevert "Generic Multimodal Support (#1021)" This reverts commit 57f89346cc6d953246d0f1705e342e2e66fce386.3382639 -
Generic Multimodal Support (#1021)
Liam Dyer +2: nsarrazin, MishigUnverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>46dd845
-
Web Search: Playwright, spatial parsing, markdown (#1094)
Liam Dyer +2: Aaditya Sahay, Aaditya SahayUnverified signature* feat: playwright, spatial parsing, markdown for web search Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> * feat: choose multiple clusters if necessary (#2) * chore: resolve linting failures * feat: improve paring performance and error messages * feat: combine embeddable chunks together on cpu * feat: reduce parsed pages from 10 to 8 * feat: disable javascript in playwright by default * feat: embedding and parsing error messages * feat: move isURL, fix type errors, misc * feat: misc cleanup * feat: change serializedHtmlElement to interface * fix: isUrl filename * fix: add playwright dependencies to docker * feat: add playwright browsers to docker image * feat: enable javascript by default * feat: remove error message from console on failed page --------- Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> Co-authored-by: Aaditya Sahay <56438732+Aaditya-Sahay@users.noreply.github.com>2c00ea8
-
[fix] Assistant websearch text/markdown source (#1129)
MishigUnverified signature4e2fc92
-
Move vars to dynamic, add metrics (#1085)
Unverified signature* Add healthcheck route * Add prom client with basic metrics * wip: serve metrics on a different port * exclude server from tsconfig * latest * refacto(all): use class & singleton * refacto(all): use class & singleton * refacto(all): add request logs * Make all the env vars dynamic (#1092) * Add truncate to task model (#1090) * retry text area height (#1091) * Make all the env vars dynamic * only check for db at runtime * remove secret from build step * improve dockerfile * Wrap db in singleton * add .env.local to dockerignore * changes to dockerfile * lint * aborted generations * move collections build check * Use a single dockerfile * lint * fixes * lint * don't return db during building * remove dev --------- Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * refacto(all): update default metrics port * fix recursion error * add version check * revert vite preview * Move request logs to debug level and add an env var to filter by log level in d…a8a9533
-
Use pino for logs (#1086)
Unverified signature* Use pino for logs * Use logger for info * Add errorId to the logs486ffa7
-
Switch task model and add max tokens limits (#1036)
Unverified signatureSwitch task modle and add max tokens limits66fa870
-
[Websearch] change context schema (#944)
MishigUnverified signaturea4dc062
-
Prepend domain filters in search query generation (#932)
Unverified signature36be130 -
Show error when webpage cannot be reached or parsed (#930)
Unverified signature6fb5de7 -
Fix multi domains for assistants (#929)
Unverified signaturec4489ae
-
Add websearch controls for assistants (#812)
Unverified signature* remove query modifiers from generateQuery * Add backend for assistant RAG * Add front-end for updating RAG assistant * enable web parser to return plaintext directly for matching headers * Update websearch flow for handling assistant rag preferences * Add our old blocklist to .env.template * Enable websearch to run on messages depending on assistant requirements * reorganized imports * Rename vars * use projection * Add environment variable for assistant rag * fix assistant rag on runwebsearch * fix styling if rag is disabled * make sure we always omit credentials when fetching web pages * Add new checks for SSRF, with a new env var `ENABLE_LOCAL_FETCH` * Use DNS to check if the links are local or not * Add a websearch indicator * Add more tags to parser * Add indicators * Display RAG options in settings view * ui * fix rag detection * bit more spacing * fix button position in assistant form * wording (mainly) * reduce number of tags * Bump max URLs from 3 t…9264459
-
Conversation trees (#223) (#807)
Unverified signature* work on branching * branching * work on input field * wip * wip * helper stuff * pass tests * add type guards and clean up type requirements * fixed shared conv type * more helpers stuff * clean up code * addChildren helper * addSibling * add test for addSibling & refacto addChildren tests * backend work pt. 1 * backend done * add children property to messages for easier frontend rendering * fix message id type rail * front-end work on simple linear conversation * fix title generation * convert conversations on post * server side retry works with branching * clean up buttons * fix retry feature backend * Send new messages in any subtree * make edit previous prompts feature work * fix padding * revert unneeded changes * bring back pending message * fix front-end streaming * fix initial message * Revert "fix initial message" This reverts commit 6257fe8789c52a20e7506aa453efda55c16e95bb. * Fix bug subtree state refresh * fix continue feature on shared co…2a808d7
-
Added support for SearXNG as a websearch source (#805)
Karlostavitch1 +1: nsarrazinUnverified signature* Created searchSearxng.ts for querying and parsing searxng instance. Added searxng to the searchWeb.ts to ensure inclusion in the search initialisation script. Added searxng to +layout.server.ts to ensure the search button is enabled if url provided in .env.local assignment Updated .env to include searxng configuration Updated README.md under Web Search Config to mention addition of searxng URL use in .env * Changes requested consolidated env variable to SEARXNG_QUERY_URL (felt considering the content the word QUERY was more relevant) refactored the searchSearxng.ts to generate the query with the new variable updated related references to variable (.env, searchWeb.ts and +layout.server.ts) Updated readme and variable comment on .env to reflect the same * urefectored to display SearXNG in search dialoge when used. * lint * types --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>8b85682
-
Web search: UI update (#749)
Unverified signature* wip * ui * font-size * leading * smaller * move icon and remove loading props * rm inline svg * rm animationb85bb4c
-
[Fix] small fixes in websearch generateQuery (#727)
MishigUnverified signature59118b8
-
[JS] use shorthand notation (#711)
MishigUnverified signature* [JS] use shorthand notation * add `"object-shorthand": ["error", "always"],` * fix "Expected method shorthand object-shorthand" * format347b211
-
Add embedding models configurable, from both transformers.js and TEI (#646)
Unverified signature* Add embedding models configurable, from both Xenova and TEI * fix lint and format * Fix bug in sentenceSimilarity * Batches for TEI using /info route * Fix web search disapear when finish searching * Fix lint and format * Add more options for better embedding model usage * Fixing CR issues * Fix websearch disapear in later PR * Fix lint * Fix more minor code CR * Valiadate embeddingModelName field in model config * Add embeddingModel into shared conversation * Fix lint and format * Add default embedding model, and more readme explanation * Fix minor embedding model readme detailed * Update settings.json * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Apply suggestions from code review Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Resolved more issues * lint * Fix more issues * Fix format * fix small typo * lint * fix defaul…b17a5c8
-
Fixes "invalid url" error in websearch (#675)
Unverified signature* Fixed #656 * lint --------- Co-authored-by: muhammadbaqir1327 <muhammad.baqir@arbisoft.com> Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>eacf6f2
