Commit History
-
fix: improve tasks performance
49721b1
-
feat(model): configure Llama-3.1-8B-Instruct with OpenAI-compatible endpoint
e7fed79 -
feat(tasks): use tools for tasks if available (#1749)
Unverified signature* feat(tasks): use tools for web search query if available * feat(websearch): improve query generation with error handling and logging * feat(tools): implement generic tool output extraction utility This commit adds a new `getToolOutput` utility to standardize tool interaction across different tasks like title generation, reasoning summary, and web search query generation. The utility supports extracting tool outputs using a consistent approach, with fallback mechanisms and error handling.66fd2dc
-
chores(svelte): migration to svelte 5 (#1685)
Unverified signature* chores(svelte): migration to svelte 5 * chores(svelte5): remove preventDefault & stopPropagation legacy handlers * chores(deps): version bumps * fix: closing modal works properly * fix: messagte loading reactivity * fix: loading indicator * fix: conversation list reactivity * fix: bug on tool logo rendering * fix: infinite loading circular dep * feat: hide new chat button on new chats * fix: move apply directive to main.css * fix: remove legacy syntax in `TokensCounter.svelte` * fix: replace legacy `run` with Svelte 5 `$effect` in NavMenu * fix: replace legacy `run` with Svelte 5 `$effect` in ScrollToPreviousBtn * fix: migrate `settings/[modelId]` page to Svelte 5 syntax * fix: replace legacy `run` with Svelte 5 `$effect` in ToolUpdate component * fix: migrate ToolEdit component to Svelte 5 syntax * fix: simplify login required handling in ChatInput21b8785
-
feat(websearch): skip pages that dont return success (#1639)
Unverified signaturec55b3ad
-
feat: improve tool calling & add tools to qwen 2.5 72b (#1615)
Unverified signature* fix: clean up tool calling more inline with latest changes in transformers lib and adds tool calling to qwen 2.5 72b * fix: add more field name options * fix: make tool calls a bit more robustf7aef71
-
feat: UI for advanced reasoning models (#1605)
Unverified signature* feat: add a reasoning dropdown for CoT models * feat: add status updates * fix: various cleanups - pass content & status to result dropdown - dont store streaming updates in db - make status generation non blocking * fix: make sure not to push reasoning token stream to db * feat: add time indicator and make the ui match websearch * fix: change in status update & prompt764ecdf
-
fix(websearch): block protocols on playwright (#1579)
Unverified signature* fix(websearch): block protocols on playwright * fix: only allow httpsd020fb0
-
Configurable websearch timeout (#1427)
ABarLTUnverified signatureMade playwright websearch timeout value configurable through an env variable2c15cac
-
Websearch using Bing API (#1420)
Unverified signature* feat: bing search enabled * lint * feat: bing url hardcoded * lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>0def3fc
-
fix(logs): better error logging
Unverified signature7f567e2
-
fix(playwright): only create adblocker if flag is true
Unverified signatureacb5e99
-
feat: playwright-adblocked toggle #1298 (#1301)
Unverified signature* feat: playwright-adblocked toggle * lint * Update src/lib/server/websearch/scrape/playwright.ts Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> * replace regex with equality check --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>e579cb6
-
feat: allow disabling metrics server, consolidate exit handlers (#1201)
Liam Dyer +1: nsarrazin Unverified signature* feat: allow disabling metrics server, consolidate exit handlers * Make server off by default, enable in prods, update docs accordingly --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>032678c
-
fix(scrape parser): Cannot read properties of 'undefined' during page parsing (#1274)
Unverified signaturefix(scrape parser): Cannot read properties of undefined (reading percentageTextShare) during page parsing Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>cd29406
-
Refactor logger error messages for consistency. (#1257)
Denzel MendezUnverified signaturefa0afa9
-
Handle errors gracefully in building PlaywrightBlocker (#1248)
Unverified signaturec205094
-
Fix error logging (#1228)
Unverified signatureLogging was switched to Pino. For error logging, Pino wants the object first, and then the string message. For example see this thread: https://github.com/pinojs/pino/issues/673906377c
-
Add support for SearchApi API (#1196)
SebastjanPrachovskijUnverified signature* Add SearchApi integration * Remove isURL657e331
-
Reduce message update size returned by websearch (#1179)
Unverified signature* Reduce message update size returned by websearch * lint * Update src/lib/migrations/routines/06-trim-message-updates.ts Co-authored-by: Liam Dyer <liamcdyer@gmail.com> * clean up types * clean up migrations --------- Co-authored-by: Liam Dyer <liamcdyer@gmail.com>8336431 -
Log parsing failures, drop from UI (#1189)
Liam DyerUnverified signaturefeat: log parsing failures, drop from UI032be59
-
Fix Playwright leak and use multiple contexts (#1187)
Liam Dyer +1: nsarrazin Unverified signature* fix: playwright leak and use multiple contexts * lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>a865c35 -
Add metrics for models, tools, websearch (#1186)
Unverified signature* Add custom metrics for messages and conversations * lint * Add metrics for - model health - tools - websearch * Add time window & age buckets to summaries * Increase max age for tool use duration --------- Co-authored-by: antoniora <antonio.ramos@adyen.com>dc36de5
-
Always close playwright page (#1171)
Liam Dyer +1: nsarrazin Unverified signaturefix: always close playwright page Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>82a33ed
-
Clear playwright singleton on close (#1170)
Liam DyerUnverified signature* fix: clear playwright singleton on close * chore: spelling mistake9621e62
-
Function calling (#996)
Unverified signature* Initial work on function calling * wip * Add websearch as a tool * lint * smol * Move tools to their own files * directly answer check * Add text2img tool * group tool calls together * show retry even if no message * fix trailing urls * Add image popup * format * wip * clean-up * better loading indicator * text colors * extra example to summarize * switch default model * Add fetchUrl tool * wip * Add latest gradio * fix types * version bump sharp * Basic tools menu * working menu * fix menu positioning * deps fix * add deps * cleanup * more cleanup * cleanup * package cleanups * moar cleanup * ui update * Update ChatMessage.svelte * upgrade gradio dep * lint * refactor and pass results to cohere * feat: code interpreter tool * fix: add e2b dependency * feat: working TGI endpoint with tool results * feat: allow image model to expand to 90dvw * fix: dont block on title gen * bump sharp * misc cleanup * fix url fetcher, adjust tool typing *…faa93d9
-
Generic Multimodal Support Fixed (#1147)
Liam Dyer +2: nsarrazin, Mishig Unverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * fix: TGI endpoints expecting multimodal --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>b4690c8
-
Revert "Generic Multimodal Support" (#1146)
MishigUnverified signatureRevert "Generic Multimodal Support (#1021)" This reverts commit 57f89346cc6d953246d0f1705e342e2e66fce386.2a40544 -
Generic Multimodal Support (#1021)
Liam Dyer +2: nsarrazin, Mishig Unverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>f493225
-
Web Search: Playwright, spatial parsing, markdown (#1094)
Liam Dyer +2: Aaditya Sahay, Aaditya SahayUnverified signature* feat: playwright, spatial parsing, markdown for web search Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> * feat: choose multiple clusters if necessary (#2) * chore: resolve linting failures * feat: improve paring performance and error messages * feat: combine embeddable chunks together on cpu * feat: reduce parsed pages from 10 to 8 * feat: disable javascript in playwright by default * feat: embedding and parsing error messages * feat: move isURL, fix type errors, misc * feat: misc cleanup * feat: change serializedHtmlElement to interface * fix: isUrl filename * fix: add playwright dependencies to docker * feat: add playwright browsers to docker image * feat: enable javascript by default * feat: remove error message from console on failed page --------- Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> Co-authored-by: Aaditya Sahay <56438732+Aaditya-Sahay@users.noreply.github.com>da34bf2
-
[fix] Assistant websearch text/markdown source (#1129)
MishigUnverified signature717875d
-
Move vars to dynamic, add metrics (#1085)
Unverified signature* Add healthcheck route * Add prom client with basic metrics * wip: serve metrics on a different port * exclude server from tsconfig * latest * refacto(all): use class & singleton * refacto(all): use class & singleton * refacto(all): add request logs * Make all the env vars dynamic (#1092) * Add truncate to task model (#1090) * retry text area height (#1091) * Make all the env vars dynamic * only check for db at runtime * remove secret from build step * improve dockerfile * Wrap db in singleton * add .env.local to dockerignore * changes to dockerfile * lint * aborted generations * move collections build check * Use a single dockerfile * lint * fixes * lint * don't return db during building * remove dev --------- Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * refacto(all): update default metrics port * fix recursion error * add version check * revert vite preview * Move request logs to debug level and add an env var to filter by log level in d…0e5ff83
-
Use pino for logs (#1086)
Unverified signature* Use pino for logs * Use logger for info * Add errorId to the logsbb6f8cb
-
Switch task model and add max tokens limits (#1036)
Unverified signatureSwitch task modle and add max tokens limits42dd7d2
-
[Websearch] change context schema (#944)
MishigUnverified signature694dbc8
-
Prepend domain filters in search query generation (#932)
Unverified signatureea2cfd8 -
Show error when webpage cannot be reached or parsed (#930)
Unverified signature4e08933 -
Fix multi domains for assistants (#929)
Unverified signatureebd1f7a
-
Add websearch controls for assistants (#812)
Unverified signature* remove query modifiers from generateQuery * Add backend for assistant RAG * Add front-end for updating RAG assistant * enable web parser to return plaintext directly for matching headers * Update websearch flow for handling assistant rag preferences * Add our old blocklist to .env.template * Enable websearch to run on messages depending on assistant requirements * reorganized imports * Rename vars * use projection * Add environment variable for assistant rag * fix assistant rag on runwebsearch * fix styling if rag is disabled * make sure we always omit credentials when fetching web pages * Add new checks for SSRF, with a new env var `ENABLE_LOCAL_FETCH` * Use DNS to check if the links are local or not * Add a websearch indicator * Add more tags to parser * Add indicators * Display RAG options in settings view * ui * fix rag detection * bit more spacing * fix button position in assistant form * wording (mainly) * reduce number of tags * Bump max URLs from 3 t…3d58f23
-
Conversation trees (#223) (#807)
Unverified signature* work on branching * branching * work on input field * wip * wip * helper stuff * pass tests * add type guards and clean up type requirements * fixed shared conv type * more helpers stuff * clean up code * addChildren helper * addSibling * add test for addSibling & refacto addChildren tests * backend work pt. 1 * backend done * add children property to messages for easier frontend rendering * fix message id type rail * front-end work on simple linear conversation * fix title generation * convert conversations on post * server side retry works with branching * clean up buttons * fix retry feature backend * Send new messages in any subtree * make edit previous prompts feature work * fix padding * revert unneeded changes * bring back pending message * fix front-end streaming * fix initial message * Revert "fix initial message" This reverts commit 6257fe8789c52a20e7506aa453efda55c16e95bb. * Fix bug subtree state refresh * fix continue feature on shared co…62d2069
-
Added support for SearXNG as a websearch source (#805)
Karlostavitch1 +1: nsarrazin Unverified signature* Created searchSearxng.ts for querying and parsing searxng instance. Added searxng to the searchWeb.ts to ensure inclusion in the search initialisation script. Added searxng to +layout.server.ts to ensure the search button is enabled if url provided in .env.local assignment Updated .env to include searxng configuration Updated README.md under Web Search Config to mention addition of searxng URL use in .env * Changes requested consolidated env variable to SEARXNG_QUERY_URL (felt considering the content the word QUERY was more relevant) refactored the searchSearxng.ts to generate the query with the new variable updated related references to variable (.env, searchWeb.ts and +layout.server.ts) Updated readme and variable comment on .env to reflect the same * urefectored to display SearXNG in search dialoge when used. * lint * types --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>6e63765
-
Web search: UI update (#749)
Unverified signature* wip * ui * font-size * leading * smaller * move icon and remove loading props * rm inline svg * rm animation7027ad5
-
[Fix] small fixes in websearch generateQuery (#727)
MishigUnverified signature2fd3af0
-
[JS] use shorthand notation (#711)
MishigUnverified signature* [JS] use shorthand notation * add `"object-shorthand": ["error", "always"],` * fix "Expected method shorthand object-shorthand" * format5869ab4
-
Add embedding models configurable, from both transformers.js and TEI (#646)
Unverified signature* Add embedding models configurable, from both Xenova and TEI * fix lint and format * Fix bug in sentenceSimilarity * Batches for TEI using /info route * Fix web search disapear when finish searching * Fix lint and format * Add more options for better embedding model usage * Fixing CR issues * Fix websearch disapear in later PR * Fix lint * Fix more minor code CR * Valiadate embeddingModelName field in model config * Add embeddingModel into shared conversation * Fix lint and format * Add default embedding model, and more readme explanation * Fix minor embedding model readme detailed * Update settings.json * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Apply suggestions from code review Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Resolved more issues * lint * Fix more issues * Fix format * fix small typo * lint * fix defaul…3a19267
-
Fixes "invalid url" error in websearch (#675)
Unverified signature* Fixed #656 * lint --------- Co-authored-by: muhammadbaqir1327 <muhammad.baqir@arbisoft.com> Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>d5a6078 -
Use JSON5 for parsing all config vars (#671)
Unverified signature806c0e0
-
Add support for SerpStack API (#669)
Unverified signature* Add support for SerpStack API * update const to SERPSTACK_API_KEY * update readme * lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>bf6ba69
-
Add allow & blocklist for websearch (#651)
Unverified signature* Add allow & blocklist for websearch * fix start whitespacea0abbf0
-
Option for running websearch locally (#563)
Unverified signature* Fully local websearch * better comments * fix else ifcb81712