Commit History
-
error console instead of crashing
5b07906 -
Make embedding model settings more future-proof (#454)
MishigUnverified signature3acc11d -
Refactor summarization so it gets called from backend (#456)
Unverified signature* Refactor summarization * get rid of debug log * remove old todo9960338 -
Backend refactor for streaming endpoints (#444)
Unverified signature* wip: complete refactor of streaming backend * working refactoring * fix missing first token & perf regression in output quality * lint * Fix websearch loading from db * fix loading * fix invalidate * remove logs * fix SSR error * typo: paragraphs * fixed save on abort * lint * lint * remove debug log in console * lint for reale943a05 -
Revert "Revert "Update embedding model for WebSearch (#437)""
This reverts commit 1061bc237c37ada9537197b10aeee43e08fc8f4e.aa07e29 -
Revert "Improve error message when the .env MODELS is not well formatted (#451)"
This reverts commit 8ce8b634e9687f00ad31d572dc047113e5b9f0d0.7ddda31 -
Revert "Update embedding model for WebSearch (#437)"
This reverts commit f88542b1121903c1df34b20bd7b8213148e85ca0.1061bc2 -
Update embedding model for WebSearch (#437)
MishigUnverified signature* Use `gte-base` as the emebdding model * use `bge-small-en-v1.5` * Revert "use `bge-small-en-v1.5`" This reverts commit 8cfe084d26884c130d6034afa095b7bbf0f7fa1b. * Use `gte-small`f88542b -
Improve error message when the .env MODELS is not well formatted (#451)
Unverified signature* feat: Improve error handling and parsing of MODELS environment variable * Add more verbose parsing error * Lint * improve message * lint * refactor error handling and default values in models * improve * format --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>8ce8b63
-
[Websearch] update (#427)
Mishig +2: julien-c, victorUnverified signature* Fix reuqest body * update webSearchQueryPromptTemplate * update generate google query parser * Add today's date to google search query creator * crawl top stories if exts; remove answer_box & knowledgeGraph * Create paragraph chunks from top articles * flattened paragprah chunks * update status texts * add gradio client * call gradio app for RAG * Web scrape only "p, li, span" els * add MAX_N_CHUNKS * gradio result typing * parse only <p> elements * rm dev change * update typing WebSearch * buld RAG prompt * Rm dev change * change websearch context msg from user to assisntat type * use hosted gradio app * fix lint * prompt engineering * more prompt engineering * MAX_N_PAGES_SCRAPE = 10 * better error msg * more prompt engineering * revert websearch prompt to previous * rm `top_stories` from websearch as the results are not good * Stop using gradio client, use regular fetch * chore * Rm websearch…ebac87f
-
🐛 Fix - Remove the min length validation on preprompt
Should fix the docker container7533ab7
-
Support custom system prompts from the user (#399)
Unverified signature* Support custom system prompts from the user * linter * types & lintcd6894d -
Make all prompt templates configurable (#400)
Unverified signature* Make all prompt templates configurable This PR enables all prompts to be configurable using handlebar templates as described in #382. For backward compatibility the old hardcoded templates are reimplemented as the default templates. The old template parameters such as `preprompt`, `userMessageToken`, `userMessageEndToken`, `assistantMessageToken`, `assistantMessageEndToken` are now considered legacy. They still work as they are exposed as variables to the default template. However, new prompt configurations should not use these. And it is recommended that the legacy support is eventually removed. As an example, this is how the default chat prompt template is implemented: ``` {{preprompt}} {{#each messages}} {{#ifUser}}{{@root.userMessageToken}}{{content}}{{@root.userMessageEndToken}}{{/ifUser}} {{#ifAssistant}}{{@root.assistantMessageToken}}{{content}}{{@root.assistantMessageEndToken}}{{/ifAssistant}} {{/each}} {{assistantMessageToken}} ``` In addition, …447c0ca
-
Add Sagemaker support (#401)
Unverified signature* work on sagemaker support * fix sagemaker integration * remove unnecessary deps * fix default endpoint * remove unneeded deps, fixed types * Use conditional validation for endpoints This was needed because the discriminated union couldn't handle the legacy case where `host` is undefined. * add note in readme about aws sagemaker2e6d1bb
-
feat: add support for endpoints requiring client authentication using PKI (#393)
TomUnverified signature* feat: add support for endpoints requiring client authentication using PKI This enables a global mTLS context for client requests using the native fetch API. It can be used when custom endpoints require client authentication via PKI. * fix: Dockerfile syntax required for macOS Set the Dockerfile syntax explictly to enable new features in Dockerfile. The default syntax uses by Docker Desktop for macOS does not include support for `--link` in the COPY command for example.66adc5d
-
allow different user and assistant end-token (#375)
Unverified signature* allow different user and assistant end-token For models like Llama2, the EndToken is not the same for a userMessage and an assistantMessage. This implements `userMessageEndToken` and `assistantMessageEndToken` which overwrites the messageEndToken behavior. This PR also allows empty strings as userMessageToken and assistantMessageToken and makes this the default. This adds additional flexibility, which is required in the case of Llama2 where the first userMessage is effectively different because of the system message. Note that because `userMessageEndToken` and `assistantMessageToken` are nearly always concatenated, it is almost redundant to have both. The exception is `generateQuery` for websearch which have several consecutive user messages. * Make model branding customizable based on env var (#345) * rm open assistant branding * Update SettingsModal.svelte * make settings work with a dynamic list of models * fixed types --------- Co-authored-…f209301 -
trim and remove stop-suffixes from summary (#369)
Unverified signatureThe chat generation removes parameters.stop and <|endoftext|> from the generated text. And additionally trims trailing whitespace. This PR copies that behavior to the summarize functionality, when the summary is produced by a the chat model.d2a650e
-
Add ability to define custom model/dataset URLs (#347)
Unverified signature* Add ability to define custom model/dataset URLs * lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>ce2231f
-
Add support for HF summarization endpoint in the websearch (#319)
Unverified signature* Add support for HF endpoint for summary * add fail-safe for summarization10d1ab5 -
feat: factor out HF_API_ROOT to allow different inference endpoints (#332)
Colin DablainUnverified signature3baa389
-
very basic rate limiter (#320)
Unverified signature922b1b2
-
Added Serper.dev API as an alternative web search provider (#302)
rogerserperUnverified signature6f7b315
-
Refactor of websearch (#281)
Unverified signature* broke up websearch into multiple endpoints * Refactored loading to use the load function instead of client side fetching * lint * Chat Logo Home Screen Bookmark icons for iOS (#279) * prettier fix for #279 * fix eslint --------- Co-authored-by: Carolyn Marie <99927612+CarolynM8ri3@users.noreply.github.com>6434339
-
Add initial support for web browsing (#237)
Unverified signature* basic poc for web search * * Hide feature when serpapi_key is not defined * handle error case where serpapi failed * only use user queries for generating the query * Update src/lib/buildPrompt.ts Co-authored-by: Eliott C. <coyotte508@gmail.com> * Update src/routes/+layout.server.ts Co-authored-by: Eliott C. <coyotte508@gmail.com> * refactored getQueryFromPrompt * add jsdom to package.json * begin work on fetching webpage content * Update .env Co-authored-by: Eliott C. <coyotte508@gmail.com> * prettier fix * Add feature for scraping webpages * refactored search functionality - now gets triggered from a separate endpoint - results are stored in db - results can be displayed in their own endpoint * Added a stream to send updates from backend on web-search endpoint * made stream more reliable * Add front-end to web search feature * made sure the web results button appears on newly posted messages * close modal when message is don…0c4cf03
-
feat openid login with google (#250)
Unverified signatureCo-authored-by: coyotte508 <coyotte508@gmail.com>fa3b3b4 -
🔧 Add "directConnection" option to MongoDB (#260)
Eliott CUnverified signature1b9697f
-
🐛 Fix "signin with HF" within space + CSRF (#236)
Eliott CUnverified signature767afa7 -
✅ Add tests setup + test sign in flow
Adrien Denat +1: Eliott C.Unverified signature* replace EthicsModal by LoginModal and start binding auth logic * start implementing login modal + give a try to @auth/sveltekit using Github oauth as a test * start custom auth implementation instead of auth.js for consistency with moon-landing * fetch user data from provider * add migration from anonymous to user + bind frontend * add missing auth secret + only migrate conversations for pre-existing users * remove email scope as it's not needed Co-authored-by: Eliott C. <coyotte508@gmail.com> * no need to define .well-known path Co-authored-by: Eliott C. <coyotte508@gmail.com> * use env var for hf hub website url * move sessionId to signature on csrf token exchange * remove ethic modal check and set default settings on new users * anonymous users can read only + modal on write tries * refresh session cookie when existing user signin again rather than use the old one * allow users to keep using the app without loging-in if env var is no…d9a878f
-
Login flow (#193)
Adrien Denat +2: Eliott C., victorUnverified signature* replace EthicsModal by LoginModal and start binding auth logic * start implementing login modal + give a try to @auth/sveltekit using Github oauth as a test * start custom auth implementation instead of auth.js for consistency with moon-landing * fetch user data from provider * add migration from anonymous to user + bind frontend * add missing auth secret + only migrate conversations for pre-existing users * remove email scope as it's not needed Co-authored-by: Eliott C. <coyotte508@gmail.com> * no need to define .well-known path Co-authored-by: Eliott C. <coyotte508@gmail.com> * use env var for hf hub website url * move sessionId to signature on csrf token exchange * remove ethic modal check and set default settings on new users * anonymous users can read only + modal on write tries * refresh session cookie when existing user signin again rather than use the old one * allow users to keep using the app without loging-in if env var is no…64d3841
-
🧑💻 Explicit error message when MongoDB configuration lacking (#208)
Eliott CUnverified signature8bb1351
-
Disable models (#187)
Adrien Denat +1: Eliott C.Unverified signature* add ability for a model to be disabled * fallback to default model if user has invalid/disabled model in settings * set conversations to read-only if conv model is disabled * add better disabled state on chat input * fix inverted if statement * remove bigcode from .env * fix not updating settings Co-authored-by: Eliott C. <coyotte508@gmail.com> * refactor solution to use an OLD_MODELS env var instead * OLD_MODELS needs to be in .env but can be empty * fix typing issue + typo * refactor models validation * old models displayName is optional * set read only prop on user message not assistant messages * remove console.log * ♻️ Refacto isReadOnly * 🩹 Fluff: use 410 http code --------- Co-authored-by: Eliott C. <coyotte508@gmail.com>b7b2c8c -
✨ Backend preparation for "Sign in with HF" (#190)
Eliott CUnverified signature2e28042
-
✨ Add model id to be able to switch models while keeping conversations valid (#181)
Eliott CUnverified signaturecf7ac8d
-
make models description dynamic (#169)
Adrien Denat +1: Eliott CUnverified signatureCo-authored-by: Eliott C <coyotte508@gmail.com>12c3a5a -
🐛 Stop bigcode prompts (#170)
Eliott CUnverified signaturead6275a -
Models selector (#164)
Adrien Denat +3: victor, julien-c, coyotte508Unverified signatureCo-authored-by: Victor Mustar <victor.mustar@gmail.com> Co-authored-by: Julien Chaumond <julien@huggingface.co> Co-authored-by: coyotte508 <coyotte508@gmail.com>2606dde
-
♻️ Simplify setup, prepare for multi-models (#156)
Eliott CUnverified signature7764421
-
Add settings (#134)
Unverified signatureCo-authored-by: Eliott C. <coyotte508@gmail.com> Co-authored-by: coyotte508 <coyotte508@gmail.com> Co-authored-by: Julien Chaumond <julien@huggingface.co>82fcab7
-
Stop generation button (closes #86) (#88)
Adrien Denat +1: coyotte508Unverified signatureCo-authored-by: coyotte508 <coyotte508@gmail.com>2772555
-
⚡️ Load balance endpoints (#106)
Eliott CUnverified signature9be5ab5
-
Prettier update (#54)
Unverified signature* Update .prettierrc * prettify everthing prettify everything5da61b4
-
♻️ Duplicate convos in DB when they are shared (#44)
Eliott CUnverified signature76d4779 -
Share convos (#35)
Eliott CUnverified signaturefc15a4c
-
Add MongoDB (#14)
Eliott CUnverified signaturecad3e14