Spaces:
Running
Running
Commit History
-
Add ollama endpoint support (#569)
Unverified signature* Add ollama endpoint support * replace if by switch * Add Ollama example in docs14f0244
-
Add support for tgi multimodal models (#531)
Unverified signature* wip: add support for tgi multimodal models * wip work on passing images to prompt * working idefics config! * rm allowed conv feature * lint * Add image resizing * fix ssr * add upload button * add delete button * misc formatting * lint * server file size check * optimistic update of images * retry with images * fix websearch button * lint * better error handling & max one image at a time * replace test image by blank one * disable loading on page change * Fix sharing of images * fix comments * Update filedropzone (#544) * Update src/lib/buildPrompt.ts Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * small tweaks * Fix merge conflicts * lint * wildcard image mime type * fix lint and comment * added comments * added comment about file size * Readme update --------- Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> Co-authored-by: Victor Mustar <victor.mustar@g…0e5c445
-
fix: Rename sagemaker endpoint to aws endpoint
Unverified signatureb5041c1 -
Modular backends & support for openAI & AWS endpoints (#541)
Unverified signature* Fix the response Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Should use /completions Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Use async generator Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Use openai npm Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Fix generateFromDefaultEndpoint Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Fix last char become undefined Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Better support for system prompt Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Updates Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Revert Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Update README Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Default system prompt Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * remove sk- Signed-off-by: Hung-Han …9db8ced
-
Switch chat model back to mistral, use zephyr for small tasks (#515)
Unverified signature* Switch chat model back to mistral, use zephyr for small tasks * typo * fix tests9187ced
-
Update websearch prompting & summary prompting (#503)
Unverified signature* Use the task model for websearch query generation * summary with examples in chat format * Update to websearch prompting - Removed web search template - Added examples in `generateQuery` - Passed previous questions when generating the web search query - Added previous questions to the bottom of the context window in `buildPrompt` when using websearch * wait for model if needed * rm console.log * get rid of regex * added a few time related examples * Update src/lib/server/websearch/generateQuery.ts Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * reformat yesterday * test * fix whitespace * remove extra whitespace for mistral * removed mistral extra whitespace * Update src/lib/server/summarize.ts Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * Update src/lib/server/summarize.ts Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * add an emoji if none is found in the first three characters ----…1e5090f
-
Pass stop sequences properly to TGI (#499)
Unverified signature* Pass stop sequences properly to TGI * fix typesa89fb7b
-
move some tasks to small model (#479)
Unverified signaturebf15962
-
Revert "Improve error message when the .env MODELS is not well formatted (#451)"
This reverts commit 8ce8b634e9687f00ad31d572dc047113e5b9f0d0.7ddda31 -
Improve error message when the .env MODELS is not well formatted (#451)
Unverified signature* feat: Improve error handling and parsing of MODELS environment variable * Add more verbose parsing error * Lint * improve message * lint * refactor error handling and default values in models * improve * format --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>8ce8b63
-
[Websearch] update (#427)
Mishig +2: julien-c, victor Unverified signature* Fix reuqest body * update webSearchQueryPromptTemplate * update generate google query parser * Add today's date to google search query creator * crawl top stories if exts; remove answer_box & knowledgeGraph * Create paragraph chunks from top articles * flattened paragprah chunks * update status texts * add gradio client * call gradio app for RAG * Web scrape only "p, li, span" els * add MAX_N_CHUNKS * gradio result typing * parse only <p> elements * rm dev change * update typing WebSearch * buld RAG prompt * Rm dev change * change websearch context msg from user to assisntat type * use hosted gradio app * fix lint * prompt engineering * more prompt engineering * MAX_N_PAGES_SCRAPE = 10 * better error msg * more prompt engineering * revert websearch prompt to previous * rm `top_stories` from websearch as the results are not good * Stop using gradio client, use regular fetch * chore * Rm websearch…ebac87f
-
🐛 Fix - Remove the min length validation on preprompt
Should fix the docker container7533ab7
-
Support custom system prompts from the user (#399)
Unverified signature* Support custom system prompts from the user * linter * types & lintcd6894d -
Make all prompt templates configurable (#400)
Unverified signature* Make all prompt templates configurable This PR enables all prompts to be configurable using handlebar templates as described in #382. For backward compatibility the old hardcoded templates are reimplemented as the default templates. The old template parameters such as `preprompt`, `userMessageToken`, `userMessageEndToken`, `assistantMessageToken`, `assistantMessageEndToken` are now considered legacy. They still work as they are exposed as variables to the default template. However, new prompt configurations should not use these. And it is recommended that the legacy support is eventually removed. As an example, this is how the default chat prompt template is implemented: ``` {{preprompt}} {{#each messages}} {{#ifUser}}{{@root.userMessageToken}}{{content}}{{@root.userMessageEndToken}}{{/ifUser}} {{#ifAssistant}}{{@root.assistantMessageToken}}{{content}}{{@root.assistantMessageEndToken}}{{/ifAssistant}} {{/each}} {{assistantMessageToken}} ``` In addition, …447c0ca
-
Add Sagemaker support (#401)
Unverified signature* work on sagemaker support * fix sagemaker integration * remove unnecessary deps * fix default endpoint * remove unneeded deps, fixed types * Use conditional validation for endpoints This was needed because the discriminated union couldn't handle the legacy case where `host` is undefined. * add note in readme about aws sagemaker2e6d1bb
-
allow different user and assistant end-token (#375)
Unverified signature* allow different user and assistant end-token For models like Llama2, the EndToken is not the same for a userMessage and an assistantMessage. This implements `userMessageEndToken` and `assistantMessageEndToken` which overwrites the messageEndToken behavior. This PR also allows empty strings as userMessageToken and assistantMessageToken and makes this the default. This adds additional flexibility, which is required in the case of Llama2 where the first userMessage is effectively different because of the system message. Note that because `userMessageEndToken` and `assistantMessageToken` are nearly always concatenated, it is almost redundant to have both. The exception is `generateQuery` for websearch which have several consecutive user messages. * Make model branding customizable based on env var (#345) * rm open assistant branding * Update SettingsModal.svelte * make settings work with a dynamic list of models * fixed types --------- Co-authored-…f209301
-
Add ability to define custom model/dataset URLs (#347)
Unverified signature* Add ability to define custom model/dataset URLs * lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>ce2231f
-
Disable models (#187)
Adrien Denat +1: Eliott C.Unverified signature* add ability for a model to be disabled * fallback to default model if user has invalid/disabled model in settings * set conversations to read-only if conv model is disabled * add better disabled state on chat input * fix inverted if statement * remove bigcode from .env * fix not updating settings Co-authored-by: Eliott C. <coyotte508@gmail.com> * refactor solution to use an OLD_MODELS env var instead * OLD_MODELS needs to be in .env but can be empty * fix typing issue + typo * refactor models validation * old models displayName is optional * set read only prop on user message not assistant messages * remove console.log * ♻️ Refacto isReadOnly * 🩹 Fluff: use 410 http code --------- Co-authored-by: Eliott C. <coyotte508@gmail.com>b7b2c8c
-
✨ Add model id to be able to switch models while keeping conversations valid (#181)
Eliott CUnverified signaturecf7ac8d
-
make models description dynamic (#169)
Adrien Denat +1: Eliott CUnverified signatureCo-authored-by: Eliott C <coyotte508@gmail.com>12c3a5a -
🐛 Stop bigcode prompts (#170)
Eliott CUnverified signaturead6275a -
Models selector (#164)
Adrien Denat +3: victor, julien-c, coyotte508 Unverified signatureCo-authored-by: Victor Mustar <victor.mustar@gmail.com> Co-authored-by: Julien Chaumond <julien@huggingface.co> Co-authored-by: coyotte508 <coyotte508@gmail.com>2606dde
-
♻️ Simplify setup, prepare for multi-models (#156)
Eliott CUnverified signature7764421