Spaces:
Paused
Paused
Commit History
-
New `InferenceClient` endpoint type (#1813)
Unverified signature* work on hf inference endpoint * working tools * fix: debug tool * feat: working tools with new endpoint type * feat: move config to HfInference * wip * fix: hf inference endpoint * refactor: rename endpoint * fix: rendering * feat: working tools on every supported model * fix: multimodal * refactor: rename endpoint type * refactor: base URL * fix: prevent simultaneous provider and baseURL usage * fix: disable tools on qwen 2.5 vl * feat: make sure json is correctly formatted4906f37
-
feat: add a local endpoint type for inference directly from chat-ui (#1778)
Unverified signature* feat: add a local endpoint type running llama.cpp from chat-ui * fix: build image * fix: lock file * wip: try to make it more reliable * feat: load chat template from .gguf file * feat: load gguf models from `models/` folder * fix: default config * feat: make endpoint use chatSession instead of completion * refactor: improve exit handling, exit immediately on second sinal * fix: various fixes to improve reliability when calling multiple models at once * docs: add instructions for adding .gguf files to the models directoryde36cdc
-
[feat] Add support for endpoint web sources (#1544)
goupilew +1: nsarrazinUnverified signature* [feat] Add support for endpoint web sources * chores: lint --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>eabf2bf
-
feat(endpoints): Add conv ID to headers passed to TGI (#1511)
Unverified signature791e118
-
Add support for Anthropic models via AWS Bedrock (#1413)
ABarLT +1: nsarrazinUnverified signature* Add support for Anthropic models via AWS Bedrock * deps * Fixed type errors * Temporary fix for continue button showing up on Claude * Fix continue button issue by setting the last message token's special to true --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>bf78ac3
-
Add Google Gemini API Support (#1330)
Unverified signature* Supports Google Gemini API * Fixed error when running svelte-check * update: from the contribution of nsarrazin1c84463
-
Function calling (#996)
Unverified signature* Initial work on function calling * wip * Add websearch as a tool * lint * smol * Move tools to their own files * directly answer check * Add text2img tool * group tool calls together * show retry even if no message * fix trailing urls * Add image popup * format * wip * clean-up * better loading indicator * text colors * extra example to summarize * switch default model * Add fetchUrl tool * wip * Add latest gradio * fix types * version bump sharp * Basic tools menu * working menu * fix menu positioning * deps fix * add deps * cleanup * more cleanup * cleanup * package cleanups * moar cleanup * ui update * Update ChatMessage.svelte * upgrade gradio dep * lint * refactor and pass results to cohere * feat: code interpreter tool * fix: add e2b dependency * feat: working TGI endpoint with tool results * feat: allow image model to expand to 90dvw * fix: dont block on title gen * bump sharp * misc cleanup * fix url fetcher, adjust tool typing *…564e576
-
Generic Multimodal Support Fixed (#1147)
Liam Dyer +2: nsarrazin, MishigUnverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * fix: TGI endpoints expecting multimodal --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>5b1a9aa
-
Revert "Generic Multimodal Support" (#1146)
MishigUnverified signatureRevert "Generic Multimodal Support (#1021)" This reverts commit 57f89346cc6d953246d0f1705e342e2e66fce386.3382639 -
Generic Multimodal Support (#1021)
Liam Dyer +2: nsarrazin, MishigUnverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>46dd845
-
feat: add support for anthropic on vertex (#958)
Jun Siang Cheah +1: nsarrazinUnverified signatureCo-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>61e5613
-
Add langserve endpoint (#1009)
Antonio Ramos +1: antonioraUnverified signature* Add support for langserve endpoints * Add support for langserve endpoints * Fix linting * Fix linting issues * Fix issue import --------- Co-authored-by: antoniora <antonio.ramos@adyen.com>f1cd31d
-
Add support for cohere endpoints (#976)
Unverified signature* Add support for cohere endpoints * readme update70cdf7a
-
Implement Cloudflare Workers AI endpoint (#907) (#972)
Unverified signature* Implement Cloudflare Workers AI endpoint (#907) * Renamed to Cloudflare Workers AI in docs * Add note about sampling parameters * clean up env example987575f
-
Google Vertex API support (#950)
Unverified signature* Added Google Vertex API support Google Application credentials can be set via GOOGLE_APPLICATION_CREDENTIALS = clientid.json * Updated the readme file * Updated the package-lock file * Updated the package-lock file Fixed minor issues * Moved "@google-cloud/vertexai" to optional dependencies * Updated for lint checkerd5625b9
-
Expose sampling controls in assistants (#955) (#959)
Unverified signature* Expose sampling controls in assistants (#955) * Make sure all labels have the same font size * styling * Add better tooltips * better padding & wrapping * Revert "better padding & wrapping" This reverts commit 1b44086465040f2cb6bc906983cfc8d95820d6fe. * ui update * tooltip on mobile * lint * Update src/lib/components/AssistantSettings.svelte Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> --------- Co-authored-by: Victor Mustar <victor.mustar@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>4e43408
-
Anthropic Endpoint Support (#923)
Liam DyerUnverified signaturefeat: anthropic endpoint58c3781
-
Conversation trees (#223) (#807)
Unverified signature* work on branching * branching * work on input field * wip * wip * helper stuff * pass tests * add type guards and clean up type requirements * fixed shared conv type * more helpers stuff * clean up code * addChildren helper * addSibling * add test for addSibling & refacto addChildren tests * backend work pt. 1 * backend done * add children property to messages for easier frontend rendering * fix message id type rail * front-end work on simple linear conversation * fix title generation * convert conversations on post * server side retry works with branching * clean up buttons * fix retry feature backend * Send new messages in any subtree * make edit previous prompts feature work * fix padding * revert unneeded changes * bring back pending message * fix front-end streaming * fix initial message * Revert "fix initial message" This reverts commit 6257fe8789c52a20e7506aa453efda55c16e95bb. * Fix bug subtree state refresh * fix continue feature on shared co…2a808d7
-
Continue generation feature (#707)
Unverified signature* Initial work on continue feature * Move continue button * Fix websearch with continue * Make it work with every model * Update src/routes/conversation/[id]/+server.ts Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * fixes * async all the things * add reduce comment * remove log * Only show loading indicator if not continuing --------- Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>c51ecfb
-
Add ollama endpoint support (#569)
Unverified signature* Add ollama endpoint support * replace if by switch * Add Ollama example in docsb07f0b1
-
Add support for tgi multimodal models (#531)
Unverified signature* wip: add support for tgi multimodal models * wip work on passing images to prompt * working idefics config! * rm allowed conv feature * lint * Add image resizing * fix ssr * add upload button * add delete button * misc formatting * lint * server file size check * optimistic update of images * retry with images * fix websearch button * lint * better error handling & max one image at a time * replace test image by blank one * disable loading on page change * Fix sharing of images * fix comments * Update filedropzone (#544) * Update src/lib/buildPrompt.ts Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * small tweaks * Fix merge conflicts * lint * wildcard image mime type * fix lint and comment * added comments * added comment about file size * Readme update --------- Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> Co-authored-by: Victor Mustar <victor.mustar@gmail.com>241ba68
-
fix: typecheck
Unverified signature357a57c -
Modular backends & support for openAI & AWS endpoints (#541)
Unverified signature* Fix the response Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Should use /completions Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Use async generator Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Use openai npm Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Fix generateFromDefaultEndpoint Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Fix last char become undefined Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Better support for system prompt Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Updates Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Revert Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Update README Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Default system prompt Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * remove sk- Signed-off-by: Hung-Han (Henry) Chen <chenhungh@gmail.com> * Fixing t…b5ae065