Spaces:
Runtime error
Runtime error
Commit History
-
fix CI (#1884)
Eliott C.Unverified signature* fix CI * add playwright as dev dep * lint * clean up spaces-config with community tools * try to make mongo run?3b53c7a
-
Refactor token parameters to standardize naming across models and generation settings
dd2acb7
-
Omni multimodality (#1880)
Unverified signature* Add multimodal fallback support to router * fix: improve error handling for multimodal model routing * Handle multimodal messages without files9092d43
-
HuggingChat 2026 (#1875)
Unverified signature* refactor: remove tokenizer-related functionality and dependencies - Removed tokenizer dependencies from package.json. - Deleted TokensCounter component and its usages across the application. - Updated model configurations to exclude tokenizer properties. - Refactored model processing logic to support only OpenAI-compatible endpoints. - Adjusted API responses to omit tokenizer information. - Cleaned up related utility functions and imports. * Remove web search functionality and related components - Deleted endpoints for various web search APIs (serpApi, serpStack, serper, webLocal, youApi). - Removed generateQuery function and its usage in search. - Eliminated web search related types and interfaces from the codebase. - Updated Assistant and Conversation types to remove references to web search and embedding models. - Cleaned up related utility functions and message updates for web search. - Adjusted API routes and components to reflect the removal of web search features. - Updated…7bf1507
-
refactor: new API & universal load functions (pt. 2) (#1847)
Unverified signature* feat(API): refactor API with Elysia * feat: initial elysia setup * feat: replace conv/[id] load function with universal * fix: delete v1 catchall * wip * fix: response type * fix: add cors * feat: more routes in tools & assistants * refacto: use normal svelte fetch in `/assistant/[assistantId]` * refacto: use normal svelte fetch in `conversation/[id]` * feat: use universal load function for `tools/[toolId]` * wip: removing more server load function stuff * feat: more routes to universal load functions * feat: more routes to universal * refactor: move tools loading to API endpoint * refactor(api): implement tools search API endpoint and move load function * fix: types on tool search * refactor: update assistant route and remove redundant page load function * refactor(api): move assistants page load function to api call * refactor(settings): remove waterfall loading * refactor: main load function * fix: types * feat: improve fetchJSON to handle empty responses * …612f16b -
Revert "refactor: new API & universal load functions (#1743)"
This reverts commit 7961ae74d12cc62461929d92aca0adac48b72d9a.813f132 -
refactor: new API & universal load functions (#1743)
Unverified signature* feat(API): refactor API with Elysia * feat: initial elysia setup * feat: replace conv/[id] load function with universal * fix: delete v1 catchall * wip * fix: response type * fix: add cors * feat: more routes in tools & assistants * refacto: use normal svelte fetch in `/assistant/[assistantId]` * refacto: use normal svelte fetch in `conversation/[id]` * feat: use universal load function for `tools/[toolId]` * wip: removing more server load function stuff * feat: more routes to universal load functions * feat: more routes to universal * refactor: move tools loading to API endpoint * refactor(api): implement tools search API endpoint and move load function * fix: types on tool search * refactor: update assistant route and remove redundant page load function * refactor(api): move assistants page load function to api call * refactor(settings): remove waterfall loading * refactor: main load function * fix: types * feat: improve fetchJSON to handle empty responses * …50aea0a
-
fix: only import node-llama-cpp if needed and skip for huggingchat image
72db8f3
-
New `InferenceClient` endpoint type (#1813)
Unverified signature* work on hf inference endpoint * working tools * fix: debug tool * feat: working tools with new endpoint type * feat: move config to HfInference * wip * fix: hf inference endpoint * refactor: rename endpoint * fix: rendering * feat: working tools on every supported model * fix: multimodal * refactor: rename endpoint type * refactor: base URL * fix: prevent simultaneous provider and baseURL usage * fix: disable tools on qwen 2.5 vl * feat: make sure json is correctly formatted4906f37
-
feat: allow storing env variable in DB (#1802)
Unverified signature* feat(config): wip, make config controllable from DB, public side for now * fix: build * feat(config): add config manager env var toggle * wip: make backend config use config manager * fix: typechecks * fix: circular import * refactor: init hook sveltekit * fix: disable config manager during tests * refactor: use enum for semaphore, move delete from auto after 60s to separate `deleteAt` field * feat: config manager checks for updates on requests * fix: config script exit * fix: remove top-level awaits * fix: script await * feat: filter config keys based on public environment variables for more security * fix: change import to type for public environment variables48059af
-
feat: allow strings in `MODELS` env var (#1791)
Unverified signature* feat: allow strings in `MODELS` env var This feature lets you simplify your `MODELS` env var by just specifying a bunch of model names on the hub and letting chat-ui deal with the rest. For example ``` MODELS=['hf:HuggingFaceTB/SmolLM2-1.7B-Instruct-GGUF'] ``` would automatically download the relevant file and serve it locally with `node-llama-cpp` * fix: make it simpler to usef887995
-
feat: add a local endpoint type for inference directly from chat-ui (#1778)
Unverified signature* feat: add a local endpoint type running llama.cpp from chat-ui * fix: build image * fix: lock file * wip: try to make it more reliable * feat: load chat template from .gguf file * feat: load gguf models from `models/` folder * fix: default config * feat: make endpoint use chatSession instead of completion * refactor: improve exit handling, exit immediately on second sinal * fix: various fixes to improve reliability when calling multiple models at once * docs: add instructions for adding .gguf files to the models directoryde36cdc
-
fix: handle no beginToken for token based reasoning models (#1713)
Unverified signature* refactor: remove debug console log in updateLocalEnv script * fix: handle no beginToken for token-based reasoning modelsa68038a
-
chores(svelte): migration to svelte 5 (#1685)
Unverified signature* chores(svelte): migration to svelte 5 * chores(svelte5): remove preventDefault & stopPropagation legacy handlers * chores(deps): version bumps * fix: closing modal works properly * fix: messagte loading reactivity * fix: loading indicator * fix: conversation list reactivity * fix: bug on tool logo rendering * fix: infinite loading circular dep * feat: hide new chat button on new chats * fix: move apply directive to main.css * fix: remove legacy syntax in `TokensCounter.svelte` * fix: replace legacy `run` with Svelte 5 `$effect` in NavMenu * fix: replace legacy `run` with Svelte 5 `$effect` in ScrollToPreviousBtn * fix: migrate `settings/[modelId]` page to Svelte 5 syntax * fix: replace legacy `run` with Svelte 5 `$effect` in ToolUpdate component * fix: migrate ToolEdit component to Svelte 5 syntax * fix: simplify login required handling in ChatInputa1a6daf
-
feat: improve tool calling & add tools to qwen 2.5 72b (#1615)
Unverified signature* fix: clean up tool calling more inline with latest changes in transformers lib and adds tool calling to qwen 2.5 72b * fix: add more field name options * fix: make tool calls a bit more robust642ce40
-
feat: UI for advanced reasoning models (#1605)
Unverified signature* feat: add a reasoning dropdown for CoT models * feat: add status updates * fix: various cleanups - pass content & status to result dropdown - dont store streaming updates in db - make status generation non blocking * fix: make sure not to push reasoning token stream to db * feat: add time indicator and make the ui match websearch * fix: change in status update & promptbf75aa7
-
Fix/oai parameters 1552 (#1557)
evalstateUnverified signature* support temperature between 0 and 2 * added parsing of presence_penalty from model parameters. OAI endpoint now correctly uses (frequency penalty=parameters.repetition penalty) and (presence penalty=parameters.presence_penalty) for both chat and completion paths. * added parsing of presence_penalty from model parameters. OAI endpoint now correctly uses (frequency penalty=parameters.repetition penalty) and (presence penalty=parameters.presence_penalty) for both chat and completion paths.9c8e5e0
-
fix: only show playground button for models that are available
Unverified signature451ffc4
-
feat: Add a model config option to disable system prompts (#1539)
Unverified signature* feat: added config option to disable system prompts * chore: updated config option name --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>5340bb9
-
fix: use custom tool template only for huggingchat
Unverified signature1fcfcd5
-
feat: use model id as fallback for finding a tokenizer (#1535)
Unverified signature07b0bcd
-
feat(models): add `nvidia/Llama-3.1-Nemotron-70B-Instruct-HF` (#1527)
Unverified signaturec5ee468
-
[vertex] Add PDF/plein texts support (#1520)
goupilewUnverified signature* [vertex] Add PDF support * [vertex] Fix lint * [vertex] Add support for text/plainaa59751
-
feat: add link to API playground for compatible models (#1488)
Unverified signature* feat: add link to API playground for compatible models * fix: move buttons to correct spot * fix: inference API placement buttoncdc7abc
-
feat(conv): let user switch models on conversations with deprecated models (#1462)
Unverified signature* feat(conv): let user switch models on conversations with deprecated models * lint * fix checks388034d
-
feat(models): add transferTo property on old models (#1453)
Unverified signature* feat(models): add transferTo property on old models used to transfer assistants to new models if specified * make sure transferTo is an existing model371a45e -
fix(continue): fix continue feature (#1459)
Unverified signature* fix(continue): more reliable end token stripping before we would try to strip end tokens once in order from the stop array, now we strip all end tokens from the array until we can't anymore * fix(tools): remove generation prompt in continue modec03be55
-
Add support for Anthropic models via AWS Bedrock (#1413)
ABarLT +1: nsarrazin Unverified signature* Add support for Anthropic models via AWS Bedrock * deps * Fixed type errors * Temporary fix for continue button showing up on Claude * Fix continue button issue by setting the last message token's special to true --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>bf78ac3
-
feat(assistants): use community tools in assistants (#1421)
Unverified signature* wip: give assistant tool access * add api endpoints * add/delete tools from assistant settings * make tools work with assistants * feat(tools): add more tools indicator throughout UI * formatting10b8070
-
chores(deps): update Transformers to latest version and remove chat templates for all models (#1414)
Unverified signature* chores(deps): update Transformers to latest version and remove chat templates for mistral models * feat(models): remove chatPromptTemplate everywherea0ed974
-
Community tools (#1250)
Unverified signature* wip community tools * push * fix * bugfix * pass inputs to gradio correctly * full inputs for imagegen * lint * update gradio * fix call to gradio * fix imagegen tool * fix name * fix image display * Community tools (#1297) * work on tools * wip * icon * page * use IDs for every tools * improve tools page * wip * add optimized deps * refacto 1tool=1function * Add preview page * fix active indicator * fix text alignment * fix populate script * tooledit * fixes * better inputs * fix console error & cancel button * upload new tools * edit * improve lint * working community tools * fix active featured check * Simplify outputs in user form * fix non file outputs * fix imagegen default tool * add community tools popup * redirect gradio API calls through chat-ui backend * better usecount * Better loading & output element * better redirects & auto activate * bugfixes * fix migration changes * Add feature flag for tools * fix tools menu * Keep tr…0c3e3b2
-
fix(logs): improve logging
Unverified signature941d09c
-
feat(models): Llama 3.1 support (#1355)
Unverified signature* feat(models): Add llama 3.1 405B and 70B * feat(tools): improve tools support for llama 3.1 models * feat(models): update mistral to latest * feat(models): use llama 3.1 8B for tasks * fix(tools): disable tools by default * feat(models): update model descriptions in huggingchat * fix(front): show branding for llama 3 * fix(config): fix encoding * feat(migrations): reset tools for everyone * feat(config): replace orgs with final org * feat(config): update website for llama 3.1d947276
-
Add Google Gemini API Support (#1330)
Unverified signature* Supports Google Gemini API * Fixed error when running svelte-check * update: from the contribution of nsarrazin1c84463
-
Refactor logger error messages for consistency. (#1257)
Denzel MendezUnverified signaturedc98038
-
Function calling (#996)
Unverified signature* Initial work on function calling * wip * Add websearch as a tool * lint * smol * Move tools to their own files * directly answer check * Add text2img tool * group tool calls together * show retry even if no message * fix trailing urls * Add image popup * format * wip * clean-up * better loading indicator * text colors * extra example to summarize * switch default model * Add fetchUrl tool * wip * Add latest gradio * fix types * version bump sharp * Basic tools menu * working menu * fix menu positioning * deps fix * add deps * cleanup * more cleanup * cleanup * package cleanups * moar cleanup * ui update * Update ChatMessage.svelte * upgrade gradio dep * lint * refactor and pass results to cohere * feat: code interpreter tool * fix: add e2b dependency * feat: working TGI endpoint with tool results * feat: allow image model to expand to 90dvw * fix: dont block on title gen * bump sharp * misc cleanup * fix url fetcher, adjust tool typing *…564e576
-
Generic Multimodal Support Fixed (#1147)
Liam Dyer +2: nsarrazin, Mishig Unverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * fix: TGI endpoints expecting multimodal --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>5b1a9aa
-
Revert "Generic Multimodal Support" (#1146)
MishigUnverified signatureRevert "Generic Multimodal Support (#1021)" This reverts commit 57f89346cc6d953246d0f1705e342e2e66fce386.3382639 -
Generic Multimodal Support (#1021)
Liam Dyer +2: nsarrazin, Mishig Unverified signature* feat: multimodal anthropic support * docs: add claude haiku and multimodal support * feat: uploaded file detection and image conversion * fix deps with sharp * fix resvg deps? * fix: image conversion, retry with files * feat: generic image processing and size target * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * docs: multimodal review comments Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * feat: review comment resolution * fix: type error on image params * feat: add multimodal for vertex ai anthropic * style: uploadFile timeout number Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>46dd845
-
feat: add support for anthropic on vertex (#958)
Jun Siang Cheah +1: nsarrazin Unverified signatureCo-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>61e5613
-
Move vars to dynamic, add metrics (#1085)
Unverified signature* Add healthcheck route * Add prom client with basic metrics * wip: serve metrics on a different port * exclude server from tsconfig * latest * refacto(all): use class & singleton * refacto(all): use class & singleton * refacto(all): add request logs * Make all the env vars dynamic (#1092) * Add truncate to task model (#1090) * retry text area height (#1091) * Make all the env vars dynamic * only check for db at runtime * remove secret from build step * improve dockerfile * Wrap db in singleton * add .env.local to dockerignore * changes to dockerfile * lint * aborted generations * move collections build check * Use a single dockerfile * lint * fixes * lint * don't return db during building * remove dev --------- Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * refacto(all): update default metrics port * fix recursion error * add version check * revert vite preview * Move request logs to debug level and add an env var to filter by log level in d…a8a9533
-
Use pino for logs (#1086)
Unverified signature* Use pino for logs * Use logger for info * Add errorId to the logs486ffa7
-
Kill app on tokenizer load fail (#1044)
Unverified signatureca2ac64
-
Add logs to tokenizer fetch (#1030)
Unverified signature623e026
-
Add langserve endpoint (#1009)
Antonio Ramos +1: antonioraUnverified signature* Add support for langserve endpoints * Add support for langserve endpoints * Fix linting * Fix linting issues * Fix issue import --------- Co-authored-by: antoniora <antonio.ramos@adyen.com>f1cd31d
-
Move default template so it doesn't override tokenizer (#987)
Unverified signature7451c63 -
Set ChatML as default chat prompt template (#985)
Unverified signature69b890b
-
Add support for cohere endpoints (#976)
Unverified signature* Add support for cohere endpoints * readme update70cdf7a -
Use jinja template for chat formatting (#730) (#744)
Unverified signature* Use jinja template for chat formatting * Add support for transformers js chat template * update to latest transformers version * Make sure to `add_generation_prompt` * unindent144112e
-
Implement Cloudflare Workers AI endpoint (#907) (#972)
Unverified signature* Implement Cloudflare Workers AI endpoint (#907) * Renamed to Cloudflare Workers AI in docs * Add note about sampling parameters * clean up env example987575f