* feat(tasks): use tools for web search query if available
* feat(websearch): improve query generation with error handling and logging
* feat(tools): implement generic tool output extraction utility
This commit adds a new `getToolOutput` utility to standardize tool interaction across different tasks like title generation, reasoning summary, and web search query generation. The utility supports extracting tool outputs using a consistent approach, with fallback mechanisms and error handling.
Anthropic Tool Support (#1594)
evalstate+1: nsarrazin
Unverified signature
1ac3a3c
* support anthropic PDF beta
* upstream merge, remove commented out console log line
* Fixing type errors.
the anthropic API does not yet include a "DocumentBlock" for
support PDFs, so an extended type has been added to the endpoint.
* changed document processor to async (matching image processor)
* use the beta api types rather than custom extension
* rudimentary tool testing
* interim commit (tool re-passing, file handling)
* remove merge error
* tidy up, isolate beta classes to utils
* anthropic tool calling support.
* improve handling of directlyAnswer tool
* fix streaming
* slight tidy up to tools flow handling
* fix: dont pass tools in final generation, instead deduce tools from tool results
---------
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
* feat: new tool UI
* wip community tools support
* fix: community tools support
* fix: line heights
* fix: MIME types
* fix: remove debug logs
* fix: make sure file upload is always last
* fix: always enable document parser when a pdf is present in the conversation
* fix: use correct icon for document upload
* fix: make sure community tools use their custom icons correctly
* feat: add button to browse community tools
* tweak buttons
* add some tooltips
* fix: bug in file upload tooltips
* fix: lint
---------
Co-authored-by: Victor Mustar <victor.mustar@gmail.com>
* fix: clean up tool calling
more inline with latest changes in transformers lib and adds tool calling to qwen 2.5 72b
* fix: add more field name options
* fix: make tool calls a bit more robust
feat(endpoints): Add conv ID to headers passed to TGI (#1511)
* wip: give assistant tool access
* add api endpoints
* add/delete tools from assistant settings
* make tools work with assistants
* feat(tools): add more tools indicator throughout UI
* formatting
* feat(models): Add llama 3.1 405B and 70B
* feat(tools): improve tools support for llama 3.1 models
* feat(models): update mistral to latest
* feat(models): use llama 3.1 8B for tasks
* fix(tools): disable tools by default
* feat(models): update model descriptions in huggingchat
* fix(front): show branding for llama 3
* fix(config): fix encoding
* feat(migrations): reset tools for everyone
* feat(config): replace orgs with final org
* feat(config): update website for llama 3.1
Revert "Request less `max_new_tokens` on tools and reduce `truncate` on CMD R+ (#1292)"
* Add custom metrics for messages and conversations
* lint
* Add metrics for
- model health
- tools
- websearch
* Add time window & age buckets to summaries
* Increase max age for tool use duration
---------
Co-authored-by: antoniora <antonio.ramos@adyen.com>
* Initial work on function calling
* wip
* Add websearch as a tool
* lint
* smol
* Move tools to their own files
* directly answer check
* Add text2img tool
* group tool calls together
* show retry even if no message
* fix trailing urls
* Add image popup
* format
* wip
* clean-up
* better loading indicator
* text colors
* extra example to summarize
* switch default model
* Add fetchUrl tool
* wip
* Add latest gradio
* fix types
* version bump sharp
* Basic tools menu
* working menu
* fix menu positioning
* deps fix
* add deps
* cleanup
* more cleanup
* cleanup
* package cleanups
* moar cleanup
* ui update
* Update ChatMessage.svelte
* upgrade gradio dep
* lint
* refactor and pass results to cohere
* feat: code interpreter tool
* fix: add e2b dependency
* feat: working TGI endpoint with tool results
* feat: allow image model to expand to 90dvw
* fix: dont block on title gen
* bump sharp
* misc cleanup
* fix url fetcher, adjust tool typing
*…
