Introduced a new documentation structure under docs/source, covering configuration, installation (local, Docker, Helm), architecture, and common issues. Updated .env and README.md to clarify model discovery and LLM router configuration. This improves onboarding, setup, and operational guidance for developers and users.
* refactor: remove tokenizer-related functionality and dependencies
- Removed tokenizer dependencies from package.json.
- Deleted TokensCounter component and its usages across the application.
- Updated model configurations to exclude tokenizer properties.
- Refactored model processing logic to support only OpenAI-compatible endpoints.
- Adjusted API responses to omit tokenizer information.
- Cleaned up related utility functions and imports.
* Remove web search functionality and related components
- Deleted endpoints for various web search APIs (serpApi, serpStack, serper, webLocal, youApi).
- Removed generateQuery function and its usage in search.
- Eliminated web search related types and interfaces from the codebase.
- Updated Assistant and Conversation types to remove references to web search and embedding models.
- Cleaned up related utility functions and message updates for web search.
- Adjusted API routes and components to reflect the removal of web search features.
- Updated…
docs: fix the llama-server README link ("examples" -> "tools") (#1869)
Solomon
Unverified signature
eb72edf
Fix broken documentation links to multimodal and tools in Cloudflare … (#1859)
VolodymyrBg+1: nsarrazin
Unverified signature
aa0a5dc
* Fix broken documentation links to multimodal and tools in Cloudflare provider doc
* Update cloudflare.md
* fix: lint
---------
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
docs: correct typos and grammar (#1839)
crStiv
Unverified signature
f04566b
* Update overview.md
* Update web-search.md
feat: rework example layout to work better on mobile
* fix(openai): systemRoleSupported model configuration for openai endpoints
* feat(openai): max_completion_tokens now used over max_tokens for chat_completeions endpoint.
* fix: lint
* feat(docs): add o1 example
* fix: make parameter default to false and fix type checks
---------
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
Added example for OpenAI API embedding models (#1555)
Kristoffer Johansson+1: nsarrazin
Unverified signature
b7caac6
Added an example on how to use OpenAI API embedding models to the documentation
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
Add support for model version in Vertex AI (#1496)
* Add support for model version in Vertex AI
* Update src/lib/server/endpoints/google/endpointVertex.ts
Co-authored-by: goupilew <arthurgoupil@gmail.com>
* fix: optional chaining on extraBody
---------
Co-authored-by: goupilew <arthurgoupil@gmail.com>
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
Move Google GenAI API key to env file instead (#1448)
- Updated the documentation with the latest links from Google AI Studio
- Fixed the incorrect documentation on `safetyThreshold`
- Fixed the `safetySettings` to exclude unspecified category, as it is
not considered as a valid input category in Google's API
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
* Update README.md
Based on https://developers.cloudflare.com/api/operations/workers-ai-post-run-cf-deepseek-ai-deepseek-math-7b-instruct#request-body, this is no longer accurate
* Remove warning in hosted docs too
---------
Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>
[docs] fix css (#1224)
Mishig
Unverified signature
91590d9
Improve docs (#1223)
Mishig
Unverified signature
9909e07
* better interlinking
* upload imgs
Add support for SearchApi API (#1196)
SebastjanPrachovskij
Unverified signature
657e331
* Add SearchApi integration
* Remove isURL
[docs] Fix errors (#1218)
Mishig
Unverified signature
58e8ae7
Revamp llama.cpp docs (#1214)
Mishig+1: victor
Unverified signature
b359d59
* Revamp llama.cpp docs
* format
* update readme
* update index page
* update readme
* bertter fomratting
* Update README.md
Co-authored-by: Victor Muštar <victor.mustar@gmail.com>
* Update README.md
Co-authored-by: Victor Muštar <victor.mustar@gmail.com>
* fix hashlink
* document llama hf args
* format
---------
Co-authored-by: Victor Muštar <victor.mustar@gmail.com>