Commit History
-
feat(chart): use inference proxy (#1688)
Unverified signature* feat(chart): use inference proxy * fix: also use `HF_API_ROOT` for embedding endpoints7a23445
-
chores(deps): update Transformers to latest version and remove chat templates for all models (#1414)
Unverified signature* chores(deps): update Transformers to latest version and remove chat templates for mistral models * feat(models): remove chatPromptTemplate everywheref3064dd
-
Fix error logging (#1228)
Unverified signatureLogging was switched to Pino. For error logging, Pino wants the object first, and then the string message. For example see this thread: https://github.com/pinojs/pino/issues/673906377c
-
Web Search: Playwright, spatial parsing, markdown (#1094)
Liam Dyer +2: Aaditya Sahay, Aaditya SahayUnverified signature* feat: playwright, spatial parsing, markdown for web search Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> * feat: choose multiple clusters if necessary (#2) * chore: resolve linting failures * feat: improve paring performance and error messages * feat: combine embeddable chunks together on cpu * feat: reduce parsed pages from 10 to 8 * feat: disable javascript in playwright by default * feat: embedding and parsing error messages * feat: move isURL, fix type errors, misc * feat: misc cleanup * feat: change serializedHtmlElement to interface * fix: isUrl filename * fix: add playwright dependencies to docker * feat: add playwright browsers to docker image * feat: enable javascript by default * feat: remove error message from console on failed page --------- Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> Co-authored-by: Aaditya Sahay <56438732+Aaditya-Sahay@users.noreply.github.com>da34bf2
-
Fix OpenAI Embeddings Auth Issue (#1077)
Unverified signature* Update embeddingEndpoints.ts Adds the `Api-Key` Parameter instead of `Authorization` since OpenAI depends on API Key * Add `defaultHeaders` to openAI embeddings endpoint and revert auth header --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>01830ce
-
Move vars to dynamic, add metrics (#1085)
Unverified signature* Add healthcheck route * Add prom client with basic metrics * wip: serve metrics on a different port * exclude server from tsconfig * latest * refacto(all): use class & singleton * refacto(all): use class & singleton * refacto(all): add request logs * Make all the env vars dynamic (#1092) * Add truncate to task model (#1090) * retry text area height (#1091) * Make all the env vars dynamic * only check for db at runtime * remove secret from build step * improve dockerfile * Wrap db in singleton * add .env.local to dockerignore * changes to dockerfile * lint * aborted generations * move collections build check * Use a single dockerfile * lint * fixes * lint * don't return db during building * remove dev --------- Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * refacto(all): update default metrics port * fix recursion error * add version check * revert vite preview * Move request logs to debug level and add an env var to filter by log level in d…0e5ff83
-
Use pino for logs (#1086)
Unverified signature* Use pino for logs * Use logger for info * Add errorId to the logsbb6f8cb
-
Use TEI space in prod (#1051)
Unverified signature1978a75
-
Always dispose of pipeline for embeddings after use (#1048)
Unverified signatureb337e06 -
Dispose of embeddings pipeline occasionally to clear memory (#1047)
Unverified signature808c327
-
return empty if error on hfapi endpoint (#1038)
Unverified signature0523db0 -
Use inference API for embeddings in huggingchat prod (#1037)
Unverified signature* Let the user use HF_TOKEN as auth bearer token in TEI endpoint * Use inference API for embeddings in huggingchat prod30ce16c
-
Use jinja template for chat formatting (#730) (#744)
Unverified signature* Use jinja template for chat formatting * Add support for transformers js chat template * update to latest transformers version * Make sure to `add_generation_prompt` * unindent3d931f5
-
Add openai embeddings (#915)
Martok88 +1: nsarrazin Unverified signature* Add OpenAI embedding compatibility * Use OPENAI_API_KEY by default * lint * Add default OpenAI URL replace `authorization` by `apiKey` * Add a note in readme --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>3a3ecfd
-
Mv embeddingEndpoints.ts (#688)
MishigUnverified signature* Mv embeddingEndpoints.ts * relative import22a099b
-
Add embedding models configurable, from both transformers.js and TEI (#646)
Unverified signature* Add embedding models configurable, from both Xenova and TEI * fix lint and format * Fix bug in sentenceSimilarity * Batches for TEI using /info route * Fix web search disapear when finish searching * Fix lint and format * Add more options for better embedding model usage * Fixing CR issues * Fix websearch disapear in later PR * Fix lint * Fix more minor code CR * Valiadate embeddingModelName field in model config * Add embeddingModel into shared conversation * Fix lint and format * Add default embedding model, and more readme explanation * Fix minor embedding model readme detailed * Update settings.json * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Apply suggestions from code review Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Resolved more issues * lint * Fix more issues * Fix format * fix small typo * lint * fix defaul…3a19267
