Commit History
-
Move vars to dynamic, add metrics (#1085)
Unverified signature* Add healthcheck route * Add prom client with basic metrics * wip: serve metrics on a different port * exclude server from tsconfig * latest * refacto(all): use class & singleton * refacto(all): use class & singleton * refacto(all): add request logs * Make all the env vars dynamic (#1092) * Add truncate to task model (#1090) * retry text area height (#1091) * Make all the env vars dynamic * only check for db at runtime * remove secret from build step * improve dockerfile * Wrap db in singleton * add .env.local to dockerignore * changes to dockerfile * lint * aborted generations * move collections build check * Use a single dockerfile * lint * fixes * lint * don't return db during building * remove dev --------- Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * refacto(all): update default metrics port * fix recursion error * add version check * revert vite preview * Move request …98b1c51
-
Support Gemini 1.5 Pro from Vertex AI (#1041)
Luke +1: nsarrazin Unverified signature* fix support for gemini on vertex ai - use native messages api - provide full content - hide "Continue" button - support "safety settings" - fix confusion in readme * respect new lines in model description * ignore google service accounts matching `gcp-*.json` * type checks * copy service account, if exists, to container * narrow response type * fix streaming generation --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>2ce3b4b
-
Docker chown change (#1046)
Unverified signaturefda044f -
Use `user` in docker image for spaces (#1045)
Unverified signaturea696fed
-
Update dockerfile to node 20 (#601)
Unverified signaturec51eb83
-
feat: add support for endpoints requiring client authentication using PKI (#393)
TomUnverified signature* feat: add support for endpoints requiring client authentication using PKI This enables a global mTLS context for client requests using the native fetch API. It can be used when custom endpoints require client authentication via PKI. * fix: Dockerfile syntax required for macOS Set the Dockerfile syntax explictly to enable new features in Dockerfile. The default syntax uses by Docker Desktop for macOS does not include support for `--link` in the COPY command for example.66adc5d
-
Add incremental build + multi layer docker for size reduction (#259)
Adrien +1: Eliott CUnverified signature* Add incremental build + multi layer docker for size reduction * Update .dockerignore * fix cache miss * pr comment .gitignore --------- Co-authored-by: Eliott C <coyotte508@gmail.com>74532d2
-
⚡️ Improve docker incremental build time (#142)
Eliott CUnverified signatureff2db2e
-
Simpler dockerfile (#126)
Eliott CUnverified signaturef177e4b
-
👷 Automatically detect number of cores
coyotte50854540f2
-
Use all CPUs in prod (#57)
Eliott CUnverified signature000ed50
-
🔧 Standardize environment config (#13)
Eliott CUnverified signature3ebd805 -
Migrate to new model + proxy from server (#5)
Adrien Denat +1: julien-c Unverified signature* use fork of hf.js to support fully custom endpoints for testing purpose * proxy textGenerationStream call to the backend to hide token from client * migrate to patch-package instead of pnpm * fix issue after merge conflict * use env var instead of hardcoded value for endpoint * fix messages not being split between assistant/user * fix stream response sometimes not split by token * remove PUBLIC_ from private env variables + rename ENDPOINT to MODEL_ENDPOINT * only set hf token as private, model can stay public * move HF_TOKEN to a dynamic env * fix env var import typo * remove @microsoft/fetch-event-source * update parameters to be identical to Python demo * small refactor to avoid typing issue * cleanup while loop Co-authored-by: Julien Chaumond <julien@huggingface.co> * make comment clearer on what is happening on stream chunks split * fix chunk spliting not being handled properly * cleanup model tokens sometimes containing "<|e…c8d90f4
-
ok im' gonna cry
Verified signaturedc0d663 -
Final try ?
Verified signaturebbc4435 -
Update Dockerfile
62cfd2a -
from Eliott too
98af244 -
from Eliott
8a32fdb -
one more try
6671664 -
another try
eac1f26 -
node build
Verified signature7cab6f4 -
First try at a Dockerfile
Verified signature356ce10