Commit History

  1. Revert to stable config: BATCH_TOKENS=512, CONCURRENT=8

    Verified signature
    b593f27
  2. Reduce MAX_BATCH_TOKENS for CPU stability

    Verified signature
    60f06b1
  3. MAX_BATCH_TOKENS=32768, MAX_INPUT_LENGTH=8192

    Verified signature
    11bc8de
  4. Increase MAX_BATCH_TOKENS to 32768, MAX_INPUT_LENGTH=8192

    Verified signature
    a9e284c
  5. Increase concurrency limits

    Verified signature
    1b7add8
  6. Increase concurrency: MAX_CONCURRENT_REQUESTS=8, MAX_BATCH_REQUESTS=16, MAX_BATCH_TOKENS=1024

    Verified signature
    7947ab6
  7. Upload Dockerfile with huggingface_hub

    Verified signature
    1ccf203

  1. Reduce memory: max_concurrent=1, max_batch_tokens=512

    Jasai
    25e25b1
  2. Try float16 to reduce memory usage

    Jasai
    105f58c
  3. Fix: use TEI 1.9 (1.6 doesn't support Qwen3)

    Jasai
    fe6dce9
  4. Deploy Qwen3-Embedding-0.6B with TEI

    Jasai
    130b24b

  1. Restore stable PyTorch CPU + 4B (backup while INT8 ONNX upload in progress)

    hu
    3d7d8c9
  2. TEI INT8 ONNX + --pooling cls --dtype float32

    hu
    ecc3c86
  3. TEI + INT8 ONNX Qwen3-Embedding-4B (4GB, fits cpu-basic)

    hu
    2ce60ae

  1. Stable: PyTorch CPU-only + Qwen3-Embedding-4B (proven working)

    hu
    a8af8fb
  2. Remove build-time model download; use ORT backend at runtime

    hu
    73fe58d
  3. Add ONNX Runtime backend option + ST fallback for Qwen3-Embedding-4B

    hu
    76a10e4
  4. TEI Candle CPU + Qwen3-Embedding-4B fp16

    hu
    624b719
  5. Use CPU-only PyTorch for smaller image & faster inference

    hu
    f4aaf14
  6. Switch to sentence-transformers + Qwen3-Embedding-4B (PyTorch CPU)

    hu
    1616f63
  7. Use ONNX ST Qwen3-Embedding-4B model

    hu
    791549a
  8. Try TEI with Qwen3-Embedding-4B

    hu
    d2342b1
  9. Switch to TEI cpu-1.9 for Qwen3-Embedding-8B

    hu
    f9a3360
  10. Add Qwen3-Embedding-8B API

    hu
    e3cb2ba
  11. initial commit

    Verified signature
    1027559