Commit History

  1. Optimize speculative decoding performance by increasing max_num_batched_tokens to 4096

    encryptd
    a0613f9
  2. Fix entrypoint override in Dockerfile

    encryptd
    8c76968
  3. Fix HF space build error by using official vllm-openai:v0.21.0 base image

    encryptd
    0a0b8ea
  4. Remove torchvision pin to allow vllm 0.12.0 to resolve its own torchvision dependency

    encryptd
    a35ce3f
  5. Upgrade to vllm 0.12.0 and restore original performance arguments for Qwen 3.5 support

    encryptd
    1cc1c9e
  6. Pin transformers to 4.48.2 to satisfy vllm>=4.48.2 dependency and resolve TokenizersBackend AttributeError

    encryptd
    ee926f5
  7. Pin transformers to 4.48.0 to resolve TokenizersBackend AttributeError in vLLM 0.8.0

    encryptd
    ab83d82
  8. Remove limit-mm-per-prompt argument to bypass vLLM 0.8.0 multimodal registration check

    encryptd
    c2fa736
  9. Remove speculative-config argument for vLLM 0.8.0 CLI parser

    encryptd
    20df6b8
  10. Fix limit-mm-per-prompt syntax for vLLM 0.8.0 CLI parser

    encryptd
    7f9201a
  11. Update torch to 2.6.0+cu124 and torchvision to 0.21.0+cu124 to satisfy vllm 0.8.0 dependency requirements

    encryptd
    860dc84
  12. Downgrade torch to 2.5.1+cu124 and vllm to 0.8.0 to match available CUDA 12.4 pre-compiled wheels

    encryptd
    bdb058c
  13. Fix NVIDIA driver mismatch on HF Space by forcing +cu124 torch wheels

    encryptd
    ba7160f
  14. Fix: Upgrade to vLLM 0.22.0 and PyTorch 2.11.0 on CUDA 12.4 for native Qwen 3.5 support and host compatibility

    encryptd
    359492c
  15. Fix: Remove speculative-config argument for vLLM 0.7.2 CLI compliance

    encryptd
    e776eb6
  16. Fix: Update --limit-mm-per-prompt format to KEY=VALUE format image=99 for vLLM 0.7.2

    encryptd
    a5a317d
  17. Fix: Align vLLM arguments with model card recommendations (chat format, MTP speculative config, limit-mm-per-prompt)

    encryptd
    244de46
  18. Fix: Change wheel index to cu124 and pin torch to 2.5.1+cu124 for native CUDA 12.4 host driver compatibility

    encryptd
    c6032e7
  19. Fix: Remove manual transformers source install to resolve tokenizer AttributeError

    encryptd
    4222b36
  20. Fix: Remove limit-mm-per-prompt and mm-processor-kwargs for vLLM 0.7.2 compatibility

    encryptd
    9700b91

  1. Fix: Update --limit-mm-per-prompt format to KEY=VALUE for vLLM 0.7.2 compatibility

    encryptd
    b7c3dd4
  2. Fix: Pin torch to 2.5.1+cu121 and vllm to 0.7.2 to guarantee CUDA 12.4 host driver compatibility

    encryptd
    d1fc8a9
  3. Fix: Add LD_LIBRARY_PATH forward compatibility for older host GPU drivers

    encryptd
    d16bf2a
  4. Fix: Switch base to CUDA devel image to provide nvcc for flashinfer JIT, and add .gitignore

    encryptd
    2ea1c55
  5. Fix: Remove show_copy_button parameter from gr.Textbox for Gradio 6 compatibility

    encryptd
    5aa37ab

  1. Fix: Remove audioop-lts as Python 3.10 natively provides audioop

    encryptd
    eeebc77
  2. Migration: Convert Hugging Face Space to custom Docker Space using CUDA 12.4

    encryptd
    f1ba762
  3. Fix: Install transformers from source to support Qwen 3.5 architecture

    encryptd
    7eb1ffe
  4. Initial commit: NuExtract3 Gradio space setup powered by vLLM on A100 GPU

    encryptd
    88dbb61