Explicitly set lang adapter bias to False
#7
by patrickvonplaten - opened
vllm serve mistralai/Pixtral-Large-Instruct-2411 --tokenizer_mode mistral --limit_mm_per_prompt 'image=10' --tensor-parallel-size 8 --tool-call-parser mistral --enable-auto-tool-choice --config-format mistral --load-format mistral --revision refs/pr/7
This should be fully compatible actually with current vllm version so it can be safely merged.
patrickvonplaten changed pull request status to merged