|
Download ms-swift/examples/deploy/server/README.md from yuccaaa/oss: direct link, hf CLI and curl.
- Browser
- Download file 301 Bytes
-
https://huggingface.co/yuccaaa/oss/resolve/main/ms-swift/examples/deploy/server/README.md
- Command line
-
hf download hf://yuccaaa/oss/ms-swift/examples/deploy/server/README.md
-
curl -L -o README.md https://huggingface.co/yuccaaa/oss/resolve/main/ms-swift/examples/deploy/server/README.md
301 Bytes
Please refer to the examples in examples/infer and change swift infer to swift deploy to start the service. (You need to additionally remove --val_dataset)
e.g.
CUDA_VISIBLE_DEVICES=0 \
swift deploy \
--model Qwen/Qwen2.5-7B-Instruct \
--infer_backend vllm