Instructions to use YingxuHe/git-base-test4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use YingxuHe/git-base-test4 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="YingxuHe/git-base-test4")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("YingxuHe/git-base-test4") model = AutoModelForMultimodalLM.from_pretrained("YingxuHe/git-base-test4", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use YingxuHe/git-base-test4 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "YingxuHe/git-base-test4" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "YingxuHe/git-base-test4", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/YingxuHe/git-base-test4
- SGLang
How to use YingxuHe/git-base-test4 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "YingxuHe/git-base-test4" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "YingxuHe/git-base-test4", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "YingxuHe/git-base-test4" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "YingxuHe/git-base-test4", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use YingxuHe/git-base-test4 with Docker Model Runner:
docker model run hf.co/YingxuHe/git-base-test4
Commit History
-
Adding `safetensors` variant of this model
Verified signatureThis is an automated PR created with https://huggingface.co/spaces/safetensors/convert This new file is equivalent to `pytorch_model.bin` but safe in the sense that no arbitrary code can be put into it. These files also happen to load much faster than their pytorch counterpart: https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb The widgets on your model page will run using this model even if this is not merged making sure the file actually works. If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions Feel free to ignore this PR.df152ed
-
update model card README.md
7c9bea2 -
End of training
317fe12 -
Training in progress, step 3000
52d1e3d -
Training in progress, step 2900
cdacb62 -
Training in progress, step 2800
2f2973b -
Training in progress, step 2700
9cb3095 -
Training in progress, step 2600
367ff7e -
Training in progress, step 2500
9d25b6b -
Training in progress, step 2400
15bac7b -
Training in progress, step 2300
6401605 -
Training in progress, step 2200
16d6a62 -
Training in progress, step 2100
613598c -
Training in progress, step 2000
b74e60d -
Training in progress, step 1900
4ef8541 -
Training in progress, step 1800
f01079c -
Training in progress, step 1700
8f724de -
Training in progress, step 1600
d1d099e -
Training in progress, step 1500
972b8a2 -
Training in progress, step 1400
fb67b7f -
Training in progress, step 1300
dc7f3d1 -
Training in progress, step 1200
14ecf5e -
Training in progress, step 1100
5f6114b -
Training in progress, step 1000
d3834f9 -
Training in progress, step 900
b4ede33 -
Training in progress, step 800
6625bce -
Training in progress, step 700
ce2ce27 -
Training in progress, step 600
d247dfd -
Training in progress, step 500
5b23bbd -
Training in progress, step 400
51cf0ba -
Training in progress, step 300
ff2e35b -
Training in progress, step 200
ba48424 -
Training in progress, step 100
8a5ce63 -
update model card README.md
ea96a9e -
End of training
bf2c63c -
Training in progress, step 1200
bb9dbcf -
Training in progress, step 1100
6d46319 -
Training in progress, step 1000
b1c2108 -
Training in progress, step 900
1ede292 -
Training in progress, step 800
91c386e -
Training in progress, step 700
2edfd35 -
Training in progress, step 600
f5d4364 -
Training in progress, step 500
1d0404b -
Training in progress, step 400
8085f55 -
Training in progress, step 300
af79ba9 -
Training in progress, step 200
27793ac -
Training in progress, step 100
1cd5d4f -
update model card README.md
5a22bb5 -
End of training
71fcbe6 -
Training in progress, step 2500
e705358