Instructions to use FahadK/huggingface_assignment_AILab with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FahadK/huggingface_assignment_AILab with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="FahadK/huggingface_assignment_AILab")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("FahadK/huggingface_assignment_AILab") model = AutoModelForMultimodalLM.from_pretrained("FahadK/huggingface_assignment_AILab", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use FahadK/huggingface_assignment_AILab with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FahadK/huggingface_assignment_AILab" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FahadK/huggingface_assignment_AILab", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/FahadK/huggingface_assignment_AILab
- SGLang
How to use FahadK/huggingface_assignment_AILab with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FahadK/huggingface_assignment_AILab" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FahadK/huggingface_assignment_AILab", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FahadK/huggingface_assignment_AILab" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FahadK/huggingface_assignment_AILab", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use FahadK/huggingface_assignment_AILab with Docker Model Runner:
docker model run hf.co/FahadK/huggingface_assignment_AILab
Commit History
-
Adding `safetensors` variant of this model
Verified signatureThis is an automated PR created with https://huggingface.co/spaces/safetensors/convert This new file is equivalent to `pytorch_model.bin` but safe in the sense that no arbitrary code can be put into it. These files also happen to load much faster than their pytorch counterpart: https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb The widgets on your model page will run using this model even if this is not merged making sure the file actually works. If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions Feel free to ignore this PR.7975d04
-
End of training
3ca95d1 -
Training in progress, epoch 30
06d2bef -
Training in progress, epoch 29
3ded3d7 -
Training in progress, epoch 28
2d0ec16 -
Training in progress, epoch 27
411259b -
Training in progress, epoch 26
f11b8fe -
Training in progress, epoch 25
070a46b -
Training in progress, epoch 24
4094a5b -
Training in progress, epoch 23
0ae26ff -
Training in progress, epoch 22
b74329a -
Training in progress, epoch 21
5fd7edf -
Training in progress, epoch 20
fc6e403 -
Training in progress, epoch 19
dae46f7 -
Training in progress, epoch 17
f2ec052 -
Training in progress, epoch 16
fb26baa -
Training in progress, epoch 15
cb5284f -
Training in progress, epoch 14
936d6cb -
Training in progress, epoch 13
0442012 -
Training in progress, epoch 12
4785da9 -
Training in progress, epoch 11
6ce0bc0 -
Training in progress, epoch 10
3c9ece4 -
Training in progress, epoch 9
504f9e9 -
Training in progress, epoch 8
e3cd576 -
Training in progress, epoch 7
ab0ffb8 -
Training in progress, epoch 6
2c1fe8f -
Training in progress, epoch 5
9a952d3 -
Training in progress, epoch 4
6d38155 -
Training in progress, epoch 3
eb5a9ce -
Training in progress, epoch 1
a81bf15 -
End of training
3441abb -
Training in progress, epoch 29
1f5c5a5 -
Training in progress, epoch 27
2942a21 -
Training in progress, epoch 25
d2f7060 -
Training in progress, epoch 23
54e8592 -
Training in progress, epoch 21
af03e74 -
Training in progress, epoch 19
462cc7a -
Training in progress, epoch 17
ea77029 -
Training in progress, epoch 15
ddfa487 -
Training in progress, epoch 13
98d4f78 -
Training in progress, epoch 11
ea47021 -
Training in progress, epoch 9
3394ebc -
Training in progress, epoch 7
1515f57 -
Training in progress, epoch 5
9ea6d20 -
Training in progress, epoch 3
9b4b90e -
Training in progress, epoch 1
7e13b21
-
End of training
5011371 -
Training in progress, epoch 24
57fd15c -
Training in progress, epoch 22
e86c9b0 -
Training in progress, epoch 20
fcb9f66