Image-Text-to-Text
Transformers
TensorBoard
Safetensors
vision-encoder-decoder
Generated from Trainer
Instructions to use Sans1807/working with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Sans1807/working with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="Sans1807/working")# Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("Sans1807/working") model = AutoModelForMultimodalLM.from_pretrained("Sans1807/working", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Sans1807/working with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Sans1807/working" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Sans1807/working", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Sans1807/working
- SGLang
How to use Sans1807/working with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Sans1807/working" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Sans1807/working", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Sans1807/working" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Sans1807/working", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Sans1807/working with Docker Model Runner:
docker model run hf.co/Sans1807/working
| {"time":"2024-10-01T08:32:49.782096842Z","level":"INFO","msg":"using version","core version":"0.18.1"} | |
| {"time":"2024-10-01T08:32:49.782115978Z","level":"INFO","msg":"created symlink","path":"/kaggle/working/wandb/run-20241001_083249-u0irpiiu/logs/debug-core.log"} | |
| {"time":"2024-10-01T08:32:49.782169147Z","level":"INFO","msg":"using version","core version":"0.18.1"} | |
| {"time":"2024-10-01T08:32:49.782175157Z","level":"INFO","msg":"created symlink","path":"/kaggle/working/wandb/run-20241001_083249-u0irpiiu/logs/debug-core.log"} | |
| {"time":"2024-10-01T08:32:49.78437176Z","level":"INFO","msg":"created new stream","id":"u0irpiiu"} | |
| {"time":"2024-10-01T08:32:49.784408835Z","level":"INFO","msg":"stream: started","id":"u0irpiiu"} | |
| {"time":"2024-10-01T08:32:49.78444374Z","level":"INFO","msg":"sender: started","stream_id":{"value":"u0irpiiu"}} | |
| {"time":"2024-10-01T08:32:49.784437611Z","level":"INFO","msg":"writer: Do: started","stream_id":{"value":"u0irpiiu"}} | |
| {"time":"2024-10-01T08:32:49.784526833Z","level":"INFO","msg":"handler: started","stream_id":{"value":"u0irpiiu"}} | |
| {"time":"2024-10-01T08:32:50.556460675Z","level":"INFO","msg":"wandb-core","!BADKEY":null} | |
| {"time":"2024-10-01T08:32:50.558412088Z","level":"INFO","msg":"Starting system monitor"} | |
| {"time":"2024-10-01T10:22:00.868419812Z","level":"INFO","msg":"api: retrying HTTP error","status":500,"url":"https://api.wandb.ai/files/iksanwijaya018-bina-sarana-informatika/huggingface/u0irpiiu/file_stream"} | |
| {"time":"2024-10-01T11:54:23.251982223Z","level":"INFO","msg":"Pausing system monitor"} | |
| {"time":"2024-10-01T11:54:23.260247019Z","level":"INFO","msg":"Resuming system monitor"} | |
| {"time":"2024-10-01T11:54:23.347309419Z","level":"INFO","msg":"Pausing system monitor"} | |
| {"time":"2024-10-01T11:54:23.35373038Z","level":"INFO","msg":"Resuming system monitor"} | |