Image-to-Text
Transformers
PyTorch
Safetensors
English
blip-2
visual-question-answering
vision
image-captioning
Instructions to use Salesforce/blip2-opt-2.7b-coco with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Salesforce/blip2-opt-2.7b-coco with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("image-to-text", model="Salesforce/blip2-opt-2.7b-coco")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Salesforce/blip2-opt-2.7b-coco") model = AutoModelForMultimodalLM.from_pretrained("Salesforce/blip2-opt-2.7b-coco", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download preprocessor_config.json from Salesforce/blip2-opt-2.7b-coco: direct link, hf CLI and curl.
- Browser
- Download file 432 Bytes
-
https://huggingface.co/Salesforce/blip2-opt-2.7b-coco/resolve/refs%2Fpr%2F2/preprocessor_config.json
- Command line
-
hf download hf://Salesforce/blip2-opt-2.7b-coco@refs/pr/2/preprocessor_config.json
-
curl -L -o preprocessor_config.json https://huggingface.co/Salesforce/blip2-opt-2.7b-coco/resolve/refs%2Fpr%2F2/preprocessor_config.json
432 Bytes
| { | |
| "do_convert_rgb": true, | |
| "do_normalize": true, | |
| "do_rescale": true, | |
| "do_resize": true, | |
| "image_mean": [ | |
| 0.48145466, | |
| 0.4578275, | |
| 0.40821073 | |
| ], | |
| "image_processor_type": "BlipImageProcessor", | |
| "image_std": [ | |
| 0.26862954, | |
| 0.26130258, | |
| 0.27577711 | |
| ], | |
| "processor_class": "Blip2Processor", | |
| "resample": 3, | |
| "rescale_factor": 0.00392156862745098, | |
| "size": { | |
| "height": 364, | |
| "width": 364 | |
| } | |
| } | |