Instructions to use captioner/caption-gen with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use captioner/caption-gen with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("image-to-text", model="captioner/caption-gen")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("captioner/caption-gen") model = AutoModelForMultimodalLM.from_pretrained("captioner/caption-gen", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Adding `safetensors` variant of this model (#1)
Devin Zhang +1: SFconvertbot- Adding `safetensors` variant of this model (242bc0af8b15e55bea27049d7a51afba3872395c) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>e4a6146
-
Update README.md
Devin Zhangb0410b9 -
BLIP Preprocessor
Devin Zhang6732422 -
BLIP Tokenizer
Devin Zhange52ccfb -
Upload 3 files
Added needed captioning model files.6091052 -
Delete pytorch_model.bin
Devin Zhang3047011 -
Delete generation_config.json
Devin Zhang1aca78c -
Delete config.json
Devin Zhangbaf9239
-
Upload config.json
Devin Zhang5ac2c4d -
Delete tokenizer_config.json
Devin Zhang744eb1d -
Delete tokenizer.json
Devin Zhangbab9e30 -
Upload 2 files
Devin Zhang0efb82e -
Delete microsoft
Devin Zhang4509d14 -
Upload microsoft/git-base
Devin Zhang06b5dc6 -
Delete vocab.txt
Devin Zhang8d71f53 -
Delete tokenizer_config.json
Devin Zhange6f99d0 -
Delete tokenizer.json
Devin Zhang69841f8 -
Delete special_tokens_map.json
Devin Zhang158c95d -
Delete preprocessor_config.json
Devin Zhang08e9e55 -
Delete training_args.bin
Devin Zhang95a21c2 -
Upload from microsoft/git-base
Devin Zhang9d36b15 -
Delete tokenizer.json
Devin Zhang52e44f1 -
Delete preprocessor_config.json
Devin Zhang3dee07d -
Delete tokenizer_config.json
Devin Zhang27b6938 -
Added microsoft/git-base processors
Devin Zhang7537aa2 -
Upload 4 files
Devin Zhang3a88ed4 -
initial commit
Devin Zhang5839a0d