Zero-Shot Image Classification
Transformers
Safetensors
tipsv2
feature-extraction
vision
image-text
contrastive-learning
zero-shot
custom_code
Instructions to use google/tipsv2-l14 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/tipsv2-l14 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-image-classification", model="google/tipsv2-l14", trust_remote_code=True) pipe( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png", candidate_labels=["animals", "humans", "landscape"], )# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("google/tipsv2-l14", trust_remote_code=True) model = AutoModel.from_pretrained("google/tipsv2-l14", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update configuration_tips.py
Verified signatureUploads configuration_tips.py.dd4449f -
Update files for transformers integration
Verified signatureUpdates the repo to smoothly integrate with transformers. PR: https://github.com/huggingface/transformers/pull/46347 Changes: - Update `config.json` to match transformers structure - Update config classes to handle new `config.json` - Add processor and tokenizer configs - Update DPT `model.safetensors` files to include DPT head + backbone weights - Update DPT model code to handle extra weights in `model.safetensors` filef51cf5c
-
Fix broken image URL and add missing .cpu() in code snippets
Verified signaturee1ff7bc -
Remove zero-shot segmentation snippet, link to GitHub for advanced use cases
Gabriele6e72194
-
PCA visualization: add whitening and sigmoid
Gabriele04250d0 -
Add navigation table linking all variants and DPT heads
Gabriele597ecc2
-
Switch to bus image with matching classes
Gabriele69113d7 -
Improve code examples: better classes, descriptive comments
Gabrielea34ff2b -
Use cat photo, add print statements to code examples
Gabriele44dd5af -
Fix meta device crash: use pure Python for drop_path_rate
Gabriele8a1db2c -
Fix zero-shot segmentation section, use public example image
Gabriele9348ed0
-
Normalize README and config.json formatting to match other variants
Gabriele2766741 -
Update README
Gabriele54b33d9 -
Align image_encoder.py drop_path_rate computation with upstream
Gabrielecc0fc02 -
Upload README.md with huggingface_hub
Verified signature1900b45
-
Upload README.md with huggingface_hub
Verified signaturefda36e6 -
Upload model.safetensors with huggingface_hub
Verified signature5b2721b -
Upload README.md with huggingface_hub
Verified signature40a199e -
Upload config.json with huggingface_hub
Verified signature4981685 -
Upload tokenizer.model with huggingface_hub
Verified signaturef4dbf88 -
Upload text_encoder.py with huggingface_hub
Verified signature6a109bf -
Upload image_encoder.py with huggingface_hub
Verified signaturef4ff2b3 -
Upload modeling_tips.py with huggingface_hub
Verified signature17d1063 -
Upload configuration_tips.py with huggingface_hub
Verified signaturee685997 -
Delete .test with huggingface_hub
Verified signature6980245 -
Upload .test with huggingface_hub
Verified signatureca702ce -
initial commit
Verified signaturefff5cf4