Instructions to use openai/clip-vit-base-patch32 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use openai/clip-vit-base-patch32 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-image-classification", model="openai/clip-vit-base-patch32") pipe( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png", candidate_labels=["animals", "humans", "landscape"], )# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForZeroShotImageClassification processor = AutoProcessor.from_pretrained("openai/clip-vit-base-patch32") model = AutoModelForZeroShotImageClassification.from_pretrained("openai/clip-vit-base-patch32", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Improve model card: Add Hear-Your-Click context and refined metadata
Verified signatureThis PR updates the model card for `openai/clip-vit-base-patch32`. It clarifies that this CLIP model serves as a crucial component (visual encoder) within the "Hear-Your-Click: Interactive Object-Specific Video-to-Audio Generation" framework. The changes include: - Retaining the detailed description of the `openai/clip-vit-base-patch32` model. - Adding a new section that introduces "Hear-Your-Click", its abstract, a link to its paper ([2507.04959](https://huggingface.co/papers/2507.04959)), and its GitHub repository (https://github.com/SynapGrid/Hear-Your-Click-2024). - Updating metadata with `license: mit`, `library_name: transformers`, and confirming `pipeline_tag: zero-shot-image-classification`. - Adding additional tags like `clip` and `video-to-audio` for better discoverability and context. - Including the BibTeX citation for the "Hear-Your-Click" paper. This update provides valuable context for users interested in the applications of this foundational CLIP model.4c4a3e8
-
Updates incorrect tokenizer configuration file (#13)
Verified signature- Adds tokenizer_config.json file (5812e510083bb2d23fa43778a39ac065d205ed4d)3d74acf
-
Add widget example input (#2)
- Add widget example input (220961d9a4200b62dc17ed2411394d105baa5b13)e6a30b6
-
Update config.json
f330785
-
Update README.md
f4881ba
-
update `tokenizer.json` for new CLIPTokenizerFast class
8759caf
-
add tf model
27464f1
-
Update README.md
7acb5c9 -
Update README.md
4b75373
-
add model
1b010d8
-
Update README.md
35754e5 -
Update README.md
8092f5b -
Update README.md
5975e42 -
Create README.md
4070d42 -
add files
25b80ac -
initial commit
856a6f2