Zero-Shot Image Classification
Transformers
Safetensors
English
clip
fashion
multimodal
image-search
text-search
embeddings
contrastive-learning
zero-shot-classification
Instructions to use Leacb4/gap-clip with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Leacb4/gap-clip with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-image-classification", model="Leacb4/gap-clip") pipe( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png", candidate_labels=["animals", "humans", "landscape"], )# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForZeroShotImageClassification processor = AutoProcessor.from_pretrained("Leacb4/gap-clip") model = AutoModelForZeroShotImageClassification.from_pretrained("Leacb4/gap-clip", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload figures/tsne_model.png with huggingface_hub
Verified signatureb54033b -
Upload figures/tsne_hierarchy_our.png with huggingface_hub
Verified signatured468750 -
Upload figures/tsne_hierarchy_baseline.png with huggingface_hub
Verified signaturece42c6e -
Upload figures/tsne_baseline.png with huggingface_hub
Verified signaturec7e16ad -
Upload figures/training_curves.png with huggingface_hub
Verified signature4d47ec9 -
Upload figures/scheme.png with huggingface_hub
Verified signaturef08858f -
Upload figures/heatmap_baseline.jpg with huggingface_hub
Verified signaturef5b8921 -
Upload figures/heatmap.png with huggingface_hub
Verified signature73b0cb9 -
Upload figures/gapclip_red_dress.png with huggingface_hub
Verified signature053b4fc -
Upload figures/gapclip_blue_pant.png with huggingface_hub
Verified signatureb0326f2 -
Upload figures/confusion_matrices/cm_sec533/gap_clip_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature75c92cc -
Upload figures/confusion_matrices/cm_sec533/gap_clip_kagl_marqo_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signatured212416 -
Upload figures/confusion_matrices/cm_sec533/gap_clip_kagl_marqo_text_color_confusion_matrix.png with huggingface_hub
Verified signature64411b6 -
Upload figures/confusion_matrices/cm_sec533/gap_clip_kagl_marqo_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature9165c19 -
Upload figures/confusion_matrices/cm_sec533/gap_clip_kagl_marqo_image_color_confusion_matrix.png with huggingface_hub
Verified signaturebb89e24 -
Upload figures/confusion_matrices/cm_sec533/gap_clip_internal_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature35b189c -
Upload figures/confusion_matrices/cm_sec533/gap_clip_internal_text_color_confusion_matrix.png with huggingface_hub
Verified signature8d3db60 -
Upload figures/confusion_matrices/cm_sec533/gap_clip_internal_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature276e4a9 -
Upload figures/confusion_matrices/cm_sec533/gap_clip_internal_image_color_confusion_matrix.png with huggingface_hub
Verified signature67bb5ba -
Upload figures/confusion_matrices/cm_sec533/gap_clip_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature4d06235 -
Upload figures/confusion_matrices/cm_sec533/baseline_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature2b98c26 -
Upload figures/confusion_matrices/cm_sec533/baseline_kagl_marqo_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signaturee7a7968 -
Upload figures/confusion_matrices/cm_sec533/baseline_kagl_marqo_text_color_confusion_matrix.png with huggingface_hub
Verified signaturece85397 -
Upload figures/confusion_matrices/cm_sec533/baseline_kagl_marqo_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature1d7f4a2 -
Upload figures/confusion_matrices/cm_sec533/baseline_kagl_marqo_image_color_confusion_matrix.png with huggingface_hub
Verified signatureebb36f2 -
Upload figures/confusion_matrices/cm_sec533/baseline_internal_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature82aa59e -
Upload figures/confusion_matrices/cm_sec533/baseline_internal_text_color_confusion_matrix.png with huggingface_hub
Verified signature1ab66fc -
Upload figures/confusion_matrices/cm_sec533/baseline_internal_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature5a2d41c -
Upload figures/confusion_matrices/cm_sec533/baseline_internal_image_color_confusion_matrix.png with huggingface_hub
Verified signature950c023 -
Upload figures/confusion_matrices/cm_sec533/baseline_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signaturedfbcd82 -
Upload figures/confusion_matrices/cm_hierarchy/gap_clip_local_(normalized)_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature95ae8ee -
Upload figures/confusion_matrices/cm_hierarchy/gap_clip_local_(normalized)_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature6bc062b -
Upload figures/confusion_matrices/cm_hierarchy/gap_clip_kagl_marqo_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature192771b -
Upload figures/confusion_matrices/cm_hierarchy/gap_clip_kagl_marqo_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature98fa579 -
Upload figures/confusion_matrices/cm_hierarchy/gap_clip_fashion-mnist_(normalized)_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signaturefa23dcd -
Upload figures/confusion_matrices/cm_hierarchy/gap_clip_fashion-mnist_(normalized)_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature3d490dc -
Upload figures/confusion_matrices/cm_hierarchy/baseline_local_(normalized)_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature4005876 -
Upload figures/confusion_matrices/cm_hierarchy/baseline_local_(normalized)_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature5e9ba43 -
Upload figures/confusion_matrices/cm_hierarchy/baseline_kagl_marqo_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature17428e2 -
Upload figures/confusion_matrices/cm_hierarchy/baseline_kagl_marqo_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signatureaecb339 -
Upload figures/confusion_matrices/cm_hierarchy/baseline_fashion-mnist_(normalized)_text_hierarchy_confusion_matrix.png with huggingface_hub
Verified signaturee4beac4 -
Upload figures/confusion_matrices/cm_hierarchy/baseline_fashion-mnist_(normalized)_image_hierarchy_confusion_matrix.png with huggingface_hub
Verified signature2d4888f -
Upload figures/confusion_matrices/cm_color/local_text_color_confusion_matrix.png with huggingface_hub
Verified signature4872045 -
Upload figures/confusion_matrices/cm_color/local_image_color_confusion_matrix.png with huggingface_hub
Verified signaturef367abc -
Upload figures/confusion_matrices/cm_color/local_baseline_text_color_confusion_matrix.png with huggingface_hub
Verified signaturea603d61 -
Upload figures/confusion_matrices/cm_color/local_baseline_image_color_confusion_matrix.png with huggingface_hub
Verified signatureb1aba46 -
Upload figures/confusion_matrices/cm_color/kaggle_text_color_confusion_matrix.png with huggingface_hub
Verified signaturef1e6ca8 -
Upload figures/confusion_matrices/cm_color/kaggle_image_color_confusion_matrix.png with huggingface_hub
Verified signature953da8c -
Upload figures/confusion_matrices/cm_color/kaggle_baseline_text_color_confusion_matrix.png with huggingface_hub
Verified signature8b0e837 -
Upload figures/confusion_matrices/cm_color/kaggle_baseline_image_color_confusion_matrix.png with huggingface_hub
Verified signature181e28d