Zero-Shot Image Classification
Transformers
PyTorch
TensorBoard
Safetensors
English
vision-text-dual-encoder
feature-extraction
clip
vision
medical
bert
Instructions to use kaveh/rclip with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kaveh/rclip with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-image-classification", model="kaveh/rclip") pipe( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png", candidate_labels=["animals", "humans", "landscape"], )# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModel processor = AutoProcessor.from_pretrained("kaveh/rclip") model = AutoModel.from_pretrained("kaveh/rclip", device_map="auto") - Notebooks
- Google Colab
- Kaggle
added citation
Browse files
README.md
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
| 3 |
tags:
|
| 4 |
- clip
|
| 5 |
- vision
|
|
@@ -10,16 +10,20 @@ language:
|
|
| 10 |
library_name: transformers
|
| 11 |
pipeline_tag: zero-shot-image-classification
|
| 12 |
widget:
|
| 13 |
-
- src:
|
|
|
|
| 14 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 15 |
example_title: Abdomen CT Scan
|
| 16 |
-
- src:
|
|
|
|
| 17 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 18 |
example_title: Chest X-Ray
|
| 19 |
-
- src:
|
|
|
|
| 20 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 21 |
example_title: MRI
|
| 22 |
-
- src:
|
|
|
|
| 23 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 24 |
example_title: Ultrasound
|
| 25 |
---
|
|
@@ -197,4 +201,17 @@ The following hyperparameters were used during training:
|
|
| 197 |
- Transformers 4.31.0.dev0
|
| 198 |
- Pytorch 2.0.1+cu117
|
| 199 |
- Datasets 2.13.1
|
| 200 |
-
- Tokenizers 0.13.3
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: gpl-3.0
|
| 3 |
tags:
|
| 4 |
- clip
|
| 5 |
- vision
|
|
|
|
| 10 |
library_name: transformers
|
| 11 |
pipeline_tag: zero-shot-image-classification
|
| 12 |
widget:
|
| 13 |
+
- src: >-
|
| 14 |
+
https://huggingface.co/spaces/kaveh/radiology-image-retrieval/resolve/main/images/ROCO_09402.jpg
|
| 15 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 16 |
example_title: Abdomen CT Scan
|
| 17 |
+
- src: >-
|
| 18 |
+
https://huggingface.co/spaces/kaveh/radiology-image-retrieval/resolve/main/images/ROCO_00319.jpg
|
| 19 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 20 |
example_title: Chest X-Ray
|
| 21 |
+
- src: >-
|
| 22 |
+
https://huggingface.co/spaces/kaveh/radiology-image-retrieval/resolve/main/images/ROCO_00016.jpg
|
| 23 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 24 |
example_title: MRI
|
| 25 |
+
- src: >-
|
| 26 |
+
https://huggingface.co/spaces/kaveh/radiology-image-retrieval/resolve/main/images/ROCO_02259.jpg
|
| 27 |
candidate_labels: Chest X-Ray, Brain MRI, Abdomen CT Scan, Ultrasound, OPG
|
| 28 |
example_title: Ultrasound
|
| 29 |
---
|
|
|
|
| 201 |
- Transformers 4.31.0.dev0
|
| 202 |
- Pytorch 2.0.1+cu117
|
| 203 |
- Datasets 2.13.1
|
| 204 |
+
- Tokenizers 0.13.3
|
| 205 |
+
|
| 206 |
+
# Citation
|
| 207 |
+
|
| 208 |
+
```bibtex
|
| 209 |
+
@misc{RCLIPmodel,
|
| 210 |
+
doi = {10.57967/HF/0896},
|
| 211 |
+
url = {https://huggingface.co/kaveh/rclip},
|
| 212 |
+
author = {{Kaveh Shahhosseini}},
|
| 213 |
+
title = {rclip},
|
| 214 |
+
publisher = {Hugging Face},
|
| 215 |
+
year = {2023}
|
| 216 |
+
}
|
| 217 |
+
```
|