Instructions to use RioJune/AG-KD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use RioJune/AG-KD with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("zero-shot-object-detection", model="RioJune/AG-KD", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("RioJune/AG-KD", trust_remote_code=True) model = AutoModelForMultimodalLM.from_pretrained("RioJune/AG-KD", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload merged model and processor
Browse files
README.md
CHANGED
|
@@ -100,3 +100,17 @@ if __name__ == "__main__":
|
|
| 100 |
|
| 101 |
run_simple(image_url, target, definition, model, processor, device)
|
| 102 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 100 |
|
| 101 |
run_simple(image_url, target, definition, model, processor, device)
|
| 102 |
```
|
| 103 |
+
|
| 104 |
+
|
| 105 |
+
## 📖 Citation
|
| 106 |
+
|
| 107 |
+
If you use our work, please cite:
|
| 108 |
+
|
| 109 |
+
```
|
| 110 |
+
@article{li2025enhancing,
|
| 111 |
+
title={Enhancing Abnormality Grounding for Vision Language Models with Knowledge Descriptions},
|
| 112 |
+
author={Li, J. and Liu, C. and Bai, W. and Arcucci, R. and Bercea, C. I. and Schnabel, J. A.},
|
| 113 |
+
journal={arXiv preprint arXiv:2503.03278},
|
| 114 |
+
year={2025}
|
| 115 |
+
}
|
| 116 |
+
```
|