Delecte README.md
Browse files
README.md
DELETED
|
@@ -1,42 +0,0 @@
|
|
| 1 |
-
---
|
| 2 |
-
title: VisualRAG
|
| 3 |
-
emoji: π
|
| 4 |
-
colorFrom: purple
|
| 5 |
-
colorTo: green
|
| 6 |
-
sdk: gradio
|
| 7 |
-
sdk_version: 4.44.1
|
| 8 |
-
python_version: "3.10"
|
| 9 |
-
app_file: app.py
|
| 10 |
-
pinned: false
|
| 11 |
-
license: mit
|
| 12 |
-
---
|
| 13 |
-
|
| 14 |
-
# π VisualRAG β Multi-Modal AI System
|
| 15 |
-
|
| 16 |
-
A production-grade **Retrieval-Augmented Generation (RAG)** system that combines computer vision and natural language understanding in a single pipeline.
|
| 17 |
-
|
| 18 |
-
## π§ Pipeline
|
| 19 |
-
|
| 20 |
-
**Index:** `Image β YOLOv8 detection β CLIP ViT-B/32 embedding β FAISS vector store`
|
| 21 |
-
**Query:** `Text β CLIP text embedding β cosine k-NN β Zephyr-7B answer generation`
|
| 22 |
-
|
| 23 |
-
## π Tech Stack
|
| 24 |
-
|
| 25 |
-
| Component | Technology |
|
| 26 |
-
|---|---|
|
| 27 |
-
| Object Detection | YOLOv8n (Ultralytics) |
|
| 28 |
-
| Visual Embedding | CLIP ViT-B/32 (OpenAI) |
|
| 29 |
-
| Vector Index | FAISS IndexFlatIP |
|
| 30 |
-
| LLM | Zephyr-7B-Ξ² (HF Serverless API) |
|
| 31 |
-
| UI | Gradio 4.44.1 |
|
| 32 |
-
|
| 33 |
-
## π How to Use
|
| 34 |
-
|
| 35 |
-
1. **Detect & Index tab** β Upload images. YOLOv8 detects objects and CLIP stores 512-d embeddings in FAISS
|
| 36 |
-
2. **Query (RAG) tab** β Ask any natural language question; CLIP retrieves relevant images, Zephyr-7B answers
|
| 37 |
-
3. **How it works tab** β Full system architecture and changelog
|
| 38 |
-
|
| 39 |
-
## π Optional: HF Token
|
| 40 |
-
|
| 41 |
-
Add a `HF_TOKEN` Space secret for higher LLM API rate limits
|
| 42 |
-
(Settings β Variables and secrets β New secret β Name: `HF_TOKEN`)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|