Spaces:
Running on Zero
Running on Zero
File size: 1,411 Bytes
4346a4c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | # Specific Object Recognition (Visual Embeddings)
## Overview
Pipeline 3 answers the crucial question: *"Is this the exact physical object I taught the platform previously?"* (e.g., distinguishing **"My Cup"** from generic *cups*).
```
Object Reference Crop βββΊ Vision Embedding Backbone βββΊ 512-dim L2 Vector
β
Query Frame Crop βββββββΊ Vision Embedding Backbone βββΊ Cosine Similarity (>= 0.65) βββΊ Match "My Cup"
```
## How Teaching Works
1. **Name & Metadata**: User inputs unique object name (e.g. *My Coffee Mug*).
2. **Reference Photos**: User uploads 3-10 reference photos from various angles and lighting.
3. **Feature Extraction**: Deep PyTorch vision backbone extracts normalized vector embeddings.
4. **Vector Persistence**: Embeddings stored in SQLite object database (`objects.db`).
5. **Real-time Recognition**: Detected bounding box crops are continuously compared against stored embeddings.
## Code Example
```python
from object_intelligence import ObjectDetector
detector = ObjectDetector()
# Teach new object
detector.add_object(
name="My Blue Mug",
images=["mug_side.jpg", "mug_front.jpg"],
category="Drinkware",
description="Personal ceramic mug with handle"
)
# Run specific object recognition
detector.set_mode("specific")
detections = detector.detect(frame)
```
|