Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,260 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
<div align="center">
|
| 3 |
+
|
| 4 |
+
# 🌍 SamyamLM
|
| 5 |
+
|
| 6 |
+
## Satellite-Based Multimodal Data Labeling for Indian Language AI
|
| 7 |
+
|
| 8 |
+
**Scale AI for India — 59% faster, 100% native Hindi support**
|
| 9 |
+
|
| 10 |
+
[](LICENSE)
|
| 11 |
+
[](https://www.makeinindia.com)
|
| 12 |
+
[](https://www.python.org)
|
| 13 |
+
[](https://pytorch.org)
|
| 14 |
+
|
| 15 |
+
</div>
|
| 16 |
+
|
| 17 |
---
|
| 18 |
+
|
| 19 |
+
## 📖 What is SamyamLM?
|
| 20 |
+
|
| 21 |
+
SamyamLM is a data labeling platform built specifically for Indian languages and Indian geography. It helps create training data for AI models using satellite images, road cameras, and Hindi text.
|
| 22 |
+
|
| 23 |
+
### The Name
|
| 24 |
+
|
| 25 |
+
- **Samyam** (संयम) = Discipline and control in Sanskrit
|
| 26 |
+
- **LM** = Language Model
|
| 27 |
+
|
| 28 |
+
So SamyamLM means disciplined, high-quality data labeling for AI systems in India.
|
| 29 |
+
|
| 30 |
+
### What Problem Does It Solve?
|
| 31 |
+
|
| 32 |
+
Most AI labeling companies like Scale AI, Labelbox, and Appen were built for Western countries. They don't work well for India because:
|
| 33 |
+
|
| 34 |
+
1. They don't support Hindi or other Indian scripts
|
| 35 |
+
2. They don't understand Indian road conditions (auto-rickshaws, cattle, potholes)
|
| 36 |
+
3. They can't process satellite images of Indian geography
|
| 37 |
+
4. They fail in Indian weather (monsoon, dust, night driving)
|
| 38 |
+
|
| 39 |
+
### How Does SamyamLM Work?
|
| 40 |
+
|
| 41 |
+
The platform has six parts that work together:
|
| 42 |
+
|
| 43 |
+
| Part | What It Does |
|
| 44 |
+
|------|---------------|
|
| 45 |
+
| Satellite Imagery | Takes pictures from ISRO satellites (5m to 30m resolution) |
|
| 46 |
+
| Ground Cameras | Records video from cameras on Indian roads |
|
| 47 |
+
| Hindi Text | Reads and understands Hindi language inputs |
|
| 48 |
+
| AI Pre-labeling | Does 58% of the work automatically using AI models |
|
| 49 |
+
| Human Review | Lets people check and fix labels using Hindi keyboard |
|
| 50 |
+
| Quality Check | Runs 3 tests to ensure labels are correct |
|
| 51 |
+
|
| 52 |
+
### What Makes It Different?
|
| 53 |
+
|
| 54 |
+
SamyamLM can detect 47 objects that other platforms miss completely:
|
| 55 |
+
|
| 56 |
+
- Auto-rickshaws, cycle-rickshaws, tractors, bullock carts
|
| 57 |
+
- Cattle, stray dogs, buffalo, camels, elephants
|
| 58 |
+
- Kutcha roads, potholes, speed breakers
|
| 59 |
+
- Monsoon rain, dust haze, night driving conditions
|
| 60 |
+
|
| 61 |
+
### How Well Does It Perform?
|
| 62 |
+
|
| 63 |
+
Compared to Scale AI (the industry leader):
|
| 64 |
+
|
| 65 |
+
- **59% faster** annotation speed
|
| 66 |
+
- **15.6% better** at answering Hindi questions about images
|
| 67 |
+
- **19.7% better** at detecting Indian road objects
|
| 68 |
+
- **58% cheaper** per label
|
| 69 |
+
|
| 70 |
+
### Who Is It For?
|
| 71 |
+
|
| 72 |
+
- Self-driving car companies working on Indian roads
|
| 73 |
+
- AI companies that want Hindi language models
|
| 74 |
+
- Government agencies doing disaster response or crop monitoring
|
| 75 |
+
- Satellite imaging companies
|
| 76 |
+
|
| 77 |
+
### What Has Been Built So Far?
|
| 78 |
+
|
| 79 |
+
The current version includes:
|
| 80 |
+
- 275,000 labeled samples
|
| 81 |
+
- 4.5 million individual annotations
|
| 82 |
+
- A working web interface in Hindi
|
| 83 |
+
- Open source code on GitHub
|
| 84 |
+
|
| 85 |
+
### What's Next?
|
| 86 |
+
|
| 87 |
+
- Support for all 22 Indian languages
|
| 88 |
+
- Real-time satellite data processing
|
| 89 |
+
- API for companies to use
|
| 90 |
+
- Expansion to other countries like Indonesia and Nigeria
|
| 91 |
+
|
| 92 |
+
### The Big Picture
|
| 93 |
+
|
| 94 |
+
SamyamLM's goal is simple: make AI that actually understands India. Not as an afterthought, but built from the ground up for Indian languages, Indian roads, Indian weather, and Indian geography.
|
| 95 |
+
|
| 96 |
+
**SamyamLM** is the world's first satellite-based multimodal data labeling platform built specifically for Indian languages and geographies.
|
| 97 |
+
|
| 98 |
+
### The Name
|
| 99 |
+
|
| 100 |
+
**Samyam** (संयम) = Discipline + Control in Sanskrit
|
| 101 |
+
**LM** = Language Model
|
| 102 |
+
|
| 103 |
+
Together, **SamyamLM** represents disciplined, controlled, and high-quality data labeling for AI systems serving India.
|
| 104 |
+
|
| 105 |
+
### What Does It Do?
|
| 106 |
+
|
| 107 |
+
SamyamLM helps companies and researchers create training data for AI models by combining:
|
| 108 |
+
|
| 109 |
+
| Component | What It Does |
|
| 110 |
+
|-----------|---------------|
|
| 111 |
+
| 🛰️ **Satellite Imagery** | Processes ISRO and commercial satellite feeds (5m-30m resolution) |
|
| 112 |
+
| 📷 **Ground Cameras** | Analyzes dashcam footage from Indian roads |
|
| 113 |
+
| 📝 **Hindi Text** | Understands and annotates Hindi and other Indic languages |
|
| 114 |
+
| 🤖 **AI Pre-labeling** | Reduces human effort by 58% using CLIP-based models |
|
| 115 |
+
| 👨💻 **Human Review** | Hindi-first interface with Devanagari keyboard |
|
| 116 |
+
| ✅ **Quality Assurance** | 3-stage QA with Cohen's κ > 0.75 |
|
| 117 |
+
|
| 118 |
+
### Why SamyamLM?
|
| 119 |
+
|
| 120 |
+
Most AI labeling platforms are built for English and Western data. They don't understand:
|
| 121 |
+
- Hindi sentences and grammar
|
| 122 |
+
- Indian road conditions (auto-rickshaws, cattle, potholes)
|
| 123 |
+
- Satellite imagery for Indian geography
|
| 124 |
+
- Monsoon, dust haze, and night driving in India
|
| 125 |
+
|
| 126 |
+
**SamyamLM fixes all of this.** It's AI training data that actually understands India.
|
| 127 |
+
|
| 128 |
---
|
| 129 |
+
|
| 130 |
+
## 📊 Key Results at a Glance
|
| 131 |
+
|
| 132 |
+
| Metric | SamyamLM | Industry Average | Improvement |
|
| 133 |
+
|--------|----------|------------------|-------------|
|
| 134 |
+
| Annotation Throughput | 510 labels/hour | 320 labels/hour | **+59%** |
|
| 135 |
+
| Hindi VQA Accuracy | 67.4% | 51.8% | **+15.6%** |
|
| 136 |
+
| India-Specific Object Detection | 58.3% mAP | 38.6% mAP | **+19.7%** |
|
| 137 |
+
| Cost per Label | $0.12 | $0.29 | **-58%** |
|
| 138 |
+
|
| 139 |
+
---
|
| 140 |
+
|
| 141 |
+
## 🎯 The Problem
|
| 142 |
+
|
| 143 |
+
**Global AI training data ignores 1.4 billion Indian voices.**
|
| 144 |
+
|
| 145 |
+
Existing platforms like Scale AI, Labelbox, and Appen were built for Western markets:
|
| 146 |
+
|
| 147 |
+
| Limitation | Consequence |
|
| 148 |
+
|------------|-------------|
|
| 149 |
+
| No Indic script support | Cannot annotate in Hindi, Tamil, Telugu, Bengali |
|
| 150 |
+
| No Indian semantic understanding | Models fail on cultural context |
|
| 151 |
+
| No satellite geospatial integration | Disaster response AI is blind |
|
| 152 |
+
| No Indian road objects | Self-driving cars miss auto-rickshaws and cattle |
|
| 153 |
+
|
| 154 |
+
**The result:** AI models that work perfectly in San Francisco but fail in Mumbai, Delhi, and Chennai.
|
| 155 |
+
|
| 156 |
+
---
|
| 157 |
+
|
| 158 |
+
## 🚀 The Solution
|
| 159 |
+
|
| 160 |
+
SamyamLM is the first data labeling platform purpose-built for India's linguistic and geographic diversity.
|
| 161 |
+
|
| 162 |
+
### Comparison with Existing Platforms
|
| 163 |
+
|
| 164 |
+
| Feature | Scale AI | Labelbox | Appen | SamyamLM |
|
| 165 |
+
|---------|----------|----------|-------|----------|
|
| 166 |
+
| Hindi Language Support | ❌ | ❌ | Partial | ✅ Native |
|
| 167 |
+
| Devanagari Script UI | ❌ | ❌ | ❌ | ✅ Yes |
|
| 168 |
+
| Satellite Imagery Input | ❌ | ❌ | ❌ | ✅ Yes |
|
| 169 |
+
| India-Specific Objects | ❌ | ❌ | ❌ | ✅ 47 classes |
|
| 170 |
+
| Indian Road Conditions | ❌ | ❌ | ❌ | ✅ Yes |
|
| 171 |
+
| Adverse Weather (Monsoon) | ❌ | ❌ | ❌ | ✅ Yes |
|
| 172 |
+
| Cost per Label | $0.29 | $0.27 | $0.25 | $0.12 |
|
| 173 |
+
|
| 174 |
+
---
|
| 175 |
+
|
| 176 |
+
## 📊 Benchmark Results
|
| 177 |
+
|
| 178 |
+
### Hindi Visual Question Answering (IndicVQA Benchmark)
|
| 179 |
+
|
| 180 |
+
| Model | Accuracy |
|
| 181 |
+
|-------|----------|
|
| 182 |
+
| SamyamLM-VL (ours) | **67.4%** |
|
| 183 |
+
| MuRIL-VL | 51.8% |
|
| 184 |
+
| Flamingo-9B | 34.1% |
|
| 185 |
+
| CLIP (zero-shot) | 28.7% |
|
| 186 |
+
|
| 187 |
+
**SamyamLM improvement: +15.6% over best baseline**
|
| 188 |
+
|
| 189 |
+
### Indian Road Object Detection (mAP@0.5)
|
| 190 |
+
|
| 191 |
+
| Model | mAP |
|
| 192 |
+
|-------|-----|
|
| 193 |
+
| SamyamLM fine-tuned (ours) | **58.3%** |
|
| 194 |
+
| Scale AI fine-tuned | 38.6% |
|
| 195 |
+
| YOLOv8 (COCO) | 31.2% |
|
| 196 |
+
|
| 197 |
+
**SamyamLM improvement: +19.7% over Scale AI on India-specific classes**
|
| 198 |
+
|
| 199 |
+
### Annotation Throughput (labels per hour)
|
| 200 |
+
|
| 201 |
+
| Platform | Labels/Hour |
|
| 202 |
+
|----------|-------------|
|
| 203 |
+
| SamyamLM (ours) | **510** |
|
| 204 |
+
| Scale AI | 320 |
|
| 205 |
+
| Labelbox | 280 |
|
| 206 |
+
| Appen | 260 |
|
| 207 |
+
|
| 208 |
+
**SamyamLM advantage: 59% faster than Scale AI**
|
| 209 |
+
|
| 210 |
+
---
|
| 211 |
+
|
| 212 |
+
## 🛰️ India-Specific Object Classes (47)
|
| 213 |
+
|
| 214 |
+
SamyamLM detects objects that other platforms completely miss:
|
| 215 |
+
|
| 216 |
+
| Category | Examples |
|
| 217 |
+
|----------|----------|
|
| 218 |
+
| **Vehicles** | Auto-rickshaw (ऑटो-रिक्शा), Cycle-rickshaw (साइकिल-रिक्शा), Tractor (ट्रैक्टर), Tempo (टेंपो), Bullock cart (बैलगाड़ी) |
|
| 219 |
+
| **Animals** | Cattle (मवेशी), Stray dog (आवारा कुत्ता), Buffalo (भैंस), Camel (ऊंट), Elephant (हाथी) |
|
| 220 |
+
| **Road Conditions** | Kutcha road (कच्ची सड़क), Pothole (गड्ढा), Speed breaker (स्पीड ब्रेकर), Missing signage (गायब साइनेज) |
|
| 221 |
+
| **Adverse Weather** | Monsoon rain (मानसून बारिश), Dust haze (धूल भरी आंधी), Night driving (रात में ड्राइविंग), Dense fog (घना कोहरा) |
|
| 222 |
+
|
| 223 |
+
---
|
| 224 |
+
|
| 225 |
+
## 📁 Dataset v1.0 Statistics
|
| 226 |
+
|
| 227 |
+
| Split | Modality | Samples | Annotated Labels |
|
| 228 |
+
|-------|----------|---------|------------------|
|
| 229 |
+
| Train | Satellite | 120,000 | 1,840,000 |
|
| 230 |
+
| Val | Satellite | 15,000 | 230,000 |
|
| 231 |
+
| Train | Ground Driving | 80,000 | 2,100,000 |
|
| 232 |
+
| Val | Ground Driving | 10,000 | 260,000 |
|
| 233 |
+
| Train | Hindi VQA | 45,000 | 90,000 |
|
| 234 |
+
| Val | Hindi VQA | 5,000 | 10,000 |
|
| 235 |
+
| **Total** | **All** | **275,000** | **4,530,000** |
|
| 236 |
+
|
| 237 |
+
---
|
| 238 |
+
|
| 239 |
+
## 🏗️ Technology Stack
|
| 240 |
+
|
| 241 |
+
| Layer | Technologies |
|
| 242 |
+
|-------|--------------|
|
| 243 |
+
| Vision-Language Model | CLIP (ViT-B/32), Fine-tuned checkpoint |
|
| 244 |
+
| Deep Learning | PyTorch 2.0+, HuggingFace Transformers |
|
| 245 |
+
| Geospatial | GDAL, Rasterio, ISRO Resourcesat-2A API |
|
| 246 |
+
| Backend | FastAPI, PostgreSQL, Redis |
|
| 247 |
+
| Frontend | React, Devanagari keyboard integration |
|
| 248 |
+
| Infrastructure | AWS S3, EC2, CloudFront |
|
| 249 |
+
|
| 250 |
+
### Code Example
|
| 251 |
+
|
| 252 |
+
```python
|
| 253 |
+
# Initialize SamyamLM annotator
|
| 254 |
+
from samyamlm import CLIPAnnotator
|
| 255 |
+
|
| 256 |
+
annotator = CLIPAnnotator(model_name="ViT-B/32")
|
| 257 |
+
|
| 258 |
+
# Detect India-specific objects
|
| 259 |
+
image = Image.open("delhi_street.jpg")
|
| 260 |
+
detections = annotator.detect_objects(image)
|