Spaces:
Paused
Paused
Commit Β·
1f1f823
1
Parent(s): f29226d
docs: upgrade Multilingual Language Matrix with professional enterprise terminology and STT endpoints
Browse files
README.md
CHANGED
|
@@ -122,30 +122,30 @@ graph LR
|
|
| 122 |
|
| 123 |
---
|
| 124 |
|
| 125 |
-
## π Language
|
| 126 |
-
|
| 127 |
-
VECTOR
|
| 128 |
-
|
| 129 |
-
| Code | Language | Script Family |
|
| 130 |
-
| :--- | :--- | :--- | :---: | :--- | :--- |
|
| 131 |
-
| **`en`** | English | Latin (`Latn`) |
|
| 132 |
-
| **`hi`** | Hindi | Devanagari (`Deva`) |
|
| 133 |
-
| **`mr`** | Marathi | Devanagari (`Deva`) |
|
| 134 |
-
| **`as`** | Assamese | Bengali/Assamese (`Beng`) |
|
| 135 |
-
| **`bn`** | Bengali | Bengali (`Beng`) |
|
| 136 |
-
| **`gu`** | Gujarati | Gujarati (`Gujr`) |
|
| 137 |
-
| **`kn`** | Kannada | Kannada (`Knda`) |
|
| 138 |
-
| **`ml`** | Malayalam | Malayalam (`Mlym`) |
|
| 139 |
-
| **`ne`** | Nepali | Devanagari (`Deva`) |
|
| 140 |
-
| **`or`** | Odia | Odia (`Orya`) |
|
| 141 |
-
| **`pa`** | Punjabi | Gurmukhi (`Guru`) |
|
| 142 |
-
| **`sa`** | Sanskrit | Devanagari (`Deva`) |
|
| 143 |
-
| **`ta`** | Tamil | Tamil (`Taml`) |
|
| 144 |
-
| **`te`** | Telugu | Telugu (`Telu`) |
|
| 145 |
-
| **`ur`** | Urdu | Perso-Arabic (`Arab`) |
|
| 146 |
|
| 147 |
> [!NOTE]
|
| 148 |
-
> Active
|
| 149 |
|
| 150 |
---
|
| 151 |
|
|
|
|
| 122 |
|
| 123 |
---
|
| 124 |
|
| 125 |
+
## π Multilingual Indic Language Capability & Provisioning Matrix
|
| 126 |
+
|
| 127 |
+
VECTOR employs dynamic runtime configuration via `config.LANGUAGES` as the single source of truth for language federation. The engine provides zero-code hot-swappable expansion across **14 Indic languages** and **English** (~743,000 deduplicated passage records).
|
| 128 |
+
|
| 129 |
+
| ISO Code | Language Target | Script Family | STT Engine Endpoint | Runtime Provisioning Status | Corpus Benchmark Source | Deduplicated Passages |
|
| 130 |
+
| :---: | :--- | :--- | :---: | :---: | :--- | :---: |
|
| 131 |
+
| **`en`** | English | Latin (`Latn`) | `en-IN` | β‘ **Active In-Memory Index** | MS MARCO English Native Stream | 49,507 |
|
| 132 |
+
| **`hi`** | Hindi | Devanagari (`Deva`) | `hi-IN` | β‘ **Active In-Memory Index** | MS MARCO-XI (`hin`) Parquet Stream | 49,509 |
|
| 133 |
+
| **`mr`** | Marathi | Devanagari (`Deva`) | `mr-IN` | β‘ **Active In-Memory Index** | MS MARCO-XI (`mar`) Parquet Stream | 49,529 |
|
| 134 |
+
| **`as`** | Assamese | Bengali/Assamese (`Beng`) | `as-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`asm`) Parquet Stream | 49,550 |
|
| 135 |
+
| **`bn`** | Bengali | Bengali (`Beng`) | `bn-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`ben`) Parquet Stream | 49,531 |
|
| 136 |
+
| **`gu`** | Gujarati | Gujarati (`Gujr`) | `gu-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`guj`) Parquet Stream | 49,550 |
|
| 137 |
+
| **`kn`** | Kannada | Kannada (`Knda`) | `kn-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`kan`) Parquet Stream | 49,545 |
|
| 138 |
+
| **`ml`** | Malayalam | Malayalam (`Mlym`) | `ml-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`mal`) Parquet Stream | 49,542 |
|
| 139 |
+
| **`ne`** | Nepali | Devanagari (`Deva`) | `ne-NP` | π Zero-Code Hot-Swappable | MS MARCO-XI (`nep`) Parquet Stream | 49,520 |
|
| 140 |
+
| **`or`** | Odia | Odia (`Orya`) | `od-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`ori`) Parquet Stream | 49,560 |
|
| 141 |
+
| **`pa`** | Punjabi | Gurmukhi (`Guru`) | `pa-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`pan`) Parquet Stream | 49,534 |
|
| 142 |
+
| **`sa`** | Sanskrit | Devanagari (`Deva`) | `sa-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`san`) Parquet Stream | 49,633 |
|
| 143 |
+
| **`ta`** | Tamil | Tamil (`Taml`) | `ta-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`tam`) Parquet Stream | 49,581 |
|
| 144 |
+
| **`te`** | Telugu | Telugu (`Telu`) | `te-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`tel`) Parquet Stream | 49,604 |
|
| 145 |
+
| **`ur`** | Urdu | Perso-Arabic (`Arab`) | `ur-IN` | π Zero-Code Hot-Swappable | MS MARCO-XI (`urd`) Parquet Stream | 49,576 |
|
| 146 |
|
| 147 |
> [!NOTE]
|
| 148 |
+
> **Active Memory Allocation**: **148,545 Native Passage Vectors** + **309 LongDoc Chunks** = **148,854 Active Vectors** in FAISS HNSW graph memory. **Total Available Federated Corpus**: **~743,000 Deduplicated Passages**.
|
| 149 |
|
| 150 |
---
|
| 151 |
|