Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -149,16 +149,32 @@ print(f"sim(Anchor, Paraphrase) = {sim_paraphrase:.4f}")
|
|
| 149 |
print(f"sim(Anchor, Unrelated) = {sim_unrelated:.4f}")
|
| 150 |
```
|
| 151 |
|
| 152 |
-
---
|
| 153 |
-
|
| 154 |
## 📐 Architecture & Principles
|
| 155 |
|
| 156 |
-
1.
|
| 157 |
-
|
| 158 |
-
|
| 159 |
-
|
| 160 |
-
|
| 161 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 162 |
|
| 163 |
---
|
| 164 |
|
|
|
|
| 149 |
print(f"sim(Anchor, Unrelated) = {sim_unrelated:.4f}")
|
| 150 |
```
|
| 151 |
|
|
|
|
|
|
|
| 152 |
## 📐 Architecture & Principles
|
| 153 |
|
| 154 |
+
### 1. Multiscale Manifold Representation
|
| 155 |
+
Text is deterministically lifted into a high-dimensional subword coordinate space that captures character-level roots, word identity, and compositional syntax without tokenization overhead.
|
| 156 |
+
|
| 157 |
+
### 2. Spectral Subspace Compression
|
| 158 |
+
A pre-distilled linear projection maps sparse text representations into the principal semantic directions of the teacher model:
|
| 159 |
+
|
| 160 |
+
$$
|
| 161 |
+
z = W x + b, \qquad W \in \mathbb{R}^{60 \times 16384}
|
| 162 |
+
$$
|
| 163 |
+
|
| 164 |
+
### 3. Hyperspherical Normalization
|
| 165 |
+
Embeddings are constrained to the 59-dimensional unit hypersphere $\mathbb{S}^{59}$:
|
| 166 |
+
|
| 167 |
+
$$
|
| 168 |
+
\hat{z} = \frac{z}{\|z\|_2}
|
| 169 |
+
$$
|
| 170 |
+
|
| 171 |
+
### 4. Calibrated Metric Space
|
| 172 |
+
Semantic distances are decoded through an anisotropic metric tensor $M$ optimized for fine-grained semantic discrimination:
|
| 173 |
+
|
| 174 |
+
$$
|
| 175 |
+
\mathcal{D}(a, b) = \exp\left(-\sqrt{\sum_{k=1}^{60} M_{kk} (a_k - b_k)^2}\right)
|
| 176 |
+
$$
|
| 177 |
+
|
| 178 |
|
| 179 |
---
|
| 180 |
|