JMullings commited on
Commit
a8cb5c0
·
verified ·
1 Parent(s): fd627ee

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +24 -8
README.md CHANGED
@@ -149,16 +149,32 @@ print(f"sim(Anchor, Paraphrase) = {sim_paraphrase:.4f}")
149
  print(f"sim(Anchor, Unrelated) = {sim_unrelated:.4f}")
150
  ```
151
 
152
- ---
153
-
154
  ## 📐 Architecture & Principles
155
 
156
- 1. **Multiscale Manifold Representation:** Text is lifted into a high-dimensional subword coordinate space that captures character-level roots, word identity, and compositional syntax without tokenization overhead.
157
- 2. **Spectral Subspace Compression:** A pre-distilled linear projection maps sparse text representations into the principal semantic directions of the teacher model:
158
- $$z = W x + b, \qquad W \in \mathbb{R}^{60 \times 16384}$$
159
- 3. **Hyperspherical Normalization:** Embeddings are constrained to the unit sphere $\mathbb{S}^{59}$:
160
- $$\hat{z} = \frac{z}{\lVert z \rVert_{2}}$$
161
- 4. **Calibrated Metric Space:** Semantic distances are decoded through an anisotropic metric tensor $M$ optimized for fine-grained semantic discrimination.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
162
 
163
  ---
164
 
 
149
  print(f"sim(Anchor, Unrelated) = {sim_unrelated:.4f}")
150
  ```
151
 
 
 
152
  ## 📐 Architecture & Principles
153
 
154
+ ### 1. Multiscale Manifold Representation
155
+ Text is deterministically lifted into a high-dimensional subword coordinate space that captures character-level roots, word identity, and compositional syntax without tokenization overhead.
156
+
157
+ ### 2. Spectral Subspace Compression
158
+ A pre-distilled linear projection maps sparse text representations into the principal semantic directions of the teacher model:
159
+
160
+ $$
161
+ z = W x + b, \qquad W \in \mathbb{R}^{60 \times 16384}
162
+ $$
163
+
164
+ ### 3. Hyperspherical Normalization
165
+ Embeddings are constrained to the 59-dimensional unit hypersphere $\mathbb{S}^{59}$:
166
+
167
+ $$
168
+ \hat{z} = \frac{z}{\|z\|_2}
169
+ $$
170
+
171
+ ### 4. Calibrated Metric Space
172
+ Semantic distances are decoded through an anisotropic metric tensor $M$ optimized for fine-grained semantic discrimination:
173
+
174
+ $$
175
+ \mathcal{D}(a, b) = \exp\left(-\sqrt{\sum_{k=1}^{60} M_{kk} (a_k - b_k)^2}\right)
176
+ $$
177
+
178
 
179
  ---
180