Spaces:
Paused
Paused
Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,7 @@ One implementation detail worth noting: `e5-small-v2` is an asymmetric retrieval
|
|
| 35 |
|
| 36 |
**Observations:**
|
| 37 |
|
| 38 |
-
* **Speed:** `all-MiniLM-L6-v2` was by far the fastest (
|
| 39 |
* **Semantic separability:** all three silhouette scores were slightly negative β expected, since interview categories share a great deal of vocabulary and overlap heavily in meaning β but `e5-small-v2` scored best (β0.033), ahead of `bge-small-en-v1.5` (β0.040) and `all-MiniLM-L6-v2` (β0.046).
|
| 40 |
* **Retrieval:** `e5-small-v2` won on all three metrics: Precision@1 = 0.18, Precision@5 = 0.16, MRR = 0.30. Interestingly, `all-MiniLM-L6-v2` came second (P@1 = 0.16, MRR = 0.28) and `bge-small-en-v1.5` last (P@1 = 0.15, MRR = 0.26), so raw model size was not the deciding factor. For context, these are strict proxy metrics β a match counts only if the retrieved question shares the exact category β and with 16 categories a random ranker would score P@1 β 0.06, so the winner performs roughly 3Γ better than chance.
|
| 41 |
|
|
|
|
| 35 |
|
| 36 |
**Observations:**
|
| 37 |
|
| 38 |
+
* **Speed:** `all-MiniLM-L6-v2` was by far the fastest (28s for 2,500 questions), while `e5-small-v2` was the slowest (84s, roughly 3Γ longer).
|
| 39 |
* **Semantic separability:** all three silhouette scores were slightly negative β expected, since interview categories share a great deal of vocabulary and overlap heavily in meaning β but `e5-small-v2` scored best (β0.033), ahead of `bge-small-en-v1.5` (β0.040) and `all-MiniLM-L6-v2` (β0.046).
|
| 40 |
* **Retrieval:** `e5-small-v2` won on all three metrics: Precision@1 = 0.18, Precision@5 = 0.16, MRR = 0.30. Interestingly, `all-MiniLM-L6-v2` came second (P@1 = 0.16, MRR = 0.28) and `bge-small-en-v1.5` last (P@1 = 0.15, MRR = 0.26), so raw model size was not the deciding factor. For context, these are strict proxy metrics β a match counts only if the retrieved question shares the exact category β and with 16 categories a random ranker would score P@1 β 0.06, so the winner performs roughly 3Γ better than chance.
|
| 41 |
|