emrevrg commited on
Commit
b32f2b0
·
verified ·
1 Parent(s): 0255475

Ad: Nythos Embed Zero

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -6,15 +6,15 @@ pipeline_tag: sentence-similarity
6
  tags: [sentence-transformers, embedding, multilingual, turkish, retrieval, audio, image, norovox]
7
  ---
8
 
9
- # Mnemos
10
 
11
- Mnemos is a multilingual embedding model from Norovox Labs, from our open-base line (its own-architecture counterpart is Norovox Embed Zero). It covers text, Turkish, retrieval, classification, clustering, audio and images, and is built on EmbeddingGemma 2. The text path has 271M parameters.
12
 
13
  > Every number below was measured by us under one protocol: fp32, the same prompts, and the same test sets for both models. Each test set was run once, after model selection on separate development sets.
14
 
15
  ## Results vs. EmbeddingGemma 2: ahead on 20 of 22 measures, tied on 1, behind on 1
16
 
17
- | Test | EmbeddingGemma 2 | Mnemos |
18
  |---|---|---|
19
  | STS-B (English similarity, Spearman) | .8749 | **.8865** |
20
  | STS-TR (Turkish similarity, Spearman) | .7863 | **.8091** |
@@ -33,7 +33,7 @@ Paired bootstrap per query, 95% interval of the difference:
33
 
34
  ### Classification (logistic regression on embeddings) and clustering (V-measure): ahead on 8 of 8
35
 
36
- | Task | EmbeddingGemma 2 | Mnemos |
37
  |---|---|---|
38
  | Banking77 | .9293 | **.9357** |
39
  | Emotion | .7009 | **.7190** |
@@ -56,7 +56,7 @@ The only measure where it is behind: image→text R@5 is .999 vs 1.000, i.e. one
56
  | NFCorpus | .3608 | **.3878** | .3432 | **.3793** |
57
 
58
  ### Against larger open embedding models (same five text tests, each with its own prompts; previous text mixture, α = 0.6)
59
- | Test | Mnemos (271M) | Qwen3-Embedding-0.6B (596M) | multilingual-e5-large-instruct (560M) | BGE-M3 (568M) |
60
  |---|---|---|---|---|
61
  | STS-B | .8873 | **.9113** | .8838 | .8485 |
62
  | STS-TR | .8067 | .7501 | **.8296** | .7978 |
@@ -76,7 +76,7 @@ Kapsül is our inference layer on top of vLLM (pooling runner, bf16, length-awar
76
 
77
  ```python
78
  from vllm import LLM
79
- llm = LLM(model="emrevrg/Mnemos", runner="pooling", dtype="bfloat16")
80
  docs = ["title: none | text: " + d for d in documents] # same prompt as prompt_name="Document"
81
  vectors = [o.outputs.embedding for o in llm.embed(docs)]
82
  ```
@@ -95,7 +95,7 @@ What we tried and dropped: a 12-layer shallow document encoder distilled from th
95
  ## Usage
96
  ```python
97
  from sentence_transformers import SentenceTransformer
98
- m = SentenceTransformer("emrevrg/Mnemos")
99
  q = m.encode(["What is the longest river in Turkey?"], prompt_name="SearchQuery")
100
  d = m.encode(["The Kızılırmak, at 1,355 km, is the longest river in Turkey."], prompt_name="Document")
101
  print(q @ d.T)
 
6
  tags: [sentence-transformers, embedding, multilingual, turkish, retrieval, audio, image, norovox]
7
  ---
8
 
9
+ # Nythos Embed Zero
10
 
11
+ Nythos Embed Zero is a multilingual embedding model from Norovox Labs, from the Nythos open-base line (its own-architecture counterpart is Norovox Embed Zero). It covers text, Turkish, retrieval, classification, clustering, audio and images, and is built on EmbeddingGemma 2. The text path has 271M parameters.
12
 
13
  > Every number below was measured by us under one protocol: fp32, the same prompts, and the same test sets for both models. Each test set was run once, after model selection on separate development sets.
14
 
15
  ## Results vs. EmbeddingGemma 2: ahead on 20 of 22 measures, tied on 1, behind on 1
16
 
17
+ | Test | EmbeddingGemma 2 | Nythos Embed Zero |
18
  |---|---|---|
19
  | STS-B (English similarity, Spearman) | .8749 | **.8865** |
20
  | STS-TR (Turkish similarity, Spearman) | .7863 | **.8091** |
 
33
 
34
  ### Classification (logistic regression on embeddings) and clustering (V-measure): ahead on 8 of 8
35
 
36
+ | Task | EmbeddingGemma 2 | Nythos Embed Zero |
37
  |---|---|---|
38
  | Banking77 | .9293 | **.9357** |
39
  | Emotion | .7009 | **.7190** |
 
56
  | NFCorpus | .3608 | **.3878** | .3432 | **.3793** |
57
 
58
  ### Against larger open embedding models (same five text tests, each with its own prompts; previous text mixture, α = 0.6)
59
+ | Test | Nythos Embed Zero (271M) | Qwen3-Embedding-0.6B (596M) | multilingual-e5-large-instruct (560M) | BGE-M3 (568M) |
60
  |---|---|---|---|---|
61
  | STS-B | .8873 | **.9113** | .8838 | .8485 |
62
  | STS-TR | .8067 | .7501 | **.8296** | .7978 |
 
76
 
77
  ```python
78
  from vllm import LLM
79
+ llm = LLM(model="emrevrg/Nythos-Embed-Zero", runner="pooling", dtype="bfloat16")
80
  docs = ["title: none | text: " + d for d in documents] # same prompt as prompt_name="Document"
81
  vectors = [o.outputs.embedding for o in llm.embed(docs)]
82
  ```
 
95
  ## Usage
96
  ```python
97
  from sentence_transformers import SentenceTransformer
98
+ m = SentenceTransformer("emrevrg/Nythos-Embed-Zero")
99
  q = m.encode(["What is the longest river in Turkey?"], prompt_name="SearchQuery")
100
  d = m.encode(["The Kızılırmak, at 1,355 km, is the longest river in Turkey."], prompt_name="Document")
101
  print(q @ d.T)