Sentence Similarity
sentence-transformers
Safetensors
embedding_gemma2
embedding
multilingual
turkish
retrieval
audio
image
norovox
Instructions to use emrevrg/Nythos-Embed-Zero with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use emrevrg/Nythos-Embed-Zero with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("emrevrg/Nythos-Embed-Zero") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Ad: Nythos Embed Zero
Browse files
README.md
CHANGED
|
@@ -6,15 +6,15 @@ pipeline_tag: sentence-similarity
|
|
| 6 |
tags: [sentence-transformers, embedding, multilingual, turkish, retrieval, audio, image, norovox]
|
| 7 |
---
|
| 8 |
|
| 9 |
-
#
|
| 10 |
|
| 11 |
-
|
| 12 |
|
| 13 |
> Every number below was measured by us under one protocol: fp32, the same prompts, and the same test sets for both models. Each test set was run once, after model selection on separate development sets.
|
| 14 |
|
| 15 |
## Results vs. EmbeddingGemma 2: ahead on 20 of 22 measures, tied on 1, behind on 1
|
| 16 |
|
| 17 |
-
| Test | EmbeddingGemma 2 |
|
| 18 |
|---|---|---|
|
| 19 |
| STS-B (English similarity, Spearman) | .8749 | **.8865** |
|
| 20 |
| STS-TR (Turkish similarity, Spearman) | .7863 | **.8091** |
|
|
@@ -33,7 +33,7 @@ Paired bootstrap per query, 95% interval of the difference:
|
|
| 33 |
|
| 34 |
### Classification (logistic regression on embeddings) and clustering (V-measure): ahead on 8 of 8
|
| 35 |
|
| 36 |
-
| Task | EmbeddingGemma 2 |
|
| 37 |
|---|---|---|
|
| 38 |
| Banking77 | .9293 | **.9357** |
|
| 39 |
| Emotion | .7009 | **.7190** |
|
|
@@ -56,7 +56,7 @@ The only measure where it is behind: image→text R@5 is .999 vs 1.000, i.e. one
|
|
| 56 |
| NFCorpus | .3608 | **.3878** | .3432 | **.3793** |
|
| 57 |
|
| 58 |
### Against larger open embedding models (same five text tests, each with its own prompts; previous text mixture, α = 0.6)
|
| 59 |
-
| Test |
|
| 60 |
|---|---|---|---|---|
|
| 61 |
| STS-B | .8873 | **.9113** | .8838 | .8485 |
|
| 62 |
| STS-TR | .8067 | .7501 | **.8296** | .7978 |
|
|
@@ -76,7 +76,7 @@ Kapsül is our inference layer on top of vLLM (pooling runner, bf16, length-awar
|
|
| 76 |
|
| 77 |
```python
|
| 78 |
from vllm import LLM
|
| 79 |
-
llm = LLM(model="emrevrg/
|
| 80 |
docs = ["title: none | text: " + d for d in documents] # same prompt as prompt_name="Document"
|
| 81 |
vectors = [o.outputs.embedding for o in llm.embed(docs)]
|
| 82 |
```
|
|
@@ -95,7 +95,7 @@ What we tried and dropped: a 12-layer shallow document encoder distilled from th
|
|
| 95 |
## Usage
|
| 96 |
```python
|
| 97 |
from sentence_transformers import SentenceTransformer
|
| 98 |
-
m = SentenceTransformer("emrevrg/
|
| 99 |
q = m.encode(["What is the longest river in Turkey?"], prompt_name="SearchQuery")
|
| 100 |
d = m.encode(["The Kızılırmak, at 1,355 km, is the longest river in Turkey."], prompt_name="Document")
|
| 101 |
print(q @ d.T)
|
|
|
|
| 6 |
tags: [sentence-transformers, embedding, multilingual, turkish, retrieval, audio, image, norovox]
|
| 7 |
---
|
| 8 |
|
| 9 |
+
# Nythos Embed Zero
|
| 10 |
|
| 11 |
+
Nythos Embed Zero is a multilingual embedding model from Norovox Labs, from the Nythos open-base line (its own-architecture counterpart is Norovox Embed Zero). It covers text, Turkish, retrieval, classification, clustering, audio and images, and is built on EmbeddingGemma 2. The text path has 271M parameters.
|
| 12 |
|
| 13 |
> Every number below was measured by us under one protocol: fp32, the same prompts, and the same test sets for both models. Each test set was run once, after model selection on separate development sets.
|
| 14 |
|
| 15 |
## Results vs. EmbeddingGemma 2: ahead on 20 of 22 measures, tied on 1, behind on 1
|
| 16 |
|
| 17 |
+
| Test | EmbeddingGemma 2 | Nythos Embed Zero |
|
| 18 |
|---|---|---|
|
| 19 |
| STS-B (English similarity, Spearman) | .8749 | **.8865** |
|
| 20 |
| STS-TR (Turkish similarity, Spearman) | .7863 | **.8091** |
|
|
|
|
| 33 |
|
| 34 |
### Classification (logistic regression on embeddings) and clustering (V-measure): ahead on 8 of 8
|
| 35 |
|
| 36 |
+
| Task | EmbeddingGemma 2 | Nythos Embed Zero |
|
| 37 |
|---|---|---|
|
| 38 |
| Banking77 | .9293 | **.9357** |
|
| 39 |
| Emotion | .7009 | **.7190** |
|
|
|
|
| 56 |
| NFCorpus | .3608 | **.3878** | .3432 | **.3793** |
|
| 57 |
|
| 58 |
### Against larger open embedding models (same five text tests, each with its own prompts; previous text mixture, α = 0.6)
|
| 59 |
+
| Test | Nythos Embed Zero (271M) | Qwen3-Embedding-0.6B (596M) | multilingual-e5-large-instruct (560M) | BGE-M3 (568M) |
|
| 60 |
|---|---|---|---|---|
|
| 61 |
| STS-B | .8873 | **.9113** | .8838 | .8485 |
|
| 62 |
| STS-TR | .8067 | .7501 | **.8296** | .7978 |
|
|
|
|
| 76 |
|
| 77 |
```python
|
| 78 |
from vllm import LLM
|
| 79 |
+
llm = LLM(model="emrevrg/Nythos-Embed-Zero", runner="pooling", dtype="bfloat16")
|
| 80 |
docs = ["title: none | text: " + d for d in documents] # same prompt as prompt_name="Document"
|
| 81 |
vectors = [o.outputs.embedding for o in llm.embed(docs)]
|
| 82 |
```
|
|
|
|
| 95 |
## Usage
|
| 96 |
```python
|
| 97 |
from sentence_transformers import SentenceTransformer
|
| 98 |
+
m = SentenceTransformer("emrevrg/Nythos-Embed-Zero")
|
| 99 |
q = m.encode(["What is the longest river in Turkey?"], prompt_name="SearchQuery")
|
| 100 |
d = m.encode(["The Kızılırmak, at 1,355 km, is the longest river in Turkey."], prompt_name="Document")
|
| 101 |
print(q @ d.T)
|