Mnemos: EmbeddingGemma 2 tabanli acik-taban embed modeli

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

NOTICE

@@ -0,0 +1,3 @@
+Norovox Embed Zero. Derived from google/embeddinggemma-2 (Apache-2.0).
+Text path: weight-space mixture (alpha = 0.7) of EmbeddingGemma 2 and a Norovox-trained soup (karisim8); training used verified distillation from EmbeddingGemma 2 and Qwen3-Embedding-8B (Apache-2.0) on the Norovox pair corpus and our own synthetic data.
+Audio and image modality layers retrained by Norovox Labs; the rest of the vision and audio towers come from EmbeddingGemma 2.

README.md

@@ -0,0 +1,119 @@
+---
+license: apache-2.0
+base_model: google/embeddinggemma-2
+library_name: sentence-transformers
+pipeline_tag: sentence-similarity
+tags: [sentence-transformers, embedding, multilingual, turkish, retrieval, audio, image, norovox]
+---
+
+# Mnemos
+
+Mnemos is a multilingual embedding model from Norovox Labs, from our open-base line (its own-architecture counterpart is Norovox Embed Zero). It covers text, Turkish, retrieval, classification, clustering, audio and images, and is built on EmbeddingGemma 2. The text path has 271M parameters.
+
+> Every number below was measured by us under one protocol: fp32, the same prompts, and the same test sets for both models. Each test set was run once, after model selection on separate development sets.
+
+## Results vs. EmbeddingGemma 2: ahead on 20 of 22 measures, tied on 1, behind on 1
+
+| Test | EmbeddingGemma 2 | Mnemos |
+|---|---|---|
+| STS-B (English similarity, Spearman) | .8749 | **.8865** |
+| STS-TR (Turkish similarity, Spearman) | .7863 | **.8091** |
+| WikiRAG-TR (Turkish retrieval, nDCG@10) | .4726 | **.4837** |
+| SciFact (scientific retrieval, nDCG@10) | .8645 | **.8714** |
+| NFCorpus (medical retrieval, nDCG@10) | .3608 | **.3913** |
+| Flickr30k text→image R@1 / R@5 / R@10 | .8676 / .9788 / .9882 | **.8714 / .9818 / .9896** |
+| Flickr30k image→text R@1 | .954 | **.956** |
+| Flickr30k image→text R@5 / R@10 | 1.000 / 1.000 | .999 / 1.000 |
+| AudioCaps text→audio R@1 / R@5 / R@10 | .068 / .250 / .362 | **.121 / .413 / .580** |
+
+Paired bootstrap per query, 95% interval of the difference:
+- WikiRAG-TR: +.0111 [+.0072, +.0150] (n = 4,999)
+- NFCorpus: +.0305 [+.0203, +.0414] (n = 323)
+- SciFact: +.0070 [−.0033, +.0176] (n = 300; not significant)
+
+### Classification (logistic regression on embeddings) and clustering (V-measure): ahead on 8 of 8
+
+| Task | EmbeddingGemma 2 | Mnemos |
+|---|---|---|
+| Banking77 | .9293 | **.9357** |
+| Emotion | .7009 | **.7190** |
+| Amazon counterfactual (en) | .9194 | **.9224** |
+| Tweet sentiment | .7230 | **.7253** |
+| IMDB | .9230 | **.9240** |
+| TwentyNewsgroups clustering | .4710 | **.4850** |
+| Reddit clustering | .5579 | **.5874** |
+| StackExchange clustering | .6732 | **.6772** |
+
+The only measure where it is behind: image→text R@5 is .999 vs 1.000, i.e. one image out of 1,000.
+
+### Smaller vectors (Matryoshka truncation; measured on the previous text mixture, α = 0.6)
+| Test | EG2 768-d | Zero 512-d | EG2 256-d | Zero 256-d |
+|---|---|---|---|---|
+| STS-B | .8749 | **.8873** | .8738 | **.8844** |
+| STS-TR | .7863 | **.8066** | .7909 | **.8083** |
+| WikiRAG-TR | .4726 | .4708 | .4271 | **.4404** |
+| SciFact | .8645 | **.8701** | .8418 | **.8548** |
+| NFCorpus | .3608 | **.3878** | .3432 | **.3793** |
+
+### Against larger open embedding models (same five text tests, each with its own prompts; previous text mixture, α = 0.6)
+| Test | Mnemos (271M) | Qwen3-Embedding-0.6B (596M) | multilingual-e5-large-instruct (560M) | BGE-M3 (568M) |
+|---|---|---|---|---|
+| STS-B | .8873 | **.9113** | .8838 | .8485 |
+| STS-TR | .8067 | .7501 | **.8296** | .7978 |
+| WikiRAG-TR | **.4804** | .3551 | .3659 | .4260 |
+| SciFact | **.8729** | .7023 | .7118 | .6437 |
+| NFCorpus | **.3913** | .3638 | .3589 | .3157 |
+
+Note: our training data includes scientific and medical retrieval pairs, which helps on SciFact and NFCorpus.
+
+## Fast indexing with the Kapsül engine
+Kapsül is our inference layer on top of vLLM (pooling runner, bf16, length-aware batching). We measured it on 20,000 web documents on one H100, with the GPU shared with another training job; both paths ran under the same conditions.
+
+| Path | Documents / second | Same vectors? |
+|---|---|---|
+| SentenceTransformers (fp32, default) | 69 | reference |
+| **Kapsül** | **554 (8.0×)** | cosine to reference: mean .99998, min .99992 |
+
+```python
+from vllm import LLM
+llm = LLM(model="emrevrg/Mnemos", runner="pooling", dtype="bfloat16")
+docs = ["title: none | text: " + d for d in documents]   # same prompt as prompt_name="Document"
+vectors = [o.outputs.embedding for o in llm.embed(docs)]
+```
+
+What we tried and dropped: a 12-layer shallow document encoder distilled from the full model was 1.84× faster but lost too much retrieval quality (WikiRAG-TR dev .258 vs .516), so it is not part of this release.
+
+## How it was made
+- **Verified distillation:** Two teachers, EmbeddingGemma 2 and Qwen3-Embedding-8B. For each example, only a teacher that ranks the gold answer correctly is allowed to teach.
+- **Our own synthetic data:**
+  - Turkish search queries for Wikipedia passages (40,000 pairs).
+  - StackExchange-style question titles (for clustering).
+  - Both were generated with our Kapsül speed engine and kept only if the query retrieves its own passage first. Passages overlapping the test sets were removed with 10-gram filtering.
+- **Weight soup + mixing:** Two training runs were averaged and mixed with the base model (α = 0.7). Alpha was chosen only on 8 development slices: similarity, retrieval, Turkish, clustering and classification.
+- **Audio and image:** The text path is frozen; only the modality layers are trained. The image layers use relational distillation from EmbeddingGemma 2 on Flickr30k images that do not overlap the test set.
+
+## Usage
+```python
+from sentence_transformers import SentenceTransformer
+m = SentenceTransformer("emrevrg/Mnemos")
+q = m.encode(["What is the longest river in Turkey?"], prompt_name="SearchQuery")
+d = m.encode(["The Kızılırmak, at 1,355 km, is the longest river in Turkey."], prompt_name="Document")
+print(q @ d.T)
+```
+
+## Support, acknowledgements and the goal behind this work
+This model was trained and measured on one week of NVIDIA H100 time provided by **portvMind (vMind) Public Cloud**. Thank you, vMind: without that week this release would not exist.
+
+I'm an independent developer in Türkiye and I build the Norovox ecosystem alone, without a company. Most compute and hardware programs require a registered company or a minimum age. I have sent close to 600 applications; vMind is the only company that said yes, and the others are still pending or declined on company or age grounds. Day to day I work on a laptop whose disk keeps filling up and that cannot run large models locally, and I regularly hit the usage limits of the AI tools I depend on.
+
+The goal is an open ecosystem: by the end of the year, my own programming language, operating system, office apps, and agent and coding tools, built with stronger AI and released openly. The techniques behind these models (IRIS lossless model compression, Aktar encrypted transfer, Sıkıştır) are part of the same effort.
+
+### How you can help
+- **Companies:** if you can support open models with compute, hardware or credits, write to **emre.games72@gmail.com**.
+- **AI companies** such as Anthropic, OpenAI and Google: access to your models and API credits would let me keep building and releasing these tools.
+- **Everyone else:** if you work at one of these companies, or know someone who does, please share this page with them or introduce me. One introduction can make the difference for an independent project like this.
+
+Every supporter is credited in the model and technical cards of the projects they help.
+
+## License and attribution
+Apache-2.0. This is a derivative of google/embeddinggemma-2 (Apache-2.0); see the NOTICE file. The Qwen3-Embedding-8B teacher is also Apache-2.0.

chat_template.jinja

@@ -0,0 +1 @@
+{%- for msg in messages if msg.get('role') == 'system' -%}{%- if msg.get('content') is string -%}{{ msg['content'] }}{%- else -%}{%- for item in msg['content'] if item.get('type') == 'text' -%}{{ item['text'] }}{%- endfor -%}{%- endif -%}{%- endfor -%}{%- for msg in messages if msg.get('role') != 'system' -%}{%- if msg.get('content') is string -%}{{ msg['content'] }}{%- else -%}{%- set existing_text = msg['content'] | selectattr('type', 'equalto', 'text') | map(attribute='text') | join -%}{%- set has_manual_placeholders = ('<|image|>' in existing_text) or ('<|video|>' in existing_text) or ('<|audio|>' in existing_text) -%}{%- for item in msg['content'] -%}{%- if item.get('type') == 'text' -%}{{ item['text'] }}{%- elif not has_manual_placeholders and item.get('type') == 'image' -%}<|image|>{%- elif not has_manual_placeholders and item.get('type') == 'video' -%}<|video|>{%- elif not has_manual_placeholders and item.get('type') == 'audio' -%}<|audio|>{%- endif -%}{%- endfor -%}{%- endif -%}{%- endfor -%}

cok_ortam.json

@@ -0,0 +1,36 @@
+{
+ "google/embeddinggemma-2": {
+  "metin_goruntu": {
+   "R@1": 0.8676,
+   "R@5": 0.9788,
+   "R@10": 0.9882
+  },
+  "goruntu_metin": {
+   "R@1": 0.954,
+   "R@5": 1.0,
+   "R@10": 1.0
+  },
+  "metin_ses": {
+   "R@1": 0.068,
+   "R@5": 0.25,
+   "R@10": 0.362
+  }
+ },
+ "/mnt/norovox/run/embed_cok_gor4/en_iyi": {
+  "metin_goruntu": {
+   "R@1": 0.8714,
+   "R@5": 0.9818,
+   "R@10": 0.9896
+  },
+  "goruntu_metin": {
+   "R@1": 0.956,
+   "R@5": 0.999,
+   "R@10": 1.0
+  },
+  "metin_ses": {
+   "R@1": 0.121,
+   "R@5": 0.413,
+   "R@10": 0.58
+  }
+ }
+}

config.json

@@ -0,0 +1,145 @@
+{
+  "architectures": [
+    "EmbeddingGemma2Model"
+  ],
+  "audio_config": {
+    "attention_chunk_size": 12,
+    "attention_context_left": 13,
+    "attention_context_right": 0,
+    "attention_invalid_logits_value": -1000000000.0,
+    "attention_logit_cap": 50.0,
+    "conv_kernel_size": 5,
+    "dtype": "float32",
+    "gradient_clipping": 10000000000.0,
+    "hidden_act": "silu",
+    "hidden_size": 1024,
+    "initializer_range": 0.02,
+    "model_type": "gemma4_audio",
+    "num_attention_heads": 8,
+    "num_hidden_layers": 12,
+    "output_proj_dims": 1536,
+    "residual_weight": 0.5,
+    "rms_norm_eps": 1e-06,
+    "subsampling_conv_channels": [
+      128,
+      32
+    ],
+    "use_clipped_linears": true
+  },
+  "audio_token_id": 258881,
+  "boa_token_id": 256000,
+  "boi_token_id": 255999,
+  "dtype": "float32",
+  "eoa_token_index": 258883,
+  "eoi_token_id": 258882,
+  "image_token_id": 258880,
+  "initializer_range": 0.02,
+  "model_type": "embedding_gemma2",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "bos_token_id": 2,
+    "dtype": "float32",
+    "embedding_dim": 768,
+    "eos_token_id": 1,
+    "head_dim": 256,
+    "hidden_activation": "gelu_pytorch_tanh",
+    "hidden_size": 512,
+    "hidden_size_per_layer_input": 512,
+    "initializer_range": 0.02,
+    "intermediate_size": 2048,
+    "layer_types": [
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention"
+    ],
+    "max_position_embeddings": 262144,
+    "model_type": "embedding_gemma2_text",
+    "num_attention_heads": 4,
+    "num_hidden_layers": 24,
+    "num_key_value_heads": 2,
+    "pad_token_id": 0,
+    "per_layer_config": {
+      "05": {
+        "head_dim": 512,
+        "num_key_value_heads": 1
+      },
+      "11": {
+        "head_dim": 512,
+        "num_key_value_heads": 1
+      },
+      "17": {
+        "head_dim": 512,
+        "num_key_value_heads": 1
+      },
+      "23": {
+        "head_dim": 512,
+        "num_key_value_heads": 1
+      }
+    },
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "full_attention": {
+        "rope_theta": 1000000.0,
+        "rope_type": "default"
+      },
+      "sliding_attention": {
+        "rope_theta": 10000.0,
+        "rope_type": "default"
+      }
+    },
+    "sliding_window": 512,
+    "vocab_size": 262144
+  },
+  "transformers_version": "5.22.1",
+  "video_token_id": 258884,
+  "vision_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "default_output_length": 280,
+    "dtype": "float32",
+    "global_head_dim": 64,
+    "head_dim": 64,
+    "hidden_activation": "gelu_pytorch_tanh",
+    "hidden_size": 768,
+    "initializer_range": 0.02,
+    "intermediate_size": 3072,
+    "max_position_embeddings": 131072,
+    "model_type": "gemma4_vision",
+    "num_attention_heads": 12,
+    "num_hidden_layers": 16,
+    "num_key_value_heads": 12,
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "position_embedding_size": 10240,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "rope_theta": 100.0,
+      "rope_type": "axial"
+    },
+    "standardize": false,
+    "use_clipped_linears": false
+  },
+  "vision_soft_tokens_per_image": 280
+}

config_sentence_transformers.json

@@ -0,0 +1,32 @@
+{
+  "__version__": {
+    "pytorch": "2.15.0+cu132",
+    "sentence_transformers": "6.2.0",
+    "transformers": "5.22.1"
+  },
+  "default_prompt_name": null,
+  "model_type": "SentenceTransformer",
+  "prompts": {
+    "BitextMining": "task: search result | query: ",
+    "Classification": "task: classification | query: ",
+    "Clustering": "task: clustering | query: ",
+    "CodeRetrieval": "task: code retrieval | query: ",
+    "Document": "title: none | text: ",
+    "FactChecking": "task: fact checking | query: ",
+    "InstructionRetrieval": "task: code retrieval | query: ",
+    "MultilabelClassification": "task: classification | query: ",
+    "PairClassification": "task: sentence similarity | query: ",
+    "QuestionAnswering": "task: question answering | query: ",
+    "Reranking": "task: search result | query: ",
+    "Retrieval": "task: search result | query: ",
+    "Retrieval-document": "title: none | text: ",
+    "Retrieval-query": "task: search result | query: ",
+    "STS": "task: sentence similarity | query: ",
+    "SearchQuery": "task: search result | query: ",
+    "SentenceSimilarity": "task: sentence similarity | query: ",
+    "Summarization": "task: sentence similarity | query: ",
+    "document": "title: none | text: ",
+    "query": "task: search result | query: "
+  },
+  "similarity_fn_name": "cosine"
+}

metin_sonuc.json

@@ -0,0 +1,119 @@
+{
+ "dev": {
+  "0.0": {
+   "stsb_dev": 0.8867,
+   "scifact_train": 0.9954,
+   "nfcorpus_dev": 0.3421,
+   "stsb_tr_dev": 0.8144,
+   "wikirag_tr_dev": 0.5146,
+   "score": 0.7106,
+   "se_kume_dev": 0.6462,
+   "tweet_dev": 0.7223,
+   "imdb_dev": 0.921
+  },
+  "0.5": {
+   "stsb_dev": 0.9064,
+   "scifact_train": 0.9977,
+   "nfcorpus_dev": 0.3701,
+   "stsb_tr_dev": 0.8389,
+   "wikirag_tr_dev": 0.5156,
+   "score": 0.7257,
+   "se_kume_dev": 0.6527,
+   "tweet_dev": 0.7277,
+   "imdb_dev": 0.92
+  },
+  "0.55": {
+   "stsb_dev": 0.9075,
+   "scifact_train": 0.9977,
+   "nfcorpus_dev": 0.372,
+   "stsb_tr_dev": 0.8408,
+   "wikirag_tr_dev": 0.5163,
+   "score": 0.7269,
+   "se_kume_dev": 0.6518,
+   "tweet_dev": 0.7293,
+   "imdb_dev": 0.9193
+  },
+  "0.6": {
+   "stsb_dev": 0.9084,
+   "scifact_train": 0.9977,
+   "nfcorpus_dev": 0.3729,
+   "stsb_tr_dev": 0.8426,
+   "wikirag_tr_dev": 0.5155,
+   "score": 0.7274,
+   "se_kume_dev": 0.653,
+   "tweet_dev": 0.7273,
+   "imdb_dev": 0.9197
+  },
+  "0.65": {
+   "stsb_dev": 0.9092,
+   "scifact_train": 0.9977,
+   "nfcorpus_dev": 0.3733,
+   "stsb_tr_dev": 0.8442,
+   "wikirag_tr_dev": 0.5161,
+   "score": 0.7281,
+   "se_kume_dev": 0.6524,
+   "tweet_dev": 0.726,
+   "imdb_dev": 0.9197
+  },
+  "0.7": {
+   "stsb_dev": 0.9099,
+   "scifact_train": 0.9977,
+   "nfcorpus_dev": 0.3742,
+   "stsb_tr_dev": 0.8459,
+   "wikirag_tr_dev": 0.5156,
+   "score": 0.7287,
+   "se_kume_dev": 0.6532,
+   "tweet_dev": 0.7263,
+   "imdb_dev": 0.9193
+  },
+  "0.75": {
+   "stsb_dev": 0.9104,
+   "scifact_train": 0.9977,
+   "nfcorpus_dev": 0.3737,
+   "stsb_tr_dev": 0.8473,
+   "wikirag_tr_dev": 0.5141,
+   "score": 0.7286,
+   "se_kume_dev": 0.6532,
+   "tweet_dev": 0.7257,
+   "imdb_dev": 0.92
+  }
+ },
+ "secilen": 0.7,
+ "puan": {
+  "0.5": [
+   7,
+   0.7411375
+  ],
+  "0.55": [
+   7,
+   0.7418375
+  ],
+  "0.6": [
+   7,
+   0.7421374999999999
+  ],
+  "0.65": [
+   7,
+   0.7423249999999999
+  ],
+  "0.7": [
+   7,
+   0.7427625
+  ],
+  "0.75": [
+   6,
+   0.7427625
+  ]
+ },
+ "test": {
+  "stsb_dev_spearman": 0.9099,
+  "stsb_spearman": 0.8865,
+  "stsb_tr_spearman": 0.8091,
+  "wikirag_tr": {
+   "ndcg10": 0.4837,
+   "r1": 0.2659
+  },
+  "scifact_ndcg10": 0.8714,
+  "nfcorpus_ndcg10": 0.3913
+ }
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47d464111f9159124941d4d5580c1b60234cf6540839a84db32111a97f511c14
+size 2977658688

model.sha256

@@ -0,0 +1 @@
+47d464111f9159124941d4d5580c1b60234cf6540839a84db32111a97f511c14

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.base.modules.transformer.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.sentence_transformer.modules.pooling.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.base.modules.normalize.Normalize"
+  }
+]

nlp_sonuc.json

@@ -0,0 +1 @@
+{"NLP_GENISLIK": {"eg2": {"sinif_banking77": 0.9293, "sinif_emotion": 0.7009, "sinif_amazon_cf_en": 0.9194, "sinif_tweet_sentiment": 0.723, "sinif_imdb": 0.923, "kume_twentynewsgroups": 0.471, "kume_reddit": 0.5579, "kume_stackexchange": 0.6732}, "norovox": {"sinif_banking77": 0.9357, "sinif_emotion": 0.719, "sinif_amazon_cf_en": 0.9224, "sinif_tweet_sentiment": 0.7253, "sinif_imdb": 0.924, "kume_twentynewsgroups": 0.485, "kume_reddit": 0.5874, "kume_stackexchange": 0.6772}, "norovox_onde": 8, "esit": 0, "toplam": 8, "ort_eg2": 0.7372, "ort_norovox": 0.747}}

preprocessor_config.json

@@ -0,0 +1,21 @@
+{
+  "dither": 0.0,
+  "feature_extractor_type": "Gemma4AudioFeatureExtractor",
+  "feature_size": 128,
+  "fft_length": 512,
+  "fft_overdrive": false,
+  "frame_length": 320,
+  "hop_length": 160,
+  "input_scale_factor": 1.0,
+  "max_frequency": 8000.0,
+  "mel_floor": 0.001,
+  "min_frequency": 0.0,
+  "padding_side": "right",
+  "padding_value": 0.0,
+  "per_bin_mean": null,
+  "per_bin_stddev": null,
+  "preemphasis": 0.0,
+  "preemphasis_htk_flavor": true,
+  "return_attention_mask": true,
+  "sampling_rate": 16000
+}

processor_config.json

@@ -0,0 +1,78 @@
+{
+  "audio_ms_per_token": 40,
+  "audio_seq_length": 280,
+  "feature_extractor": {
+    "dither": 0.0,
+    "feature_extractor_type": "Gemma4AudioFeatureExtractor",
+    "feature_size": 128,
+    "fft_length": 512,
+    "fft_overdrive": false,
+    "frame_length": 320,
+    "hop_length": 160,
+    "input_scale_factor": 1.0,
+    "max_frequency": 8000.0,
+    "mel_floor": 0.001,
+    "min_frequency": 0.0,
+    "padding_side": "right",
+    "padding_value": 0.0,
+    "per_bin_mean": null,
+    "per_bin_stddev": null,
+    "preemphasis": 0.0,
+    "preemphasis_htk_flavor": true,
+    "return_attention_mask": true,
+    "sampling_rate": 16000
+  },
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": false,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.0,
+      0.0,
+      0.0
+    ],
+    "image_processor_type": "Gemma4ImageProcessor",
+    "image_seq_length": 280,
+    "image_std": [
+      1.0,
+      1.0,
+      1.0
+    ],
+    "max_soft_tokens": 280,
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098
+  },
+  "image_seq_length": 280,
+  "processor_class": "EmbeddingGemma2Processor",
+  "video_processor": {
+    "add_timestamps": false,
+    "do_convert_rgb": true,
+    "do_normalize": false,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": true,
+    "fps": 1,
+    "image_mean": [
+      0.0,
+      0.0,
+      0.0
+    ],
+    "image_std": [
+      1.0,
+      1.0,
+      1.0
+    ],
+    "max_frames": 32,
+    "max_soft_tokens": 140,
+    "overflow_strategy": "uniform",
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "video_processor_type": "EmbeddingGemma2VideoProcessor"
+  }
+}

sentence_bert_config.json

@@ -0,0 +1,27 @@
+{
+    "transformer_task": "feature-extraction",
+    "modality_config": {
+        "text": {
+            "method": "forward",
+            "method_output_name": "last_hidden_state"
+        },
+        "image": {
+            "method": "forward",
+            "method_output_name": "last_hidden_state"
+        },
+        "audio": {
+            "method": "forward",
+            "method_output_name": "last_hidden_state"
+        },
+        "video": {
+            "method": "forward",
+            "method_output_name": "last_hidden_state"
+        },
+        "message": {
+            "method": "forward",
+            "method_output_name": "last_hidden_state",
+            "format": "structured"
+        }
+    },
+    "module_output_name": "token_embeddings"
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4d777ef5bdc1aa36227abdfb77c3e49e7b9c892d16e1b6bda41c393504828be4
+size 32170510

tokenizer_config.json

@@ -0,0 +1,57 @@
+{
+  "audio_token": "<|audio|>",
+  "backend": "tokenizers",
+  "boa_token": "<|audio>",
+  "boi_token": "<|image>",
+  "bos_token": "<bos>",
+  "eoa_token": "<audio|>",
+  "eoc_token": "<channel|>",
+  "eoi_token": "<image|>",
+  "eos_token": "<eos>",
+  "eot_token": "<turn|>",
+  "escape_token": "<|\"|>",
+  "etc_token": "<tool_call|>",
+  "etd_token": "<tool|>",
+  "etr_token": "<tool_response|>",
+  "extra_special_tokens": [
+    "<|video|>"
+  ],
+  "image_token": "<|image|>",
+  "is_local": true,
+  "local_files_only": false,
+  "mask_token": "<mask>",
+  "model_max_length": 1000000000000000019884624838656,
+  "model_specific_special_tokens": {
+    "audio_token": "<|audio|>",
+    "boa_token": "<|audio>",
+    "boi_token": "<|image>",
+    "eoa_token": "<audio|>",
+    "eoc_token": "<channel|>",
+    "eoi_token": "<image|>",
+    "eot_token": "<turn|>",
+    "escape_token": "<|\"|>",
+    "etc_token": "<tool_call|>",
+    "etd_token": "<tool|>",
+    "etr_token": "<tool_response|>",
+    "image_token": "<|image|>",
+    "soc_token": "<|channel>",
+    "sot_token": "<|turn>",
+    "stc_token": "<|tool_call>",
+    "std_token": "<|tool>",
+    "str_token": "<|tool_response>",
+    "think_token": "<|think|>",
+    "video_token": "<|video|>"
+  },
+  "pad_token": "<pad>",
+  "padding_side": "right",
+  "processor_class": "EmbeddingGemma2Processor",
+  "soc_token": "<|channel>",
+  "sot_token": "<|turn>",
+  "stc_token": "<|tool_call>",
+  "std_token": "<|tool>",
+  "str_token": "<|tool_response>",
+  "think_token": "<|think|>",
+  "tokenizer_class": "GemmaTokenizer",
+  "unk_token": "<unk>",
+  "video_token": "<|video|>"
+}