Upload via Autoresearch export_data

.gitattributes

@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 models/labse-ig-ha-yo/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

1_Pooling/config.json

@@ -0,0 +1,5 @@
+{
+    "embedding_dimension": 768,
+    "pooling_mode": "cls",
+    "include_prompt": true
+}

2_Dense/config.json

@@ -0,0 +1,8 @@
+{
+    "in_features": 768,
+    "out_features": 768,
+    "bias": true,
+    "activation_function": "torch.nn.modules.activation.Tanh",
+    "module_input_name": "sentence_embedding",
+    "module_output_name": "sentence_embedding"
+}

2_Dense/model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7d0e218e49743fefa25884a33cdcdb52d2f119c693db1bd7e0d149fc5932c85
+size 2362528

3_Normalize/config.json

@@ -0,0 +1,4 @@
+{
+    "module_input_name": "sentence_embedding",
+    "module_output_name": "sentence_embedding"
+}

MODEL_CARD.md

@@ -0,0 +1,232 @@
+---
+language:
+  - ig
+  - ha
+  - yo
+  - en
+library_name: sentence-transformers
+pipeline_tag: sentence-similarity
+tags:
+  - embeddings
+  - sentence-transformers
+  - cross-lingual
+  - multilingual
+  - igbo
+  - hausa
+  - yoruba
+  - information-retrieval
+  - semantic-search
+base_model: sentence-transformers/LaBSE
+---
+
+# Native-Bird
+
+**Native-Bird** is a 768-dimensional multilingual sentence-embedding model fine-tuned from **LaBSE** for cross-lingual retrieval involving **Igbo, Hausa, Yoruba, and English**.
+
+Its primary use case is **native-language query → English document retrieval**. A user can describe what they are looking for in Igbo while the indexed document is written in English, and Native-Bird maps both into the same embedding space for semantic search.
+
+## What it is designed to do
+
+Example:
+
+> **Igbo query:** “Neuklọs ahụ bụ ahụ ihe abụọ mejupụtara ya - neutrọn na protọn.”
+>
+> **English document:** “The nucleus consists of two particles - neutrons and protons.”
+
+The model should assign a high cosine similarity to the matching English text even though the languages differ.
+
+## Model details
+
+- **Model name:** Native-Bird
+- **Architecture:** SentenceTransformer based on LaBSE
+- **Embedding dimension:** 768
+- **Maximum sequence length used during training:** 128 tokens
+- **Similarity:** cosine similarity
+- **Base model:** sentence-transformers/LaBSE
+- **Training objective:** Cached Multiple Negatives Ranking Loss (CachedMNRL)
+- **Languages:** Igbo, Hausa, Yoruba, English
+- **Training examples:** 76,150 paired examples
+- **Epochs:** 4
+- **Per-device batch size:** 256
+- **Learning rate:** 2e-5
+- **Warmup:** 10%
+- **Scheduler:** cosine
+- **Training precision:** BF16
+- **Negative sampling:** in-batch negatives with NO_DUPLICATES; CachedMNRL mini-batch size 128
+
+## Evaluation
+
+The retrieval evaluation uses an English corpus of **1,004 sentences** and **204 queries per language**. For each query, the correct English sentence is known. We report Recall@1, Recall@10, and Mean Reciprocal Rank (MRR).
+
+### Fine-tuned Native-Bird
+
+| Language | Query condition | R@1 | R@10 | MRR |
+|---|---|---:|---:|---:|
+| Igbo | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Igbo | ASR-style noise | 1.0000 | 1.0000 | 1.0000 |
+| Hausa | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Hausa | ASR-style noise | 1.0000 | 1.0000 | 1.0000 |
+| Yoruba | Clean | 0.9804 | 1.0000 | 0.9902 |
+| Yoruba | ASR-style noise | 0.9804 | 1.0000 | 0.9867 |
+
+### Before fine-tuning: LaBSE baseline
+
+| Language | Query condition | R@1 | R@10 | MRR |
+|---|---|---:|---:|---:|
+| Igbo | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Igbo | ASR-style noise | 0.9853 | 0.9951 | 0.9888 |
+| Hausa | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Hausa | ASR-style noise | 0.9951 | 1.0000 | 0.9975 |
+| Yoruba | Clean | 0.9804 | 1.0000 | 0.9871 |
+| Yoruba | ASR-style noise | 0.9559 | 0.9951 | 0.9683 |
+
+### Interpretation
+
+Native-Bird is **strong on the benchmark it was trained and evaluated against**, particularly for Igbo and Hausa. Fine-tuning improved noisy-query retrieval for Igbo and Hausa and slightly improved Yoruba.
+
+The scores do **not** prove that Native-Bird will retrieve arbitrary long English documents from arbitrary Igbo descriptions with the same accuracy. The current evaluation is sentence-level. Real document search should therefore split documents into passages/chunks before embedding.
+
+## Direct Igbo → English retrieval checks
+
+The trained model was directly run against the English evaluation corpus. Examples:
+
+**Igbo:** “Mgbanwe n'ọdịdị na-agbakwunye ọdịdị kejenetiki ọhụrụ, ma nhọpụta na-ewepụ ya n'ogwu ọdịdị nke a kọwapụtara.”
+
+→ **Top English result:** “Mutation adds new genetic variation, and selection removes it from the pool of expressed variation.”
+
+Cosine similarity: **0.7079**
+
+**Igbo:** “Neuklọs ahụ bụ ahụ ihe abụọ mejupụtara ya - neutrọn na protọn.”
+
+→ **Top English result:** “The nucleus consists of two particles - neutrons and protons.”
+
+Cosine similarity: **0.7049**
+
+**Igbo:** “Enwere ọtụtụ ihe mere ha ji kara web prọgzi mma: ha na-agbanwe ụzọ trafik ịntanetị niile, ọ bụghị naanị http.”
+
+→ **Top English result:** “They are superior to web proxies for several reasons: They re-route all Internet traffic, not only http.”
+
+Cosine similarity: **0.6774**
+
+These are direct demonstrations of the intended behavior: the query is Igbo while the retrieved target is English.
+
+## Installation
+
+~~~bash
+pip install -U sentence-transformers torch
+~~~
+
+## Basic usage
+
+~~~python
+from sentence_transformers import SentenceTransformer
+
+model = SentenceTransformer("Modularcomputing/Native-Bird")
+
+query = "Neuklọs ahụ bụ ahụ ihe abụọ mejupụtara ya - neutrọn na protọn."
+
+documents = [
+    "The nucleus consists of two particles - neutrons and protons.",
+    "The liver is an organ responsible for many metabolic functions.",
+    "Photosynthesis converts light energy into chemical energy.",
+]
+
+q = model.encode(query, normalize_embeddings=True)
+d = model.encode(documents, normalize_embeddings=True)
+
+scores = d @ q
+
+for i in scores.argsort()[::-1]:
+    print(float(scores[i]), documents[i])
+~~~
+
+The matching English sentence should rank first.
+
+## Testing the model
+
+A minimal test is:
+
+1. Load Native-Bird.
+2. Encode an Igbo query.
+3. Encode several English candidate documents.
+4. Compute cosine similarity.
+5. Sort candidates by similarity.
+6. Check whether the semantically matching English document is ranked first.
+
+For a real search system, replace the small list with a vector database or FAISS index.
+
+## Searching a real English document collection
+
+Do **not** embed a multi-page document as one vector. Split each document into passages, normally around 100–300 words with overlap, and store each passage embedding together with its parent document ID.
+
+At query time:
+
+1. Encode the user's Igbo query with Native-Bird.
+2. Search the English passage vectors using cosine similarity or an ANN index such as FAISS.
+3. Return the highest-scoring passages.
+4. Group or rerank passages by their parent document.
+
+Conceptually:
+
+~~~text
+Igbo query
+    ↓
+Native-Bird encoder
+    ↓
+768-dimensional query vector
+    ↓ cosine similarity
+English passage index
+    ↓
+Top-k English passages
+    ↓
+Parent documents
+~~~
+
+This is the architecture needed for the intended “describe it in Igbo, find the English document” product.
+
+## Important limitation
+
+Native-Bird is an **embedding/retrieval model**, not a translator and not a generative language model. It does not generate an English answer. It represents text as vectors so that semantically related text can be found across languages.
+
+The current model uses a 128-token training sequence length and was evaluated on sentence-level retrieval. For long documents, chunking is therefore important.
+
+A production deployment should be evaluated on the actual target domain. Nigerian government documents, university material, medical documents, legal documents, and technical documentation can have vocabulary and writing styles that differ substantially from the current benchmark.
+
+## Evaluation methodology
+
+The evaluation script embeds the 1,004-item English corpus, embeds each language's 204 queries, computes cosine similarities, and measures the rank of the known matching English sentence.
+
+Two query variants are evaluated:
+
+- **clean:** original native-language query
+- **ASR-style noise:** Unicode diacritics removed, lowercased, punctuation stripped, and whitespace normalized
+
+The benchmark is useful for measuring cross-lingual retrieval and robustness to transcription-style normalization, but should not be interpreted as a universal real-world retrieval score.
+
+## Intended applications
+
+- Igbo → English semantic document search
+- Hausa → English semantic document search
+- Yoruba → English semantic document search
+- Multilingual educational search
+- Native-language interfaces for English knowledge bases
+- Cross-lingual RAG retrieval
+- Search over Nigerian institutional documents
+
+## Training provenance
+
+Native-Bird was fine-tuned from LaBSE using paired native-language/English retrieval data prepared for this project. Training used 76,150 pairs and a contrastive retrieval objective.
+
+The final training run completed successfully for four epochs, saved the model, and produced the evaluation results reported above.
+
+## Model status
+
+**Status: research / early release.**
+
+The core cross-lingual retrieval capability is demonstrated. The next meaningful validation step is a human-annotated benchmark of real Nigerian documents and real Igbo/Hausa/Yoruba information needs, especially for multi-paragraph documents.
+
+## Citation
+
+If you use Native-Bird in research or a project, please reference the model as:
+
+**Native-Bird: Cross-lingual Native-Language Embeddings for English Document Retrieval.**

README.md

@@ -1,3 +1,232 @@
 ---
-license: apache-2.0
+language:
+  - ig
+  - ha
+  - yo
+  - en
+library_name: sentence-transformers
+pipeline_tag: sentence-similarity
+tags:
+  - embeddings
+  - sentence-transformers
+  - cross-lingual
+  - multilingual
+  - igbo
+  - hausa
+  - yoruba
+  - information-retrieval
+  - semantic-search
+base_model: sentence-transformers/LaBSE
 ---
+
+# Native-Bird
+
+**Native-Bird** is a 768-dimensional multilingual sentence-embedding model fine-tuned from **LaBSE** for cross-lingual retrieval involving **Igbo, Hausa, Yoruba, and English**.
+
+Its primary use case is **native-language query → English document retrieval**. A user can describe what they are looking for in Igbo while the indexed document is written in English, and Native-Bird maps both into the same embedding space for semantic search.
+
+## What it is designed to do
+
+Example:
+
+> **Igbo query:** “Neuklọs ahụ bụ ahụ ihe abụọ mejupụtara ya - neutrọn na protọn.”
+>
+> **English document:** “The nucleus consists of two particles - neutrons and protons.”
+
+The model should assign a high cosine similarity to the matching English text even though the languages differ.
+
+## Model details
+
+- **Model name:** Native-Bird
+- **Architecture:** SentenceTransformer based on LaBSE
+- **Embedding dimension:** 768
+- **Maximum sequence length used during training:** 128 tokens
+- **Similarity:** cosine similarity
+- **Base model:** sentence-transformers/LaBSE
+- **Training objective:** Cached Multiple Negatives Ranking Loss (CachedMNRL)
+- **Languages:** Igbo, Hausa, Yoruba, English
+- **Training examples:** 76,150 paired examples
+- **Epochs:** 4
+- **Per-device batch size:** 256
+- **Learning rate:** 2e-5
+- **Warmup:** 10%
+- **Scheduler:** cosine
+- **Training precision:** BF16
+- **Negative sampling:** in-batch negatives with NO_DUPLICATES; CachedMNRL mini-batch size 128
+
+## Evaluation
+
+The retrieval evaluation uses an English corpus of **1,004 sentences** and **204 queries per language**. For each query, the correct English sentence is known. We report Recall@1, Recall@10, and Mean Reciprocal Rank (MRR).
+
+### Fine-tuned Native-Bird
+
+| Language | Query condition | R@1 | R@10 | MRR |
+|---|---|---:|---:|---:|
+| Igbo | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Igbo | ASR-style noise | 1.0000 | 1.0000 | 1.0000 |
+| Hausa | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Hausa | ASR-style noise | 1.0000 | 1.0000 | 1.0000 |
+| Yoruba | Clean | 0.9804 | 1.0000 | 0.9902 |
+| Yoruba | ASR-style noise | 0.9804 | 1.0000 | 0.9867 |
+
+### Before fine-tuning: LaBSE baseline
+
+| Language | Query condition | R@1 | R@10 | MRR |
+|---|---|---:|---:|---:|
+| Igbo | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Igbo | ASR-style noise | 0.9853 | 0.9951 | 0.9888 |
+| Hausa | Clean | 1.0000 | 1.0000 | 1.0000 |
+| Hausa | ASR-style noise | 0.9951 | 1.0000 | 0.9975 |
+| Yoruba | Clean | 0.9804 | 1.0000 | 0.9871 |
+| Yoruba | ASR-style noise | 0.9559 | 0.9951 | 0.9683 |
+
+### Interpretation
+
+Native-Bird is **strong on the benchmark it was trained and evaluated against**, particularly for Igbo and Hausa. Fine-tuning improved noisy-query retrieval for Igbo and Hausa and slightly improved Yoruba.
+
+The scores do **not** prove that Native-Bird will retrieve arbitrary long English documents from arbitrary Igbo descriptions with the same accuracy. The current evaluation is sentence-level. Real document search should therefore split documents into passages/chunks before embedding.
+
+## Direct Igbo → English retrieval checks
+
+The trained model was directly run against the English evaluation corpus. Examples:
+
+**Igbo:** “Mgbanwe n'ọdịdị na-agbakwunye ọdịdị kejenetiki ọhụrụ, ma nhọpụta na-ewepụ ya n'ogwu ọdịdị nke a kọwapụtara.”
+
+→ **Top English result:** “Mutation adds new genetic variation, and selection removes it from the pool of expressed variation.”
+
+Cosine similarity: **0.7079**
+
+**Igbo:** “Neuklọs ahụ bụ ahụ ihe abụọ mejupụtara ya - neutrọn na protọn.”
+
+→ **Top English result:** “The nucleus consists of two particles - neutrons and protons.”
+
+Cosine similarity: **0.7049**
+
+**Igbo:** “Enwere ọtụtụ ihe mere ha ji kara web prọgzi mma: ha na-agbanwe ụzọ trafik ịntanetị niile, ọ bụghị naanị http.”
+
+→ **Top English result:** “They are superior to web proxies for several reasons: They re-route all Internet traffic, not only http.”
+
+Cosine similarity: **0.6774**
+
+These are direct demonstrations of the intended behavior: the query is Igbo while the retrieved target is English.
+
+## Installation
+
+~~~bash
+pip install -U sentence-transformers torch
+~~~
+
+## Basic usage
+
+~~~python
+from sentence_transformers import SentenceTransformer
+
+model = SentenceTransformer("Modularcomputing/Native-Bird")
+
+query = "Neuklọs ahụ bụ ahụ ihe abụọ mejupụtara ya - neutrọn na protọn."
+
+documents = [
+    "The nucleus consists of two particles - neutrons and protons.",
+    "The liver is an organ responsible for many metabolic functions.",
+    "Photosynthesis converts light energy into chemical energy.",
+]
+
+q = model.encode(query, normalize_embeddings=True)
+d = model.encode(documents, normalize_embeddings=True)
+
+scores = d @ q
+
+for i in scores.argsort()[::-1]:
+    print(float(scores[i]), documents[i])
+~~~
+
+The matching English sentence should rank first.
+
+## Testing the model
+
+A minimal test is:
+
+1. Load Native-Bird.
+2. Encode an Igbo query.
+3. Encode several English candidate documents.
+4. Compute cosine similarity.
+5. Sort candidates by similarity.
+6. Check whether the semantically matching English document is ranked first.
+
+For a real search system, replace the small list with a vector database or FAISS index.
+
+## Searching a real English document collection
+
+Do **not** embed a multi-page document as one vector. Split each document into passages, normally around 100–300 words with overlap, and store each passage embedding together with its parent document ID.
+
+At query time:
+
+1. Encode the user's Igbo query with Native-Bird.
+2. Search the English passage vectors using cosine similarity or an ANN index such as FAISS.
+3. Return the highest-scoring passages.
+4. Group or rerank passages by their parent document.
+
+Conceptually:
+
+~~~text
+Igbo query
+    ↓
+Native-Bird encoder
+    ↓
+768-dimensional query vector
+    ↓ cosine similarity
+English passage index
+    ↓
+Top-k English passages
+    ↓
+Parent documents
+~~~
+
+This is the architecture needed for the intended “describe it in Igbo, find the English document” product.
+
+## Important limitation
+
+Native-Bird is an **embedding/retrieval model**, not a translator and not a generative language model. It does not generate an English answer. It represents text as vectors so that semantically related text can be found across languages.
+
+The current model uses a 128-token training sequence length and was evaluated on sentence-level retrieval. For long documents, chunking is therefore important.
+
+A production deployment should be evaluated on the actual target domain. Nigerian government documents, university material, medical documents, legal documents, and technical documentation can have vocabulary and writing styles that differ substantially from the current benchmark.
+
+## Evaluation methodology
+
+The evaluation script embeds the 1,004-item English corpus, embeds each language's 204 queries, computes cosine similarities, and measures the rank of the known matching English sentence.
+
+Two query variants are evaluated:
+
+- **clean:** original native-language query
+- **ASR-style noise:** Unicode diacritics removed, lowercased, punctuation stripped, and whitespace normalized
+
+The benchmark is useful for measuring cross-lingual retrieval and robustness to transcription-style normalization, but should not be interpreted as a universal real-world retrieval score.
+
+## Intended applications
+
+- Igbo → English semantic document search
+- Hausa → English semantic document search
+- Yoruba → English semantic document search
+- Multilingual educational search
+- Native-language interfaces for English knowledge bases
+- Cross-lingual RAG retrieval
+- Search over Nigerian institutional documents
+
+## Training provenance
+
+Native-Bird was fine-tuned from LaBSE using paired native-language/English retrieval data prepared for this project. Training used 76,150 pairs and a contrastive retrieval objective.
+
+The final training run completed successfully for four epochs, saved the model, and produced the evaluation results reported above.
+
+## Model status
+
+**Status: research / early release.**
+
+The core cross-lingual retrieval capability is demonstrated. The next meaningful validation step is a human-annotated benchmark of real Nigerian documents and real Igbo/Hausa/Yoruba information needs, especially for multi-paragraph documents.
+
+## Citation
+
+If you use Native-Bird in research or a project, please reference the model as:
+
+**Native-Bird: Cross-lingual Native-Language Embeddings for English Document Retrieval.**

config.json

@@ -0,0 +1,36 @@
+{
+  "add_cross_attention": false,
+  "architectures": [
+    "BertModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": null,
+  "classifier_dropout": null,
+  "directionality": "bidi",
+  "dtype": "float32",
+  "eos_token_id": null,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "is_decoder": false,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 0,
+  "pooler_fc_size": 768,
+  "pooler_num_attention_heads": 12,
+  "pooler_num_fc_layers": 3,
+  "pooler_size_per_head": 128,
+  "pooler_type": "first_token_transform",
+  "position_embedding_type": "absolute",
+  "tie_word_embeddings": true,
+  "transformers_version": "5.19.0",
+  "type_vocab_size": 2,
+  "use_cache": false,
+  "vocab_size": 501153
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "pytorch": "2.13.0+cu129",
+    "sentence_transformers": "6.1.0",
+    "transformers": "5.19.0"
+  },
+  "default_prompt_name": null,
+  "model_type": "SentenceTransformer",
+  "prompts": {
+    "document": "",
+    "query": ""
+  },
+  "similarity_fn_name": "cosine"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb68b8f24b63156c6faa4dde3c178f31e0ab942a09a361c73bc6cb9ade8eb935
+size 1883730160

modules.json

@@ -0,0 +1,26 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.base.modules.transformer.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.sentence_transformer.modules.pooling.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Dense",
+    "type": "sentence_transformers.base.modules.dense.Dense"
+  },
+  {
+    "idx": 3,
+    "name": "3",
+    "path": "3_Normalize",
+    "type": "sentence_transformers.base.modules.normalize.Normalize"
+  }
+]

results.json

@@ -0,0 +1,66 @@
+{
+ "baseline": {
+  "ig/clean": {
+   "R@1": 1.0,
+   "R@10": 1.0,
+   "MRR": 1.0
+  },
+  "ig/asr_noise": {
+   "R@1": 0.9853,
+   "R@10": 0.9951,
+   "MRR": 0.9888
+  },
+  "ha/clean": {
+   "R@1": 1.0,
+   "R@10": 1.0,
+   "MRR": 1.0
+  },
+  "ha/asr_noise": {
+   "R@1": 0.9951,
+   "R@10": 1.0,
+   "MRR": 0.9975
+  },
+  "yo/clean": {
+   "R@1": 0.9804,
+   "R@10": 1.0,
+   "MRR": 0.9871
+  },
+  "yo/asr_noise": {
+   "R@1": 0.9559,
+   "R@10": 0.9951,
+   "MRR": 0.9683
+  }
+ },
+ "finetuned": {
+  "ig/clean": {
+   "R@1": 1.0,
+   "R@10": 1.0,
+   "MRR": 1.0
+  },
+  "ig/asr_noise": {
+   "R@1": 1.0,
+   "R@10": 1.0,
+   "MRR": 1.0
+  },
+  "ha/clean": {
+   "R@1": 1.0,
+   "R@10": 1.0,
+   "MRR": 1.0
+  },
+  "ha/asr_noise": {
+   "R@1": 1.0,
+   "R@10": 1.0,
+   "MRR": 1.0
+  },
+  "yo/clean": {
+   "R@1": 0.9804,
+   "R@10": 1.0,
+   "MRR": 0.9902
+  },
+  "yo/asr_noise": {
+   "R@1": 0.9804,
+   "R@10": 1.0,
+   "MRR": 0.9867
+  }
+ }
+}

sentence_bert_config.json

@@ -0,0 +1,10 @@
+{
+    "transformer_task": "feature-extraction",
+    "modality_config": {
+        "text": {
+            "method": "forward",
+            "method_output_name": "last_hidden_state"
+        }
+    },
+    "module_output_name": "token_embeddings"
+}

test_native_bird.py

@@ -0,0 +1,22 @@
+from sentence_transformers import SentenceTransformer
+
+MODEL = "Modularcomputing/Native-Bird"
+
+query = "Neuklọs ahụ bụ ahụ ihe abụọ mejupụtara ya - neutrọn na protọn."
+documents = [
+    "The nucleus consists of two particles - neutrons and protons.",
+    "The liver is an organ responsible for many metabolic functions.",
+    "Photosynthesis converts light energy into chemical energy.",
+]
+
+model = SentenceTransformer(MODEL)
+q = model.encode(query, normalize_embeddings=True)
+d = model.encode(documents, normalize_embeddings=True)
+scores = d @ q
+
+print("Native-Bird cross-lingual retrieval test")
+for rank, i in enumerate(scores.argsort()[::-1], 1):
+    print(f"{rank}. score={scores[i]:.4f} | {documents[i]}")
+
+assert scores.argmax() == 0, "The expected English match was not ranked first."
+print("PASS: Igbo query retrieved the matching English document first.")

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:edba4e57ec22a2a74bbdb601d3f908e4699c34f8386d52ed055e6fe6bd2b51ac
+size 13632172

tokenizer_config.json

@@ -0,0 +1,18 @@
+{
+  "backend": "tokenizers",
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": false,
+  "full_tokenizer_file": null,
+  "is_local": false,
+  "local_files_only": false,
+  "mask_token": "[MASK]",
+  "model_max_length": 128,
+  "never_split": null,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}