Text Ranking
sentence-transformers
Safetensors
Korean
English
modernbert
cross-encoder
reranker
korean
english
text-embeddings-inference
Instructions to use nlpai-lab/KURE-Reranker-nano with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use nlpai-lab/KURE-Reranker-nano with sentence-transformers:
from sentence_transformers import CrossEncoder model = CrossEncoder("nlpai-lab/KURE-Reranker-nano") query = "Which planet is known as the Red Planet?" passages = [ "Venus is often called Earth's twin because of its similar size and proximity.", "Mars, known for its reddish appearance, is often referred to as the Red Planet.", "Jupiter, the largest planet in our solar system, has a prominent red spot.", "Saturn, famous for its rings, is sometimes mistaken for the Red Planet." ] scores = model.predict([(query, passage) for passage in passages]) print(scores) - Inference
- Notebooks
- Google Colab
- Kaggle
File size: 23,552 Bytes
ab1e525 ba5d290 ab1e525 8514b9e d4e648c f3b3eff ab1e525 d4e648c ab1e525 63e39d7 ab1e525 63e39d7 ab1e525 63e39d7 ba5d290 ab1e525 d4e648c ab1e525 d4e648c f3b3eff d4e648c 04fb87d 8514b9e 04fb87d f3b3eff d4e648c 63e39d7 d4e648c 04fb87d 8514b9e 04fb87d d4e648c 63e39d7 d4e648c 04fb87d 8514b9e 04fb87d d4e648c ab1e525 63e39d7 ab1e525 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 | ---
pipeline_tag: text-ranking
library_name: sentence-transformers
license: apache-2.0
language:
- ko
- en
base_model:
- skt/A.X-Encoder-base
tags:
- sentence-transformers
- cross-encoder
- reranker
- korean
- english
---
<a href="https://github.com/nlpai-lab/KURE">
<img src="./assets/kure_logo.png" width="50%" alt="KURE logo">
</a>
# KURE-Reranker-nano
**KURE-Reranker-nano** is a lightweight, approximately **150M-parameter** Korean-English bilingual reranker. It jointly encodes a query and a candidate document and predicts a scalar relevance score. It is also served through the [KURE API](https://kure.kullm.ai/).
## Key Characteristics
- **Strong Korean reranking:** 87.57 average nDCG@10 across nine Korean benchmarks, the highest average among the evaluated models with fewer than 1B parameters and only 1.5 points below KURE-Reranker-base (1.7B).
- **Long-document reranking:** 79.66 nDCG@10 on MultiLongDocRetrieval (MLDR), the best among the evaluated models with fewer than 1B parameters.
- **High throughput:** 482.4 pairs per second averaged over nine benchmarks on an NVIDIA RTX A6000 48GB, about 19.8Γ Qwen3-Reranker-4B under the measurement conditions described below.
- **Lightweight:** Approximately 150M parameters, based on [`skt/A.X-Encoder-base`](https://huggingface.co/skt/A.X-Encoder-base).
## Model Overview
| Property | Value |
|---|---|
| Model type | Cross-encoder reranker |
| Backbone | A.X-Encoder-base |
| Parameters | 149M |
| Languages | Korean and English |
| Maximum inference input length | 8,192 tokens, including query, document, and special tokens |
| Output | One scalar relevance score per queryβdocument pair |
| License | Apache-2.0 |
## Usage
Install the required libraries:
```bash
pip install "sentence-transformers>=5.1.0" "transformers>=4.55.4" torch
```
### Sentence Transformers
```python
from sentence_transformers import CrossEncoder
model = CrossEncoder("nlpai-lab/KURE-Reranker-nano", max_length=8192)
query = "λνλ―Όκ΅μ μλλ μ΄λμΈκ°μ?"
documents = [
"λνλ―Όκ΅μ μλλ μμΈμ
λλ€.",
"The capital of South Korea is Seoul.",
"λ°λλλ μ΄λ μ§μμμ μ¬λ°°λλ κ³ΌμΌμ
λλ€.",
]
results = model.rank(query, documents, batch_size=8, return_documents=True)
for result in results:
print(f"{result['score']:.4f}\t{result['text']}")
```
For pair scoring without sorting:
```python
pairs = [(query, document) for document in documents]
scores = model.predict(pairs, batch_size=8)
```
### Transformers
```python
import torch
from transformers import AutoModelForSequenceClassification, AutoTokenizer
model_id = "nlpai-lab/KURE-Reranker-nano"
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForSequenceClassification.from_pretrained(model_id).to(device)
model.eval()
query = "λνλ―Όκ΅μ μλλ μ΄λμΈκ°μ?"
documents = [
"λνλ―Όκ΅μ μλλ μμΈμ
λλ€.",
"The capital of South Korea is Seoul.",
"λ°λλλ μ΄λ μ§μμμ μ¬λ°°λλ κ³ΌμΌμ
λλ€.",
]
inputs = tokenizer(
[query] * len(documents), documents,
padding=True, truncation=True, max_length=8192, return_tensors="pt",
).to(device)
with torch.inference_mode():
scores = model(**inputs).logits.squeeze(-1).float().cpu()
for index in torch.argsort(scores, descending=True).tolist():
print(f"{scores[index]:.4f}\t{documents[index]}")
```
### API
KURE-Reranker-nano is served at [kure.kullm.ai](https://kure.kullm.ai/). Sign in with GitHub there to get an API key.
```python
import os
import requests
query = "λνλ―Όκ΅μ μλλ μ΄λμΈκ°μ?"
documents = [
"λνλ―Όκ΅μ μλλ μμΈμ
λλ€.",
"The capital of South Korea is Seoul.",
"λ°λλλ μ΄λ μ§μμμ μ¬λ°°λλ κ³ΌμΌμ
λλ€.",
]
# Results come sorted by relevance_score (sigmoid of the logit, 0 to 1). top_n keeps only the best N
response = requests.post(
"https://kure.kullm.ai/api/v1/rerank",
headers={"Authorization": f"Bearer {os.environ['KURE_API_KEY']}"},
json={"model": "kure-reranker-nano", "query": query, "documents": documents, "return_documents": True},
)
response.raise_for_status()
for result in response.json()["results"]:
print(f"{result['relevance_score']:.4f}\t{result['document']['text']}")
# 0.9984 λνλ―Όκ΅μ μλλ μμΈμ
λλ€.
# 0.8661 The capital of South Korea is Seoul.
# 0.0000 λ°λλλ μ΄λ μ§μμμ μ¬λ°°λλ κ³ΌμΌμ
λλ€.
```
## Korean Reranking Evaluation
Scores are **nDCG@10**, and throughput is pairs per second (**PPS**).
Evaluation was conducted using the [reranker-simple-benchmark](https://github.com/instructkr/reranker-simple-benchmark) implementation as a reference.
<img src="./assets/pps_vs_ndcg9.png" width="700" alt="Reranking performance (mean nDCG@10) vs. throughput (mean PPS)">
The figure plots mean nDCG@10 against mean PPS across the nine Korean benchmarks, including MLDR. Dot color marks model size; stars mark the KURE-Reranker models. PPS uses each model's own input limit and its best measured batch size, so it measures neither speed at equal token lengths nor end-to-end retrieval latency. The x-axis is a non-uniform log scale that stretches 20β26 and compresses 26β50 pairs/s so that nearby points stay readable.
### Results β MTEB-ko-retrieval (9 subsets)
<!-- **곡μ 9κ° subset μ λͺ¨λ νκ°ν λͺ¨λΈ**μ 9-subset mean NDCG@10, PPS -->
<div style="width: fit-content; max-width: 100%; margin: 0 auto;">
<div style="overflow-x: auto;">
<table cellpadding="6" style="margin: 0 auto; border-collapse: collapse; color: inherit; text-align: right; font-size: 0.85em; line-height: 1.6; font-variant-numeric: tabular-nums;">
<thead>
<tr style="border-bottom: 1px solid rgba(128, 128, 128, 0.35);">
<th scope="col" style="text-align: left;">Model</th>
<th scope="col">Params</th>
<th scope="col">Mean NDCG@10</th>
<th scope="col">Mean PPS</th>
</tr>
</thead>
<tbody>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-8B</td><td>8.2B</td><td>0.8990</td><td>15.0</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-4B</td><td>4.0B</td><td>0.8916</td><td>24.3</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">KaLM-Embedding/KaLM-Reranker-V1-Large-R2</td><td>7.5B</td><td>0.8910</td><td>25.3</td></tr>
<tr><td style="text-align: left; white-space: nowrap;"><strong style="color: #c9496b;">nlpai-lab/KURE-Reranker-base</strong></td><td><span style="color: #c9496b;">1.7B</span></td><td><span style="color: #c9496b;">0.8908</span></td><td><span style="color: #c9496b;">56.2</span></td></tr>
<tr><td style="text-align: left; white-space: nowrap;"><strong style="color: #c9496b;">nlpai-lab/KURE-Reranker-nano</strong></td><td><span style="color: #c9496b;">149M</span></td><td><span style="color: #c9496b;">0.8757</span></td><td><span style="color: #c9496b;">482.4</span></td></tr>
<tr><td style="text-align: left; white-space: nowrap;">zeroentropy/zerank-2-reranker</td><td>4.0B</td><td>0.8652</td><td>29.3</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">mixedbread-ai/mxbai-rerank-large-v2</td><td>1.5B</td><td>0.8607</td><td>64.8</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">lightonai/LightOn-rerank-PW-4B</td><td>4.5B</td><td>0.8605</td><td>15.1</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-0.6B</td><td>596M</td><td>0.8528</td><td>101.0</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">BAAI/bge-reranker-v2-m3</td><td>568M</td><td>0.8518</td><td>412.6</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">nvidia/llama-nemotron-rerank-1b-v2</td><td>1.2B</td><td>0.8468</td><td>128.2</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">nlpai-lab/LAMAR-600m</td><td>568M</td><td>0.8375</td><td>415.0</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">dragonkue/bge-reranker-v2-m3-ko</td><td>568M</td><td>0.8199</td><td>409.1</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">BAAI/bge-reranker-v2-gemma</td><td>2.5B</td><td>0.8099</td><td>58.8</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">upskyy/ko-reranker-8k</td><td>568M</td><td>0.8054</td><td>409.8</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Dongjin-kr/ko-reranker</td><td>560M</td><td>0.7861</td><td>488.0</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">telepix/PIXIE-Spell-Reranker-Preview-0.6B</td><td>596M</td><td>0.7760</td><td>99.7</td></tr>
</tbody>
</table>
</div>
</div>
PPS is measured on a single NVIDIA RTX A6000 48GB per model and averaged over the nine benchmarks. For each benchmark, every model is timed on the same ~550 sampled queryβdocument pairs (whole queries, fixed seed). Inputs are length-sorted and dynamically padded within each batch. Models run in bf16 with flash_attention_2, except `KaLM-Embedding/KaLM-Reranker-V1-Large-R2`, which uses sdpa because transformers does not support flash_attention_2 for T5Gemma2. Each query is reranked over its gold documents plus, as negatives, the BM25 top-50 minus the golds; BelebeleRetrieval uses its kor_Hang-kor_Hang subset.
`jinaai/jina-reranker-v3` and `jinaai/jina-reranker-v3.5` are listwise rerankers that cannot be compared under the same 8,192-token condition on MLDR, so they are excluded from the 9-subset table and their MLDR cells are left blank below.
<details>
<summary>Per-dataset NDCG@10</summary>
<div style="width: fit-content; max-width: 100%; margin: 0 auto;">
<div style="overflow-x: auto;">
<table cellpadding="6" style="margin: 0 auto; border-collapse: collapse; color: inherit; text-align: right; font-size: 0.85em; line-height: 1.6; font-variant-numeric: tabular-nums;">
<thead>
<tr style="border-bottom: 1px solid rgba(128, 128, 128, 0.35);">
<th scope="col" style="text-align: left;">Model</th>
<th scope="col">Params</th>
<th scope="col">Ko-StrategyQA</th>
<th scope="col">AutoRAGRetrieval</th>
<th scope="col">PublicHealthQA</th>
<th scope="col">BelebeleRetrieval</th>
<th scope="col">MIRACLRetrieval</th>
<th scope="col">MrTidyRetrieval</th>
<th scope="col">MultiLongDocRetrieval</th>
<th scope="col">SQuADKorV1Retrieval</th>
<th scope="col">LawIRKo</th>
</tr>
</thead>
<tbody>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-8B</td><td>8.2B</td><td>0.8720</td><td>0.9653</td><td>0.8654</td><td>0.9785</td><td>0.8513</td><td>0.8416</td><td>0.8255</td><td>0.9897</td><td>0.9013</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-4B</td><td>4.0B</td><td>0.8733</td><td>0.9630</td><td>0.8442</td><td>0.9794</td><td>0.8559</td><td>0.8298</td><td>0.8161</td><td>0.9861</td><td>0.8766</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">KaLM-Embedding/KaLM-Reranker-V1-Large-R2</td><td>7.5B</td><td>0.8796</td><td>0.9415</td><td>0.8633</td><td>0.9809</td><td>0.8382</td><td>0.8500</td><td>0.7970</td><td>0.9863</td><td>0.8824</td></tr>
<tr><td style="text-align: left; white-space: nowrap;"><strong style="color: #c9496b;">nlpai-lab/KURE-Reranker-base</strong></td><td><span style="color: #c9496b;">1.7B</span></td><td><span style="color: #c9496b;">0.8605</span></td><td><span style="color: #c9496b;">0.9870</span></td><td><span style="color: #c9496b;">0.8331</span></td><td><span style="color: #c9496b;">0.9757</span></td><td><span style="color: #c9496b;">0.8496</span></td><td><span style="color: #c9496b;">0.8252</span></td><td><span style="color: #c9496b;">0.8189</span></td><td><span style="color: #c9496b;">0.9907</span></td><td><span style="color: #c9496b;">0.8768</span></td></tr>
<tr><td style="text-align: left; white-space: nowrap;"><strong style="color: #c9496b;">nlpai-lab/KURE-Reranker-nano</strong></td><td><span style="color: #c9496b;">149M</span></td><td><span style="color: #c9496b;">0.8582</span></td><td><span style="color: #c9496b;">0.9741</span></td><td><span style="color: #c9496b;">0.8078</span></td><td><span style="color: #c9496b;">0.9768</span></td><td><span style="color: #c9496b;">0.8400</span></td><td><span style="color: #c9496b;">0.8011</span></td><td><span style="color: #c9496b;">0.7966</span></td><td><span style="color: #c9496b;">0.9895</span></td><td><span style="color: #c9496b;">0.8368</span></td></tr>
<tr><td style="text-align: left; white-space: nowrap;">jinaai/jina-reranker-v3.5</td><td>597M</td><td>0.8539</td><td>0.9838</td><td>0.8337</td><td>0.9659</td><td>0.8565</td><td>0.8194</td><td>β</td><td>0.9887</td><td>0.8545</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">jinaai/jina-reranker-v3</td><td>597M</td><td>0.8553</td><td>0.9773</td><td>0.7762</td><td>0.9606</td><td>0.8449</td><td>0.8104</td><td>β</td><td>0.9859</td><td>0.8546</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">zeroentropy/zerank-2-reranker</td><td>4.0B</td><td>0.8712</td><td>0.9436</td><td>0.8377</td><td>0.9731</td><td>0.8003</td><td>0.8027</td><td>0.7120</td><td>0.9791</td><td>0.8669</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">mixedbread-ai/mxbai-rerank-large-v2</td><td>1.5B</td><td>0.8563</td><td>0.9531</td><td>0.8407</td><td>0.9659</td><td>0.7939</td><td>0.8771</td><td>0.6787</td><td>0.9681</td><td>0.8130</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">lightonai/LightOn-rerank-PW-4B</td><td>4.5B</td><td>0.8567</td><td>0.9321</td><td>0.8312</td><td>0.9735</td><td>0.8072</td><td>0.8091</td><td>0.7609</td><td>0.9803</td><td>0.7938</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-0.6B</td><td>596M</td><td>0.8336</td><td>0.9321</td><td>0.8092</td><td>0.9721</td><td>0.8470</td><td>0.7325</td><td>0.7819</td><td>0.9804</td><td>0.7865</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">BAAI/bge-reranker-v2-m3</td><td>568M</td><td>0.8487</td><td>0.9663</td><td>0.7982</td><td>0.9725</td><td>0.8129</td><td>0.8222</td><td>0.6690</td><td>0.9853</td><td>0.7906</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">nvidia/llama-nemotron-rerank-1b-v2</td><td>1.2B</td><td>0.8536</td><td>0.9480</td><td>0.8130</td><td>0.9755</td><td>0.8182</td><td>0.8026</td><td>0.6719</td><td>0.9858</td><td>0.7527</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">nlpai-lab/LAMAR-600m</td><td>568M</td><td>0.8461</td><td>0.9591</td><td>0.8044</td><td>0.9740</td><td>0.8214</td><td>0.7975</td><td>0.5679</td><td>0.9850</td><td>0.7822</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">dragonkue/bge-reranker-v2-m3-ko</td><td>568M</td><td>0.8232</td><td>0.9684</td><td>0.8155</td><td>0.9744</td><td>0.7573</td><td>0.6776</td><td>0.7061</td><td>0.9846</td><td>0.6721</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">BAAI/bge-reranker-v2-gemma</td><td>2.5B</td><td>0.8614</td><td>0.9407</td><td>0.8069</td><td>0.9696</td><td>0.8362</td><td>0.8429</td><td>0.2881</td><td>0.9858</td><td>0.7572</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">upskyy/ko-reranker-8k</td><td>568M</td><td>0.8143</td><td>0.9230</td><td>0.7792</td><td>0.9609</td><td>0.7249</td><td>0.6998</td><td>0.5975</td><td>0.9718</td><td>0.7770</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Dongjin-kr/ko-reranker</td><td>560M</td><td>0.8468</td><td>0.9014</td><td>0.6976</td><td>0.9655</td><td>0.8017</td><td>0.7772</td><td>0.3721</td><td>0.9785</td><td>0.7343</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">telepix/PIXIE-Spell-Reranker-Preview-0.6B</td><td>596M</td><td>0.8329</td><td>0.9794</td><td>0.8211</td><td>0.9689</td><td>0.8449</td><td>0.7650</td><td>0.1829</td><td>0.9850</td><td>0.6042</td></tr>
</tbody>
</table>
</div>
</div>
</details>
<details>
<summary>Per-dataset PPS</summary>
<div style="width: fit-content; max-width: 100%; margin: 0 auto;">
<div style="overflow-x: auto;">
<table cellpadding="6" style="margin: 0 auto; border-collapse: collapse; color: inherit; text-align: right; font-size: 0.85em; line-height: 1.6; font-variant-numeric: tabular-nums;">
<thead>
<tr style="border-bottom: 1px solid rgba(128, 128, 128, 0.35);">
<th scope="col" style="text-align: left;">Model</th>
<th scope="col">Params</th>
<th scope="col">Ko-StrategyQA</th>
<th scope="col">AutoRAGRetrieval</th>
<th scope="col">PublicHealthQA</th>
<th scope="col">BelebeleRetrieval</th>
<th scope="col">MIRACLRetrieval</th>
<th scope="col">MrTidyRetrieval</th>
<th scope="col">MultiLongDocRetrieval</th>
<th scope="col">SQuADKorV1Retrieval</th>
<th scope="col">LawIRKo</th>
</tr>
</thead>
<tbody>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-8B</td><td>8.2B</td><td>16.5</td><td>7.4</td><td>15.3</td><td>20.5</td><td>25.0</td><td>26.6</td><td>0.7</td><td>10.8</td><td>12.4</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-4B</td><td>4.0B</td><td>26.2</td><td>11.8</td><td>25.6</td><td>34.5</td><td>40.1</td><td>42.8</td><td>1.1</td><td>17.1</td><td>19.9</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">KaLM-Embedding/KaLM-Reranker-V1-Large-R2</td><td>7.5B</td><td>28.6</td><td>12.4</td><td>25.4</td><td>36.9</td><td>39.6</td><td>43.8</td><td>0.8</td><td>18.7</td><td>21.4</td></tr>
<tr><td style="text-align: left; white-space: nowrap;"><strong style="color: #c9496b;">nlpai-lab/KURE-Reranker-base</strong></td><td><span style="color: #c9496b;">1.7B</span></td><td><span style="color: #c9496b;">60.9</span></td><td><span style="color: #c9496b;">27.9</span></td><td><span style="color: #c9496b;">58.5</span></td><td><span style="color: #c9496b;">77.9</span></td><td><span style="color: #c9496b;">91.7</span></td><td><span style="color: #c9496b;">99.7</span></td><td><span style="color: #c9496b;">2.5</span></td><td><span style="color: #c9496b;">39.9</span></td><td><span style="color: #c9496b;">46.2</span></td></tr>
<tr><td style="text-align: left; white-space: nowrap;"><strong style="color: #c9496b;">nlpai-lab/KURE-Reranker-nano</strong></td><td><span style="color: #c9496b;">149M</span></td><td><span style="color: #c9496b;">475.4</span></td><td><span style="color: #c9496b;">233.2</span></td><td><span style="color: #c9496b;">529.0</span></td><td><span style="color: #c9496b;">750.0</span></td><td><span style="color: #c9496b;">765.8</span></td><td><span style="color: #c9496b;">855.2</span></td><td><span style="color: #c9496b;">16.5</span></td><td><span style="color: #c9496b;">330.8</span></td><td><span style="color: #c9496b;">386.0</span></td></tr>
<tr><td style="text-align: left; white-space: nowrap;">jinaai/jina-reranker-v3.5</td><td>597M</td><td>141.0</td><td>38.6</td><td>123.2</td><td>197.5</td><td>277.3</td><td>295.7</td><td>β</td><td>68.4</td><td>86.7</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">jinaai/jina-reranker-v3</td><td>597M</td><td>113.8</td><td>25.0</td><td>95.7</td><td>166.3</td><td>244.6</td><td>261.6</td><td>β</td><td>48.7</td><td>64.0</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">zeroentropy/zerank-2-reranker</td><td>4.0B</td><td>31.0</td><td>12.7</td><td>29.5</td><td>41.4</td><td>51.0</td><td>56.4</td><td>1.1</td><td>18.8</td><td>22.3</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">mixedbread-ai/mxbai-rerank-large-v2</td><td>1.5B</td><td>70.0</td><td>32.9</td><td>68.0</td><td>89.8</td><td>104.2</td><td>113.6</td><td>3.2</td><td>47.0</td><td>54.7</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">lightonai/LightOn-rerank-PW-4B</td><td>4.5B</td><td>16.2</td><td>7.3</td><td>17.0</td><td>22.2</td><td>23.4</td><td>26.1</td><td>0.7</td><td>10.7</td><td>12.4</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Qwen/Qwen3-Reranker-0.6B</td><td>596M</td><td>105.9</td><td>49.4</td><td>109.5</td><td>145.8</td><td>162.6</td><td>177.4</td><td>4.3</td><td>70.8</td><td>83.6</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">BAAI/bge-reranker-v2-m3</td><td>568M</td><td>420.7</td><td>195.6</td><td>440.9</td><td>651.8</td><td>653.2</td><td>724.8</td><td>9.3</td><td>271.6</td><td>345.5</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">nvidia/llama-nemotron-rerank-1b-v2</td><td>1.2B</td><td>133.7</td><td>54.4</td><td>131.6</td><td>186.3</td><td>220.0</td><td>243.1</td><td>3.9</td><td>84.9</td><td>95.9</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">nlpai-lab/LAMAR-600m</td><td>568M</td><td>418.0</td><td>196.5</td><td>442.5</td><td>651.1</td><td>656.7</td><td>742.5</td><td>9.2</td><td>275.0</td><td>343.8</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">dragonkue/bge-reranker-v2-m3-ko</td><td>568M</td><td>416.9</td><td>195.1</td><td>434.4</td><td>641.3</td><td>653.4</td><td>716.7</td><td>9.2</td><td>271.9</td><td>342.7</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">BAAI/bge-reranker-v2-gemma</td><td>2.5B</td><td>64.7</td><td>26.1</td><td>60.5</td><td>83.8</td><td>99.8</td><td>106.8</td><td>2.5</td><td>40.0</td><td>44.7</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">upskyy/ko-reranker-8k</td><td>568M</td><td>411.8</td><td>195.6</td><td>436.2</td><td>641.7</td><td>649.3</td><td>726.0</td><td>9.2</td><td>275.1</td><td>342.8</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">Dongjin-kr/ko-reranker</td><td>560M</td><td>520.8</td><td>258.0</td><td>468.3</td><td>644.1</td><td>747.6</td><td>765.2</td><td>272.7</td><td>334.4</td><td>381.2</td></tr>
<tr><td style="text-align: left; white-space: nowrap;">telepix/PIXIE-Spell-Reranker-Preview-0.6B</td><td>596M</td><td>104.6</td><td>49.4</td><td>106.3</td><td>141.5</td><td>160.5</td><td>175.6</td><td>4.3</td><td>72.1</td><td>82.6</td></tr>
</tbody>
</table>
</div>
</div>
Batch size starts at 8 and doubles until an out-of-memory error. Samples are repeated to fill complete batches. After warmup, three full passes are timed with CUDA events. Throughput is the total number of processed pairs divided by the accumulated GPU forward time. The highest-throughput successful batch is reported. Tokenization, data loading, and CPU preprocessing are excluded. The batch-search approach is informed by the [Ettin reranker speed benchmark](https://huggingface.co/blog/ettin-reranker#speed).
</details>
## Citation
```bibtex
@misc{kure-reranker-nano,
title = {KURE-Reranker-nano: A Lightweight KoreanβEnglish Bilingual Reranking Model},
author = {Hong, Seongtae and Jang, Youngjoon and Son, Junyoung and Lee, Taemin and Lim, Heuiseok},
year = {2026},
url = {https://huggingface.co/nlpai-lab/KURE-Reranker-nano},
}
```
|