yjoonjang commited on
Commit
2ce4a4d
·
verified ·
1 Parent(s): a64a617

Use full KURE-Reranker names in the figure and fix a missing space in the PPS note

Browse files
Files changed (2) hide show
  1. README.md +1 -1
  2. assets/pps_vs_ndcg9.png +2 -2
README.md CHANGED
@@ -163,7 +163,7 @@ The figure plots mean nDCG@10 against mean PPS across the nine Korean benchmarks
163
  | telepix/PIXIE-Spell-Reranker-Preview-0.6B | 596M | 0.7806 | 99.6 |
164
  | cross-encoder/ettin-reranker-1b-v1 | 1.0B | 0.6901 | 49.7 |
165
 
166
- PPS is measured on a single NVIDIA RTX A6000 48GB per model and averaged over the nine benchmarks.Inputs are length-sorted and dynamically padded within each batch.
167
 
168
  `jinaai/jina-reranker-v3` and `jinaai/jina-reranker-v3.5` are listwise rerankers that cannot be compared under the same 8,192-token condition on MLDR, so they are excluded from the 9-subset table and their MLDR cells are left blank below.
169
 
 
163
  | telepix/PIXIE-Spell-Reranker-Preview-0.6B | 596M | 0.7806 | 99.6 |
164
  | cross-encoder/ettin-reranker-1b-v1 | 1.0B | 0.6901 | 49.7 |
165
 
166
+ PPS is measured on a single NVIDIA RTX A6000 48GB per model and averaged over the nine benchmarks. Inputs are length-sorted and dynamically padded within each batch.
167
 
168
  `jinaai/jina-reranker-v3` and `jinaai/jina-reranker-v3.5` are listwise rerankers that cannot be compared under the same 8,192-token condition on MLDR, so they are excluded from the 9-subset table and their MLDR cells are left blank below.
169
 
assets/pps_vs_ndcg9.png CHANGED

Git LFS Details

  • SHA256: 99ba835554b7c39a471a033633472e0138339e45d9bfce2ef67cb3b08b4f5d51
  • Pointer size: 131 Bytes
  • Size of remote file: 110 kB

Git LFS Details

  • SHA256: 3a6982d9adfe31fe8f67992fb193bdbdbf105d7349591703260a56e150cadd6a
  • Pointer size: 131 Bytes
  • Size of remote file: 113 kB