Use full KURE-Reranker names in the figure and fix a missing space in the PPS note

#2
by yjoonjang - opened
Files changed (2) hide show
  1. README.md +1 -1
  2. assets/pps_vs_ndcg9.png +2 -2
README.md CHANGED
@@ -143,7 +143,7 @@ The figure plots mean nDCG@10 against mean PPS across the nine Korean benchmarks
143
  | telepix/PIXIE-Spell-Reranker-Preview-0.6B | 596M | 0.7806 | 99.6 |
144
  | cross-encoder/ettin-reranker-1b-v1 | 1.0B | 0.6901 | 49.7 |
145
 
146
- PPS is measured on a single NVIDIA RTX A6000 48GB per model and averaged over the nine benchmarks.Inputs are length-sorted and dynamically padded within each batch.
147
 
148
  `jinaai/jina-reranker-v3` and `jinaai/jina-reranker-v3.5` are listwise rerankers that cannot be compared under the same 8,192-token condition on MLDR, so they are excluded from the 9-subset table and their MLDR cells are left blank below.
149
 
 
143
  | telepix/PIXIE-Spell-Reranker-Preview-0.6B | 596M | 0.7806 | 99.6 |
144
  | cross-encoder/ettin-reranker-1b-v1 | 1.0B | 0.6901 | 49.7 |
145
 
146
+ PPS is measured on a single NVIDIA RTX A6000 48GB per model and averaged over the nine benchmarks. Inputs are length-sorted and dynamically padded within each batch.
147
 
148
  `jinaai/jina-reranker-v3` and `jinaai/jina-reranker-v3.5` are listwise rerankers that cannot be compared under the same 8,192-token condition on MLDR, so they are excluded from the 9-subset table and their MLDR cells are left blank below.
149
 
assets/pps_vs_ndcg9.png CHANGED

Git LFS Details

  • SHA256: 99ba835554b7c39a471a033633472e0138339e45d9bfce2ef67cb3b08b4f5d51
  • Pointer size: 131 Bytes
  • Size of remote file: 110 kB

Git LFS Details

  • SHA256: 5b10c89e253670c6d812bd652cee8c9b9591983ede58a9d7ce7472fde6653c95
  • Pointer size: 131 Bytes
  • Size of remote file: 113 kB