Update evaluation: official Qwen3-Reranker and KaLM-Reranker-V1-Large-R2 added, seq-cls variants and ettin removed

#3
by yjoonjang - opened
NLP & AI - Korea University org
  • Tables now use the official Qwen/Qwen3-Reranker-{0.6B,4B,8B} instead of the tomaarsen seq-cls conversions, add KaLM-Embedding/KaLM-Reranker-V1-Large-R2, and drop cross-encoder/ettin-reranker-1b-v1 (not multilingual).
  • New figure; caption notes the non-uniform x-axis.
  • PPS note: same ~550 sampled pairs per task for every model; KaLM uses sdpa.
  • Model weights are unchanged.
yjoonjang changed pull request status to merged

Sign up or log in to comment