CPU-friendly query encoder for EVIE-4.5B
#2
by Ryenhails - opened
Hi, thanks for releasing EVIE, very great work!
We distilled a 150M text-only query encoder for EVIE-4.5B (ColNanoVDR, arXiv:2609.34899). It supports all Prefix-MRL widths and works with existing EVIE indexes, including HAC-compressed ones, so queries can be encoded on CPU. On ViDoRe v3 it keeps 95-96% of EVIE-4.5B's NDCG@10 (93.8-94.9% with HAC).
Model: https://huggingface.co/nanovdr/ColNanoVDR-Q-Ettin150M-EVIE45B-2048-ML
If you find it useful, would you consider linking it to the Huggingface model card? Happy to open a PR. Thanks!
Sure, we'd be very happy! Thanks for your work!