Johonson
/

adasparse-8B

sparse-retrieval

information-retrieval

Model card Files Files and versions

Johonson commited on Jul 15

Commit

b4b323d

·

verified ·

1 Parent(s): 12084ee

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ tags:
 # AdaSparse-8B (LLaMA-3-8B, MS MARCO)
 AdaSparse sparse retriever built on `meta-llama/Meta-Llama-3-8B`, trained on MS MARCO with
-contrastive + knowledge-distillation loss and a learned per-term threshold. This repository
 contains the LoRA adapter (including the learned `q_thres`/`d_thres` thresholding modules),
 the tokenizer, and the retriever config.

 # AdaSparse-8B (LLaMA-3-8B, MS MARCO)
 AdaSparse sparse retriever built on `meta-llama/Meta-Llama-3-8B`, trained on MS MARCO with
+contrastive + knowledge-distillation loss, an adaptive top-k pruning and a learned per-term threshold. This repository
 contains the LoRA adapter (including the learned `q_thres`/`d_thres` thresholding modules),
 the tokenizer, and the retriever config.