Feature Extraction
Transformers
Safetensors
English
base_encoder
scientific-retrieval
dense-passage-retrieval
dual-encoder
citation-prediction
talk2ref
SBERT
Instructions to use s8frbroy/talk2ref_ref_key_cited_paper_encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use s8frbroy/talk2ref_ref_key_cited_paper_encoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="s8frbroy/talk2ref_ref_key_cited_paper_encoder")# pip install -U transformers accelerate # Load model directly from transformers import BaseEncoderHF model = BaseEncoderHF.from_pretrained("s8frbroy/talk2ref_ref_key_cited_paper_encoder", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -84,9 +84,9 @@ The cited-paper encoder was trained jointly with the query-talk encoder under a
|
|
| 84 |
Each talk *Ti* and paper *Rj* is encoded into embeddings *fT(Ti)* and *fR(Rj)*.
|
| 85 |
Their dot-product similarity *sij = fT(Ti)路fR(Rj)* is optimized using a sigmoid-based binary loss supporting multiple positives per query:
|
| 86 |
|
| 87 |
-
|
| 88 |
L = - \sum_i [y_i \log \sigma(s_i) + (1 - y_i)\log(1 - \sigma(s_i))]
|
| 89 |
-
|
| 90 |
|
| 91 |
Negatives are sampled in-batch from other talk鈥損aper pairs.
|
| 92 |
Before training, a **domain adaptation stage** aligned each talk with its own paper鈥檚 abstract to adapt to scientific and spoken-language data.
|
|
|
|
| 84 |
Each talk *Ti* and paper *Rj* is encoded into embeddings *fT(Ti)* and *fR(Rj)*.
|
| 85 |
Their dot-product similarity *sij = fT(Ti)路fR(Rj)* is optimized using a sigmoid-based binary loss supporting multiple positives per query:
|
| 86 |
|
| 87 |
+
$$
|
| 88 |
L = - \sum_i [y_i \log \sigma(s_i) + (1 - y_i)\log(1 - \sigma(s_i))]
|
| 89 |
+
$$
|
| 90 |
|
| 91 |
Negatives are sampled in-batch from other talk鈥損aper pairs.
|
| 92 |
Before training, a **domain adaptation stage** aligned each talk with its own paper鈥檚 abstract to adapt to scientific and spoken-language data.
|