hgissbkh commited on
Commit
39e7612
·
verified ·
1 Parent(s): d2be6b9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -5
README.md CHANGED
@@ -1,10 +1,8 @@
1
  ---
2
  datasets:
3
- - hgissbkh/BERTJudge-Dataset-Train
4
  language:
5
  - en
6
- metrics:
7
- - accuracy
8
  base_model:
9
  - EuroBERT/EuroBERT-210m
10
  ---
@@ -13,7 +11,8 @@ base_model:
13
  BERT-as-a-Judge is a family of encoder-based models designed for efficient, reference-based evaluation of LLM outputs. Moving beyond rigid lexical extraction and matching, these models evaluate semantic correctness, accommodating variations in phrasing and formatting while using only a fraction of the computational resources required by LLM-as-a-Judge approaches.
14
 
15
  ## Model Summary
16
- - **Paper:** [BERT-as-a-Judge: A Robust Alternative to Lexical Methods for Efficient Reference-Based LLM Evaluation](URL_TO_PAPER)
 
17
  - **Model Type:** Encoder-based Judge (EuroBERT-210m backbone)
18
  - **Language:** English
19
 
@@ -55,4 +54,21 @@ with torch.no_grad():
55
  logits = model(**inputs).logits
56
  prediction = torch.argmax(logits, dim=-1)
57
 
58
- print("Correct" if prediction.item() == 1 else "Incorrect")
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  datasets:
3
+ - hgissbkh/BERTJudge-Dataset
4
  language:
5
  - en
 
 
6
  base_model:
7
  - EuroBERT/EuroBERT-210m
8
  ---
 
11
  BERT-as-a-Judge is a family of encoder-based models designed for efficient, reference-based evaluation of LLM outputs. Moving beyond rigid lexical extraction and matching, these models evaluate semantic correctness, accommodating variations in phrasing and formatting while using only a fraction of the computational resources required by LLM-as-a-Judge approaches.
12
 
13
  ## Model Summary
14
+ - **Paper:** [BERT-as-a-Judge: A Robust Alternative to Lexical Methods for Efficient Reference-Based LLM Evaluation](https://arxiv.org/abs/2604.09497)
15
+ - **Code:** [https://github.com/artefactory/BERT-as-a-Judge](https://github.com/artefactory/BERT-as-a-Judge)
16
  - **Model Type:** Encoder-based Judge (EuroBERT-210m backbone)
17
  - **Language:** English
18
 
 
54
  logits = model(**inputs).logits
55
  prediction = torch.argmax(logits, dim=-1)
56
 
57
+ print("Correct" if prediction.item() == 1 else "Incorrect")
58
+ ```
59
+
60
+ ## Citation
61
+
62
+ If you find this model useful for your research, please consider citing:
63
+
64
+ ```bibtex
65
+ @article{gisserotboukhlef2026bertasajudgerobustalternativelexical,
66
+ title={BERT-as-a-Judge: A Robust Alternative to Lexical Methods for Efficient Reference-Based LLM Evaluation},
67
+ author={Gisserot-Boukhlef, Hippolyte and Boizard, Nicolas and Malherbe, Emmanuel and Hudelot, C{\'e}line and Colombo, Pierre},
68
+ year={2026},
69
+ eprint={2604.09497},
70
+ archivePrefix={arXiv},
71
+ primaryClass={cs.CL},
72
+ url={https://arxiv.org/abs/2604.09497}
73
+ }
74
+ ```