minsik-oh commited on
Commit
90c0798
·
verified ·
1 Parent(s): f595380

Add paper citation and simplify result wording

Browse files
Files changed (2) hide show
  1. README.md +17 -4
  2. checksums.json +1 -1
README.md CHANGED
@@ -29,16 +29,15 @@ same prompt. Scores are not probabilities and are not calibrated across models.
29
  | Measurement | Accuracy |
30
  |---|---:|
31
  | Starting global model, overall | 51.6393% |
32
- | Selected checkpoint, overall | 64.7541% |
33
 
34
  These are original in-memory post-training experiment scores, with no model-mode
35
  or random-state reset before scoring. A fresh `eval()` inference session disables
36
  dropout and may produce different accuracy. `validation.json` checks loading and
37
  finite, repeatable inference on generic probes; it is not a benchmark result.
38
 
39
- The country configuration was selected through exploratory trials on a fixed
40
- test split. It is not an unbiased held-out estimate or the paper's three-run mean.
41
- The independent execution rerun reproduced the selected recorded accuracy.
42
 
43
  ## Training and reproduction
44
 
@@ -99,3 +98,17 @@ The [OpenAssistant base model](https://huggingface.co/OpenAssistant/reward-model
99
  marked MIT. The [PRISM dataset card](https://huggingface.co/datasets/HannahRoseKirk/prism-alignment)
100
  lists human text as CC-BY-4.0 and model responses as CC-BY-NC-4.0, subject to
101
  original provider terms. This package contains no PRISM records.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  | Measurement | Accuracy |
30
  |---|---:|
31
  | Starting global model, overall | 51.6393% |
32
+ | SCPO model, overall | 64.7541% |
33
 
34
  These are original in-memory post-training experiment scores, with no model-mode
35
  or random-state reset before scoring. A fresh `eval()` inference session disables
36
  dropout and may produce different accuracy. `validation.json` checks loading and
37
  finite, repeatable inference on generic probes; it is not a benchmark result.
38
 
39
+ Configurations were tuned on a fixed test split; these checkpoint results differ
40
+ from the paper’s three-run averages. Reproduction details are in `provenance.json`.
 
41
 
42
  ## Training and reproduction
43
 
 
98
  marked MIT. The [PRISM dataset card](https://huggingface.co/datasets/HannahRoseKirk/prism-alignment)
99
  lists human text as CC-BY-4.0 and model responses as CC-BY-NC-4.0, subject to
100
  original provider terms. This package contains no PRISM records.
101
+
102
+ ## Citation
103
+
104
+ ```bibtex
105
+ @misc{scpo,
106
+ title={Steerable Cultural Preference Optimization of Reward Models},
107
+ author={Minsik Oh and Advit Deepak and Sophie Wu and Douwe Kiela and Ekaterina Shutova},
108
+ year={2026},
109
+ eprint={2606.18606},
110
+ archivePrefix={arXiv},
111
+ primaryClass={cs.CL},
112
+ url={https://arxiv.org/abs/2606.18606},
113
+ }
114
+ ```
checksums.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "LICENSE": "871f503d007714998cf2b9d35d73563b856182070552156771260aa3d12d953e",
3
- "README.md": "d34ea7279e544d0fd2f906c2add3ac5ff03abf439fb5992a9017ec3e66ca24b0",
4
  "added_tokens.json": "dc046d04c9b0ada7ae6f1dc89c465801799acdf0c9a6aab8c15a1b2d5ca4e91f",
5
  "config.json": "d88248219ef56b7227b25161fe83bfc1f949d77032367525b372270ef80bef17",
6
  "model.safetensors": "cf720f4fc08e4ee3dca4a191f9171fb9e787ffd79b7c09faf80192439a4af473",
 
1
  {
2
  "LICENSE": "871f503d007714998cf2b9d35d73563b856182070552156771260aa3d12d953e",
3
+ "README.md": "0da7775a463899974191855d0332531d1d15270459a19ff1d514033cca200fea",
4
  "added_tokens.json": "dc046d04c9b0ada7ae6f1dc89c465801799acdf0c9a6aab8c15a1b2d5ca4e91f",
5
  "config.json": "d88248219ef56b7227b25161fe83bfc1f949d77032367525b372270ef80bef17",
6
  "model.safetensors": "cf720f4fc08e4ee3dca4a191f9171fb9e787ffd79b7c09faf80192439a4af473",