Text Classification
Transformers
Safetensors
English
deberta-v2
reward-model
scpo
cultural-alignment
mexico
text-embeddings-inference
Instructions to use MulticulturalAlignment/scpo-reward-model-mexico with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MulticulturalAlignment/scpo-reward-model-mexico with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="MulticulturalAlignment/scpo-reward-model-mexico")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("MulticulturalAlignment/scpo-reward-model-mexico") model = AutoModelForSequenceClassification.from_pretrained("MulticulturalAlignment/scpo-reward-model-mexico", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add paper citation and simplify result wording
Browse files- README.md +17 -4
- checksums.json +1 -1
README.md
CHANGED
|
@@ -29,16 +29,15 @@ same prompt. Scores are not probabilities and are not calibrated across models.
|
|
| 29 |
| Measurement | Accuracy |
|
| 30 |
|---|---:|
|
| 31 |
| Starting global model, overall | 51.6393% |
|
| 32 |
-
|
|
| 33 |
|
| 34 |
These are original in-memory post-training experiment scores, with no model-mode
|
| 35 |
or random-state reset before scoring. A fresh `eval()` inference session disables
|
| 36 |
dropout and may produce different accuracy. `validation.json` checks loading and
|
| 37 |
finite, repeatable inference on generic probes; it is not a benchmark result.
|
| 38 |
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
The independent execution rerun reproduced the selected recorded accuracy.
|
| 42 |
|
| 43 |
## Training and reproduction
|
| 44 |
|
|
@@ -99,3 +98,17 @@ The [OpenAssistant base model](https://huggingface.co/OpenAssistant/reward-model
|
|
| 99 |
marked MIT. The [PRISM dataset card](https://huggingface.co/datasets/HannahRoseKirk/prism-alignment)
|
| 100 |
lists human text as CC-BY-4.0 and model responses as CC-BY-NC-4.0, subject to
|
| 101 |
original provider terms. This package contains no PRISM records.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
| Measurement | Accuracy |
|
| 30 |
|---|---:|
|
| 31 |
| Starting global model, overall | 51.6393% |
|
| 32 |
+
| SCPO model, overall | 64.7541% |
|
| 33 |
|
| 34 |
These are original in-memory post-training experiment scores, with no model-mode
|
| 35 |
or random-state reset before scoring. A fresh `eval()` inference session disables
|
| 36 |
dropout and may produce different accuracy. `validation.json` checks loading and
|
| 37 |
finite, repeatable inference on generic probes; it is not a benchmark result.
|
| 38 |
|
| 39 |
+
Configurations were tuned on a fixed test split; these checkpoint results differ
|
| 40 |
+
from the paper’s three-run averages. Reproduction details are in `provenance.json`.
|
|
|
|
| 41 |
|
| 42 |
## Training and reproduction
|
| 43 |
|
|
|
|
| 98 |
marked MIT. The [PRISM dataset card](https://huggingface.co/datasets/HannahRoseKirk/prism-alignment)
|
| 99 |
lists human text as CC-BY-4.0 and model responses as CC-BY-NC-4.0, subject to
|
| 100 |
original provider terms. This package contains no PRISM records.
|
| 101 |
+
|
| 102 |
+
## Citation
|
| 103 |
+
|
| 104 |
+
```bibtex
|
| 105 |
+
@misc{scpo,
|
| 106 |
+
title={Steerable Cultural Preference Optimization of Reward Models},
|
| 107 |
+
author={Minsik Oh and Advit Deepak and Sophie Wu and Douwe Kiela and Ekaterina Shutova},
|
| 108 |
+
year={2026},
|
| 109 |
+
eprint={2606.18606},
|
| 110 |
+
archivePrefix={arXiv},
|
| 111 |
+
primaryClass={cs.CL},
|
| 112 |
+
url={https://arxiv.org/abs/2606.18606},
|
| 113 |
+
}
|
| 114 |
+
```
|
checksums.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
{
|
| 2 |
"LICENSE": "871f503d007714998cf2b9d35d73563b856182070552156771260aa3d12d953e",
|
| 3 |
-
"README.md": "
|
| 4 |
"added_tokens.json": "dc046d04c9b0ada7ae6f1dc89c465801799acdf0c9a6aab8c15a1b2d5ca4e91f",
|
| 5 |
"config.json": "d88248219ef56b7227b25161fe83bfc1f949d77032367525b372270ef80bef17",
|
| 6 |
"model.safetensors": "cf720f4fc08e4ee3dca4a191f9171fb9e787ffd79b7c09faf80192439a4af473",
|
|
|
|
| 1 |
{
|
| 2 |
"LICENSE": "871f503d007714998cf2b9d35d73563b856182070552156771260aa3d12d953e",
|
| 3 |
+
"README.md": "0da7775a463899974191855d0332531d1d15270459a19ff1d514033cca200fea",
|
| 4 |
"added_tokens.json": "dc046d04c9b0ada7ae6f1dc89c465801799acdf0c9a6aab8c15a1b2d5ca4e91f",
|
| 5 |
"config.json": "d88248219ef56b7227b25161fe83bfc1f949d77032367525b372270ef80bef17",
|
| 6 |
"model.safetensors": "cf720f4fc08e4ee3dca4a191f9171fb9e787ffd79b7c09faf80192439a4af473",
|