Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +33 -0
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ pipeline_tag: text-classification
4
+ ---
5
+
6
+ # Unified PRM (MAHALO)
7
+
8
+ This repository contains the Unified Process Reward Model (PRM) introduced in the paper [Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards](https://huggingface.co/papers/2510.01167).
9
+
10
+ ## Model Description
11
+ This model is a generalist reward model trained across seven dimensions spanning multiple domains:
12
+ - **Mathematics**: Accuracy and engagement.
13
+ - **Human Values**: Helpfulness, honesty, and truthfulness.
14
+ - **Socratic Mind (AI Tutoring)**: Accuracy and engagement.
15
+
16
+ It is based on a Llama-3 8B backbone and fine-tuned for sequence classification to provide step-level supervision as part of the **MAHALO** (Multi-Action-Head ALignment with PRM-guided DecOding) framework.
17
+
18
+ - **Paper:** [Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards](https://arxiv.org/abs/2510.01167)
19
+ - **Repository:** [GitHub - pearls-lab/multiobj-align](https://github.com/pearls-lab/multiobj-align)
20
+
21
+ ## Citation
22
+
23
+ If you find this model useful, please consider citing the original work:
24
+
25
+ ```bibtex
26
+ @article{shen2025simultaneous,
27
+ title={Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards},
28
+ author={Shen, Yiran and Xia, Yu and Chang, Jonathan and Ammanabrolu, Prithviraj},
29
+ journal={arXiv preprint arXiv:2510.01167},
30
+ year={2025},
31
+ url={https://arxiv.org/abs/2510.01167}
32
+ }
33
+ ```