Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ library_name: transformers
4
+ pipeline_tag: text-classification
5
+ base_model: meta-llama/Meta-Llama-3-8B
6
+ ---
7
+
8
+ # eng_prm
9
+
10
+ This model is a Process Reward Model (PRM) trained to evaluate **engagement** in mathematical reasoning tasks. It was introduced as part of the **MAHALO** (Multi-Action-Head ALignment with PRM-guided DecOding) framework in the paper [Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards](https://huggingface.co/papers/2510.01167).
11
+
12
+ The model is based on `Meta-Llama-3-8B` and fine-tuned as a sequence classifier to provide step-level reward signals.
13
+
14
+ ## Resources
15
+
16
+ - **Paper:** [Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards](https://huggingface.co/papers/2510.01167)
17
+ - **GitHub Repository:** [pearls-lab/multiobj-align](https://github.com/pearls-lab/multiobj-align)
18
+
19
+ ## Model Description
20
+
21
+ MAHALO is a unified framework that standardizes PRM training across verifiable and non-verifiable settings for step-level supervision. This specific checkpoint serves as the Engagement PRM for the math domain, enabling controllable inference through objective-specific weighting and PRM-guided decoding.
22
+
23
+ ## Citation
24
+
25
+ If you find this work useful, please consider citing:
26
+
27
+ ```bibtex
28
+ @article{shen2025simultaneous,
29
+ title={Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards},
30
+ author={Shen, Yiran and Xia, Yu and Chang, Jonathan and Ammanabrolu, Prithviraj},
31
+ journal={arXiv preprint arXiv:2510.01167},
32
+ year={2025},
33
+ url={https://arxiv.org/abs/2510.01167}
34
+ }
35
+ ```