notmuch2 commited on
Commit
7a73bd4
·
verified ·
1 Parent(s): 9813deb

Add model card

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md CHANGED
@@ -1,3 +1,41 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+
5
+ # eVTA₀ Models
6
+
7
+ This repository hosts the released checkpoints of the paper
8
+ ["Demonstration-Free Success-Probability Reward Learning for Generalist Robot
9
+ Policies"](https://arxiv.org/abs/2609.33653).
10
+
11
+ - **Reward models** (`reward_model/`): the eVTA₀ success-probability reward
12
+ model trained on LIBERO and MetaWorld rollouts (`checkpoint_adapter.pth`).
13
+ The checkpoints contain only the LoRA adapter, the reward-token embedding,
14
+ and the prediction head — the backbone is not included; download
15
+ [Qwen/Qwen3-VL-4B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct)
16
+ separately and load the checkpoint on top of it. These checkpoints were
17
+ serialized under transformers 5.8.0 / peft 0.19.1; loading them requires
18
+ `transformers >= 5.8.0` and `peft >= 0.19.1`.
19
+ - **RL policies** (`pi05_policy/`): pi0.5 policies trained with GRPO driven by
20
+ the eVTA₀ reward, one per LIBERO suite
21
+ (`evta0-grpo-6400ep-{suite}-pi05.pt`).
22
+
23
+
24
+ **Code:** https://github.com/duowuyms/eVTA0
25
+
26
+ **Paper:** https://arxiv.org/abs/2609.33653
27
+
28
+ **Author:** [Duo Wu](https://duowuyms.github.io/)
29
+
30
+ ## Citation
31
+
32
+ If you find these models useful, please cite our paper:
33
+
34
+ ```bibtex
35
+ @article{wu2026evta0,
36
+ title={Demonstration-Free Success-Probability Reward Learning for Generalist Robot Policies},
37
+ author={Wu, Duo and Wang, Haifeng and Lu, Rongwei and Wang, Jinghe and Xiong, Tianyi and Wang, Zhimin and Yu, Chao and Ma, Shuai and Wang, Zhi},
38
+ journal={arXiv preprint arXiv:2609.33653},
39
+ year={2026}
40
+ }
41
+ ```