RTO-RL
/

Llama3-8B-RTO_RPP

Model card Files Files and versions

Llama3-8B-RTO_RPP / README.md

zkshan2002's picture

Update README.md

e72855c verified over 1 year ago

|

Raw History Blame Contribute Delete

471 Bytes

datasets:
  - weqweasdas/ultra_train
base_model:
  - OpenRLHF/Llama-3-8b-sft-mixture

Base Model: OpenRLHF/Llama-3-8b-sft-mixture

DPO model: RTO-RL/Llama3-8B-DPO

Reward model: RTO-RL/Llama3.2-1B-RewardModel

Prompt dataset: weqweasdas/ultra_train