Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Shamima
/
dpo-implicit-reward
Like
0
PEFT
Safetensors
HuggingFaceH4/ultrafeedback_binarized
allenai/reward-bench
Anthropic/hh-rlhf
dpo
reward-model
preference-learning
lora
trl
interpretability
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Copy to bucket
new
Use this model
Instructions to use Shamima/dpo-implicit-reward with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
Libraries
PEFT
How to use Shamima/dpo-implicit-reward with PEFT:
Task type is invalid.
Notebooks
Google Colab
Kaggle
main
dpo-implicit-reward
2.81 GB
Ctrl+K
Ctrl+K
1 contributor
History:
28 commits
Shamima
Remove stray Jupyter checkpoint artifact
7a75a30
verified
27 days ago
dpo_beta0.1_8k
Add dpo_beta0.1_8k
about 2 months ago
dpo_beta0.1_8k_s0
Add dpo_beta0.1_8k_s0 (3-seed run)
27 days ago
dpo_beta0.1_8k_s1
Add dpo_beta0.1_8k_s1 (3-seed run)
27 days ago
dpo_beta0.1_8k_s2
Add dpo_beta0.1_8k_s2 (3-seed run)
27 days ago
figures
Remove stray Jupyter checkpoint artifact
27 days ago
long
Add 4-epoch convergence run: rm_8k_s1 (+8 step checkpoints)
27 days ago
results
Sync results (5-seed, bias drift, curves)
27 days ago
rm_8k
Add rm_8k
about 2 months ago
rm_8k_s0
Add rm_8k_s0 (3-seed run)
27 days ago
rm_8k_s1
Add rm_8k_s1 (3-seed run)
27 days ago
rm_8k_s2
Add rm_8k_s2 (3-seed run)
27 days ago
sft
Add sft
about 2 months ago
sft_merged
Add sft_merged
about 2 months ago
.gitattributes
3.88 kB
Sync figures
27 days ago
README.md
10.4 kB
Document all checkpoints and how to load them
27 days ago
