How to use helloTR/dpo-training-fixed with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("helloTR/dpo-training-fixed", device_map="auto")
helloTR commited on 