Hugging Face's logo

dfrees
/
llama-1b-instruct-dpo

PEFT
Safetensors
llama
4-bit precision
bitsandbytes
Model card Files
xet
 Community
llama-1b-instruct-dpo

Commit History

  1. Uploading merged DPO-trained model

    dfrees
    Verified signature
    11e04b0

  2. Uploading merged DPO-trained model

    dfrees
    Verified signature
    350e24b

  3. Uploading merged DPO-trained model

    dfrees
    Verified signature
    411221a

  4. Uploading merged DPO-trained model

    dfrees
    Verified signature
    5a8bf1d

  5. Uploading DPO-trained model

    dfrees
    Verified signature
    fba78d6

  6. initial commit

    dfrees
    Verified signature
    44f4e52