Hugging Face's logo

Shawnno
/
RL-sft-adapter

PEFT
Safetensors
Model card Files
xet
 Community
RL-sft-adapter

Commit History

  1. v3 SFT: lr=2e-4 NEFTune=0 no-oversample | eval_loss 1.039->0.992 train_loss 0.941 acc 81.1%

    Shawnno
    Verified signature
    11fc04f

  2. SFT v2: Qwen2.5-3B QLoRA, eval_loss=0.983, acc=73.9%

    Shawnno
    Verified signature
    8fabe65

  1. remove train.log

    Shawnno
    Verified signature
    230e3e9

  2. remove checkpoint-600/vocab.json

    Shawnno
    Verified signature
    c2324be

  3. remove checkpoint-600/training_args.bin

    Shawnno
    Verified signature
    90bdb18

  4. remove checkpoint-600/trainer_state.json

    Shawnno
    Verified signature
    fa807bb

  5. remove checkpoint-600/tokenizer_config.json

    Shawnno
    Verified signature
    287e788

  6. remove checkpoint-600/tokenizer.json

    Shawnno
    Verified signature
    bcd33e7

  7. remove checkpoint-600/special_tokens_map.json

    Shawnno
    Verified signature
    12028bd

  8. remove checkpoint-600/scheduler.pt

    Shawnno
    Verified signature
    83e884f

  9. remove checkpoint-600/rng_state.pth

    Shawnno
    Verified signature
    86de83e

  10. remove checkpoint-600/optimizer.pt

    Shawnno
    Verified signature
    0b2c920

  11. remove checkpoint-600/merges.txt

    Shawnno
    Verified signature
    d8fb54e

  12. remove checkpoint-600/added_tokens.json

    Shawnno
    Verified signature
    8633c75

  13. remove checkpoint-600/adapter_model.safetensors

    Shawnno
    Verified signature
    92d74d1

  14. remove checkpoint-600/adapter_config.json

    Shawnno
    Verified signature
    805f85b

  15. remove checkpoint-600/README.md

    Shawnno
    Verified signature
    4443435

  16. remove checkpoint-1104/vocab.json

    Shawnno
    Verified signature
    96663c8

  17. remove checkpoint-1104/training_args.bin

    Shawnno
    Verified signature
    50a4262

  18. remove checkpoint-1104/trainer_state.json

    Shawnno
    Verified signature
    c553aee

  19. remove checkpoint-1104/tokenizer_config.json

    Shawnno
    Verified signature
    885a2df

  20. remove checkpoint-1104/tokenizer.json

    Shawnno
    Verified signature
    85f9c36

  21. remove checkpoint-1104/special_tokens_map.json

    Shawnno
    Verified signature
    16d5717

  22. remove checkpoint-1104/scheduler.pt

    Shawnno
    Verified signature
    8f2c756

  23. remove checkpoint-1104/rng_state.pth

    Shawnno
    Verified signature
    261622c

  24. remove checkpoint-1104/optimizer.pt

    Shawnno
    Verified signature
    20c4705

  25. remove checkpoint-1104/merges.txt

    Shawnno
    Verified signature
    4b00a28

  26. remove checkpoint-1104/added_tokens.json

    Shawnno
    Verified signature
    8f8cd13

  27. remove checkpoint-1104/adapter_model.safetensors

    Shawnno
    Verified signature
    ebb6f6a

  28. remove checkpoint-1104/adapter_config.json

    Shawnno
    Verified signature
    ec7f960

  29. remove checkpoint-1104/README.md

    Shawnno
    Verified signature
    3ab5d6b

  30. v2: sft quality improvements - loss masking, neftune, system prompt, oversampling

    Shawnno
    Verified signature
    75af566

  1. Upload folder using huggingface_hub

    Shawnno
    Verified signature
    b0e8d85

  2. initial commit

    Shawnno
    Verified signature
    2a95b69