Safetensors
qwen2
leave-one-out
loo-domain-knowledge
max_seq_length=16384
lr=2e-5
batch_size=1
grad_accum=16
epochs=1
qlora
quantize=4bit_nf4
lora_rank=64
lora_alpha=128
lora_dropout=0.05
completion_only_loss
eval_size=0.1
cosine_schedule
warmup=0.05
bf16
ddp_workers=2
ray_job=raysubmit_A55M5NnZckrXmfWN
- Xet hash:
- 4bd2f092eeec244c0448f13e31edd4b25e625568713e4155993a3dea90c7437a
- Size of remote file:
- 11.4 MB
- SHA256:
- 9c5ae00e602b8860cbd784ba82a8aa14e8feecec692e7076590d014d7b7fdafa
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.