File size: 1,187 Bytes
8c19e93 7f9f3f5 8c19e93 7f9f3f5 8c19e93 7f9f3f5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
delta: warm start from /__modal/volumes/vo-RociVuGycNGtzvUcdOqecz/hub/models--macmacmacmac--Sev-4B/snapshots/da0a131c2636b06c16bbca7d8ae84f0dc1e90b7e: 496 adapter tensors and the pointer head loaded
device=cuda trainable params=33.8M
123 training requests (holdout=[]), questions by type {'choice': 188}
[transformers] `causal_conv1d_fn` is falling back to its reference PyTorch implementation because `causal_conv1d` is not installed. This is correct but much slower; install `causal_conv1d` for the optimized kernel.
ep0 step 10/80 loss 0.521 kl 0.000 anchor 0.000 1.937s/rec
ep1 step 20/80 loss 0.157 kl 0.000 anchor 0.000 1.087s/rec
ep1 step 30/80 loss 0.001 kl 0.000 anchor 0.000 0.763s/rec
ep2 step 40/80 loss 0.000 kl 0.000 anchor 0.000 0.611s/rec
ep3 step 50/80 loss 0.000 kl 0.000 anchor 0.000 0.518s/rec
ep3 step 60/80 loss 0.000 kl 0.000 anchor 0.000 0.453s/rec
ep4 step 70/80 loss 0.000 kl 0.000 anchor 0.000 0.409s/rec
ep4 step 80/80 loss 0.000 kl 0.000 anchor 0.000 0.377s/rec
saved /runs/sev-html-contrast-4b-v1/00-trial-0/checkpoint
|