rubentium
/

sparse-checkpoints

Model card Files Files and versions

sparse-checkpoints / epfl_final /log_files

1.25 GB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

rubentium's picture

EPFL ALiBi and training provenance 551-600 of 1184

1e7c2c5 verified 21 days ago

1-2b_dense_cont_46k.log

25.5 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
1-2b_dense_cont_48k.log

34.6 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
1mask_continued.log

31.3 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
1mask_perlayerfix.log

403 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
another_sparse_33%.log

41 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
build_mask_19.log

5.39 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
building_masks_16.log

1.5 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
building_masks_23.log

1.5 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain.log

18.2 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_10k.log

268 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_16k.log

21.5 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_18k.log

29.8 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
cont_pretrain_19k.log

21.8 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_20k.log

71.7 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_40k.log

81 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_8k.log

23.7 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_diff_lr.log

29.1 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_lr.log

18.7 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
cont_pretrain_mixed.log

278 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
dense.log

175 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
eval_sparse_64.log

1.25 GB
xet

EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
fineweb.log

342 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
mix_sparse_33%.log

19 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
pile_download.log

628 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
pretrain.log

213 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
pretrain_test.log

81.5 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
sparse50%.log

38.6 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
sparse_12%.log

39.2 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
sparse_25%.log

92.5 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
sparse_30%.log

34.1 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
sparse_30%_continued.log

16 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
sparse_33%.log

1.37 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
sparse_50%.log

176 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
sparse_50%_10kmask.log

176 kB
EPFL ALiBi and training provenance 501-550 of 1184 21 days ago
sparse_eval_dense.log

102 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
sparse_pretrain_64%.log

113 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago
sparse_pretrain_85%.log

59.2 kB
EPFL ALiBi and training provenance 551-600 of 1184 21 days ago