Hugging Face's logo

bertin-project
/
bertin-base-stepwise-exp-512seqlen

Fill-Mask
Transformers
PyTorch
JAX
TensorBoard
Joblib
Safetensors
Spanish
roberta
spanish
Model card Files
xet
 Metrics Community
1
bertin-base-stepwise-exp-512seqlen

Commit History

  1. Adding `safetensors` variant of this model (#1)⁠

    versae +1: SFconvertbot
    Verified signature
    6c0776c

  1. Automatic correction of README.md metadata. Contact website@huggingface.co for any question

    elishowk
    62feafb

  1. Step... (49000/50000 | Loss: 1.558030366897583, Acc: 0.6817952990531921): 100%|██████████████████████████████| 50000/50000 [20:22:14<00:00, 2.20s/it]

    versae
    33421ff

  2. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    a135ed0

  3. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    449906e

  4. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    8948548

  5. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    f13cd90

  6. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    6a27d73

  7. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    87bc157

  8. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    de9be4b

  9. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    8096da9

  10. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31806/50000 [12:45:50<7:10:54, 1.42s/it]

    versae
    effec0d

  11. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 64%|█████████████████▊ | 31807/50000 [12:45:51<7:16:37, 1.44s/it]

    versae
    26aaf99

  12. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 63%|█████████████████▊ | 31722/50000 [12:43:49<6:54:43, 1.36s/it]

    versae
    c8bbf89

  13. Step... (31000/50000 | Loss: 1.604581594467163, Acc: 0.6744211912155151): 62%|█████████████████▍ | 31239/50000 [12:32:24<7:08:13, 1.37s/it]

    versae
    c5c5875

  14. Step... (29000/50000 | Loss: 1.6177186965942383, Acc: 0.67269366979599): 58%|████████████████▊ | 29067/50000 [11:37:39<7:29:53, 1.29s/it]

    versae
    4aa2475

  15. Step... (26000/50000 | Loss: 1.6362030506134033, Acc: 0.6691190600395203): 53%|█████████████▊ | 26656/50000 [10:36:57<11:06:38, 1.71s/it]

    versae
    a015097

  16. Step... (24000/50000 | Loss: 1.6508632898330688, Acc: 0.6671841740608215): 48%|█████████████ | 24215/50000 [9:36:14<10:45:10, 1.50s/it]

    versae
    de8489d

  17. Step... (21000/50000 | Loss: 1.669716238975525, Acc: 0.6647850275039673): 44%|████████████▏ | 21775/50000 [8:35:31<11:59:11, 1.53s/it]

    versae
    4619063

  18. Step... (19000/50000 | Loss: 1.6823453903198242, Acc: 0.6625654101371765): 39%|██████████▍ | 19301/50000 [7:34:52<11:40:44, 1.37s/it]

    versae
    b270287

  19. Step... (16000/50000 | Loss: 1.6991859674453735, Acc: 0.659552812576294): 34%|█████████▍ | 16847/50000 [6:34:07<17:05:58, 1.86s/it]

    versae
    e438145

  20. Step... (14000/50000 | Loss: 1.7139594554901123, Acc: 0.6574689745903015): 29%|███████▋ | 14350/50000 [5:33:22<15:08:11, 1.53s/it]

    versae
    821784a

  21. Step... (11000/50000 | Loss: 1.7415039539337158, Acc: 0.6532756686210632): 24%|██████▎ | 11805/50000 [4:32:17<14:50:33, 1.40s/it]

    versae
    40cc04e

  22. Step... (9000/50000 | Loss: 1.7518370151519775, Acc: 0.6520029902458191): 18%|█████▎ | 9175/50000 [3:31:42<14:26:35, 1.27s/it]

    versae
    2528d68

  23. Step... (6000/50000 | Loss: 1.7780379056930542, Acc: 0.6486639976501465): 13%|███▊ | 6566/50000 [2:31:01<14:32:27, 1.21s/it]

    versae
    e2ef14f

  24. Step... (3000/50000 | Loss: 1.7852987051010132, Acc: 0.6470173597335815): 8%|██▎ | 3951/50000 [1:30:17<16:22:03, 1.28s/it]

    versae
    e9393ef

  25. Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it]

    versae
    cefa210

  1. initial commit

    system HF Staff
    529e26d