Commit History

  1. Adding `safetensors` variant of this model (#1)⁠

    yhavinga +1: SFconvertbot
    Verified signature
    ee83601

  1. update tfevent

    3d400e8
  2. update event

    596725d
  3. fix run.sh

    6665f93
  4. new event

    6e833e6

  1. use proper tokenizer.json and change to batch_size=256

    de940b9

  1. train with 10K batch_size

    89c14b0
  2. remove old tokenizer.json. it's not trained properly

    a615d86
  3. change config and fix training tokenizer script

    13d02d7
  4. remove tfevents

    70b401c
  5. rename previous tfevents

    d12a293
  6. add 4th tfevents

    8dc7108
  7. increaaase bs=128 and change dtype to fp32

    2071335
  8. remove old model

    8887f4f
  9. change to proper vocab_size

    9fa8adc
  10. update pt model

    d6a778b
  11. add pt model from 15K trained steps

    1aa50f9
  12. update rule

    5a8de81
  13. update evnt

    24b543a
  14. update event

    578dba5

  1. update event

    2c966a4
  2. Saving weights and logs of step 15000

    8664a01
  3. check event

    d74794e

  1. Saving weights and logs of step 10000

    908d1a5
  2. update event

    be4ec62
  3. update tfevent

    e60615a

  1. Saving weights and logs of step 5000

    acba88d
  2. update event

    14c6643
  3. Create Thai Tokenizer script

    5ad5b72
  4. check event

    e76044d
  5. init tfevents for experiment#3

    bbeb147
  6. remove old exp&model and lower steps to save

    64934c7
  7. fix script

    9c0b789
  8. make it resumable training

    51e884f
  9. Saving weights and logs of step 10000

    3040f73

  1. update event

    a9d2138
  2. update tfevent

    f8a3350

  1. update event

    bae02ca
  2. remove old event

    23b10e3
  3. add experiment_2 tfevents

    e0c32ef
  4. update script

    8976790
  5. update script regarding to https://github.com/huggingface/transformers/pull/12608

    6aba5c0
  6. lower lr regarding explode gradient. also new seed number

    b0729e9
  7. Merge branch 'main' of https://huggingface.co/flax-community/roberta-base-thai into main

    bfd5d73
  8. update tfevents

    0d2b32a

  1. Update .gitattributes

    1e02891
  2. update event

    d9006b0
  3. update event

    33260f5

  1. update event

    0b153f6
  2. update tfevents

    e0cfb09