Instructions to use flax-community/roberta-base-thai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use flax-community/roberta-base-thai with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="flax-community/roberta-base-thai")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("flax-community/roberta-base-thai") model = AutoModelForMaskedLM.from_pretrained("flax-community/roberta-base-thai", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Adding `safetensors` variant of this model (#1)
Verified signature- Adding `safetensors` variant of this model (d435364c10ac66dd30f0b46eb9ee87aff9df9e81) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>ee83601
-
update tfevent
3d400e8 -
update event
596725d -
fix run.sh
6665f93 -
new event
6e833e6
-
use proper tokenizer.json and change to batch_size=256
de940b9
-
train with 10K batch_size
89c14b0 -
remove old tokenizer.json. it's not trained properly
a615d86 -
change config and fix training tokenizer script
13d02d7 -
remove tfevents
70b401c -
rename previous tfevents
d12a293 -
add 4th tfevents
8dc7108 -
increaaase bs=128 and change dtype to fp32
2071335 -
remove old model
8887f4f -
change to proper vocab_size
9fa8adc -
update pt model
d6a778b -
add pt model from 15K trained steps
1aa50f9 -
update rule
5a8de81 -
update evnt
24b543a -
update event
578dba5
-
update event
2c966a4 -
Saving weights and logs of step 15000
8664a01 -
check event
d74794e
-
Saving weights and logs of step 10000
908d1a5 -
update event
be4ec62 -
update tfevent
e60615a
-
Saving weights and logs of step 5000
acba88d -
update event
14c6643 -
Create Thai Tokenizer script
5ad5b72 -
check event
e76044d -
init tfevents for experiment#3
bbeb147 -
remove old exp&model and lower steps to save
64934c7 -
fix script
9c0b789 -
make it resumable training
51e884f -
Saving weights and logs of step 10000
3040f73
-
update event
a9d2138 -
update tfevent
f8a3350
-
update event
bae02ca -
remove old event
23b10e3 -
add experiment_2 tfevents
e0c32ef -
update script
8976790 -
update script regarding to https://github.com/huggingface/transformers/pull/12608
6aba5c0 -
lower lr regarding explode gradient. also new seed number
b0729e9 -
Merge branch 'main' of https://huggingface.co/flax-community/roberta-base-thai into main
bfd5d73 -
update tfevents
0d2b32a
-
Update .gitattributes
1e02891 -
update event
d9006b0 -
update event
33260f5
-
update event
0b153f6 -
update tfevents
e0cfb09