How to use GeneZC/bert-base-cola with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, BertCls tokenizer = AutoTokenizer.from_pretrained("GeneZC/bert-base-cola") model = BertCls.from_pretrained("GeneZC/bert-base-cola", device_map="auto")
bert-base-uncased finetuned on CoLA.
bert-base-uncased
CoLA
batch size is 32, learning rate is 2e-5.
matthews_corr: 0.6295
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, BertCls tokenizer = AutoTokenizer.from_pretrained("GeneZC/bert-base-cola") model = BertCls.from_pretrained("GeneZC/bert-base-cola", device_map="auto")