How to use tali1/LLM-bartlarge-1 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("tali1/LLM-bartlarge-1") model = AutoModelForSeq2SeqLM.from_pretrained("tali1/LLM-bartlarge-1", device_map="auto")
loss: 0.739513099193573
rouge1: 16.5172
rouge2: 4.4155
rougeL: 16.5116
rougeLsum: 16.5175
gen_len: 57.763
runtime: 919.9505
samples_per_second: 7.431
steps_per_second: 0.465
: 3.0
Files info
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("tali1/LLM-bartlarge-1") model = AutoModelForSeq2SeqLM.from_pretrained("tali1/LLM-bartlarge-1", device_map="auto")