feat: Add Pretrained tokenizer d1190be
psj8252 commited on
How to use cosmoquester/bart-ko-small with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("cosmoquester/bart-ko-small")
model = AutoModelForSeq2SeqLM.from_pretrained("cosmoquester/bart-ko-small", device_map="auto")