anzorq/kbd_lat-835k_ru-3M
Viewer • Updated • 3.84M • 56
How to use anzorq/kbd_lat-835k_ru-3M_t5-small with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("anzorq/kbd_lat-835k_ru-3M_t5-small")
model = AutoModelForSeq2SeqLM.from_pretrained("anzorq/kbd_lat-835k_ru-3M_t5-small", device_map="auto")t5-v1_1-small pretrained with mlm task on
• kbd (custom latin script) 835K lines: a pile of scraped text from news sites, books etc.
• ru 3M lines: wiki corpus from OPUS
tokenizer: sentencepiece unigram, 8K, shared vocabulary