samarthSonawane/marathi_news_articles
Viewer โข Updated โข 510k โข 11 โข 1
How to use NotShrirang/marathi-tokenizer with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("NotShrirang/marathi-tokenizer", device_map="auto")