How to use Rustem/roberta-base-trained-50k-docs with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Rustem/roberta-base-trained-50k-docs")
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("Rustem/roberta-base-trained-50k-docs") model = AutoModelForSequenceClassification.from_pretrained("Rustem/roberta-base-trained-50k-docs", device_map="auto")
https://huggingface.co/Rustem/roberta-base-trained-50k-docs/resolve/main/tokenizer.json
hf download hf://Rustem/roberta-base-trained-50k-docs/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/Rustem/roberta-base-trained-50k-docs/resolve/main/tokenizer.json
