Salesforce/wikitext
Viewer โข Updated โข 3.71M โข 2.21M โข 866
How to use Skier8402/BERT_like_tokenizer with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Skier8402/BERT_like_tokenizer", device_map="auto")
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Skier8402/BERT_like_tokenizer", device_map="auto")