Automodel support 03ef821
Dan Fu commited on
How to use togethercomputer/m2-bert-80M-8k-retrieval with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForSequenceClassification
model = AutoModelForSequenceClassification.from_pretrained("togethercomputer/m2-bert-80M-8k-retrieval", trust_remote_code=True, device_map="auto")