90B-ckpt 28b9716
Yixin Song commited on
How to use SparseLLM/swiglu-90B with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("SparseLLM/swiglu-90B", device_map="auto")