Transformers How to use hyen/LLaMA-MLM-Large with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, LlamaForMLM
tokenizer = AutoTokenizer.from_pretrained("hyen/LLaMA-MLM-Large")
model = LlamaForMLM.from_pretrained("hyen/LLaMA-MLM-Large", device_map="auto") 
