Transformers How to use eltokh7/lory-27b with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="eltokh7/lory-27b") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("eltokh7/lory-27b")
model = AutoModel.from_pretrained("eltokh7/lory-27b", device_map="auto") 
