Transformers How to use alvis44/Phi-3-mini-128k-instruct-RU-GPTQ with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("alvis44/Phi-3-mini-128k-instruct-RU-GPTQ", device_map="auto") 
