How to use ibm-ai-platform/codellama-34b-accelerator with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ibm-ai-platform/codellama-34b-accelerator", device_map="auto")
