PEFT How to use sohith18/blip-lora-vqa with PEFT:
from peft import PeftModel
from transformers import AutoModelForQuestionAnswering
base_model = AutoModelForQuestionAnswering.from_pretrained("Salesforce/blip-vqa-base")
model = PeftModel.from_pretrained(base_model, "sohith18/blip-lora-vqa") 
