How to use ThisIs-Developer/Llama-2-GGML-Medical-Chatbot with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("question-answering", model="ThisIs-Developer/Llama-2-GGML-Medical-Chatbot") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ThisIs-Developer/Llama-2-GGML-Medical-Chatbot", device_map="auto")
