Question Answering on Patient Medical Records with Private Fine-Tuned LLMs
Paper • 2501.13687 • Published • 9
How to use genloop/FHIR_QnA_Mistral-NeMo-Base-500-FT_T2 with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "question-answering" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# pip install "transformers<5.0.0"
from transformers import pipeline
pipe = pipeline("question-answering", model="genloop/FHIR_QnA_Mistral-NeMo-Base-500-FT_T2") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("genloop/FHIR_QnA_Mistral-NeMo-Base-500-FT_T2", device_map="auto")This repository contains the model introduced in the paper Question Answering on Patient Medical Records with Private Fine-Tuned LLMs.