Question Answering on Patient Medical Records with Private Fine-Tuned LLMs
Paper • 2501.13687 • Published • 9
How to use genloop/FHIR_QnA_Relevance_Classification_Mistral-NeMo-Instruct-FT_T1 with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "question-answering" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# pip install "transformers<5.0.0"
from transformers import pipeline
pipe = pipeline("question-answering", model="genloop/FHIR_QnA_Relevance_Classification_Mistral-NeMo-Instruct-FT_T1") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("genloop/FHIR_QnA_Relevance_Classification_Mistral-NeMo-Instruct-FT_T1", device_map="auto")# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("genloop/FHIR_QnA_Relevance_Classification_Mistral-NeMo-Instruct-FT_T1", device_map="auto")This repository contains the model introduced in the paper Question Answering on Patient Medical Records with Private Fine-Tuned LLMs.
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="genloop/FHIR_QnA_Relevance_Classification_Mistral-NeMo-Instruct-FT_T1")