Instructions to use ThisIs-Developer/Llama-2-GGML-Medical-Chatbot with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ThisIs-Developer/Llama-2-GGML-Medical-Chatbot with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="ThisIs-Developer/Llama-2-GGML-Medical-Chatbot")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ThisIs-Developer/Llama-2-GGML-Medical-Chatbot", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Package versions have conflicting dependencies.
#2
by ThisIs-Developer - opened
ERROR: Cannot install -r requirements.txt (line 13) and -r requirements.txt (line 4) because these package versions have conflicting dependencies.
The conflict is caused by:
chainlit 0.6.402 depends on click<9.0.0 and >=8.1.3
streamlit 0.89.0 depends on click<8.0 and >=7.0
Solution
To sort it out with the updated versions (chainlit 1.0.0 and streamlit 1.29.0), tweak your requirements.txt like so:
chainlit==1.0.0
streamlit==1.29.0
Updated in v2.0.2dev10012024
Github issues #8