Safetensors
GGUF
English
qwen2
clinical
medical
healthcare
qlora
unsloth
chatml
rapha
8-bit precision
conversational
Instructions to use Phora68/rapha with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Phora68/rapha with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Phora68/rapha:Q4_K_M # Run inference directly in the terminal: llama cli -hf Phora68/rapha:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Phora68/rapha:Q4_K_M # Run inference directly in the terminal: llama cli -hf Phora68/rapha:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Phora68/rapha:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Phora68/rapha:Q4_K_M
Use Docker
docker model run hf.co/Phora68/rapha:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Phora68/rapha with Ollama:
ollama run hf.co/Phora68/rapha:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use Phora68/rapha with Docker Model Runner:
docker model run hf.co/Phora68/rapha:Q4_K_M
- Lemonade
How to use Phora68/rapha with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Phora68/rapha:Q4_K_M
Run and chat with the model
lemonade run user.rapha-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
Add Ollama Modelfile
Verified signatureadf51af -
Update model card
Verified signaturedc28457 -
Add Qwen2.5-7B-Instruct.Q8_0.gguf
Verified signature9a20f9f -
Add Qwen2.5-7B-Instruct.Q5_K_M.gguf
Verified signature4a7037a -
Add Qwen2.5-7B-Instruct.Q4_K_M.gguf
Verified signature78f4c9e -
Add merged fp16 model
Verified signature735927c -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster00585cb
-
Upload gguf/rapha-qwen25-7b.Q5_K_M.gguf with huggingface_hub
Verified signaturee3d4478 -
Upload gguf/rapha-qwen25-7b.Q8_0.gguf with huggingface_hub
Verified signature82b8878 -
Upload gguf/Qwen2.5-7B-Instruct.Q4_K_M.gguf with huggingface_hub
Verified signature8d27fd3 -
Upload folder using huggingface_hub
Verified signature43ff76b
-
Upload gguf/rapha-qwen25-7b.Q5_K_M.gguf with huggingface_hub
Verified signaturefb3368e -
Upload gguf/rapha-qwen25-7b.Q8_0.gguf with huggingface_hub
Verified signature448e3f1 -
Upload gguf/Qwen2.5-7B-Instruct.Q4_K_M.gguf with huggingface_hub
Verified signature52c6953 -
Upload folder using huggingface_hub
Verified signature67d2710 -
Upload folder using huggingface_hub
Verified signature8e04d37
-
Add Ollama Modelfile
Verified signatureb71db35 -
Update model card
Verified signaturedf0858e -
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signature2c33a2c -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signaturefdda40f -
Add Qwen2.5-3B-Instruct.Q4_K_M.gguf
Verified signature5e2e490 -
Add merged fp16 model
Verified signature8c47fdd -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster2411cce
-
Add Ollama Modelfile
Verified signature2cbba7e -
Update model card
Verified signature0d28b84 -
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signature47cb96b -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signature5fd2c31 -
Add Qwen2.5-3B-Instruct.Q4_K_M.gguf
Verified signaturea1b7f3b -
Add merged fp16 model
Verified signature5d4dc74 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterd2ca352
-
Update model card
Verified signature9c707a3 -
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signature7dee91c -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signature1dd2e1f -
Add Qwen2.5-3B-Instruct.Q4_K_M.gguf
Verified signature6ac04c3 -
Add merged fp16 model
Verified signaturec0315b0 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster9d646f7
-
Update model card
Verified signatureb44b670 -
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signature01be0fe -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signature6ed30cc -
Add Qwen2.5-3B-Instruct.Q4_K_M.gguf
Verified signature4255390 -
Add merged fp16 model
Verified signature8fc394d -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fastere4353cc
-
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signatureb5f5acc -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signature841ddfc -
Add Qwen2.5-3B-Instruct.Q4_K_M.gguf
Verified signature3f2ac1f -
Update model card
Verified signatureca5756d -
Add merged fp16 model
Verified signature0b6df7e -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster48da4bd
-
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signatureb6ce3dd -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signaturec88c7b0