How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Docglasses-AI/llama32-soap-e2-gguf:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Docglasses-AI/llama32-soap-e2-gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Docglasses-AI/llama32-soap-e2-gguf:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Docglasses-AI/llama32-soap-e2-gguf:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf Docglasses-AI/llama32-soap-e2-gguf:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama cli -hf Docglasses-AI/llama32-soap-e2-gguf:Q4_K_M
Use Docker
docker model run hf.co/Docglasses-AI/llama32-soap-e2-gguf:Q4_K_M
Quick Links

llama32-soap-e2-gguf

Llama 3.2 1B fine-tuned for clinical SOAP notes (epoch-2). Intended for SarvaDoc / GenieX on-device summary.

Files

  • llama32-soap-e2-Q4_K_M.gguf (807694016 bytes) β€” phone Q4
  • llama32-soap-e2-Q6_K.gguf β€” higher-quality Q6
  • soap_prompt.ts / llama32_mobile_config.json β€” mobile prompt + config

Not a diagnostic device.

Downloads last month
194
GGUF
Model size
1B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support