How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf miesdevries/stay4s-summarizer-agent
# Run inference directly in the terminal:
llama cli -hf miesdevries/stay4s-summarizer-agent
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf miesdevries/stay4s-summarizer-agent
# Run inference directly in the terminal:
llama cli -hf miesdevries/stay4s-summarizer-agent
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf miesdevries/stay4s-summarizer-agent
# Run inference directly in the terminal:
./llama-cli -hf miesdevries/stay4s-summarizer-agent
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf miesdevries/stay4s-summarizer-agent
# Run inference directly in the terminal:
./build/bin/llama-cli -hf miesdevries/stay4s-summarizer-agent
Use Docker
docker model run hf.co/miesdevries/stay4s-summarizer-agent
Quick Links

stay4s-summarizer-agent

Summarizer agent โ€” vat lange teksten samen in het Nederlands

Details

  • Base model: Qwen2.5-7B-Instruct
  • Training: SFT met LoRA (r=64)
  • Formaat: GGUF Q8
  • Taal: Nederlands
  • Gemaakt door: Het Nieuwe Begin B.V.

Gebruik

Laad in Ollama of llama.cpp voor lokale inferentie.

Downloads last month
120
GGUF
Model size
4B params
Architecture
qwen3
Hardware compatibility
Log In to add your hardware

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support