How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Mast-LLM/Gargantua-Pro:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Mast-LLM/Gargantua-Pro:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Mast-LLM/Gargantua-Pro:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf Mast-LLM/Gargantua-Pro:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf Mast-LLM/Gargantua-Pro:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama cli -hf Mast-LLM/Gargantua-Pro:Q4_K_M
Use Docker
docker model run hf.co/Mast-LLM/Gargantua-Pro:Q4_K_M
Quick Links

Gargantua Pro (12B)

Gargantua Pro is the big model of the openTARS assistant, built for longer tasks: plan the steps, call the tools, check the result and keep going until the job is done. It uses the same 19 tools as Gargantua 2, on a larger base.

  • Base: Gemma 4 12B (Apache-2.0), fine-tuned by MastLLM for openTARS on its own tool-use data.
  • File: gargantua-pro-gemma4-12b-Q4_K_M.gguf (7.4 GB, text only).
  • Runs with: llama.cpp and Ollama (the gemma4 renderer and parser are built in). It needs a graphics card with about 8 GB, or plenty of RAM on the CPU.

Use

printf 'FROM ./gargantua-pro-gemma4-12b-Q4_K_M.gguf\nRENDERER gemma4\nPARSER gemma4\nPARAMETER temperature 0.1\n' > Modelfile
ollama create gargantua-pro -f Modelfile
ollama run gargantua-pro

It calls tools through the standard Ollama tool-calling API; the openTARS app sends the 19 tools for you.

Status

First release. We have not published benchmark numbers for it yet.

Follow the project at mastllm.github.io/OpenTARS.


Made by MastLLM, makers of openTARS. Other labs keep building bigger. We build small.

Downloads last month
145
GGUF
Model size
12B params
Architecture
gemma4
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support