---
license: gemma
base_model: google/gemma-4-E2B-it
tags:
- gguf
- gemma
- on-device
- android
- tool-use
- agent
- llama.cpp
language:
- en
pipeline_tag: text-generation
---

# Hanu by Vanaras

**Hanu** is the on-device planner model for the **Maaya** assistant by Vanaras. It's built to run on Android phones in the ~Rs 20k price range.

- **Base:** google/gemma-4-E2B-it
- **Training:** LoRA SFT on 3.7k rows, then DPO
- **Quantization:** Q4_K_M with an importance matrix (imatrix), ~2.7 GB GGUF
- **Language:** English only for now

## What it does

Hanu turns a user request into a tool plan written in the **Vanaras plan language**. Every plan ends with a `say(...)` call. The model never talks freely. It plans tool calls and spoken replies under these privacy rules:

- If the audio is on speaker or other people may be listening, it **asks before speaking private information** aloud.
- It **refuses to store, speak or show PINs, passwords, CVVs and OTPs**.
- It asks for confirmation before deleting, sending, paying, scheduling or cancelling.

## Files

| File | Purpose |
|---|---|
| `Hanu-E2B-Q4_K_M.gguf` | Model weights (Q4_K_M, imatrix) |
| `system_prompt.txt` | **Required** system prompt. The model only behaves correctly with this prompt. Replace `{name}` with the assistant's name. |
| `template_vanaras.jinja` | Chat template |
| `plan_v026_llamacpp.gbnf` | GBNF grammar that restricts output to valid plans |

## Usage (llama.cpp)

Run with temperature 0 and thinking turned off. Use `system_prompt.txt`, with `{name}` replaced, as the system message:

```bash
llama-server -m Hanu-E2B-Q4_K_M.gguf --jinja \
  --chat-template-file template_vanaras.jinja \
  --grammar-file plan_v026_llamacpp.gbnf \
  --temp 0 --reasoning-budget 0 -c 4096 --port 8080
```

```bash
SYS=$(sed 's/{name}/Maaya/g' system_prompt.txt)
curl -s localhost:8080/v1/chat/completions -H 'Content-Type: application/json' \
  -d "$(jq -n --arg s "$SYS" '{temperature:0, messages:[{role:"system",content:$s},{role:"user",content:"What is the weather in Bengaluru today?"}]}')"
```

The output is one plan, for example a weather check followed by `say(...)`. Your app runs the tool calls in the plan.

## Evaluation (internal)

> These are **internal benchmarks** run on Vanaras's own locked test sets. They are **not public benchmarks** and cannot be reproduced from public data. Setup: llama.cpp b11612, CPU, temperature 0. **Stock Gemma 4 E2B** (google/gemma-4-E2B-it, Q4_K_M GGUF) got the same system prompt, grammar and settings as Hanu.

| Metric | Stock Gemma 4 E2B | v3 | v4-SFT | **Hanu (this)** |
|---|---|---|---|---|
| Call-safety pass (of 50) ↑ | 23 | 26 | 31 | **37** |
| Leaks ↓ | 14 | 16 | 10 | **2** |
| Missed asks (of 15) ↓ | 15 | 15 | 14 | **4** |
| Wrong refusals (of 17) ↓ | 6 | 5 | 4 | 8 |
| Queries (of 50) ↑ | 4 | 40 | 44 | 41 |
| eval_hard (of 21) ↑ | 5 | 16 | 20 | 18 |
| Behaviour probes (of 151) ↑ | 11 | 101 | 136 | **143** |

## Known limitations

- **Hanu doesn't block every leak.** In internal testing it spoke a Wi-Fi password in 1 of 50 tests. In one other case it read out an account number on speaker without asking first. **Deploy with an app-side secret filter** and don't rely on the model alone.
- It sometimes asks for confirmation when it doesn't need to. Wrong refusals rose compared with v4-SFT.
- The Q4 quantization loses some of the gains measured at full precision.
- English only.
- The plan language is specific to Vanaras. Outside the Maaya runtime, the output is not general-purpose chat.

## Gemma terms of use

Hanu is derived from Gemma. Gemma is provided under and subject to the Gemma Terms of Use: https://ai.google.dev/gemma/terms. By using this model you agree to those terms, including the Gemma Prohibited Use Policy.