File size: 1,516 Bytes
c3bd586
 
 
 
475f629
c3bd586
 
 
 
475f629
c3bd586
475f629
 
 
c3bd586
 
 
 
475f629
c3bd586
475f629
c3bd586
a156957
c3bd586
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
475f629
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
license: apache-2.0
license_link: https://ai.google.dev/gemma/apache_2
base_model:
- google/gemma-4-E2B-it
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
language:
- en
tags:
- gguf
- gemma4
- shell
---

# Bonsai ShellAI

A highly compressed, text-only GGUF derivative of Google DeepMind's
[Gemma 4 E2B instruction-tuned model](https://huggingface.co/google/gemma-4-E2B-it/tree/3e22461f65e89153144f8adb70e3b8c2cc9845a7),
prepared for ShellAI command suggestions.

The model generates text containing shell commands based on natural language input. Designed for use in [ShellAI](https://github.com/sittinginatreesec/shellai).

## Download

```sh
hf download micrictor/bonsai-shellai bonsai-shellai-Q4_K_S-MLP10-PLE_Q2_K-VOCAB_Q2_K.gguf --local-dir ./bonsai-shellai
```

The GGUF contains the tokenizer and model weights. Use a Gemma 4-compatible
llama.cpp runtime; the tested runtime revision is recorded below. Configure the
application to accept a single JSON Markdown fence as described in the evaluation.

## License and attribution

The pinned upstream model card identifies Gemma 4 as Apache-2.0 and links to
[Google's official Apache 2.0 license page](https://ai.google.dev/gemma/apache_2).
This distribution includes [LICENSE](LICENSE), [NOTICE](NOTICE) and a
[public artifact manifest](manifest.json). This is a modified derivative,
not an official Google DeepMind release. Google/Google DeepMind attribution
identifies the upstream source and does not imply endorsement.