| --- |
| license: apache-2.0 |
| language: |
| - en |
| tags: |
| - windows |
| - desktop-app |
| - agent |
| - tool-calling |
| - llama.cpp |
| - gguf |
| - local-ai |
| --- |
| |
| # GRAFT Code |
|
|
| **A local AI agent for Windows that actually does things.** GRAFT Code is a desktop app that runs a GRAFT model on |
| your own PC and lets it work on your files: it makes folders, writes and reads files, moves, renames, copies and |
| deletes things, runs commands and Python, does exact math, and searches and reads the web. Every change asks you |
| first. Nothing leaves your computer except web-search keywords. |
|
|
| Made by **SmallAICreator / UltraLabs**. |
|
|
| | File | What it is | |
| |---|---| |
| | `GRAFT-Code.exe` | GRAFT Code for **Windows 10/11** (x64, runs on CPU). llama.cpp is bundled. | |
| | `graft-bridge/` | Optional: a Claude Code skill that lets GRAFT ask Claude for help (`talk_to_claude`). | |
|
|
| ## Pick a model |
|
|
| | Model | Size | Best for | |
| |---|---|---| |
| | [GRAFT-10B-A2B](https://huggingface.co/SmallAICreator/GRAFT-10B-A2B-GGUF) | 6.3 GB, 16 GB RAM | The smartest option: a 10B mixture-of-experts with only 2B active, perfect recall up to 32K tokens | |
| | [GRAFT-1B-Agentic](https://huggingface.co/SmallAICreator/GRAFT-1B-Agentic) | 1 GB, 8 GB RAM | Fast and light, tuned for tool use | |
|
|
| Put the `.gguf` in your **Downloads** folder and GRAFT Code finds it. |
|
|
| ## Get started |
|
|
| 1. Download `GRAFT-Code.exe` and a model (above). |
| 2. Double-click the EXE. It's unsigned, so Windows SmartScreen may warn you: click *More info → Run anyway*. |
| 3. Wait for the model to load. The first launch reads GRAFT's instructions once (about 2 minutes on a laptop CPU with |
| the 10B). Later launches restore them from disk in seconds. |
| 4. Type what you want done, for example *"make a Python script that renames all my photos by date"*. |
|
|
| It needs Microsoft Edge WebView2, which Windows 10 and 11 already have. GRAFT works in `~/GRAFT-Workspace`; change |
| the folder from the sidebar. |
|
|
| ## Features |
|
|
| - **Clean chat window** with light and dark themes. Replies stream in live, with formatted text, tables and code |
| blocks you can copy. |
| - **Tool cards and approvals.** Each action (write, run, search…) shows up as a card you can expand. Changes need an |
| approval: **Yes**, **Yes, and don't ask again** or **No, tell GRAFT what to do instead**. |
| - **Model picker.** Searches every `.gguf` in your Downloads, Desktop, Documents and LM Studio folders, has |
| *Browse…* for anything else, and reopens the last model you used. |
| - **Personas.** GRAFT, Coder, Playful, Concise and Teacher, or make your own with an emoji. Each persona has its own |
| system prompt and sampling settings. |
| - **Settings.** |
| - *Sampling:* temperature, top-p, top-k, min-p, repeat penalty, and reply length (or **unlimited**: GRAFT writes |
| until it's done). |
| - *Model:* context size (up to what the model supports), CPU threads and the draft model. |
| - *Agent:* max steps, command timeout, auto-approve and full access. |
| - **Chat history.** Every chat is saved in the sidebar. Reopen one and GRAFT remembers it. |
| - **Copy, Regenerate and a context gauge** that shows how much of GRAFT's memory the chat uses. |
| - **Stop anytime**, even while GRAFT is still reading a long message, not just while it writes. |
| - **Speculative decoding.** If a matching draft model (`GRAFT-10B-A2B-draft-*.gguf`) sits next to GRAFT-10B-A2B, |
| GRAFT Code uses it automatically for faster replies. |
| - **Use the model from other apps.** While GRAFT Code is open, its model is also an OpenAI-compatible API at |
| `http://127.0.0.1:1337/v1`. Other apps get their own slot, so they never slow GRAFT down by wiping its cache. |
| - **Web search and page reading.** Just ask. It uses DuckDuckGo with Wikipedia as a backup, and no API key is needed. |
| - **GRAFT.md notes.** Facts about your PC and how you like things done, read at the start of every chat. |
| |
| ## Talk to Claude (optional) |
|
|
| Copy the `graft-bridge` folder to `~/.claude/skills/`. In a Claude Code window, type `/graft-bridge`. Then tell GRAFT |
| *"ask Claude …"*: the question goes to that Claude Code window, and Claude's answer comes back to GRAFT. |
|
|
| ## Where things are stored |
|
|
| Everything stays in `%LOCALAPPDATA%\GRAFTCode`: settings (`config.json`), personas, saved chats, your `GRAFT.md` notes |
| and the saved instruction cache. |
|
|
| ## Good to know |
|
|
| - GRAFT Code runs real commands on your computer. Keep approvals on unless you trust the task. |
| - Only run one big model at a time. Two copies of a 10B model won't fit in 16 GB of RAM. |
| - Small models can make mistakes or make up results. Check anything important. |
|
|
| GRAFT Code bundles [llama.cpp](https://github.com/ggml-org/llama.cpp) (MIT). |
|
|
