Instructions to use johangdarkdev/Ember-8B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use johangdarkdev/Ember-8B-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf johangdarkdev/Ember-8B-GGUF # Run inference directly in the terminal: llama cli -hf johangdarkdev/Ember-8B-GGUF
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf johangdarkdev/Ember-8B-GGUF # Run inference directly in the terminal: llama cli -hf johangdarkdev/Ember-8B-GGUF
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf johangdarkdev/Ember-8B-GGUF # Run inference directly in the terminal: ./build/bin/llama cli -hf johangdarkdev/Ember-8B-GGUF
Use Docker
docker model run hf.co/johangdarkdev/Ember-8B-GGUF
- Llama new
- LM Studio
- Jan
- Ollama
How to use johangdarkdev/Ember-8B-GGUF with Ollama:
ollama run hf.co/johangdarkdev/Ember-8B-GGUF
- Unsloth Desktop
- Pi
How to use johangdarkdev/Ember-8B-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf johangdarkdev/Ember-8B-GGUF
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "johangdarkdev/Ember-8B-GGUF" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use johangdarkdev/Ember-8B-GGUF with Docker Model Runner:
docker model run hf.co/johangdarkdev/Ember-8B-GGUF
- Lemonade
How to use johangdarkdev/Ember-8B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull johangdarkdev/Ember-8B-GGUF
Run and chat with the model
lemonade run user.Ember-8B-GGUF-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use johangdarkdev/Ember-8B-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf johangdarkdev/Ember-8B-GGUF
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default johangdarkdev/Ember-8B-GGUF
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use johangdarkdev/Ember-8B-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf johangdarkdev/Ember-8B-GGUF
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "johangdarkdev/Ember-8B-GGUF" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf johangdarkdev/Ember-8B-GGUF# Run inference directly in the terminal:
llama cli -hf johangdarkdev/Ember-8B-GGUFBuild from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf johangdarkdev/Ember-8B-GGUF# Run inference directly in the terminal:
./build/bin/llama cli -hf johangdarkdev/Ember-8B-GGUFUse Docker
docker model run hf.co/johangdarkdev/Ember-8B-GGUFEmber 8B (GGUF)
Ember is the AI partner built into RusticEngine, a game engine based on Godot 4.7 where games are written in Rust (godot-rust 0.5).
Ember is meant to work with a creator rather than build a whole game from one prompt. It asks about the creator's idea and inspirations before making creative choices, explains what it builds when the creator wants to learn, and guides people to make their own art in RusticEngine's Studio instead of making it for them.
New in RusticEngine 2.0: Ember also teaches Blender, from modeling concepts to keyboard shortcuts, and can answer questions from inside Blender. That comes from RusticEngine's built-in Blender library and guides, not from retraining: this is the same model as in 1.0.
RusticEngine downloads this model automatically the first time you open the AI Guide. You only need this page if you want to run Ember yourself.
What it is
- Base: Qwen3-8B (Apache-2.0). Fine-tuned with QLoRA (rank 16) on several hundred RusticEngine agent traces: real tool calls (reading and editing code,
cargobuilds with compiler feedback, headless playtests, Godot API lookups), plus collaboration conversations (kickoff questions, learning mode, concept art, Studio guidance). - File:
ember.gguf(SHA-2565b0017088220f714af249405a5ba5db5a93bb5880bb29072e727b127cc9fa02c). - Format: GGUF, mixed 4/5-bit (attention and ffn_down in Q5_0, ffn_gate/up and embeddings in Q4_0, output in Q8_0), about 5.5 GB.
- Chat format: Qwen3 ChatML with
<tool_call>tool calls, non-thinking mode (an empty<think></think>block before each reply).
How well it does
On RusticEngine's own evaluation (32 unseen godot-rust coding tasks, scored by whether the code builds and the game runs), Ember with RusticEngine's agent harness built about 17 of 32 and ran about 16 of 32 per pass. Base Qwen3-8B scored roughly 7 of 16 on an earlier, smaller version of the same evaluation. On held-out Studio and Mechanics questions it gives grounded, step-by-step guidance (34/34 and 9/9 on the current probes). Asked for new game mechanics it hasn't seen (a dash, a door, checkpoints, a patrolling enemy...), it delivers ones that build and do what was asked in most cases (6 of 8 in the latest full run, up from 0 of 5), by starting from RusticEngine's tested mechanic variants.
It is an 8B model, so it still invents Godot methods sometimes. RusticEngine's harness compensates: builds feed compiler errors back to it, missing imports are fixed automatically, and API lookups are offered before it writes code. For harder work, RusticEngine can also use a frontier model (Claude, OpenAI and others) in the AI Guide settings.
Running it yourself
- RusticEngine: built in, nothing to do.
- llama.cpp:
llama-server -m ember.gguf --jinja. Turn thinking off by ending prompts with an empty<think>\n\n</think>\n\nblock, as in training. - Ollama: create a model from this GGUF using Qwen3's template, with
think: false.
The tools Ember was trained with come from RusticEngine's agent (rustic-agent --print-tools). RusticEngine can also act as an MCP server (rustic-agent --mcp), so other agents can use the same tools.
License
Apache-2.0, like the Qwen3 base model. RusticEngine itself is GPL-3.0.
- Downloads last month
- 297
We're not able to determine the quantization variants.
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf johangdarkdev/Ember-8B-GGUF# Run inference directly in the terminal: llama cli -hf johangdarkdev/Ember-8B-GGUF