Instructions to use theredteamtech/JengaCoder-v1.2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use theredteamtech/JengaCoder-v1.2 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf theredteamtech/JengaCoder-v1.2:Q4_K_M # Run inference directly in the terminal: llama cli -hf theredteamtech/JengaCoder-v1.2:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf theredteamtech/JengaCoder-v1.2:Q4_K_M # Run inference directly in the terminal: llama cli -hf theredteamtech/JengaCoder-v1.2:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf theredteamtech/JengaCoder-v1.2:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf theredteamtech/JengaCoder-v1.2:Q4_K_M
Use Docker
docker model run hf.co/theredteamtech/JengaCoder-v1.2:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use theredteamtech/JengaCoder-v1.2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "theredteamtech/JengaCoder-v1.2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "theredteamtech/JengaCoder-v1.2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/theredteamtech/JengaCoder-v1.2:Q4_K_M
- Ollama
How to use theredteamtech/JengaCoder-v1.2 with Ollama:
ollama run hf.co/theredteamtech/JengaCoder-v1.2:Q4_K_M
- Unsloth Desktop
- Pi
How to use theredteamtech/JengaCoder-v1.2 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf theredteamtech/JengaCoder-v1.2:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "theredteamtech/JengaCoder-v1.2:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use theredteamtech/JengaCoder-v1.2 with Docker Model Runner:
docker model run hf.co/theredteamtech/JengaCoder-v1.2:Q4_K_M
- Lemonade
How to use theredteamtech/JengaCoder-v1.2 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull theredteamtech/JengaCoder-v1.2:Q4_K_M
Run and chat with the model
lemonade run user.JengaCoder-v1.2-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use theredteamtech/JengaCoder-v1.2 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf theredteamtech/JengaCoder-v1.2:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default theredteamtech/JengaCoder-v1.2:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use theredteamtech/JengaCoder-v1.2 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf theredteamtech/JengaCoder-v1.2:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "theredteamtech/JengaCoder-v1.2:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
JengaCoder v1.2
JengaCoder v1.2
JengaCoder v1.2 is a compact offline coding and engineering assistant developed for JengaAI Edge.
It is intended for students, teachers and developers using affordable laptops or working in environments where internet connectivity, cloud access and data cost are significant constraints.
The model runs locally through llama.cpp and does not require a dedicated GPU for inference.
Model details
- Developer: Abdulkarim Mohammed Ngulangwa / JengaAI Edge
- Base model:
Qwen/Qwen2.5-Coder-1.5B-Instruct - Base-model revision:
2e1fd397ee46e1388853d2af2c993145b0f1098a - Fine-tuning method: QLoRA supervised fine-tuning
- Parameters: approximately 1.54 billion
- Published format: GGUF
- Quantization: Q4_K_M
- Runtime: llama.cpp
- Primary language: English
- Model file:
JengaCoder-v1.2-Q4_K_M.gguf - Model SHA-256:
e253182086f2bfd9e48ee3e4b683f151276fa1dfc6510faea8be0824dbe433bc
Intended uses
JengaCoder is intended to provide offline assistance with:
- Python and C++ programming
- debugging and code explanation
- memory-conscious programming
- introductory web development
- Arduino and ESP32 projects
- embedded-system explanations
- practical coding and engineering education
The model is particularly intended for educational and development environments where continuous cloud access is not practical.
Running with llama.cpp
Download the GGUF file and run:
llama-cli \
-m JengaCoder-v1.2-Q4_K_M.gguf \
-cnv \
-n 512 \
--temp 0.2
An example prompt is:
Write a complete Python function named count_error_lines that reads a text file too large to fit in memory and returns the number of lines containing the exact substring ERROR. Use only the Python standard library, process the file in one pass with O(1) additional memory, handle FileNotFoundError gracefully, and explain the time and space complexity. Do not store matching lines in a list.
Training
JengaCoder v1.2 was trained using QLoRA with the following configuration:
- training records: 160
- validation records: 20
- epochs: 2
- final global step: 40
- random seed: 42
- LoRA rank: 16
- LoRA alpha: 32
- LoRA dropout: 0.05
- training quantization: NF4 with double quantization
- learning rate:
1e-4 - maximum sequence length: 2048
The LoRA adapter targeted:
q_projk_projv_projo_projgate_projup_projdown_proj
The authentic final trainer state records:
- final evaluation loss:
0.9508873224258423 - final evaluation mean token accuracy:
0.8057295680046082 - completed epoch:
2.0 - completed global step:
40
The original adapter, trainer state, training script, dataset checksums and reproduction documentation are available in the Gate 2 repository.
Evaluation
ADTC participant profiler
A final participant-mode profiler run on an Intel Core i7-1065G7 laptop with 7.6 GB RAM and no discrete GPU produced:
- generation throughput: approximately 19.02 tokens per second
- peak resident memory: approximately 1692.38 MB
- ARC Easy normalized accuracy: 0.70
- ARC Easy samples: 50
- runtime: CPU-only llama.cpp
Performance varies with CPU frequency, background processes, thermal conditions and llama.cpp build configuration.
Constraint-focused evaluation
The repository contains a frozen 10-prompt ConstraintBench diagnostic comparing the Qwen base model and JengaCoder v1.2.
| Evaluation | Qwen base | JengaCoder v1.2 |
|---|---|---|
| Overall ConstraintBench score | 77/100 | 59/100 |
| Physical/electrical subset | 24/40 | 15/40 |
These results are disclosed because they show that fine-tuning did not produce universal improvement. JengaCoder v1.2 showed useful behavior on several practical coding tasks but regressed on some tightly constrained physical-computing questions.
Complete prompts, rubrics, outputs and scoring evidence are available in the project repository.
Limitations
JengaCoder is a compact 1.54B-parameter model and has substantially less reasoning capacity than larger language models.
Known limitations include:
- occasional failure to follow strict hardware constraints
- possible invention of unrequested components
- incorrect electrical or sensor assumptions
- inconsistent handling of impossible requirements
- possible coding or memory-complexity errors
- English is the primary supported language
- generated code may require correction before deployment
A known example is that the model may incorrectly recommend driving a bare external LED without a current-limiting resistor. Such advice is unsafe and must not be followed.
All hardware guidance should be reviewed against component datasheets and tested safely before deployment.
Safety recommendations
Users should:
- verify electrical voltage and current limits
- use appropriate current-limiting and protection components
- review generated wiring before powering a circuit
- test code incrementally
- avoid using generated output in safety-critical systems without qualified review
- treat the model as an educational assistant rather than an authoritative engineering source
Reproducibility and provenance
The complete Gate 2 evidence package is available at:
https://github.com/theredteamtech/jengaai-edge/tree/gate2
It includes:
- original LoRA adapter weights
- adapter configuration
- final trainer state
- exact training script
- training and validation datasets
- SHA-256 checksum manifest
- base-model identity
- merge script
- quantization script
- benchmark evidence
- complete base-versus-fine-tuned output examples
Dataset and licensing
The JengaAI Edge training and validation datasets are included in the GitHub repository:
training/data/jengacoder_train_v1.jsontraining/data/jengacoder_validation_v1.json
The repository code and included datasets are distributed under the repositoryโs GNU General Public License v3.0.
The model is derived from Qwen/Qwen2.5-Coder-1.5B-Instruct, which is distributed under the Apache License 2.0. Users must comply with all applicable upstream and repository licensing terms.
Development status
JengaCoder v1.2 is the stable submitted model.
Later experimental adapters were not published as replacements because evaluation revealed regressions. A separate corrective v2 dataset is being developed to improve physical grounding, constraint following and embedded-system safety.
The v2 development data was not used to train JengaCoder v1.2.
Contact
- Developer: Abdulkarim Mohammed Ngulangwa
- GitHub: https://github.com/theredteamtech
- Project repository: https://github.com/theredteamtech/jengaai-edge
- Downloads last month
- 15
4-bit
Model tree for theredteamtech/JengaCoder-v1.2
Base model
Qwen/Qwen2.5-1.5B