How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "theredteamtech/JengaCoder-v1.2"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "theredteamtech/JengaCoder-v1.2",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Use Docker
docker model run hf.co/theredteamtech/JengaCoder-v1.2:Q4_K_M
Quick Links

JengaCoder v1.2


JengaCoder v1.2

JengaCoder v1.2 is a compact offline coding and engineering assistant developed for JengaAI Edge.

It is intended for students, teachers and developers using affordable laptops or working in environments where internet connectivity, cloud access and data cost are significant constraints.

The model runs locally through llama.cpp and does not require a dedicated GPU for inference.

Model details

  • Developer: Abdulkarim Mohammed Ngulangwa / JengaAI Edge
  • Base model: Qwen/Qwen2.5-Coder-1.5B-Instruct
  • Base-model revision: 2e1fd397ee46e1388853d2af2c993145b0f1098a
  • Fine-tuning method: QLoRA supervised fine-tuning
  • Parameters: approximately 1.54 billion
  • Published format: GGUF
  • Quantization: Q4_K_M
  • Runtime: llama.cpp
  • Primary language: English
  • Model file: JengaCoder-v1.2-Q4_K_M.gguf
  • Model SHA-256: e253182086f2bfd9e48ee3e4b683f151276fa1dfc6510faea8be0824dbe433bc

Intended uses

JengaCoder is intended to provide offline assistance with:

  • Python and C++ programming
  • debugging and code explanation
  • memory-conscious programming
  • introductory web development
  • Arduino and ESP32 projects
  • embedded-system explanations
  • practical coding and engineering education

The model is particularly intended for educational and development environments where continuous cloud access is not practical.

Running with llama.cpp

Download the GGUF file and run:

llama-cli \
  -m JengaCoder-v1.2-Q4_K_M.gguf \
  -cnv \
  -n 512 \
  --temp 0.2

An example prompt is:

Write a complete Python function named count_error_lines that reads a text file too large to fit in memory and returns the number of lines containing the exact substring ERROR. Use only the Python standard library, process the file in one pass with O(1) additional memory, handle FileNotFoundError gracefully, and explain the time and space complexity. Do not store matching lines in a list.

Training

JengaCoder v1.2 was trained using QLoRA with the following configuration:

  • training records: 160
  • validation records: 20
  • epochs: 2
  • final global step: 40
  • random seed: 42
  • LoRA rank: 16
  • LoRA alpha: 32
  • LoRA dropout: 0.05
  • training quantization: NF4 with double quantization
  • learning rate: 1e-4
  • maximum sequence length: 2048

The LoRA adapter targeted:

  • q_proj
  • k_proj
  • v_proj
  • o_proj
  • gate_proj
  • up_proj
  • down_proj

The authentic final trainer state records:

  • final evaluation loss: 0.9508873224258423
  • final evaluation mean token accuracy: 0.8057295680046082
  • completed epoch: 2.0
  • completed global step: 40

The original adapter, trainer state, training script, dataset checksums and reproduction documentation are available in the Gate 2 repository.

Evaluation

ADTC participant profiler

A final participant-mode profiler run on an Intel Core i7-1065G7 laptop with 7.6 GB RAM and no discrete GPU produced:

  • generation throughput: approximately 19.02 tokens per second
  • peak resident memory: approximately 1692.38 MB
  • ARC Easy normalized accuracy: 0.70
  • ARC Easy samples: 50
  • runtime: CPU-only llama.cpp

Performance varies with CPU frequency, background processes, thermal conditions and llama.cpp build configuration.

Constraint-focused evaluation

The repository contains a frozen 10-prompt ConstraintBench diagnostic comparing the Qwen base model and JengaCoder v1.2.

Evaluation Qwen base JengaCoder v1.2
Overall ConstraintBench score 77/100 59/100
Physical/electrical subset 24/40 15/40

These results are disclosed because they show that fine-tuning did not produce universal improvement. JengaCoder v1.2 showed useful behavior on several practical coding tasks but regressed on some tightly constrained physical-computing questions.

Complete prompts, rubrics, outputs and scoring evidence are available in the project repository.

Limitations

JengaCoder is a compact 1.54B-parameter model and has substantially less reasoning capacity than larger language models.

Known limitations include:

  • occasional failure to follow strict hardware constraints
  • possible invention of unrequested components
  • incorrect electrical or sensor assumptions
  • inconsistent handling of impossible requirements
  • possible coding or memory-complexity errors
  • English is the primary supported language
  • generated code may require correction before deployment

A known example is that the model may incorrectly recommend driving a bare external LED without a current-limiting resistor. Such advice is unsafe and must not be followed.

All hardware guidance should be reviewed against component datasheets and tested safely before deployment.

Safety recommendations

Users should:

  • verify electrical voltage and current limits
  • use appropriate current-limiting and protection components
  • review generated wiring before powering a circuit
  • test code incrementally
  • avoid using generated output in safety-critical systems without qualified review
  • treat the model as an educational assistant rather than an authoritative engineering source

Reproducibility and provenance

The complete Gate 2 evidence package is available at:

https://github.com/theredteamtech/jengaai-edge/tree/gate2

It includes:

  • original LoRA adapter weights
  • adapter configuration
  • final trainer state
  • exact training script
  • training and validation datasets
  • SHA-256 checksum manifest
  • base-model identity
  • merge script
  • quantization script
  • benchmark evidence
  • complete base-versus-fine-tuned output examples

Dataset and licensing

The JengaAI Edge training and validation datasets are included in the GitHub repository:

  • training/data/jengacoder_train_v1.json
  • training/data/jengacoder_validation_v1.json

The repository code and included datasets are distributed under the repositoryโ€™s GNU General Public License v3.0.

The model is derived from Qwen/Qwen2.5-Coder-1.5B-Instruct, which is distributed under the Apache License 2.0. Users must comply with all applicable upstream and repository licensing terms.

Development status

JengaCoder v1.2 is the stable submitted model.

Later experimental adapters were not published as replacements because evaluation revealed regressions. A separate corrective v2 dataset is being developed to improve physical grounding, constraint following and embedded-system safety.

The v2 development data was not used to train JengaCoder v1.2.

Contact

Downloads last month
15
GGUF
Model size
2B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for theredteamtech/JengaCoder-v1.2

Quantized
(208)
this model