Instructions to use Monibee-Fudgekins/gemma-coder-dev with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Monibee-Fudgekins/gemma-coder-dev with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Monibee-Fudgekins/gemma-coder-dev")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Monibee-Fudgekins/gemma-coder-dev", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Monibee-Fudgekins/gemma-coder-dev with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Monibee-Fudgekins/gemma-coder-dev" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Monibee-Fudgekins/gemma-coder-dev", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Monibee-Fudgekins/gemma-coder-dev
- SGLang
How to use Monibee-Fudgekins/gemma-coder-dev with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Monibee-Fudgekins/gemma-coder-dev" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Monibee-Fudgekins/gemma-coder-dev", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Monibee-Fudgekins/gemma-coder-dev" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Monibee-Fudgekins/gemma-coder-dev", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Unsloth Desktop
- Docker Model Runner
How to use Monibee-Fudgekins/gemma-coder-dev with Docker Model Runner:
docker model run hf.co/Monibee-Fudgekins/gemma-coder-dev
File size: 2,642 Bytes
35e4588 3ee5236 35e4588 3ee5236 35e4588 3ee5236 35e4588 3ee5236 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 | ---
license: apache-2.0
base_model: google/gemma-4-E4B-it
datasets:
- google/code_x_glue_cc_defect_detection
- bstee615/diversevul
- bstee615/bigvul
- hitoshura25/cvefixes
library_name: transformers
pipeline_tag: text-generation
tags:
- code
- security
- vulnerability-detection
- qlora
- unsloth
---
# gemma-coder-dev
Defensive-security fine-tune of [`google/gemma-4-E4B-it`](https://huggingface.co/google/gemma-4-E4B-it),
produced by the retrain pipeline in [remote-agent-dev-platform](https://github.com/Monibee-Fudgekins/remote-agent-dev-platform).
**Last updated: 2026-11-10 19:44 UTC** · run mode: `smoke` · promoted: **False**.
> Numbers below come from this pipeline's own held-out eval. No ExploitGym
> results are claimed; that evaluation has not been run.
## Intended uses & limitations
- **Intended:** secure code review — decide whether a function is vulnerable, name the
CWE, and propose a secure rewrite; write code that avoids common weakness classes.
- **Not intended:** exploit development or any offensive use; unreviewed automated
patching; safety-critical decisions.
- **Limitations:** labels come from commit-mined datasets (noisy); the fix score is a
proxy, not a proof that the vulnerability is gone. Always review and test.
## Training data
- [`google/code_x_glue_cc_defect_detection`](https://huggingface.co/datasets/google/code_x_glue_cc_defect_detection)
- [`bstee615/diversevul`](https://huggingface.co/datasets/bstee615/diversevul)
- [`bstee615/bigvul`](https://huggingface.co/datasets/bstee615/bigvul)
- [`hitoshura25/cvefixes`](https://huggingface.co/datasets/hitoshura25/cvefixes)
Formatted into three chat tasks (detect / CWE classify / secure fix) by
`finetune/security_data.py`; functions are deduplicated, length-capped and capped
per source. A fixed-seed held-out slice (by function hash) is excluded from training.
## Training procedure
- Method: QLoRA (Unsloth), 4-bit base, LoRA r=16 / alpha=32 on
attention + MLP, lr 2e-4,
max seq len 768, optimizer adamw_8bit.
- Progress: cycle 1 — 10 / 4000 steps.
## Evaluation (20 items: synthetic seed + held-out)
| model | detection F1 | CWE top-1 | fix-validity (proxy) |
|---|---|---|---|
| this run | 0.0000 | 1.0000 | 0.0000 |
| base (adapter off) | not measured | | |
Promotion requires detection F1 and CWE accuracy to beat the base model by the
configured margins and the fix proxy not to regress (`finetune/evaluate.py`).
## Provenance
Generated by `finetune/kaggle/run.py` in [https://github.com/Monibee-Fudgekins/remote-agent-dev-platform](https://github.com/Monibee-Fudgekins/remote-agent-dev-platform).
|