CTFty-9b / README.md
Qefoz's picture
v2: retrain from MiMo-V2.6-Distill-Qwen-9B, dataset v2 (42 flag-verified runs incl. 8 NTO)
4707151 verified
|
Raw History Blame Contribute Delete
1.03 kB
---
base_model: XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B
library_name: transformers
pipeline_tag: text-generation
tags:
- ctf
- cybersecurity
- agent
- sft
---
# CTFty-9b (v2)
CTF/security agent, full SFT from **XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B** (v1 was trained from Qwen3.5-9B).
## Training data — 1651 examples
- **42 agent runs with verified captured flags** (Kaspersky CTF, KubSTU, RCPISS/Avito, НТО — 8 tasks: reverse, pwn, forensics, web, crypto). Runs where the flag was NOT actually captured were excluded.
- 535 pentest walkthroughs (Pentest-R1)
- 858 MITRE ATT&CK technique cards
- 216 MBC malware behavior cards
## Recipe
Full fine-tune: 2 epochs, lr 5e-6 cosine, warmup 6 steps, global batch 16 (bs1 x ga16), bf16, max_length 8192, adamw_8bit, gradient checkpointing, RTX PRO 6000.
Train metrics: final logged loss 1.237, avg train_loss 1.267, runtime 71 min.
## Usage
Same ChatML format as the base model (`<|im_start|>user ... <|im_end|>`). Works with `AutoModelForImageTextToText` / `AutoProcessor`.