CTFty-9b / README.md
Qefoz's picture
v2: retrain from MiMo-V2.6-Distill-Qwen-9B, dataset v2 (42 flag-verified runs incl. 8 NTO)
4707151 verified
|
Raw History Blame Contribute Delete
1.03 kB
metadata
base_model: XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B
library_name: transformers
pipeline_tag: text-generation
tags:
  - ctf
  - cybersecurity
  - agent
  - sft

CTFty-9b (v2)

CTF/security agent, full SFT from XiaomiMiMo/MiMo-V2.6-Distill-Qwen-9B (v1 was trained from Qwen3.5-9B).

Training data — 1651 examples

  • 42 agent runs with verified captured flags (Kaspersky CTF, KubSTU, RCPISS/Avito, НТО — 8 tasks: reverse, pwn, forensics, web, crypto). Runs where the flag was NOT actually captured were excluded.
  • 535 pentest walkthroughs (Pentest-R1)
  • 858 MITRE ATT&CK technique cards
  • 216 MBC malware behavior cards

Recipe

Full fine-tune: 2 epochs, lr 5e-6 cosine, warmup 6 steps, global batch 16 (bs1 x ga16), bf16, max_length 8192, adamw_8bit, gradient checkpointing, RTX PRO 6000.

Train metrics: final logged loss 1.237, avg train_loss 1.267, runtime 71 min.

Usage

Same ChatML format as the base model (<|im_start|>user ... <|im_end|>). Works with AutoModelForImageTextToText / AutoProcessor.