feng0929's picture
Add files using upload-large-folder tool
9d3e3f1 verified
|
Raw History Blame Contribute Delete
1.8 kB
---
license: apache-2.0
base_model: Qwen/Qwen3.5-9B
base_model_relation: finetune
library_name: transformers
pipeline_tag: image-text-to-text
tags:
- game2player
- sft
- thinking
---
# Game2Player-9B-Thinking
Final checkpoint after one epoch of SFT on game examples containing nonempty
assistant thinking blocks. Training mixes **DeepSeek and MiniMax** data:
14,336 selected DeepSeek-v4.1-flash records and 8,138 MiniMax-m3.1-flash records.
After preprocessing, 22,425 records remain (49 filtered). This is not a
DeepSeek-only model. Final training step: 157.
Full language-model fine-tuning with vision encoder and aligner frozen;
4 H200 GPUs, BF16, ZeRO-2, gradient checkpointing, 25K packing,
global batch 48, LR 1e-5, cosine schedule, 3% warmup, seed 3407.
Base revision: `c202236235762e1c871ad0ccb60c8ee5ba337b9a`.
The 9B run uses non-fused AdamW. All 157 actual optimizer updates passed numerical checks.
No downstream benchmark evaluation has been performed.
The repository contains inference weights and all tokenizer/processor assets,
including supplemental base tokenizer/video assets where absent from the
checkpoint. Optimizer states, RNG states, training data and images are not
included. Full training checkpoints remain stored locally.
See `training_summary.json` for provenance.
Load using a Transformers version supporting Qwen3.5 (the training environment
uses Transformers 5.16.1).
This repository is public; authentication is not required to download it.
```python
import torch
from transformers import AutoProcessor, Qwen3_5ForConditionalGeneration
model_id = "game2player/Game2Player-9B-Thinking"
processor = AutoProcessor.from_pretrained(model_id)
model = Qwen3_5ForConditionalGeneration.from_pretrained(
model_id, dtype=torch.bfloat16, device_map="auto"
)
```