You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Rewind run1 SFT model

The completed supervised fine-tuning checkpoint from run1, before GRPO/RL training. This is a full Qwen3-1.7B checkpoint in BF16 safetensors format, with its tokenizer, chat template, model configuration, and generation configuration.

It was trained on the 584 examples in Sangsang/rewind-run1-sft-data. Training used two epochs, global batch size 8, learning rate 2e-6, and eight warmup steps: 146 optimization steps and 1,168 examples seen. The vocabulary is unchanged; <rewind> is a plain-text action marker, not an added special token.

Loading

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "Sangsang/rewind-run1-sft-model"
tokenizer = AutoTokenizer.from_pretrained(repo, token=True)
model = AutoModelForCausalLM.from_pretrained(repo, token=True, torch_dtype="auto")

This repository is private; authenticate with an account that has access. To execute the learned operation, an inference controller must intercept <rewind>, remove the last four reasoning sections, and resume from the retained prefix. The training instruction allows one rewind per trajectory, before </think>. A normal Transformers generate() call does not perform that context deletion automatically. Deleted tokens still count against the trajectory's generation budget.

training_summary.json records the saved run settings and SFT summary. manifest.json provides file checksums. No RL checkpoint or optimizer state is included.

Downloads last month
-
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Sangsang/rewind-run1-sft-model

Finetuned
Qwen/Qwen3-1.7B
Finetuned
(1268)
this model

Dataset used to train Sangsang/rewind-run1-sft-model