RAVEC: main-result checkpoints

This repository releases the verified 3B and 7B checkpoints associated with Table 2 of RAVEC.

Directory	Base model	Checkpoint	Availability
RAVEC-3B	Qwen2.5-VL-3B-Instruct	F0, step 175	Uploaded
RAVEC-7B	Qwen2.5-VL-7B-Instruct	M1, step 100 Actor	Uploaded

The 7B release is the exact M1 step100 Actor export used by all fourteen recorded evaluation runs. All 15 original files were verified against the evaluation-time SHA-256 hashes; see RAVEC-7B/checkpoint_manifest.json. The current paper and table-generation metadata identify the 3B step175 export as Actor/student. Older records use EMA_G3R / EMA labels. The released 3B files match the original checkpoint manifest byte-for-byte; RAVEC-3B/checkpoint_manifest.json records their SHA-256 hashes.

Reported results

Avg@8 is mean accuracy over eight generations per question. Avg is the equal-weight mean of the ten listed benchmarks. Scores are percentages.

Model	Geometry3K	MathVista	We-Math	MathVerse	LogicVista	MMMU-Pro	MathVerse-V	C-VQA-Real	MARS-Bench	POPE	Avg
RAVEC-3B	33.28	59.78	61.68	57.43	41.67	28.38	54.44	66.54	53.05	87.98	54.42
RAVEC-7B	43.20	66.44	70.73	67.53	46.28	36.09	65.03	70.69	55.99	87.99	61.00

See evaluation_results.json for available score precision, checkpoint selection, and source hashes.

Loading the 3B checkpoint

from transformers import AutoProcessor, Qwen2_5_VLForConditionalGeneration

repo = "Jack04810/RAVEC"
processor = AutoProcessor.from_pretrained(repo, subfolder="RAVEC-3B")
model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
    repo, subfolder="RAVEC-3B", torch_dtype="auto", device_map="auto"
)

The export records Transformers 4.51.3. Use a Transformers version supporting Qwen2.5-VL.

Loading the 7B checkpoint

Use the same loading example with subfolder="RAVEC-7B" for both the processor and model. See RAVEC-7B/README.md for details and the original evaluation summary.

License

The 3B checkpoint is derived from Qwen2.5-VL-3B-Instruct and retains the Qwen Research License; see RAVEC-3B/LICENSE and RAVEC-3B/NOTICE.

The 7B checkpoint is derived from Qwen2.5-VL-7B-Instruct under Apache-2.0; see RAVEC-7B/LICENSE. The two model directories retain their respective base-model licenses.