File size: 2,821 Bytes
377660b bc9139e 377660b bc9139e 377660b bc9139e 377660b bc9139e 377660b bc9139e 377660b bc9139e 377660b bc9139e 377660b bc9139e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 | ---
library_name: transformers
pipeline_tag: image-text-to-text
base_model:
- Qwen/Qwen2.5-VL-3B-Instruct
- Qwen/Qwen2.5-VL-7B-Instruct
tags:
- ravec
- qwen2_5_vl
- multimodal
- reinforcement-learning
license: other
license_name: qwen-research
license_link: https://huggingface.co/Jack04810/RAVEC/blob/main/RAVEC-3B/LICENSE
---
# RAVEC: main-result checkpoints
This repository releases the verified 3B and 7B checkpoints associated with Table 2 of RAVEC.
| Directory | Base model | Checkpoint | Availability |
|---|---|---|---|
| `RAVEC-3B` | Qwen2.5-VL-3B-Instruct | F0, step 175 | Uploaded |
| `RAVEC-7B` | Qwen2.5-VL-7B-Instruct | M1, step 100 Actor | Uploaded |
The 7B release is the exact M1 step100 Actor export used by all fourteen recorded evaluation runs. All 15 original files were verified against the evaluation-time SHA-256 hashes; see `RAVEC-7B/checkpoint_manifest.json`.
The current paper and table-generation metadata identify the 3B step175 export as Actor/student.
Older records use `EMA_G3R` / `EMA` labels. The released 3B files match the original
checkpoint manifest byte-for-byte; `RAVEC-3B/checkpoint_manifest.json` records their SHA-256 hashes.
## Reported results
Avg@8 is mean accuracy over eight generations per question. Avg is the equal-weight
mean of the ten listed benchmarks. Scores are percentages.
| Model | Geometry3K | MathVista | We-Math | MathVerse | LogicVista | MMMU-Pro | MathVerse-V | C-VQA-Real | MARS-Bench | POPE | Avg |
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
| RAVEC-3B | 33.28 | 59.78 | 61.68 | 57.43 | 41.67 | 28.38 | 54.44 | 66.54 | 53.05 | 87.98 | 54.42 |
| RAVEC-7B | 43.20 | 66.44 | 70.73 | 67.53 | 46.28 | 36.09 | 65.03 | 70.69 | 55.99 | 87.99 | 61.00 |
See `evaluation_results.json` for available score precision, checkpoint selection, and source hashes.
## Loading the 3B checkpoint
```python
from transformers import AutoProcessor, Qwen2_5_VLForConditionalGeneration
repo = "Jack04810/RAVEC"
processor = AutoProcessor.from_pretrained(repo, subfolder="RAVEC-3B")
model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
repo, subfolder="RAVEC-3B", torch_dtype="auto", device_map="auto"
)
```
The export records Transformers 4.51.3. Use a Transformers version supporting Qwen2.5-VL.
## Loading the 7B checkpoint
Use the same loading example with `subfolder="RAVEC-7B"` for both the processor and model. See [RAVEC-7B/README.md](RAVEC-7B/README.md) for details and the original evaluation summary.
## License
The 3B checkpoint is derived from Qwen2.5-VL-3B-Instruct and retains the
Qwen Research License; see `RAVEC-3B/LICENSE` and `RAVEC-3B/NOTICE`.
The 7B checkpoint is derived from Qwen2.5-VL-7B-Instruct under Apache-2.0; see `RAVEC-7B/LICENSE`. The two model directories retain their respective base-model licenses.
|