VIEScore2

A unified evaluator for generated and edited images. In a single autoregressive pass the model emits:

  • a quality score — dual-axis perceptual quality (pq:) and semantic consistency (sc:),
  • a defect grid — sparse cells on a text-native 16×16 grid localizing problems, optionally split into artifact: / misalign: channels, and
  • a verifiable explanation, rendered deterministically from the score and grid so the text can never contradict the spatial evidence.

Because every output element is a discrete text token set, predictions are exactly checkable against ground truth. Training is supervised fine-tuning followed by GRPO with a verifiable cell-level F_β reward on the defect grid.

Repository contents

Naming convention: VIEScore2 denotes the full model after GRPO; ablated variants are marked by what they lack, never by added suffixes.

path contents
/ (root) VIEScore2 — the full post-GRPO checkpoint (drop-in Qwen3VLForConditionalGeneration)
wo-grpo/ VIEScore2 (w/o GRPO) — the SFT-stage LoRA adapter on Qwen/Qwen3-VL-8B-Instruct

Usage

from transformers import AutoProcessor, Qwen3VLForConditionalGeneration

model = Qwen3VLForConditionalGeneration.from_pretrained(
    "Allenda/VIEScore2", dtype="bfloat16", device_map="auto")
processor = AutoProcessor.from_pretrained("Allenda/VIEScore2")

Evaluation prompts, the frozen protocol, the deterministic explanation renderer, and all benchmark converters and baseline harnesses live in the accompanying code release (see the paper).

Evaluation

On a 1,300-example multi-source suite (RichHF, PAL4VST, EvalMuse, ImagenWorld, COCO; frozen protocol v3.1): localization cell-F1 0.506, problem-sample grid IoU 0.324, overall-score SRCC 0.601. After mapping all methods to a shared 16×16 grid, VIEScore2 is the only evaluator in the top two of cell-F1 or grid-IoU on all six external localization benchmarks (RichHF, AbHuman, HAD, SynthScars, PAL4VST, SDG-30K). See the paper and code repository for the full tables and protocol details.

Citation

Citation information will be added upon publication.

Downloads last month
19
Safetensors
Model size
9B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Allenda/VIEScore2

Finetuned
(600)
this model