PsycheMME: A Psychology-Informed Benchmark for Social Understanding and Interaction in Videos
Abstract
PsycheMME is a psychology-informed video benchmark that evaluates human understanding and response selection across eight capabilities using reasoning-verified scoring and expert-reviewed questions.
Understanding human needs and selecting responses require distinct judgments that aggregate accuracy can obscure. We introduce PsycheMME, a video benchmark informed by psychology, with eight capabilities spanning grounding, states, needs, interaction decisions, memory, and risk. Drawing on Social Information Processing and the Perception-Action Cycle, this organization separates human understanding from response selection. We construct 1,000 questions from 630 episodes through independent answering with proposed references withheld and expert review. Our Reasoning-Verified protocol weights answer credit by the support and logical consistency of explicit rationales against annotated cues. Across 17 models, Timing has the lowest Verified scores and credit retention, with weaker support judgments for correct Timing answers. Models with similar Need scores still differ in answer completeness on open questions. Input controls and SFT/GRPO examine context dependence and adaptation. Evaluating answers alongside rationales locates where models fail across understanding, response selection, and justification.
Get this paper in your agent:
hf papers read 2610.28625 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 2
psychemme/PsycheMME-Qwen3.5-4B-GRPO
Datasets citing this paper 3
psychemme/PsycheMME
psychemme/PsycheMME-logs
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper