---
library_name: transformers
license: apache-2.0
pipeline_tag: video-text-to-text
tags:
- video
- multimodal
- robotics
- embodied-ai
- evaluation
- qwen
---

# RoboJudge-9B

This model was presented in the paper [RoboJudge: Multimodal Language Models as Judges for Embodied Video Generation](https://huggingface.co/papers/2610.27782).

RoboJudge-9B is a multimodal judge for generated embodied-manipulation videos.
It scores two axes on a 1–5 scale:

- **Physical Adherence (PA):** agent consistency, scene consistency, and
  interaction realism.
- **Instruction Alignment (IA):** agent match, object correctness, and goal
  completion.

## Links

- Project page: https://spherelab.ai/RoboJudge/
- Code: https://github.com/Sphere-AI-Lab/RoboJudge

## Benchmark results on RoboJudge-Bench

| Metric | Pearson r with human ratings |
|---|---:|
| PA | 0.645 |
| IA | 0.775 |
| Overall | 0.719 |

## License

The RoboJudge release code and model weights are provided under Apache-2.0.
Use of the associated datasets is additionally subject to the terms of their
upstream sources.