Add OmniCompass evaluation results
#24
by VCLab-PolyU - opened
.eval_results/omnicompass.yaml
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: VCLab-PolyU/OmniCompass
|
| 3 |
+
task_id: OmniCompass-AV
|
| 4 |
+
value: 17.5
|
| 5 |
+
source:
|
| 6 |
+
url: https://omnicompass.netlify.app/#leaderboard
|
| 7 |
+
name: OmniCompass official results
|
| 8 |
+
user: VCLab-PolyU
|
| 9 |
+
notes: OmniCompass-AV; Overall CS on a 0-100 scale, higher is better. 32 video frames;
|
| 10 |
+
paired Text and Text+Image; TG, SG and QA. Imported from the benchmark authors'
|
| 11 |
+
published results, rounded to one decimal. Evaluation settings and model-specific
|
| 12 |
+
limits follow the cited source. This submission does not claim HF verified status.
|