cloudyu's picture
JEV-9B can see: robot-arm and computer-use demos, vl/ (multimodal serving), image evaluations
b63f651 verified
Raw History Blame Contribute Delete
445 Bytes
{
"t2i": {
"n": 1000,
"accuracy": 0.65,
"order_agreement": 0.637,
"seconds": 90.77313542366028
},
"edit": {
"n": 1000,
"accuracy": 0.585,
"order_agreement": 0.342,
"seconds": 122.78884029388428
},
"interleaved": {
"n": 1000,
"accuracy": 0.622,
"order_agreement": 0.663,
"seconds": 151.45967888832092
},
"reasoning": {
"n": 1000,
"accuracy": 0.58,
"order_agreement": 0.593,
"seconds": 94.65101504325867
}
}