Question: How many floral patterns are there in the image?

Answer: 4

{"text":"set of four seamless red floral pattern vector image","source":"CountBench"}


Question: How many pigs are there in the image?

Answer: 5

{"text":"Studies of five pigs, lying down, by James","source":"CountBench","replacement_provenance":{"revision":"quality-revision-20260720","replaces":"perception_counting_110","review_decision":"watch"}}


Question: How many glasses are there in the image?

Answer: 4

{"text":"LSA Wine set of four stemless red wine glasses","source":"CountBench"}


Question: How many chairs are there in the image?

Answer: 8

{"text":"Set of eight walnut queen anne dining chairs for sale at for Dining room chairs queen anne","source":"CountBench"}


Question: How many gears are there in the image?

Answer: 3

{"text":"Conceptual three gears with Earth globes - 3d render","source":"CountBench"}


Question: How many eggs are there in the image?

Answer: 8

{"text":"A Barn Owl laid eight eggs in this box - the center one is hatching!","source":"CountBench","replacement_provenance":{"revision":"quality-revision-20260720","replaces":"perception_counting_124","review_decision":"watch"}}


Question: How many apples are there in the image?

Answer: 7

{"text":"A set of seven red plastic apples on a white background","source":"CountBench"}


Question: How many people are there in the image?

Answer: 10

{"text":"Our creative team of ten people with occupations icons","source":"CountBench"}


Question: How many couples are there in the image?

Answer: 8

{"text":"The eight remaining couples on 'Dancing With The Stars' week 6","source":"CountBench"}


Question: How many golfers are there in the image?

Answer: 9

{"text":"Watch nine golfers sink putts into same hole","source":"CountBench"}


Question: How many roses are there in the image?

Answer: 9

{"text":"American Box entry of nine miniature roses","source":"CountBench"}


Question: How many people are there in the image?

Answer: 2

{"text":"Joshua (left) and Alexander are the 2013 Hill-Stephens Scholars, an honor awarded to two African-American sophomores or juniors at Harvard College.","source":"CountBench"}


Question: How many guitars are there in the image?

Answer: 3

{"text":"three guitars vector image","source":"CountBench"}


Question: How many chairs are there in the image?

Answer: 5

{"text":"five solid oak dining chairs by maurice pr france 1950s","source":"CountBench"}


Question: How many girls are there in the image?

Answer: 3

{"text":"three girls raised their glasses in a nightclub","source":"CountBench"}


Question: How many mandalas are there in the image?

Answer: 9

{"text":"Set of nine geometric colorful mandala vector","source":"CountBench"}


Question: How many outfits are there in the image?

Answer: 4

{"text":"A look at style queen Maxima's four inauguration outfits","source":"CountBench"}


Question: How many doors are there in the image?

Answer: 3

{"text":"Choice of three doors opening to possible vacation or getaway destinations Imagens","source":"CountBench"}


Question: How many candles are there in the image?

Answer: 6

{"text":"Pack of six LED battery operated tea lights/candles","source":"CountBench"}


Question: How many men are there in the image?

Answer: 2

{"text":"Portrait of two men, unidentified","source":"CountBench"}


Question: How many frames are there in the image?

Answer: 3

{"text":"The three Sellwood finish options for Sisi Photography wedding collections - Teal, white and black.","source":"CountBench"}


Question: How many figurines are there in the image?

Answer: 8

{"text":"All eight kinds of one piece figure skating world collector bulldog figure skating ONE PIECE FILM Z Vol.4 《 immediate delivery product 》","source":"CountBench"}


Question: How many dice are there in the image?

Answer: 10

{"text":"d10 set of ten - Yellow","source":"CountBench"}


Question: How many silhouettes of couples are there in the image?

Answer: 9

{"text":"Silhouette of groom and a bride in a nine different poses","source":"CountBench"}


Question: How many dice are there in the image?

Answer: 10

{"text":"d10 set of ten","source":"CountBench"}


Question: How many poinsettias are there in the image?

Answer: 10

{"text":"All ten Christmas Poinsettia","source":"CountBench"}


Question: How many moais are there in the image?

Answer: 9

{"text":"The view of the nine leftmost moai at Ahu on Easter Island","source":"CountBench","replacement_provenance":{"revision":"quality-revision-20260720","replaces":"perception_counting_253","review_decision":"watch"}}


Question: How many keychains are there in the image?

Answer: 8

{"text":"A person on behalf of eight Mushroom Doll Keychain","source":"CountBench"}


Question: How many silhouettes are there in the image?

Answer: 10

{"text":"Silhouette of ten young women, walking hand in hand.","source":"CountBench"}


Question: How many eggs are there in the image?

Answer: 10

{"text":"3D illustration of ten eggs in a carton package","source":"CountBench"}


Question: How many Cookies are there in the image?

Answer: 7

{"text":"Overhead shot of seven Chewy Peanut Butter Cookies with Chocolate M&M's on a white plate.","source":"CountBench"}


Question: How many dice are there in the image?

Answer: 7

{"text":"set of seven green polyhedral dice for role playing games","source":"CountBench"}


Question: How many butterflies are there in the image?

Answer: 10

{"text":"Set of ten ornamental butterflies","source":"CountBench"}


Question: How many people are in the foreground of this image?

Answer: 7

{"text":"Lloyds Bank Commercial Banking has appointed seven new specialist banking professionals dedicated to the property SME sector. Pictured are Harjit, Andy , Dave, Mike, Demetrius, Damian and Dave","source":"CountBench"}


Question: How many dice are there in the image?

Answer: 10

{"text":"d10 set of ten red dice","source":"CountBench"}


Question: How many groomsmen are there in the image?

Answer: 7

{"text":"All of Peter's seven groomsmen wore gray Vera Wang tuxedos with slim black ties, forgoing boutonnieres for white pocket squares.","source":"CountBench"}


Question: How many children are there in the image?

Answer: 10

{"text":"Portrait of ten children standing on a bench at an outdoors part","source":"CountBench","replacement_provenance":{"revision":"quality-revision-20260720","replaces":"perception_counting_420","review_decision":"remove"}}


Question: How many pairs of socks are there in the image?

Answer: 5

{"text":"bluezoo - Pack of five boys+ white tip striped socks","source":"CountBench"}


Question: How many wooden spoons are there in the image?

Answer: 9

{"text":"nine healthy dried berry collection (blueberry, mulberry, cherry, goji, elderberry, chokeberry, cranberry, goldenberry) on isolated wooden spoons, top view","source":"CountBench"}


Question: How many silhouettes of couples are there in the image?

Answer: 10

{"text":"ten couples silhouettes vector image vector image","source":"CountBench"}


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Which point is closer to the camera?

Choices:
- A is closer
- B is closer


Question: Is the steel bowl narrower than the shoulder of the lady behind?

Answer: no

Choices:
- no
- yes


Question: Which person is taller?

Answer: the right

Choices:
- the left
- the right


Question: Which chandelier is bigger?

Answer: the left chandelier

Choices:
- the left chandelier
- the right chandelier


Question: Which sheep is the shortest?

Answer: the middle sheep

Choices:
- the leftmost sheep
- the middle sheep


Question: Which vase is the highest?

Answer: second vase from the right

Choices:
- first vase from the right
- second vase from the right


Question: Which utensil is shorter?

Answer: fork

Choices:
- knife
- fork


Question: Are the three black goblets the same height?

Answer: yes

Choices:
- no
- yes


Question: Is the rightmost pumpkin the biggest?

Answer: yes

Choices:
- no
- yes


Question: Do the two cows look the same height?

Answer: yes

Choices:
- no
- yes


Question: Are the table lamps on the left and right sides of the bed of the same size?

Answer: yes

Choices:
- no
- yes


Question: Do the two giraffes have different height?

Answer: yes

Choices:
- no
- yes


Question: Do the two zebras have different height?

Answer: yes

Choices:
- no
- yes


Question: Do the five cups in the first row look the same height?

Answer: yes

Choices:
- no
- yes


Question: Which giraffe is taller

Answer: the right

Choices:
- the left
- the right


Question: Which person is taller?

Answer: the one standing at the back

Choices:
- the one standing at the front
- the one standing at the back


Question: Which baby is taller?

Answer: the right

Choices:
- the left
- the right


Question: Is the leftmost sunflower the biggest of the three sunflowers in the picture?

Answer: no

Choices:
- no
- yes


Question: Is the second giraffe from the right the shortest?

Answer: yes

Choices:
- no
- yes


Question: Which man is taller?

Answer: the man walking at the front

Choices:
- the man walking at the front
- the man walking behind


Question: Are the four motorbikes the same size?

Answer: yes

Choices:
- no
- yes


Question: Do all three phones in the photo have similar size?

Answer: yes

Choices:
- no
- yes


Question: Which window pane has the largest area?

Answer: the center one

Choices:
- the leftmost one
- the center one


Question: Do the four planes in the picture look the same size?

Answer: yes

Choices:
- no
- yes


Question: Are two giraffes the same height?

Answer: no

Choices:
- no
- yes


Question: Which refrigerator is higher?

Answer: the white one

Choices:
- the white one
- the yellow one


Question: On the desk on the left, which computer screen is larger?

Answer: the screen on the left

Choices:
- the screen on the left
- the screen on the right


Question: Are the two giraffes of the same height?

Answer: no

Choices:
- no
- yes


Question: Which vehicle is wider?

Answer: the vehicle on the left

Choices:
- the vehicle on the left
- the vehicle on the right


Question: The leftmost mobile phone is the longest.

Answer: yes

Choices:
- no
- yes


Question: Which ring on the handle of scissors is smaller?

Answer: the left ring

Choices:
- the left ring
- the right ring


Question: Is the second giraffe from the right the tallest?

Answer: yes

Choices:
- no
- yes


Question: Do both windows have the same height?

Answer: yes

Choices:
- no
- yes


Question: Which giraffe is taller?

Answer: the left

Choices:
- the left
- the right


Question: Which zebra is the biggest?

Answer: the rightmost one

Choices:
- the leftmost one
- the rightmost one


Question: The yellow sauce bottle is as tall as the red one.

Answer: yes

Choices:
- no
- yes


Question:
From the perspective of the camera, which orientation is the bird in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the cat in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: left


Question:
From the perspective of the camera, which orientation is the person in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the bear in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front left


Question:
From the perspective of the camera, which orientation is the cat in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the person in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front left


Question:
From the perspective of the camera, which orientation is the garbage truck in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the bullfrog in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the tractor in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the pickup in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the racer in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"racer, race car, racing car","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the trailer truck in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"trailer truck, tractor trailer, trucking rig, rig, articulated lorry, semi","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the bald eagle in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"bald eagle, American eagle, Haliaeetus leucocephalus","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the recreational vehicle in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the pickup in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the person in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: left


Question:
From the perspective of the camera, which orientation is the recreational vehicle in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the Komodo dragon in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"Komodo dragon, Komodo lizard, dragon lizard, giant lizard, Varanus komodoensis","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the tree frog in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the European fire salamander in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"European fire salamander, Salamandra salamandra","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the racer in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"racer, race car, racing car","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the Gila monster in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the trolleybus in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"trolleybus, trolley coach, trackless trolley","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the electric ray in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"electric ray, crampfish, numbfish, torpedo","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the person in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: left


Question:
From the perspective of the camera, which orientation is the pickup in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the great grey owl in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"great grey owl, great gray owl, Strix nebulosa","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the moving van in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the tractor in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the moving van in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the tractor in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the pickup in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the garbage truck in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the alligator lizard in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the racer in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right

{"type":"choose","domain":"real","base_dataset":"ImageNet","category_name":"racer, race car, racing car","source":"EgoOrientBench"}


Question:
From the perspective of the camera, which orientation is the person in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front left


Question:
From the perspective of the camera, which orientation is the partridge in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the moving van in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front right


Question:
From the perspective of the camera, which orientation is the pig in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front


Question:
From the perspective of the camera, which orientation is the pig in the photo facing? A.front B.front right C.right D.back right E.back F.back left G.left H.front left
 Answer with the option's letter and word from the given choices directly.

Answer: front


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Diagonally forward and left B. Directly right C. Diagonally forward and right D. Directly left

Answer: A

{"category":["perpendicular","P-P","meanwhile","self"],"type":"0_frame","images":["among/011ee9e638b75b983746252c02622e56d5477cbc8f1ae7e1a27410cbce89b282/front_126.png","among/011ee9e638b75b983746252c02622e56d5477cbc8f1ae7e1a27410cbce89b282/left_151.png"],"meta_info":[["office chair with blue seat","blue bin and black chair","blue bin and grey bin","door","white cabinet"],[null,null,null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the office chair with blue seat from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 1, what is behind me? A. Door B. White cabinet C. Blue bin and grey bin D. Blue bin and black chair

Answer: D


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Diagonally forward and right B. Directly right C. Directly left D. Diagonally forward and left

Answer: A

{"category":["perpendicular","P-P","meanwhile","self"],"type":"1_frame","images":["among/011ee9e638b75b983746252c02622e56d5477cbc8f1ae7e1a27410cbce89b282/left_151.png","among/011ee9e638b75b983746252c02622e56d5477cbc8f1ae7e1a27410cbce89b282/front_126.png"],"meta_info":[["office chair with blue seat","blue bin and black chair","blue bin and grey bin","door","white cabinet"],[null,null,null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the office chair with blue seat from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 3, then I turn right and move forward, will I get closer to the blue bin and grey bin? A. Yes B. No

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the office chair with blue seat from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 3, what is to the left of the office chair with blue seat? A. Door B. Blue bin and black chair C. White cabinet D. Blue bin and grey bin

Answer: C


Question: Based on these four images (image 1, 2, 3, and 4) showing the office chair with blue seat from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 4, what is behind me? A. White cabinet B. Blue bin and black chair C. Door D. Blue bin and grey bin

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the office chair with blue seat from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 4, what is to the right of the office chair with blue seat? A. Door B. Blue bin and black chair C. White cabinet D. Blue bin and grey bin

Answer: A


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Directly left B. Directly right C. Diagonally forward and left D. Diagonally forward and right

Answer: C

{"category":["perpendicular","P-P","meanwhile","self"],"type":"0_frame","images":["among/07a60a723ebf3a478a81f413345b5d6da80aebd75c67e5e4e40836c09831b338/front_129.png","among/07a60a723ebf3a478a81f413345b5d6da80aebd75c67e5e4e40836c09831b338/left_151.png"],"meta_info":[["white square stool with pillows","two single sofas","TV","leather loveseat with three seat cushions","leather loveseat"],[null,"face",null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the white square stool with pillows from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 2, what is to the left of the white square stool with pillows? A. Leather loveseat with three seat cushions B. TV C. Leather loveseat D. Two single sofas

Answer: A


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Directly left B. Directly right C. Diagonally forward and left D. Diagonally forward and right

Answer: D

{"category":["perpendicular","P-P","meanwhile","self"],"type":"2_frame","images":["among/07a60a723ebf3a478a81f413345b5d6da80aebd75c67e5e4e40836c09831b338/back_168.png","among/07a60a723ebf3a478a81f413345b5d6da80aebd75c67e5e4e40836c09831b338/left_151.png"],"meta_info":[["white square stool with pillows","two single sofas","TV","leather loveseat with three seat cushions","leather loveseat"],[null,"face",null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the white square stool with pillows from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 3, what is behind me? A. TV B. Leather loveseat with three seat cushions C. Leather loveseat D. Two single sofas

Answer: B


Question: Based on these four images (image 1, 2, 3, and 4) showing the white square stool with pillows from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 3, then I turn right and move forward, will I get closer to the TV? A. No B. Yes

Answer: B


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Directly left B. Diagonally forward and right C. Diagonally forward and left D. Directly right

Answer: C

{"category":["perpendicular","P-P","meanwhile","self"],"type":"3_frame","images":["among/07a60a723ebf3a478a81f413345b5d6da80aebd75c67e5e4e40836c09831b338/right_190.png","among/07a60a723ebf3a478a81f413345b5d6da80aebd75c67e5e4e40836c09831b338/front_129.png"],"meta_info":[["white square stool with pillows","two single sofas","TV","leather loveseat with three seat cushions","leather loveseat"],[null,"face",null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the white square stool with pillows from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 4, then I turn left and move forward, will I get closer to the two single sofas? A. Yes B. No

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the coffee table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 2, what is to the left of the coffee table? A. Two blue leather armchairs B. Table and white chair C. Blue bin D. Cream-colored cabinet

Answer: D


Question: Based on these four images (image 1, 2, 3, and 4) showing the coffee table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 3, then I turn right and move forward, will I get closer to the table and white chair? A. Yes B. No

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the coffee table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 3, what is to the left of the coffee table? A. Two blue leather armchairs B. Table and white chair C. Cream-colored cabinet D. Blue bin

Answer: A


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Diagonally forward and right B. Diagonally forward and left C. Directly right D. Directly left

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the coffee table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 4, what is behind me? A. Blue bin B. Two blue leather armchairs C. Cream-colored cabinet D. Table and white chair

Answer: B


Question: Based on these four images (image 1, 2, 3, and 4) showing the coffee table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 4, then I turn right and move forward, will I get closer to the cream-colored cabinet? A. No B. Yes

Answer: B


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Diagonally forward and left B. Diagonally forward and right C. Directly left D. Directly right

Answer: B

{"category":["perpendicular","P-P","meanwhile","self"],"type":"0_frame","images":["among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/front_116.png","among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/right_188.png"],"meta_info":[["white board","blue-gray chair paired with white table","office chair with blue seat","kitchenette","small table with books inside"],[null,null,null,null,null]],"source":"MindCube"}


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Diagonally forward and left B. Diagonally forward and right C. Directly left D. Directly right

Answer: B

{"category":["perpendicular","P-P","meanwhile","self"],"type":"1_frame","images":["among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/left_140.png","among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/front_116.png"],"meta_info":[["white board","blue-gray chair paired with white table","office chair with blue seat","kitchenette","small table with books inside"],[null,null,null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the white board from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 2, what is behind me? A. blue-gray chair paired with white table B. office chair with blue seat C. kitchenette D. small table with books inside

Answer: B


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Diagonally forward and left B. Diagonally forward and right C. Directly left D. Directly right

Answer: B

{"category":["perpendicular","P-P","meanwhile","self"],"type":"2_frame","images":["among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/back_160.png","among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/left_140.png"],"meta_info":[["white board","blue-gray chair paired with white table","office chair with blue seat","kitchenette","small table with books inside"],[null,null,null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the white board from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 3, what is to the right of the white board? A. blue-gray chair paired with white table B. office chair with blue seat C. kitchenette D. small table with books inside

Answer: B


Question: Based on these two views showing the same scene: in which direction did I move from the first view to the second view? A. Diagonally forward and left B. Diagonally forward and right C. Directly left D. Directly right

Answer: A

{"category":["perpendicular","P-P","meanwhile","self"],"type":"3_frame","images":["among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/right_188.png","among/26da8aea7dc318bbeddc6d935b28352f67b12915ec4ff634e04c31495e656449/front_116.png"],"meta_info":[["white board","blue-gray chair paired with white table","office chair with blue seat","kitchenette","small table with books inside"],[null,null,null,null,null]],"source":"MindCube"}


Question: Based on these four images (image 1, 2, 3, and 4) showing the black chair with pillows from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 2, what is to the left of the black chair with pillows? A. Two single sofas B. Leather loveseat with three seat cushions C. Leather loveseat D. TV

Answer: B


Question: Based on these four images (image 1, 2, 3, and 4) showing the black chair with pillows from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 4, what is to the right of the black chair with pillows? A. Leather loveseat with three seat cushions B. Leather loveseat C. TV D. Two single sofas

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the table with black clothes from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 1, what is to the right of the table with black clothes? A. White board B. Lectern C. Door D. Classroom seating area

Answer: C


Question: Based on these four images (image 1, 2, 3, and 4) showing the table with black clothes from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 2, what is behind me? A. White board B. Lectern C. Door D. Classroom seating area

Answer: B


Question: Based on these four images (image 1, 2, 3, and 4) showing the adjustable standing desk from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 1, what is to the right of the adjustable standing desk? A. Door B. Bookcase C. Walkway between table and trash bins D. Walkway between desk and chairs

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the adjustable standing desk from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 2, then I turn right and move forward, will I get closer to the walkway between table and trash bins? A. Yes B. No

Answer: A


Question: Based on these four images (image 1, 2, 3, and 4) showing the blue table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 3, what is to the right of the blue table? A. Plain white wall B. Sofa C. Wall with an air conditioning unit D. Seating bench

Answer: D


Question: Based on these four images (image 1, 2, 3, and 4) showing the sideboard table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: From the viewpoint presented in image 3, what is to the right of the sideboard table? A. Sideboard table B. Display shelves C. Gate D. Wooden door and yellow decoration

Answer: D


Question: Based on these four images (image 1, 2, 3, and 4) showing the white table from different viewpoints (front, left, back, and right), with each camera aligned with room walls and partially capturing the surroundings: If I am standing at the same spot and facing the same direction as shown in image 3, what is behind me? A. Glass door B. Glass wall C. Gridded glass wall D. TV

Answer: B


Question: From the perspective of the man in white, the man in green was in what position relative to him?

Answer: D. right

Choices:
- A. front
- B. front-left
- C. back-left
- D. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the man wearing glasses, where is this woman positioned?

Answer: C. left

Choices:
- A. back
- B. back-right
- C. left
- D. front

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: Which hand does this man use to hold the surfboard?

Answer: B. right

Choices:
- A. left
- B. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of this giraffe, where is the green brush located?

Answer: D. front

Choices:
- A. left
- B. right
- C. back-left
- D. front

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of this little girl, where is the little boy?

Answer: B. left

Choices:
- A. right
- B. left
- C. back-right
- D. front-right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: Which hand does this man use to hold the toothbrush?

Answer: A. left

Choices:
- A. left
- B. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of this cat, where is the book located?

Answer: B. back

Choices:
- A. right
- B. back
- C. front
- D. left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of this man wearing sunglasses, where is the man in a suit positioned?

Answer: C. back-left

Choices:
- A. back-right
- B. front-right
- C. back-left
- D. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the man in black clothes, where is the man in blue clothes located?

Answer: B. left

Choices:
- A. back
- B. left
- C. front-right
- D. back-right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: Which hand does this girl hold this pink brush with?

Answer: A. left

Choices:
- A. left
- B. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From this woman's perspective, where is the man positioned?

Answer: B. left

Choices:
- A. back
- B. left
- C. back-right
- D. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the woman in red, where is the woman in grey?

Answer: A. right

Choices:
- A. right
- B. front-left
- C. front
- D. back-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of this dog, where are the potted plant located?

Answer: B. back-right

Choices:
- A. back-left
- B. back-right
- C. front-left
- D. front

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From this boy's perspective, where is the man positioned?

Answer: A. back

Choices:
- A. back
- B. front-right
- C. left
- D. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From this woman's perspective, where is the boy positioned?

Answer: B. right

Choices:
- A. left
- B. right
- C. back
- D. front-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of this bear, where are the bear's paw located?

Answer: D. front-right

Choices:
- A. back-right
- B. left
- C. back
- D. front-right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the woman standing there, where is the man holding the bat positioned?

Answer: A. back-left

Choices:
- A. back-left
- B. back-right
- C. front
- D. front-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the horse, in which direction is the carriage?

Answer: D. back

Choices:
- A. right
- B. front
- C. front-left
- D. back

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the female's perspective, in which direction is the clock located?

Answer: B. back-left

Choices:
- A. back-right
- B. back-left
- C. front-right
- D. front-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From this man's perspective, in which direction is the dog?

Answer: D. front

Choices:
- A. right
- B. back
- C. back-left
- D. front

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: Which hand does this woman hold the racket with?

Answer: B. right

Choices:
- A. left
- B. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of this woman wearing glasses, in which direction is the woman with golden hair?

Answer: D. left

Choices:
- A. front
- B. front-right
- C. back-right
- D. left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From this girl's perspective, in which direction is the teddy bear?

Answer: D. front-left

Choices:
- A. back
- B. back-right
- C. right
- D. front-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the man carrying the suitcase, where is the man wearing glasses positioned?

Answer: A. front-right

Choices:
- A. front-right
- B. front-left
- C. back
- D. back-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From this man's perspective, in which direction is the woman wearing the wedding dress?

Answer: D. left

Choices:
- A. right
- B. back
- C. front-right
- D. left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the boy in the center of the picture, in which direction is the other boy?

Answer: D. back-right

Choices:
- A. left
- B. front-right
- C. back-left
- D. back-right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the man holding a baseball bat and wearing yellow clothes, in which direction is the audience stand?

Answer: A. right

Choices:
- A. right
- B. back-left
- C. front-left
- D. front

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the man wearing the black helmet, in which direction is the man in red shorts?

Answer: D. front-left

Choices:
- A. right
- B. back-left
- C. back-right
- D. front-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the cat, where is the bed located?

Answer: A. back

Choices:
- A. back
- B. right
- C. left
- D. front

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the man wearing the white helmet, where is the dog?

Answer: B. front

Choices:
- A. back-right
- B. front
- C. right
- D. left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the sitting man, where is the man wearing gloves positioned?

Answer: A. left

Choices:
- A. left
- B. front-right
- C. back
- D. back-right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From this woman's perspective, where is the riverbank?

Answer: D. right

Choices:
- A. front-left
- B. front
- C. back-left
- D. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the perspective of the man in white clothes, where is the man in black clothes located?

Answer: B. front-left

Choices:
- A. front-right
- B. front-left
- C. back
- D. right

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the boy's perspective, where is the TV positioned?

Answer: C. front

Choices:
- A. back-left
- B. back-right
- C. front
- D. left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: From the boy's perspective, where is the wall located?

Answer: B. back

Choices:
- A. front-right
- B. back
- C. front
- D. front-left

{"question_type":"Person perspective - Relative Direction","source":"ViewSpatial-Bench"}


Question: Is the following statement true or false: The cat is under the backpack.

Answer: false

Choices:
- True
- False

{"caption":"The cat is under the backpack.","relation":"under","subj":"cat","obj":"backpack","source":"VSR"}


Question: Is the following statement true or false: The suitcase is under the cat.

Answer: false

Choices:
- True
- False

{"caption":"The suitcase is under the cat.","relation":"under","subj":"suitcase","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The keyboard is on top of the cat.

Answer: false

Choices:
- True
- False

{"caption":"The keyboard is on top of the cat.","relation":"on top of","subj":"keyboard","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The car is above the cat.

Answer: false

Choices:
- True
- False

{"caption":"The car is above the cat.","relation":"above","subj":"car","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The cat is facing away from the toilet.

Answer: false

Choices:
- True
- False

{"caption":"The cat is facing away from the toilet.","relation":"facing away from","subj":"cat","obj":"toilet","source":"VSR"}


Question: Is the following statement true or false: The cat is in the suitcase.

Answer: false

Choices:
- True
- False

{"caption":"The cat is in the suitcase.","relation":"in","subj":"cat","obj":"suitcase","source":"VSR"}


Question: Is the following statement true or false: The cat is facing away from the toilet.

Answer: true

Choices:
- True
- False

{"caption":"The cat is facing away from the toilet.","relation":"facing away from","subj":"cat","obj":"toilet","source":"VSR"}


Question: Is the following statement true or false: The suitcase is beside the cat.

Answer: true

Choices:
- True
- False

{"caption":"The suitcase is beside the cat.","relation":"beside","subj":"suitcase","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The book is perpendicular to the bed.

Answer: false

Choices:
- True
- False

{"caption":"The book is perpendicular to the bed.","relation":"perpendicular to","subj":"book","obj":"bed","source":"VSR","replacement_provenance":{"revision":"quality-revision-20260720","replaces":"understanding_relationship_1160","review_decision":"remove"}}


Question: Is the following statement true or false: The sink is in front of the cat.

Answer: true

Choices:
- True
- False

{"caption":"The sink is in front of the cat.","relation":"in front of","subj":"sink","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The cat is facing away from the toilet.

Answer: true

Choices:
- True
- False

{"caption":"The cat is facing away from the toilet.","relation":"facing away from","subj":"cat","obj":"toilet","source":"VSR"}


Question: Is the following statement true or false: The bed is under the suitcase.

Answer: true

Choices:
- True
- False

{"caption":"The bed is under the suitcase.","relation":"under","subj":"bed","obj":"suitcase","source":"VSR"}


Question: Is the following statement true or false: The suitcase contains the cat.

Answer: false

Choices:
- True
- False

{"caption":"The suitcase contains the cat.","relation":"contains","subj":"suitcase","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The cell phone is next to the bed.

Answer: false

Choices:
- True
- False

{"caption":"The cell phone is next to the bed.","relation":"next to","subj":"cell phone","obj":"bed","source":"VSR"}


Question: Is the following statement true or false: The cat is at the back of the keyboard.

Answer: true

Choices:
- True
- False

{"caption":"The cat is at the back of the keyboard.","relation":"at the back of","subj":"cat","obj":"keyboard","source":"VSR"}


Question: Is the following statement true or false: The book is parallel to the bed.

Answer: false

Choices:
- True
- False

{"caption":"The book is parallel to the bed.","relation":"parallel to","subj":"book","obj":"bed","source":"VSR"}


Question: Is the following statement true or false: The suitcase contains the cat.

Answer: false

Choices:
- True
- False

{"caption":"The suitcase contains the cat.","relation":"contains","subj":"suitcase","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The cat is touching the bed.

Answer: false

Choices:
- True
- False


Question: Is the following statement true or false: The remote is at the edge of the bed.

Answer: false

Choices:
- True
- False

{"caption":"The remote is at the edge of the bed.","relation":"at the edge of","subj":"remote","obj":"bed","source":"VSR"}


Question: Is the following statement true or false: The book is in front of the cat.

Answer: true

Choices:
- True
- False

{"caption":"The book is in front of the cat.","relation":"in front of","subj":"book","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The cat is on the suitcase.

Answer: false

Choices:
- True
- False

{"caption":"The cat is on the suitcase.","relation":"on","subj":"cat","obj":"suitcase","source":"VSR"}


Question: Is the following statement true or false: The cat is on the toilet.

Answer: false

Choices:
- True
- False

{"caption":"The cat is on the toilet.","relation":"on","subj":"cat","obj":"toilet","source":"VSR"}


Question: Is the following statement true or false: The cat is by the toilet.

Answer: false

Choices:
- True
- False

{"caption":"The cat is by the toilet.","relation":"by","subj":"cat","obj":"toilet","source":"VSR"}


Question: Is the following statement true or false: The cat is at the edge of the sink.

Answer: false

Choices:
- True
- False

{"caption":"The cat is at the edge of the sink.","relation":"at the edge of","subj":"cat","obj":"sink","source":"VSR"}


Question: Is the following statement true or false: The bed is touching the cat.

Answer: false

Choices:
- True
- False

{"caption":"The bed is touching the cat.","relation":"touching","subj":"bed","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The cat is touching the keyboard.

Answer: false

Choices:
- True
- False


Question: Is the following statement true or false: The car is in front of the cat.

Answer: true

Choices:
- True
- False

{"caption":"The car is in front of the cat.","relation":"in front of","subj":"car","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The parking meter is in front of the car.

Answer: false

Choices:
- True
- False

{"caption":"The parking meter is in front of the car.","relation":"in front of","subj":"parking meter","obj":"car","source":"VSR"}


Question: Is the following statement true or false: The book is beside the cat.

Answer: false

Choices:
- True
- False

{"caption":"The book is beside the cat.","relation":"beside","subj":"book","obj":"cat","source":"VSR"}


Question: Is the following statement true or false: The cat is facing away from the toilet.

Answer: true

Choices:
- True
- False

{"caption":"The cat is facing away from the toilet.","relation":"facing away from","subj":"cat","obj":"toilet","source":"VSR"}


Question: Is the following statement true or false: The cat is in the sink.

Answer: true

Choices:
- True
- False


Question: Is the following statement true or false: The cat is on the suitcase.

Answer: true

Choices:
- True
- False


Question: Is the following statement true or false: The handbag is behind the bed.

Answer: true

Choices:
- True
- False

{"caption":"The handbag is behind the bed.","relation":"behind","subj":"andbag","obj":"bed","source":"VSR"}


Question: Is the following statement true or false: The cat is facing away from the bed.

Answer: true

Choices:
- True
- False

{"caption":"The cat is facing away from the bed.","relation":"facing away from","subj":"cat","obj":"bed","source":"VSR"}


Question: Is the following statement true or false: The cat is facing away from the sink.

Answer: true

Choices:
- True
- False

{"caption":"The cat is facing away from the sink.","relation":"facing away from","subj":"cat","obj":"sink","source":"VSR"}


Question: Locate the object described as: "A large vase between two smaller vases.". Return one normalized point inside the target object.

Answer: [0.48,0.6126]


Question: Locate the object described as: "A zebra running to the left in front of other zebras". Return one normalized point inside the target object.

Answer: [0.3219,0.6721]

{"source":"RefCOCOg","source_id":"590216","source_scene_id":"COCO_train2014_000000313963","difficulty":"medium","difficulty_factors":["relational_instance_disambiguation","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.1977,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"590216","file_name":"COCO_train2014_000000313963_590216.jpg","referring_expression":"A zebra running to the left in front of other zebras","all_expressions":["A zebra running to the left in front of other zebras","The zebra running towards us."],"bbox_xywh":[113.68,193.05,250.27,215.89],"strong_spatial_keywords":["in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_005_mask.png","representative_point":[0.3219,0.6721],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":42.45,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "the slice of apple closest to the red bananas". Return one normalized point inside the target object.

Answer: [0.4578,0.7042]

{"source":"RefCOCOg","source_id":"1048737","source_scene_id":"COCO_train2014_000000269477","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":480,"bbox_area_ratio":0.0571,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1048737","file_name":"COCO_train2014_000000269477_1048737.jpg","referring_expression":"the slice of apple closest to the red bananas","all_expressions":["the slice of apple closest to the red bananas","The slice of the apple closest to the bananas"],"bbox_xywh":[243.95,192.0,90.36,194.26],"strong_spatial_keywords":["closest"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_006_mask.png","representative_point":[0.4578,0.7042],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":480,"interior_distance_px":31.62,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A empty blue chair behind the plate of pizza". Return one normalized point inside the target object.

Answer: [0.9203,0.0812]


Question: Locate the object described as: "a short giraffe in front of a taller giraffe". Return one normalized point inside the target object.

Answer: [0.2266,0.5995]

{"source":"RefCOCOg","source_id":"597582","source_scene_id":"COCO_train2014_000000152253","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.0891,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"597582","file_name":"COCO_train2014_000000152253_597582.jpg","referring_expression":"a short giraffe in front of a taller giraffe","all_expressions":["a short giraffe in front of a taller giraffe","giraffe standing next to a giant giraffe"],"bbox_xywh":[75.6,156.3,117.41,207.5],"strong_spatial_keywords":["in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_008_mask.png","representative_point":[0.2266,0.5995],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":26.93,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A wicker chair sitting directly in front of a closed door.". Return one normalized point inside the target object.

Answer: [0.1344,0.772]

{"source":"RefCOCOg","source_id":"108052","source_scene_id":"COCO_train2014_000000185116","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target","depth_order_relation","multiple_spatial_constraints"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":386,"bbox_area_ratio":0.0639,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"108052","file_name":"COCO_train2014_000000185116_108052.jpg","referring_expression":"A wicker chair sitting directly in front of a closed door.","all_expressions":["The wicker chair to the left.","A wicker chair sitting directly in front of a closed door."],"bbox_xywh":[30.71,225.84,121.2,130.33],"strong_spatial_keywords":["directly","in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_009_mask.png","representative_point":[0.1344,0.772],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":386,"interior_distance_px":56.0,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "Chair in front of purple placemat with blue diffuser.". Return one normalized point inside the target object.

Answer: [0.626,0.9973]

{"source":"RefCOCOg","source_id":"108494","source_scene_id":"COCO_train2014_000000337068","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":500,"height":375,"bbox_area_ratio":0.1174,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"108494","file_name":"COCO_train2014_000000337068_108494.jpg","referring_expression":"Chair in front of purple placemat with blue diffuser.","all_expressions":["Chair in front of purple placemat with blue diffuser.","A white chair facing the window."],"bbox_xywh":[306.47,261.26,193.53,113.74],"strong_spatial_keywords":["in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_011_mask.png","representative_point":[0.626,0.9973],"point_derivation":"maximum-distance interior mask pixel","mask_width":500,"mask_height":375,"interior_distance_px":7.28,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A baby polar bear between it's mother's legs.". Return one normalized point inside the target object.

Answer: [0.5062,0.63]

{"source":"RefCOCOg","source_id":"587642","source_scene_id":"COCO_train2014_000000081476","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.0531,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"587642","file_name":"COCO_train2014_000000081476_587642.jpg","referring_expression":"A baby polar bear between it's mother's legs.","all_expressions":["A baby polar bear between it's mother's legs.","a white polar cub looking at the mother licking the other baby cub"],"bbox_xywh":[251.94,221.24,113.5,127.89],"strong_spatial_keywords":["between"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_012_mask.png","representative_point":[0.5062,0.63],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":39.56,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "this is a cake behind the cake with candles on it". Return one normalized point inside the target object.

Answer: [0.8547,0.5386]

{"source":"RefCOCOg","source_id":"1577240","source_scene_id":"COCO_train2014_000000478105","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.0868,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1577240","file_name":"COCO_train2014_000000478105_1577240.jpg","referring_expression":"this is a cake behind the cake with candles on it","all_expressions":["this is a cake behind the cake with candles on it"],"bbox_xywh":[427.94,179.08,212.06,111.85],"strong_spatial_keywords":["behind"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_014_mask.png","representative_point":[0.8547,0.5386],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":45.54,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "The yellow bench behind the fence.". Return one normalized point inside the target object.

Answer: [0.7469,0.5316]


Question: Locate the object described as: "sheep going last and the head is covered behind another sheep". Return one normalized point inside the target object.

Answer: [0.1328,0.5223]

{"source":"RefCOCOg","source_id":"63517","source_scene_id":"COCO_train2014_000000144519","difficulty":"medium","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":404,"bbox_area_ratio":0.1227,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"63517","file_name":"COCO_train2014_000000144519_63517.jpg","referring_expression":"sheep going last and the head is covered behind another sheep","all_expressions":["sheep going last and the head is covered behind another sheep","A sheep who's head is not visible, standing next to three other sheep."],"bbox_xywh":[24.33,150.31,191.14,165.94],"strong_spatial_keywords":["behind"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_026_mask.png","representative_point":[0.1328,0.5223],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":404,"interior_distance_px":58.82,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "An office chair closest to the corner.". Return one normalized point inside the target object.

Answer: [0.1562,0.6333]


Question: Locate the object described as: "A frosted sprinkled cupcake, one out of four to the right and front of the others.". Return one normalized point inside the target object.

Answer: [0.6172,0.7396]

{"source":"RefCOCOg","source_id":"1080754","source_scene_id":"COCO_train2014_000000244846","difficulty":"medium","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":480,"bbox_area_ratio":0.1477,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1080754","file_name":"COCO_train2014_000000244846_1080754.jpg","referring_expression":"A frosted sprinkled cupcake, one out of four to the right and front of the others.","all_expressions":["A frosted sprinkled cupcake, one out of four to the right and front of the others."],"bbox_xywh":[290.16,250.25,211.41,214.65],"strong_spatial_keywords":["front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_030_mask.png","representative_point":[0.6172,0.7396],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":480,"interior_distance_px":101.82,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "The back of someone to the upper right corner of the picture, facing away from a catered buffet.". Return one normalized point inside the target object.

Answer: [0.9979,0.1719]

{"source":"RefCOCOg","source_id":"1214084","source_scene_id":"COCO_train2014_000000190469","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":483,"height":640,"bbox_area_ratio":0.0537,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1214084","file_name":"COCO_train2014_000000190469_1214084.jpg","referring_expression":"The back of someone to the upper right corner of the picture, facing away from a catered buffet.","all_expressions":["The back of someone to the upper right corner of the picture, facing away from a catered buffet.","A man wearing a white shirt on the right hand side."],"bbox_xywh":[396.32,0.47,86.68,191.66],"strong_spatial_keywords":["corner"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_031_mask.png","representative_point":[0.9979,0.1719],"point_derivation":"maximum-distance interior mask pixel","mask_width":483,"mask_height":640,"interior_distance_px":63.32,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "The first empty chair closest to the camera.". Return one normalized point inside the target object.

Answer: [0.2656,0.8501]

{"source":"RefCOCOg","source_id":"373167","source_scene_id":"COCO_train2014_000000344644","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.065,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"373167","file_name":"COCO_train2014_000000344644_373167.jpg","referring_expression":"The first empty chair closest to the camera.","all_expressions":["The empty chair on the end of the row.","The first empty chair closest to the camera."],"bbox_xywh":[91.16,284.27,127.62,139.13],"strong_spatial_keywords":["closest"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_032_mask.png","representative_point":[0.2656,0.8501],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":25.24,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "black cow on in front of other cows on a field". Return one normalized point inside the target object.

Answer: [0.3062,0.5273]

{"source":"RefCOCOg","source_id":"73172","source_scene_id":"COCO_train2014_000000546031","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":495,"bbox_area_ratio":0.1141,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"73172","file_name":"COCO_train2014_000000546031_73172.jpg","referring_expression":"black cow on in front of other cows on a field","all_expressions":["A large, black cow that is standing in the foreground and facing to the left.","black cow on in front of other cows on a field"],"bbox_xywh":[124.94,181.35,141.96,254.55],"strong_spatial_keywords":["in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_034_mask.png","representative_point":[0.3062,0.5273],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":495,"interior_distance_px":68.35,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A police motorcycle behind another police motorcycle.". Return one normalized point inside the target object.

Answer: [0.6156,0.4307]


Question: Locate the object described as: "A small white teddy bear sitting in front of a large bear.". Return one normalized point inside the target object.

Answer: [0.6953,0.7752]

{"source":"RefCOCOg","source_id":"1160306","source_scene_id":"COCO_train2014_000000177440","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.0834,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1160306","file_name":"COCO_train2014_000000177440_1160306.jpg","referring_expression":"A small white teddy bear sitting in front of a large bear.","all_expressions":["A small white teddy bear sitting in front of a large bear.","WHITE COLOR TEDDY BEAR FRONT POSITION AND BACK ANOTHER TEDDY AND SITE POSITION WAS GIRL BABY SITTING"],"bbox_xywh":[371.35,230.29,138.17,165.04],"strong_spatial_keywords":["in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_044_mask.png","representative_point":[0.6953,0.7752],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":55.32,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A silver macbook is to the right of a slightly larger macbook.". Return one normalized point inside the target object.

Answer: [0.7359,0.7042]

{"source":"RefCOCOg","source_id":"1103404","source_scene_id":"COCO_train2014_000000154911","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":480,"bbox_area_ratio":0.0571,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1103404","file_name":"COCO_train2014_000000154911_1103404.jpg","referring_expression":"A silver macbook is to the right of a slightly larger macbook.","all_expressions":["A silver macbook is to the right of a slightly larger macbook.","The laptop of the man in the plaid shirt,  with his hands in front of his face."],"bbox_xywh":[382.92,286.74,169.35,103.55],"strong_spatial_keywords":["right of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_047_mask.png","representative_point":[0.7359,0.7042],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":480,"interior_distance_px":37.95,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "Black bicycle seat and rack in front of bike with light grey seat.". Return one normalized point inside the target object.

Answer: [0.1377,0.928]

{"source":"RefCOCOg","source_id":"130374","source_scene_id":"COCO_train2014_000000047020","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":334,"height":500,"bbox_area_ratio":0.0968,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"130374","file_name":"COCO_train2014_000000047020_130374.jpg","referring_expression":"Black bicycle seat and rack in front of bike with light grey seat.","all_expressions":["Black bicycle seat and rack in front of bike with light grey seat."],"bbox_xywh":[1.08,435.3,278.49,58.07],"strong_spatial_keywords":["in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_052_mask.png","representative_point":[0.1377,0.928],"point_derivation":"maximum-distance interior mask pixel","mask_width":334,"mask_height":500,"interior_distance_px":29.0,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "a bus in front of others". Return one normalized point inside the target object.

Answer: [0.8578,0.7556]

{"source":"RefCOCOg","source_id":"165363","source_scene_id":"COCO_train2014_000000147303","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":360,"bbox_area_ratio":0.1066,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"165363","file_name":"COCO_train2014_000000147303_165363.jpg","referring_expression":"a bus in front of others","all_expressions":["a bus in front of others","The bus has a violet colour only in bottom"],"bbox_xywh":[335.68,231.49,280.54,87.56],"strong_spatial_keywords":["in front of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_055_mask.png","representative_point":[0.8578,0.7556],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":360,"interior_distance_px":38.12,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A blurry white keyboard behind a remote control". Return one normalized point inside the target object.

Answer: [0.9719,0.3848]


Question: Locate the object described as: "A chair to the far right of the couch with gold trim.". Return one normalized point inside the target object.

Answer: [0.8141,0.5438]

{"source":"RefCOCOg","source_id":"1934938","source_scene_id":"COCO_train2014_000000001822","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":480,"bbox_area_ratio":0.0674,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1934938","file_name":"COCO_train2014_000000001822_1934938.jpg","referring_expression":"A chair to the far right of the couch with gold trim.","all_expressions":["A chair to the far right of the couch with gold trim.","This is a golden edged chair that faces the television."],"bbox_xywh":[466.29,180.78,138.39,149.61],"strong_spatial_keywords":["far right"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_059_mask.png","representative_point":[0.8141,0.5438],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":480,"interior_distance_px":33.53,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "The pizza spatula to the bottom right.". Return one normalized point inside the target object.

Answer: [0.7734,0.5979]


Question: Locate the object described as: "The farthest banana to the right". Return one normalized point inside the target object.

Answer: [0.8609,0.3438]


Question: Locate the object described as: "A horse behind two other horses that are standing in line with it, being partially obscured by the middle horse.". Return one normalized point inside the target object.

Answer: [0.1047,0.4688]

{"source":"RefCOCOg","source_id":"57859","source_scene_id":"COCO_train2014_000000023194","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target","depth_order_relation","multiple_spatial_constraints"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":480,"bbox_area_ratio":0.0539,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"57859","file_name":"COCO_train2014_000000023194_57859.jpg","referring_expression":"A horse behind two other horses that are standing in line with it, being partially obscured by the middle horse.","all_expressions":["A horse behind two other horses that are standing in line with it, being partially obscured by the middle horse.","A brown horse to the far left of two others."],"bbox_xywh":[0.0,178.82,103.0,160.68],"strong_spatial_keywords":["behind","middle"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_068_mask.png","representative_point":[0.1047,0.4688],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":480,"interior_distance_px":27.66,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "black car closest". Return one normalized point inside the target object.

Answer: [0.9984,0.7453]


Question: Locate the object described as: "The giraffe that is further away from the camera, it is slightly behind the other giraffe, and to the left.". Return one normalized point inside the target object.

Answer: [0.5734,0.5902]

{"source":"RefCOCOg","source_id":"600318","source_scene_id":"COCO_train2014_000000085962","difficulty":"medium","difficulty_factors":["relational_instance_disambiguation","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.1571,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"600318","file_name":"COCO_train2014_000000085962_600318.jpg","referring_expression":"The giraffe that is further away from the camera, it is slightly behind the other giraffe, and to the left.","all_expressions":["The giraffe that is further away from the camera, it is slightly behind the other giraffe, and to the left.","The giraffe standing behind another giraffe."],"bbox_xywh":[285.83,106.46,152.45,281.59],"strong_spatial_keywords":["behind"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_074_mask.png","representative_point":[0.5734,0.5902],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":37.36,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "the piece of broccoli that is right in the center". Return one normalized point inside the target object.

Answer: [0.4203,0.3099]


Question: Locate the object described as: "The giraffe standing to the right of two giraffes and to the left of one giraffe.". Return one normalized point inside the target object.

Answer: [0.7391,0.5518]

{"source":"RefCOCOg","source_id":"597940","source_scene_id":"COCO_train2014_000000171484","difficulty":"medium","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","multiple_spatial_constraints"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":386,"bbox_area_ratio":0.1027,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"597940","file_name":"COCO_train2014_000000171484_597940.jpg","referring_expression":"The giraffe standing to the right of two giraffes and to the left of one giraffe.","all_expressions":["The giraffe standing to the right of two giraffes and to the left of one giraffe.","tallest giraffe"],"bbox_xywh":[412.7,66.06,91.0,278.78],"strong_spatial_keywords":["left of","right of"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_084_mask.png","representative_point":[0.7391,0.5518],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":386,"interior_distance_px":29.41,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A piece of broccoli on the bottom right of the plate". Return one normalized point inside the target object.

Answer: [0.806,0.742]

{"source":"RefCOCOg","source_id":"1058074","source_scene_id":"COCO_train2014_000000032963","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","small_target"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":500,"height":500,"bbox_area_ratio":0.0579,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1058074","file_name":"COCO_train2014_000000032963_1058074.jpg","referring_expression":"A piece of broccoli on the bottom right of the plate","all_expressions":["The broccoli is a part of a chinese food dish including chicken, noodles and peppers.","A piece of broccoli on the bottom right of the plate"],"bbox_xywh":[314.12,303.53,128.23,112.94],"strong_spatial_keywords":["bottom right"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_085_mask.png","representative_point":[0.806,0.742],"point_derivation":"maximum-distance interior mask pixel","mask_width":500,"mask_height":500,"interior_distance_px":33.11,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A vase sitting behind and between two kneeling children figurines.". Return one normalized point inside the target object.

Answer: [0.6172,0.4982]

{"source":"RefCOCOg","source_id":"1153960","source_scene_id":"COCO_train2014_000000521870","difficulty":"medium","difficulty_factors":["relational_instance_disambiguation","depth_order_relation","multiple_spatial_constraints"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":568,"bbox_area_ratio":0.3118,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"1153960","file_name":"COCO_train2014_000000521870_1153960.jpg","referring_expression":"A vase sitting behind and between two kneeling children figurines.","all_expressions":["The vase that is covered most by the two praying children.","A vase sitting behind and between two kneeling children figurines."],"bbox_xywh":[335.69,49.39,239.97,472.27],"strong_spatial_keywords":["behind","between"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_087_mask.png","representative_point":[0.6172,0.4982],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":568,"interior_distance_px":45.45,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A pizza behind another pizza.". Return one normalized point inside the target object.

Answer: [0.334,0.3275]


Question: Locate the object described as: "The white motorcycle closest to the red truck.". Return one normalized point inside the target object.

Answer: [0.2875,0.6066]

{"source":"RefCOCOg","source_id":"154039","source_scene_id":"COCO_train2014_000000239933","difficulty":"hard","difficulty_factors":["relational_instance_disambiguation","moderate_target_extent","depth_order_relation"],"visual_evidence_type":"relational_target_mask","visual_verifiability":"point_verified_inside_source_mask","selection_reason":"Retained after source-image and annotation review.","quality":{"width":640,"height":427,"bbox_area_ratio":0.0855,"mask_available":true},"source_annotation":{"source_dataset":"RefCOCOg","split_shard":"val-00000-of-00003.parquet","question_id":"154039","file_name":"COCO_train2014_000000239933_154039.jpg","referring_expression":"The white motorcycle closest to the red truck.","all_expressions":["The white motorcycle closest to the red truck.","A white motorcycle that is betweena red truck and another white motercycle"],"bbox_xywh":[116.08,170.58,136.74,170.93],"strong_spatial_keywords":["closest"],"selection_note":"Filtered to avoid RoboAfford-Eval affordance-like interaction/action semantics."},"mask":"understanding/grounding/masks/grounding_refcocog_092_mask.png","representative_point":[0.2875,0.6066],"point_derivation":"maximum-distance interior mask pixel","mask_width":640,"mask_height":427,"interior_distance_px":42.05,"recommended_for_compact_split":true,"curation_status":"strict_human_reviewed_compact","model_screening_status":"pending"}


Question: Locate the object described as: "A zebra grabbing another zebra from behind.". Return one normalized point inside the target object.

Answer: [0.2406,0.5145]


Question: Can the banana be put entirely into the bowl?

Answer: yes

Choices:
- no
- yes


Question: Is the white square plate large enough to hold the entire square pizza?

Answer: no

Choices:
- no
- yes


Question: Is the box large enough to hold 10 fruit puddings?

Answer: yes

Choices:
- no
- yes


Question: Can the lady put her latop on the nightstand beside the bed?

Answer: no

Choices:
- no
- yes


Question: Is there enough room for the standing people to sit on the sofa?

Answer: yes

Choices:
- no
- yes


Question: Is the train able to pass under the stone bridge?

Answer: yes

Choices:
- no
- yes


Question: Is one white plate large enough to hold the entire cake in the glass baking pan?

Answer: no

Choices:
- no
- yes


Question: Is there enough space between the two buses to safely park another bus?

Answer: no

Choices:
- no
- yes


Question: Is the cabinet compartment large enough to hold an oven?

Answer: yes

Choices:
- no
- yes


Question: If you are using the laptop in the photo, can you place another laptop on its right?

Answer: no

Choices:
- no
- yes


Question: Can we pour all the wine from the bottle into the glass cup?

Answer: no

Choices:
- no
- yes