Buckets:
| id,domain,suite,family_id,variant,question,assumptions,options,gold_index,gold_answer,rationale,origin,source_dataset,source_item_id,source_split,source_url,source_paper,source_revision,original_dataset_answer,adaptation_notes,related_dataset,gold_basis,review_status,personal_connection,created_date | |
| T_coin_canonical,temporal_physics,temporal_core,coin,canonical,"A coin is inside a closed box in the kitchen. | |
| 1. Carry the closed box to the bedroom. | |
| 2. Open the box and tip all its contents onto the floor. | |
| 3. Carry the box back to the kitchen. | |
| Where is the coin at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""On the bedroom floor"",""On the kitchen floor"",""Inside the box in the kitchen"",""Inside the box in the bedroom""]",0,On the bedroom floor,The coin travels inside the box until it is emptied in the bedroom. Moving the box later does not move the coin.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_coin_paraphrase,temporal_physics,temporal_core,coin,paraphrase,"In the kitchen, a coin is sealed in a box. The box is taken to the bedroom and emptied onto the floor there. The box alone is brought back to the kitchen. Where is the coin now?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""On the bedroom floor"",""On the kitchen floor"",""Inside the box in the kitchen"",""Inside the box in the bedroom""]",0,On the bedroom floor,The coin travels inside the box until it is emptied in the bedroom. Moving the box later does not move the coin.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_coin_retold,temporal_physics,temporal_core,coin,retold,"A coin is inside a closed box in the kitchen. | |
| The following entries have explicit event times and are listed out of order. | |
| 10:02 — Carry the box back to the kitchen. | |
| 10:01 — Open the box and tip all its contents onto the floor. | |
| 10:00 — Carry the closed box to the bedroom. | |
| Where is the coin at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""On the bedroom floor"",""On the kitchen floor"",""Inside the box in the kitchen"",""Inside the box in the bedroom""]",0,On the bedroom floor,The coin travels inside the box until it is emptied in the bedroom. Moving the box later does not move the coin.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_coin_changed,temporal_physics,temporal_core,coin,changed,"A coin is inside a closed box in the kitchen. | |
| 1. Open the box in the kitchen and tip all its contents onto the floor. | |
| 2. Carry the box to the bedroom. | |
| 3. Carry the box back to the kitchen. | |
| Where is the coin at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""On the bedroom floor"",""On the kitchen floor"",""Inside the box in the kitchen"",""Inside the box in the bedroom""]",1,On the kitchen floor,The coin leaves the box before the box travels and remains on the kitchen floor.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_coin_explicit_control,temporal_physics,temporal_core,coin,explicit_control,"A coin is inside a closed box in the kitchen. | |
| 1. Carry the closed box to the bedroom. | |
| 2. Open the box and tip all its contents onto the floor. | |
| 3. Carry the box back to the kitchen. | |
| Where is the coin at the end? | |
| An observer explicitly reports: On the bedroom floor.",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""On the bedroom floor"",""On the kitchen floor"",""Inside the box in the kitchen"",""Inside the box in the bedroom""]",0,On the bedroom floor,The reported state is explicitly supplied; this controls for answer selection and reading.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_water_canonical,temporal_physics,temporal_core,water,canonical,"A red cup contains water. A blue cup is empty. Both cups are held over a sink when they are tipped. | |
| 1. Pour all water from the red cup into the blue cup. | |
| 2. Tip the blue cup upside down over the sink until it has emptied. | |
| 3. Return the blue cup upright and put it on a dry table. | |
| Where is the original water at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""In the sink or its drain"",""In the blue cup"",""In the red cup"",""On the dry table""]",0,In the sink or its drain,"After the transfer, emptying the blue cup sends the water to the sink. Returning it upright does not refill it.",assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_water_paraphrase,temporal_physics,temporal_core,water,paraphrase,Water starts in a red cup. It is transferred completely to a blue cup. The blue cup is then emptied into a sink and set upright on a table. Where did the original water end up?,Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""In the sink or its drain"",""In the blue cup"",""In the red cup"",""On the dry table""]",0,In the sink or its drain,"After the transfer, emptying the blue cup sends the water to the sink. Returning it upright does not refill it.",assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_water_retold,temporal_physics,temporal_core,water,retold,"A red cup contains water. A blue cup is empty. Both cups are held over a sink when they are tipped. | |
| The following entries have explicit event times and are listed out of order. | |
| 10:02 — Return the blue cup upright and put it on a dry table. | |
| 10:01 — Tip the blue cup upside down over the sink until it has emptied. | |
| 10:00 — Pour all water from the red cup into the blue cup. | |
| Where is the original water at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""In the sink or its drain"",""In the blue cup"",""In the red cup"",""On the dry table""]",0,In the sink or its drain,"After the transfer, emptying the blue cup sends the water to the sink. Returning it upright does not refill it.",assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_water_changed,temporal_physics,temporal_core,water,changed,"A red cup contains water. A blue cup is empty. Both cups are held over a sink when they are tipped. | |
| 1. Tip the empty blue cup upside down over the sink, then return it upright. | |
| 2. Pour all water from the red cup into the blue cup. | |
| 3. Put the blue cup on the dry table without spilling. | |
| Where is the original water at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""In the sink or its drain"",""In the blue cup"",""In the red cup"",""On the dry table""]",1,In the blue cup,Tipping the cup while it is still empty removes no water. It is subsequently filled and retains that water.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_water_explicit_control,temporal_physics,temporal_core,water,explicit_control,"A red cup contains water. A blue cup is empty. Both cups are held over a sink when they are tipped. | |
| 1. Pour all water from the red cup into the blue cup. | |
| 2. Tip the blue cup upside down over the sink until it has emptied. | |
| 3. Return the blue cup upright and put it on a dry table. | |
| Where is the original water at the end? | |
| An observer explicitly reports: In the sink or its drain.",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""In the sink or its drain"",""In the blue cup"",""In the red cup"",""On the dry table""]",0,In the sink or its drain,The reported state is explicitly supplied; this controls for answer selection and reading.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_towel_canonical,temporal_physics,temporal_core,towel,canonical,"A clean towel starts dry. | |
| 1. Soak the towel completely in water. | |
| 2. Dry the towel completely. | |
| 3. Fold it and put it into a dry drawer. | |
| Is the towel wet or dry at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Dry"",""Wet"",""Frozen"",""The described sequence does not determine this""]",0,Dry,Complete drying occurs after soaking; folding and storage do not wet it again.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_towel_paraphrase,temporal_physics,temporal_core,towel,paraphrase,"A towel is soaked, subsequently dried all the way through, and finally folded into a dry drawer. What is its final wetness state?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Dry"",""Wet"",""Frozen"",""The described sequence does not determine this""]",0,Dry,Complete drying occurs after soaking; folding and storage do not wet it again.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_towel_retold,temporal_physics,temporal_core,towel,retold,"A clean towel starts dry. | |
| The following entries have explicit event times and are listed out of order. | |
| 10:02 — Fold it and put it into a dry drawer. | |
| 10:01 — Dry the towel completely. | |
| 10:00 — Soak the towel completely in water. | |
| Is the towel wet or dry at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Dry"",""Wet"",""Frozen"",""The described sequence does not determine this""]",0,Dry,Complete drying occurs after soaking; folding and storage do not wet it again.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_towel_changed,temporal_physics,temporal_core,towel,changed,"A clean towel starts dry. | |
| 1. Dry the towel completely. | |
| 2. Soak the towel completely in water. | |
| 3. Fold it and immediately put it into a dry drawer without drying it. | |
| Is the towel wet or dry at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Dry"",""Wet"",""Frozen"",""The described sequence does not determine this""]",1,Wet,Soaking occurs after the last drying event and no later event dries it.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_towel_explicit_control,temporal_physics,temporal_core,towel,explicit_control,"A clean towel starts dry. | |
| 1. Soak the towel completely in water. | |
| 2. Dry the towel completely. | |
| 3. Fold it and put it into a dry drawer. | |
| Is the towel wet or dry at the end? | |
| An observer explicitly reports: Dry.",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Dry"",""Wet"",""Frozen"",""The described sequence does not determine this""]",0,Dry,The reported state is explicitly supplied; this controls for answer selection and reading.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_glass_canonical,temporal_physics,temporal_core,glass,canonical,"An intact glass stands on a shelf. | |
| 1. Drop the glass onto concrete; it shatters. | |
| 2. Collect all the glass fragments in a box. | |
| 3. Place the box on the original shelf. | |
| What is the physical condition of the original glass at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Broken into fragments"",""An intact glass"",""Melted into liquid"",""Not specified""]",0,Broken into fragments,Collecting and moving fragments does not reassemble or repair the glass.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_glass_paraphrase,temporal_physics,temporal_core,glass,paraphrase,A glass breaks into pieces after hitting concrete. Those pieces are boxed and returned to the shelf where the glass originally stood. Has the original glass remained broken or become intact?,Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Broken into fragments"",""An intact glass"",""Melted into liquid"",""Not specified""]",0,Broken into fragments,Collecting and moving fragments does not reassemble or repair the glass.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_glass_retold,temporal_physics,temporal_core,glass,retold,"An intact glass stands on a shelf. | |
| The following entries have explicit event times and are listed out of order. | |
| 10:02 — Place the box on the original shelf. | |
| 10:01 — Collect all the glass fragments in a box. | |
| 10:00 — Drop the glass onto concrete; it shatters. | |
| What is the physical condition of the original glass at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Broken into fragments"",""An intact glass"",""Melted into liquid"",""Not specified""]",0,Broken into fragments,Collecting and moving fragments does not reassemble or repair the glass.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_glass_changed,temporal_physics,temporal_core,glass,changed,"An intact glass stands on a shelf. | |
| 1. Carefully put the intact glass in a padded box without damaging it. | |
| 2. Move the box across the room. | |
| 3. Place the box on the original shelf. | |
| What is the physical condition of the original glass at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Broken into fragments"",""An intact glass"",""Melted into liquid"",""Not specified""]",1,An intact glass,The replacement handling event preserves the glass; no event breaks it.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_glass_explicit_control,temporal_physics,temporal_core,glass,explicit_control,"An intact glass stands on a shelf. | |
| 1. Drop the glass onto concrete; it shatters. | |
| 2. Collect all the glass fragments in a box. | |
| 3. Place the box on the original shelf. | |
| What is the physical condition of the original glass at the end? | |
| An observer explicitly reports: Broken into fragments.",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Broken into fragments"",""An intact glass"",""Melted into liquid"",""Not specified""]",0,Broken into fragments,The reported state is explicitly supplied; this controls for answer selection and reading.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_domino_canonical,temporal_physics,temporal_core,domino,canonical,"Dominoes A, B and C stand in a row. If A hits B, B will hit C. A cannot reach C directly, and no other event can knock C down. | |
| 1. Remove B from the row and put it aside. | |
| 2. Tip A toward the gap where B stood. | |
| 3. Wait until all resulting motion stops. | |
| Is C standing or fallen at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Standing"",""Fallen"",""Removed from the row"",""The described conditions do not determine this""]",0,Standing,Removing the intermediate domino before initiating the chain interrupts the only route to C.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_domino_paraphrase,temporal_physics,temporal_core,domino,paraphrase,"Three dominoes would fall in sequence A to B to C, but A cannot touch C. B is taken away first; A is then tipped and everything is allowed to settle. What is C's state?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Standing"",""Fallen"",""Removed from the row"",""The described conditions do not determine this""]",0,Standing,Removing the intermediate domino before initiating the chain interrupts the only route to C.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_domino_retold,temporal_physics,temporal_core,domino,retold,"Dominoes A, B and C stand in a row. If A hits B, B will hit C. A cannot reach C directly, and no other event can knock C down. | |
| The following entries have explicit event times and are listed out of order. | |
| 10:02 — Wait until all resulting motion stops. | |
| 10:01 — Tip A toward the gap where B stood. | |
| 10:00 — Remove B from the row and put it aside. | |
| Is C standing or fallen at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Standing"",""Fallen"",""Removed from the row"",""The described conditions do not determine this""]",0,Standing,Removing the intermediate domino before initiating the chain interrupts the only route to C.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_domino_changed,temporal_physics,temporal_core,domino,changed,"Dominoes A, B and C stand in a row. If A hits B, B will hit C. A cannot reach C directly, and no other event can knock C down. | |
| 1. Tip A into B. | |
| 2. Wait until the resulting chain of falls has finished. | |
| 3. Remove B and put it aside. | |
| Is C standing or fallen at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Standing"",""Fallen"",""Removed from the row"",""The described conditions do not determine this""]",1,Fallen,The completed chain knocks C down. Removing B afterward does not undo that event.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_domino_explicit_control,temporal_physics,temporal_core,domino,explicit_control,"Dominoes A, B and C stand in a row. If A hits B, B will hit C. A cannot reach C directly, and no other event can knock C down. | |
| 1. Remove B from the row and put it aside. | |
| 2. Tip A toward the gap where B stood. | |
| 3. Wait until all resulting motion stops. | |
| Is C standing or fallen at the end? | |
| An observer explicitly reports: Standing.",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""Standing"",""Fallen"",""Removed from the row"",""The described conditions do not determine this""]",0,Standing,The reported state is explicitly supplied; this controls for answer selection and reading.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_tap_canonical,temporal_physics,temporal_core,tap,canonical,"A tap is already running into a sink with an open drain. An upright empty cup is next to it. Thirty seconds under the running stream fills the cup; no water reaches it while the tap is off. | |
| 1. Place the empty cup under the tap. | |
| 2. Talk on the phone for thirty seconds without touching the tap or cup. | |
| 3. Turn the tap off. | |
| 4. Move the cup to a dry table without spilling. | |
| Does the cup contain water at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""It contains water"",""It is empty"",""Its water has frozen"",""Not enough information under the stated conditions""]",0,It contains water,The stream keeps flowing while attention is elsewhere. Turning it off after filling does not empty the cup.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_tap_paraphrase,temporal_physics,temporal_core,tap,paraphrase,"A running faucet would fill an empty cup in half a minute. Someone puts the cup under it, spends that half-minute on a call, shuts the faucet, then carries the cup away without spilling. Does the cup now hold water?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""It contains water"",""It is empty"",""Its water has frozen"",""Not enough information under the stated conditions""]",0,It contains water,The stream keeps flowing while attention is elsewhere. Turning it off after filling does not empty the cup.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_tap_retold,temporal_physics,temporal_core,tap,retold,"A tap is already running into a sink with an open drain. An upright empty cup is next to it. Thirty seconds under the running stream fills the cup; no water reaches it while the tap is off. | |
| The following entries have explicit event times and are listed out of order. | |
| 10:03 — Move the cup to a dry table without spilling. | |
| 10:02 — Turn the tap off. | |
| 10:01 — Talk on the phone for thirty seconds without touching the tap or cup. | |
| 10:00 — Place the empty cup under the tap. | |
| Does the cup contain water at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""It contains water"",""It is empty"",""Its water has frozen"",""Not enough information under the stated conditions""]",0,It contains water,The stream keeps flowing while attention is elsewhere. Turning it off after filling does not empty the cup.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_tap_changed,temporal_physics,temporal_core,tap,changed,"A tap is already running into a sink with an open drain. An upright empty cup is next to it. Thirty seconds under the running stream fills the cup; no water reaches it while the tap is off. | |
| 1. Turn the tap off. | |
| 2. Place the empty cup under the tap. | |
| 3. Talk on the phone for thirty seconds without touching the tap or cup. | |
| 4. Move the cup to the dry table. | |
| Does the cup contain water at the end?",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""It contains water"",""It is empty"",""Its water has frozen"",""Not enough information under the stated conditions""]",1,It is empty,"The tap is turned off before the cup is placed beneath it, so no filling happens.",assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_tap_explicit_control,temporal_physics,temporal_core,tap,explicit_control,"A tap is already running into a sink with an open drain. An upright empty cup is next to it. Thirty seconds under the running stream fills the cup; no water reaches it while the tap is off. | |
| 1. Place the empty cup under the tap. | |
| 2. Talk on the phone for thirty seconds without touching the tap or cup. | |
| 3. Turn the tap off. | |
| 4. Move the cup to a dry table without spilling. | |
| Does the cup contain water at the end? | |
| An observer explicitly reports: It contains water.",Only the described actions occur. Ordinary rigid containers retain their contents unless emptied.,"[""It contains water"",""It is empty"",""Its water has frozen"",""Not enough information under the stated conditions""]",0,It contains water,The reported state is explicitly supplied; this controls for answer selection and reading.,assistant_brainstorm,,,,,,,,,TRIP; OpenPI (related tasks only; no source dataset item),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_cushion,temporal_physics,temporal_extra,cushion,standalone,"A book is released above a bare floor. It lands and comes to rest. Only afterward, someone lifts it and puts a cushion on that spot. Which surface did the book first hit?",,"[""The bare floor"",""The cushion"",""Neither surface""]",0,The bare floor,The later cushion cannot alter an impact that has already occurred.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_occlusion,temporal_physics,temporal_extra,occlusion,standalone,A solid ball rolls behind an opaque screen. Nothing destroys or removes it. Does becoming invisible mean the ball has ceased to exist?,,"[""Yes"",""No""]",1,No,"Occlusion changes visibility, not existence.",assistant_brainstorm,,,,,,,,,IntPhys (related principle only),Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| T_ice_tray,temporal_physics,temporal_extra,ice_tray,standalone,"An ice cube melts completely in a warm room. The liquid is poured into its old ice tray, which stays in the same warm room. Does the old tray alone turn it back into ice?",,"[""Yes"",""No""]",1,No,Changing the container does not provide cooling needed to freeze the water.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_vertical_motion_base,everyday_science,everyday_science,vertical_motion,base,A ball is thrown straight upward. At the highest point its instantaneous velocity is zero. What is its acceleration?,Neglect air resistance; use ordinary Newtonian mechanics.,"[""Downward with magnitude g"",""Zero"",""Upward with magnitude g""]",0,Downward with magnitude g,Gravity acts at the highest point even though instantaneous velocity is zero.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_vertical_motion_changed,everyday_science,everyday_science,vertical_motion,changed,A ball rests on a table in an inertial frame. What is its acceleration?,Neglect air resistance; use ordinary Newtonian mechanics.,"[""Zero"",""Downward with magnitude g"",""Upward with magnitude g""]",0,Zero,The support force balances weight and the stationary ball has zero acceleration.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_circular_motion_base,everyday_science,everyday_science,circular_motion,base,A car moves around a circular track at constant nonzero speed. Is its acceleration zero?,Use an inertial reference frame.,"[""Yes"",""No""]",1,No,"The direction of velocity changes, so acceleration is nonzero.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_circular_motion_changed,everyday_science,everyday_science,circular_motion,changed,A car moves along a straight road at constant velocity. Is its acceleration zero?,Use an inertial reference frame.,"[""Yes"",""No""]",0,Yes,A constant velocity has zero time derivative.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_force_balance_base,everyday_science,everyday_science,force_balance,base,A book rests on a horizontal table. Does gravity still exert a force on the book?,"No magnetic, buoyancy or other significant forces.","[""Yes"",""No""]",0,Yes,Gravity remains present; the upward contact force balances it.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_force_balance_changed,everyday_science,everyday_science,force_balance,changed,"The supporting table is suddenly removed while the book is stationary. Ignoring air resistance, is its net force now zero?","No magnetic, buoyancy or other significant forces.","[""Yes"",""No""]",1,No,"With support removed, weight is unbalanced.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_tank_balance_base,everyday_science,everyday_science,tank_balance,base,Water enters a tank at 2 L/min and exits at 2 L/min. Its volume remains constant. Has the flow stopped?,The tank is not empty or overflowing; stated rates remain fixed.,"[""Yes"",""No""]",1,No,Equal inflow and outflow give zero net accumulation despite ongoing flow.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_tank_balance_changed,everyday_science,everyday_science,tank_balance,changed,"Water enters a tank at 2 L/min and exits at 3 L/min. Is its water volume increasing, unchanged, or decreasing?",The tank is not empty or overflowing; stated rates remain fixed.,"[""Increasing"",""Unchanged"",""Decreasing""]",2,Decreasing,Net accumulation is 2 minus 3 = -1 L/min.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_thermal_balance_base,everyday_science,everyday_science,thermal_balance,base,A room stays at a constant temperature while a heater runs and heat escapes through its walls. Is constant temperature consistent with ongoing heat transfer?,Treat the room as a single thermal body; no phase changes.,"[""Yes"",""No""]",0,Yes,Heating can balance the rate of heat loss without changing temperature.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_thermal_balance_changed,everyday_science,everyday_science,thermal_balance,changed,A room has ongoing heat loss to colder outdoors. Its heater is switched off and there are no other heat sources. What happens to its temperature initially?,Treat the room as a single thermal body; no phase changes.,"[""It decreases"",""It necessarily stays fixed"",""It increases""]",0,It decreases,Loss of thermal energy without replacement initially cools the room.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_heat_capacity_base,everyday_science,everyday_science,heat_capacity,base,"Samples A and B are liquid water, with masses 100 g and 200 g. Each receives 100 J. Which has the larger temperature increase?",Same initial temperature and specific heat; no heat loss or phase change.,"[""A"",""B"",""They are equal""]",0,A,"Delta T = Q/(m c), so A warms twice as much.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_heat_capacity_changed,everyday_science,everyday_science,heat_capacity,changed,Water samples A and B have masses 100 g and 200 g. A receives 100 J and B receives 200 J. Which has the larger temperature increase?,Same initial temperature and specific heat; no heat loss or phase change.,"[""A"",""B"",""They are equal""]",2,They are equal,The same Q/m gives the same temperature increase.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_hydrostatic_pressure_base,everyday_science,everyday_science,hydrostatic_pressure,base,"Two open containers have different shapes and water volumes, but equal water depth. Compare pressure at their bottoms.",Water is stationary with the same density; same gravity and atmospheric pressure.,"[""Equal"",""Larger in the container with more water"",""Smaller in the container with more water""]",0,Equal,"Hydrostatic pressure depends on depth, density and atmospheric pressure.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_hydrostatic_pressure_changed,everyday_science,everyday_science,hydrostatic_pressure,changed,Two open containers hold the same water. Container A is 1 m deep and B is 2 m deep. Which has greater bottom pressure?,Water is stationary with the same density; same gravity and atmospheric pressure.,"[""A"",""B"",""Equal""]",1,B,"At equal atmospheric pressure and density, greater depth gives greater pressure.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_power_energy_base,everyday_science,everyday_science,power_energy,base,A 10 W lamp runs for 2 hours. A 20 W lamp runs for 1 hour. Which consumes more energy?,The stated powers are constant electrical input powers.,"[""The 10 W lamp"",""The 20 W lamp"",""Equal""]",2,Equal,Both use 20 Wh.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_power_energy_changed,everyday_science,everyday_science,power_energy,changed,A 10 W lamp and a 20 W lamp each run for 2 hours. Which consumes more energy?,The stated powers are constant electrical input powers.,"[""The 10 W lamp"",""The 20 W lamp"",""Equal""]",1,The 20 W lamp,Energy is power times time; the 20 W lamp uses twice as much.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_concentration_base,everyday_science,everyday_science,concentration,base,A solution contains 10 g of dissolved salt. Pure water is added without spilling. Has the amount of salt decreased?,"No precipitation, evaporation, reaction or salt addition.","[""Yes"",""No""]",1,No,Adding solvent changes concentration without removing solute.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_concentration_changed,everyday_science,everyday_science,concentration,changed,Half of a well-mixed salt solution is poured away. Has the amount of salt in the remaining container decreased?,"No precipitation, evaporation, reaction or salt addition.","[""Yes"",""No""]",0,Yes,Removing half the homogeneous solution removes half its dissolved salt.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_measurement_error_base,everyday_science,everyday_science,measurement_error,base,A scale has a fixed +2 g calibration offset. Repeated measurements of a 100 g reference average 102 g. Will averaging arbitrarily many readings eliminate that fixed offset?,The reference mass is unchanged.,"[""Yes"",""No""]",1,No,Averaging does not remove a systematic offset.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| P_measurement_error_changed,everyday_science,everyday_science,measurement_error,changed,"A calibrated scale has no systematic offset, but each reading has independent zero-mean noise with finite variance. Does averaging more readings reduce the standard deviation of the mean?",The reference mass is unchanged.,"[""Yes"",""No""]",0,Yes,"For independent finite-variance noise, the mean has variance sigma squared divided by n.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_units_equal_error,ml_concepts,ml_concepts,ml_units_equal,error,Model A has prediction error magnitude 0.1 metres. Model B has error magnitude 10 centimetres on the same target. Which has lower physical error?,,"[""Model A"",""Model B"",""Equal physical error""]",2,Equal physical error,Convert both errors to the same unit before comparing.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_units_equal_mse,ml_concepts,ml_concepts,ml_units_equal,mse,Model A has MSE 0.01 square metres. Model B has MSE 100 square centimetres on the same examples. Which has lower physical squared error?,,"[""Model A"",""Model B"",""Equal physical error""]",2,Equal physical error,"One square metre is 10,000 square centimetres; 0.01 square metres is 100 square centimetres.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_units_better_B_error,ml_concepts,ml_concepts,ml_units_better_B,error,Model A has prediction error magnitude 0.1 metres. Model B has error magnitude 8 centimetres on the same target. Which has lower physical error?,,"[""Model A"",""Model B"",""Equal physical error""]",1,Model B,Convert both errors to the same unit before comparing.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_units_better_B_mse,ml_concepts,ml_concepts,ml_units_better_B,mse,Model A has MSE 0.01 square metres. Model B has MSE 64 square centimetres on the same examples. Which has lower physical squared error?,,"[""Model A"",""Model B"",""Equal physical error""]",1,Model B,"One square metre is 10,000 square centimetres; 0.01 square metres is 100 square centimetres.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_units_better_A_error,ml_concepts,ml_concepts,ml_units_better_A,error,Model A has prediction error magnitude 0.1 metres. Model B has error magnitude 12 centimetres on the same target. Which has lower physical error?,,"[""Model A"",""Model B"",""Equal physical error""]",0,Model A,Convert both errors to the same unit before comparing.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_units_better_A_mse,ml_concepts,ml_concepts,ml_units_better_A,mse,Model A has MSE 0.01 square metres. Model B has MSE 144 square centimetres on the same examples. Which has lower physical squared error?,,"[""Model A"",""Model B"",""Equal physical error""]",0,Model A,"One square metre is 10,000 square centimetres; 0.01 square metres is 100 square centimetres.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_leakage_named,ml_concepts,ml_concepts,leakage,named,"A model predicts whether a customer will cancel tomorrow. Its feature customer_score is computed as 2*y+1, where y is that same customer's actual cancellation outcome tomorrow. Is this valid information for making the prediction today?",,"[""Yes"",""No""]",1,No,The feature encodes the target outcome and is unavailable at the prediction time.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_leakage_renamed,ml_concepts,ml_concepts,leakage,renamed,"For a prediction made today about tomorrow's cancellation, a column called engagement_index is derived from tomorrow's observed cancellation outcome. Does its harmless-looking name make it a valid feature today?",,"[""Yes"",""No""]",1,No,Renaming a feature does not change its dependence on the future target.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_leakage_valid,ml_concepts,ml_concepts,leakage,valid_control,"A cancellation model uses last month's usage, available today. A normalization mean is fitted only on training records and then applied unchanged to validation records. Do these stated operations necessarily leak validation outcomes?",,"[""Yes"",""No""]",1,No,Features are available at prediction time and preprocessing is fitted on training data only; the stated operations do not themselves establish leakage.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| ML_confidence,ml_concepts,ml_concepts,confidence,standalone,A classifier emits confidence 0.99. No calibration study or correctness labels are provided. Can you conclude that 99 percent of its predictions with that score are correct?,,"[""Yes"",""No""]",1,No,A numeric confidence score alone does not establish empirical calibration.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_const_k,pde_concepts,pde_concepts,conductivity,constant,"For 1D conduction in a stationary rod with constant conductivity k, constant volumetric heat capacity rho*c, and no heat source, which equation applies?",,"[""rho*c*T_t = k*T_xx"",""rho*c*T_t = k*T_x"",""T_t = 0 for every initial state""]",0,rho*c*T_t = k*T_xx,"For constant k, the divergence of k times the temperature gradient reduces to k*T_xx.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_variable_k,pde_concepts,pde_concepts,conductivity,changed,"For the same rod, conductivity now varies with position: k=k(x). Fourier's law is q=-k(x)*T_x. Which conservation equation applies?","Constant rho*c, no source, stationary rod and Fourier conduction.","[""rho*c*T_t = d/dx(k(x)*T_x)"",""rho*c*T_t = k(x)*T_xx in all cases"",""rho*c*T_t = k(x)*T_x""]",0,rho*c*T_t = d/dx(k(x)*T_x),Differentiating k*T_x introduces k_x*T_x in addition to k*T_xx.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_insulated,pde_concepts,pde_concepts,boundary_meaning,insulated,"In 1D conduction with k>0, the left end is perfectly insulated. Which boundary condition expresses this?",,"[""T_x = 0 at the left end"",""T = 0 at the left end"",""T_t = 0 everywhere""]",0,T_x = 0 at the left end,Insulation means zero conductive flux; with scalar positive k this gives zero spatial derivative.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_fixed_temperature,pde_concepts,pde_concepts,boundary_meaning,fixed_temperature,The left end of a rod is held at temperature T0. Which boundary condition expresses this?,,"[""T = T0 at the left end"",""T_x = 0 at the left end"",""No boundary condition is needed""]",0,T = T0 at the left end,"Prescribed temperature is a value condition, not a zero-flux condition.",assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_flux_isotropic,pde_concepts,pde_concepts,flux,isotropic,"The outward normal is n=(1,0), conductivity K=[[1, 0], [0, 1]], temperature gradient=[0, 1], and heat flux q=-K*gradient. Is outward normal heat flux zero?",,"[""Yes"",""No""]",0,Yes,The first component of -K*gradient is 0.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_flux_anisotropic,pde_concepts,pde_concepts,flux,anisotropic,"The outward normal is n=(1,0), conductivity K=[[2, 1], [1, 2]], temperature gradient=[0, 1], and heat flux q=-K*gradient. Is outward normal heat flux zero?",,"[""Yes"",""No""]",1,No,The first component of -K*gradient is -1.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_flux_anisotropic_zero,pde_concepts,pde_concepts,flux,anisotropic_zero,"The outward normal is n=(1,0), conductivity K=[[2, 1], [1, 2]], temperature gradient=[1, -2], and heat flux q=-K*gradient. Is outward normal heat flux zero?",,"[""Yes"",""No""]",0,Yes,The first component of -K*gradient is 0.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_residual,pde_concepts,pde_concepts,pinn_validation,standalone,"A candidate u(x,t)=0 satisfies u_t=alpha*u_xx exactly. The specified initial condition is u(x,0)=sin(pi*x) on 0<x<1. Is this the solution of the specified initial-value problem?",,"[""Yes"",""No""]",1,No,It satisfies the differential equation but violates the nonzero initial condition.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| D_underdetermined,pde_concepts,pde_concepts,missing_condition,standalone,A rod has steady T_xx=0 and insulated ends T_x(0)=T_x(1)=0. No mean temperature or initial thermal energy is given. Is its unique numerical temperature determined?,,"[""Yes, it must be zero"",""No, an arbitrary constant temperature satisfies the stated conditions""]",1,"No, an arbitrary constant temperature satisfies the stated conditions",The homogeneous Neumann conditions leave the additive constant undetermined.,assistant_brainstorm,,,,,,,,,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_quarel_carpet,dataset_examples,dataset_examples,quarel_carpet,paper_example,"A toy car travels farther across wood than across a thick carpet. Under the intended equal-starting-conditions comparison, which surface offers greater resistance?",,"[""Carpet"",""Wood""]",0,Carpet,The intended qualitative relation is greater resistance leading to shorter travel.,paper_illustration,community-datasets/quarel,paper Figure 1,,https://huggingface.co/datasets/community-datasets/quarel,https://ojs.aaai.org/index.php/AAAI/article/view/4687,,A: carpet has more resistance,Paraphrase; equal starting conditions made explicit.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_quarel_ice,dataset_examples,dataset_examples,quarel_ice,paraphrase,"A snowboarder moves faster after passing from snow onto ice. Under the dataset's surface comparison, which surface is smoother?",,"[""Snow"",""Ice""]",1,Ice,The dataset label identifies ice.,dataset_paraphrase,community-datasets/quarel,QuaRel_V1_Fr_0223,train,https://huggingface.co/datasets/community-datasets/quarel,https://ojs.aaai.org/index.php/AAAI/article/view/4687,52be7f062d2c13d401a9e53b6963d8fbcc4abeb4,answer_index=1 (B: ice),Paraphrase of an identified row; the dataset uses an implicit qualitative comparison.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_quartz_density,dataset_examples,dataset_examples,quartz_density,paraphrase,The same amount of hydrogen gas occupies 40 litres instead of 50 litres. What happens to its density?,,"[""It increases"",""It decreases""]",0,It increases,Density is mass divided by volume; the same mass occupies less volume.,dataset_paraphrase,allenai/quartz,QRQA-10313-1-flip,train,https://huggingface.co/datasets/allenai/quartz,https://aclanthology.org/D19-1608/,28c1dbb56caf81799296cb17892fa73402e23464,A: increases,Paraphrase; mass conservation made explicit.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_quartz_sound,dataset_examples,dataset_examples,quartz_sound,paraphrase,"For sound to propagate more slowly through otherwise comparable air, should a room be colder or warmer?",,"[""Colder"",""Warmer""]",0,Colder,The supplied dataset relation says sound travels slower at lower air temperatures.,dataset_paraphrase,allenai/quartz,QRQA-10134-5,train,https://huggingface.co/datasets/allenai/quartz,https://aclanthology.org/D19-1608/,28c1dbb56caf81799296cb17892fa73402e23464,A: colder,Paraphrase; comparable medium made explicit.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_arc_ramp,dataset_examples,dataset_examples,arc_ramp,paraphrase,Why can a worker use a ramp to move a heavy box onto a truck with less applied force?,Compare ideal steady motion with negligible friction.,"[""The ramp reduces the box's gravitational weight"",""The ramp spreads the height gain over a longer path"",""The ramp makes gravity disappear""]",1,The ramp spreads the height gain over a longer path,A ramp trades a longer path for a smaller required applied force under suitable conditions.,dataset_adaptation,allenai/ai2_arc,Mercury_7119770,ARC-Easy/train,https://huggingface.co/datasets/allenai/ai2_arc,https://arxiv.org/abs/1803.05457,210d026faf9955653af8916fad021475a3f00453,D: reduces the amount of force applied,Reworded question and options; this is not the original benchmark item.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_arc_friction,dataset_examples,dataset_examples,arc_friction,paraphrase,"In the ARC hand-rubbing question, which listed condition is intended to produce the most frictional heating?",,"[""Dry palms"",""Oil-covered palms"",""Lotion-covered palms""]",0,Dry palms,The source answer key chooses dry palms.,dataset_adaptation,allenai/ai2_arc,Mercury_SC_415702,ARC-Challenge/train,https://huggingface.co/datasets/allenai/ai2_arc,https://arxiv.org/abs/1803.05457,210d026faf9955653af8916fad021475a3f00453,A: dry palms,"Paraphrase with one distractor omitted; use as a dataset example, not an exact replication.",,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_piqa_bottle,dataset_examples,dataset_examples,piqa_bottle,project_example,"An empty flexible plastic bottle is squeezed, and its opening is placed against an egg yolk to lift it. Which action creates the intended suction?",,"[""Release the squeezed bottle"",""Keep squeezing the bottle""]",0,Release the squeezed bottle,Allowing the bottle to expand draws material inward.,paper_illustration,PIQA,author project-page example (no row ID verified),,https://yonatanbisk.com/piqa/,https://ojs.aaai.org/index.php/AAAI/article/view/6239,,Solution 1: release the squeezed bottle,Paraphrased author-page illustration; no train/test row ID claimed.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_wiqa_erosion,dataset_examples,dataset_examples,wiqa_erosion,paper_adaptation,"A process description states: wind creates waves; waves hit shore rocks; impacts break off fragments. In this stated process, stronger wave impacts increase, decrease, or leave unchanged the erosion?",,"[""Increase"",""Decrease"",""Leave unchanged""]",0,Increase,The given causal chain links stronger impacts to more rock fragmentation.,paper_illustration,allenai/wiqa,paper Figure 1 / introductory erosion illustration,,https://huggingface.co/datasets/allenai/wiqa,https://aclanthology.org/D19-1629/,,No exact dataset row label claimed,"New question based on the paper's process illustration, not a copied WIQA record.",,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_kinetic_equal_speeds,scientific_assumptions,scientific_assumptions,kinetic_assumptions,equal_speeds,A basketball has greater mass than a baseball. Both move at the same speed. Which has greater kinetic energy?,,"[""The basketball"",""The baseball"",""Cannot be determined from the given information""]",0,The basketball,"At equal speed, kinetic energy increases with mass.",dataset_adaptation,allenai/quartz,QRQA-10208-3,train,https://huggingface.co/datasets/allenai/quartz,https://aclanthology.org/D19-1608/,28c1dbb56caf81799296cb17892fa73402e23464,A: basketball (source question does not explicitly supply speeds),Controlled adaptation. The new wording determines its own gold answer; the original answer is provenance only.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_kinetic_missing_speeds,scientific_assumptions,scientific_assumptions,kinetic_assumptions,missing_speeds,A basketball has greater mass than a baseball. Their speeds are not supplied and should not be assumed equal. Which has greater kinetic energy?,,"[""The basketball"",""The baseball"",""Cannot be determined from the given information""]",2,Cannot be determined from the given information,Mass alone cannot determine one-half mass times speed squared.,dataset_adaptation,allenai/quartz,QRQA-10208-3,train,https://huggingface.co/datasets/allenai/quartz,https://aclanthology.org/D19-1608/,28c1dbb56caf81799296cb17892fa73402e23464,A: basketball (source question does not explicitly supply speeds),Controlled adaptation. The new wording determines its own gold answer; the original answer is provenance only.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| S_kinetic_baseball_faster,scientific_assumptions,scientific_assumptions,kinetic_assumptions,baseball_faster,A 0.6 kg basketball moves at 2 m/s. A 0.15 kg baseball moves at 10 m/s. Which has greater kinetic energy?,,"[""The basketball"",""The baseball"",""Cannot be determined from the given information""]",1,The baseball,The basketball has 1.2 J and the baseball has 7.5 J.,dataset_adaptation,allenai/quartz,QRQA-10208-3,train,https://huggingface.co/datasets/allenai/quartz,https://aclanthology.org/D19-1608/,28c1dbb56caf81799296cb17892fa73402e23464,A: basketball (source question does not explicitly supply speeds),Controlled adaptation. The new wording determines its own gold answer; the original answer is provenance only.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_uncertainty_english,technical_language,technical_language,uncertainty,english,"The cache is probably causing the bug, but we have not confirmed that yet. | |
| What is the status of the proposed cache cause?",Judge only what is explicitly stated.,"[""Suspected, not confirmed"",""Confirmed"",""Ruled out""]",0,"Suspected, not confirmed",The message explicitly retains uncertainty.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_uncertainty_mixed_arabic_english,technical_language,technical_language,uncertainty,mixed_arabic_english,"غالبًا الـ bug من الـ cache، بس لسه ما اتأكدناش. | |
| What is the status of the proposed cache cause?",Judge only what is explicitly stated.,"[""Suspected, not confirmed"",""Confirmed"",""Ruled out""]",0,"Suspected, not confirmed",The message explicitly retains uncertainty.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_deployment_english,technical_language,technical_language,deployment,english,"We have not deployed the update yet. | |
| Has the update already been deployed?",Judge only what is explicitly stated.,"[""Yes"",""No""]",1,No,The negation and yet indicate the deployment has not happened.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_deployment_mixed_arabic_english,technical_language,technical_language,deployment,mixed_arabic_english,"لسه ما deployناش الـ update. | |
| Has the update already been deployed?",Judge only what is explicitly stated.,"[""Yes"",""No""]",1,No,The negation and yet indicate the deployment has not happened.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_conditional_english,technical_language,technical_language,conditional,english,"We will roll back if the error rate increases. | |
| Which status is actually stated?",Judge only what is explicitly stated.,"[""A conditional rollback plan"",""An already completed rollback"",""A rollback is ruled out""]",0,A conditional rollback plan,The statement describes a future action conditional on an increase.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_conditional_mixed_arabic_english,technical_language,technical_language,conditional,mixed_arabic_english,"هنعمل rollback لو الـ error rate زاد. | |
| Which status is actually stated?",Judge only what is explicitly stated.,"[""A conditional rollback plan"",""An already completed rollback"",""A rollback is ruled out""]",0,A conditional rollback plan,The statement describes a future action conditional on an increase.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_entity_english,technical_language,technical_language,entity,english,"The baseline improved, not the new model. | |
| Which entity is stated to have improved?",Judge only what is explicitly stated.,"[""The baseline"",""The new model"",""Both""]",0,The baseline,The improvement is assigned to the baseline and denied for the new model.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_entity_mixed_arabic_english,technical_language,technical_language,entity,mixed_arabic_english,"الـ baseline اتحسن، مش الـ model الجديد. | |
| Which entity is stated to have improved?",Judge only what is explicitly stated.,"[""The baseline"",""The new model"",""Both""]",0,The baseline,The improvement is assigned to the baseline and denied for the new model.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_tradeoff_english,technical_language,technical_language,tradeoff,english,"Recall improved, but false positives increased, and we have not tested on new cameras. | |
| Has performance on new cameras been tested?",Judge only what is explicitly stated.,"[""Yes"",""No""]",1,No,The message says new-camera testing has not yet happened.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
| L_tradeoff_mixed_arabic_english,technical_language,technical_language,tradeoff,mixed_arabic_english,"الـ recall اتحسن، بس الـ false positives زادت، ولسه ما اختبرناش على كاميرات جديدة. | |
| Has performance on new cameras been tested?",Judge only what is explicitly stated.,"[""Yes"",""No""]",1,No,The message says new-camera testing has not yet happened.,assistant_brainstorm,,,,,,,,AI-authored example from our brainstorming. Ahmed must check naturalness and semantic equivalence personally.,,Draft answer for the stated question; personally verify before final use.,needs_review,,2026-10-22 | |
Xet Storage Details
- Size:
- 60.9 kB
- Xet hash:
- 4ca193f23f69251c62bf2a519f3e63817b71d0a4d09b48da0ce7c583b7844dbc
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.