{"request": {"context": "The casting of actors not known for their singing abilities led to some mixed reviews. Variety stated that ``some stars, especially the bouncy and rejuvenated Streep, seem better suited for musical comedy than others, including Brosnan and Skarsgård.'' Brosnan, especially, was savaged by many critics: his singing was compared to ``a water buffalo'' (New York Magazine), ``a donkey braying'' (The Philadelphia Inquirer) and ``a wounded raccoon'' (The Miami Herald), and Matt Brunson of Creative Loafing Charlotte said he ``looks physically pained choking out the lyrics, as if he's being subjected to a prostate exam just outside of the camera's eye.''", "question": "does everyone do their own singing in mamma mia?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Sweden's defeat by Russia in the Great Northern War resulted in the capitulation of Estonia and Livonia in 1710, confirmed by the Treaty of Nystad in 1721, and Russian rule was then imposed on what later became modern Estonia. Nonetheless, the legal system, Lutheran church, local and town governments, and education remained mostly German until the late 19th century and partially until 1918.", "question": "did estonia used to be part of russia?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: This is a record of Canada's results at the FIFA World Cup. Canada has appeared in the FIFA World Cup on one occasion, which was in 1986.", "question": "has canada ever competed in the world cup?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Stachys byzantina (syn. S. lanata; lamb's-ear or woolly hedgenettle) is a species of Stachys, native to Turkey, Armenia, and Iran. It is cultivated over much of the temperate world as an ornamental plant, and is naturalised in some locations as an escapee from gardens. Plants are very often found under the synonym Stachys lanata or Stachys olympica.", "question": "is there a plant called lamb's ear?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "The gray wolf (Canis lupus), also known as the timber wolf, western wolf, or simply, wolf, is a canine native to the wilderness and remote areas of Eurasia and North America. It is the largest extant member of its family, with males averaging 43--45 kg (95--99 lb) and females 36--38.5 kg (79--85 lb). Like the red wolf, it is distinguished from other Canis species by its larger size and less pointed features, particularly on the ears and muzzle. Its winter fur is long and bushy and predominantly a mottled gray in color, although nearly pure white, red, and brown to black also occur. Mammal Species of the World (3rd ed., 2005), a standard reference work in zoology, recognises 38 subspecies of C. lupus..", "question": "is a timber wolf the same as a gray wolf?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: It is possible to have extra, or ``supernumerary,'' teeth. This phenomenon is called hyperdontia and is often erroneously referred to as ``a third set of teeth.'' These teeth may erupt into the mouth or remain impacted in the bone. Hyperdontia is often associated with syndromes such as cleft lip and palate, trichorhinophalangeal syndrome, cleidocranial dysplasia, and Gardner's syndrome.", "question": "question: can you get a 3rd set of teeth?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The first film was followed by two successful sequels, The Empire Strikes Back (1980) and Return of the Jedi (1983); these three films constitute the original Star Wars trilogy. A prequel trilogy was released between 1999 and 2005, albeit to mixed reactions from critics and fans. A sequel trilogy concluding the main story of the nine-episode saga began in 2015 with The Force Awakens. The first eight films were nominated for Academy Awards (with wins going to the first two released) and were commercially successful, with a combined box office revenue of over US$8.5 billion. Together with the theatrical spin-off films The Clone Wars (2008), Rogue One (2016) and Solo: A Star Wars Story (2018), Star Wars is the second highest-grossing film series ever.", "question": "question: is there a star wars movie this year?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Gone Baby Gone is a 2007 American neo-noir mystery drama film directed by Ben Affleck. In his feature-length directorial debut, Affleck co-wrote the screenplay with Aaron Stockard based on the novel Gone, Baby, Gone by Dennis Lehane. The film stars Casey Affleck and Michelle Monaghan as two private investigators hunting for a little girl who was abducted from the Boston neighborhood of Dorchester. The supporting cast includes Morgan Freeman, Ed Harris and Amy Ryan.", "question": "is the movie gone baby gone a true story?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: The untitled Avengers film is scheduled to be released in the United States on May 3, 2019, in IMAX and 3D.", "question": "is there a sequal to avengers infinity war?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "The mahi-mahi (/ˈmɑːhiːˈmɑːhiː/) or common dolphinfish (Coryphaena hippurus) is a surface-dwelling ray-finned fish found in off-shore temperate, tropical, and subtropical waters worldwide. Also widely called dorado and dolphin, it is one of two members of the Coryphaenidae family, the other being the pompano dolphinfish.", "question": "is mahi mahi the same as ahi tuna?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The sea otter (Enhydra lutris) is a marine mammal native to the coasts of the northern and eastern North Pacific Ocean. Adult sea otters typically weigh between 14 and 45 kg (31 and 99 lb), making them the heaviest members of the weasel family, but among the smallest marine mammals. Unlike most marine mammals, the sea otter's primary form of insulation is an exceptionally thick coat of fur, the densest in the animal kingdom. Although it can walk on land, the sea otter is capable of living exclusively in the ocean.", "question": "do sea otters live in the pacific ocean?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "The central nervous system is responsible for the orderly recruitment of motor neurons, beginning with the smallest motor units. Henneman's size principle indicates that motor units are recruited from smallest to largest based on the size of the load. For smaller loads requiring less force, slow twitch, low-force, fatigue-resistant muscle fibers are activated prior to the recruitment of the fast twitch, high-force, less fatigue-resistant muscle fibers. Larger motor units are typically composed of faster muscle fibers that generate higher forces.", "question": "does the size of a motor unit vary?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Sweeney Todd: The Demon Barber of Fleet Street is a 1979 musical thriller with music and lyrics by Stephen Sondheim and book by Hugh Wheeler. The musical is based on the 1973 play Sweeney Todd, the Demon Barber of Fleet Street by Christopher Bond.", "question": "question: is the barber of seville the same as sweeney todd?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Seawise Giant, later Happy Giant, Jahre Viking, Knock Nevis, Oppama, and finally Mont, was a ULCC supertanker that was the longest ship ever built. She possessed the greatest deadweight tonnage ever recorded. Fully loaded, her displacement was 657,019 tonnes (646,642 long tons; 724,239 short tons), the heaviest ship of any kind, and with a laden draft of 24.6 m (81 ft), she was incapable of navigating the English Channel, the Suez Canal or the Panama Canal. Overall, she is generally considered the largest ship ever built. She was sunk during the Iran--Iraq War, but was later salvaged and restored to service. She was last used as a floating storage and offloading unit (FSO) moored off the coast of Qatar in the Persian Gulf at the Al Shaheen Oil Field.", "question": "is the titanic still the biggest ship ever built?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "An associate degree (or associate's degree) is an undergraduate academic degree awarded by colleges and universities upon completion of a course of study intended to usually last two years or more. It is considered to be a greater level of education than a high school diploma or GED. The first associate degrees were awarded in the UK (where they are no longer awarded) in 1873 before spreading to the US in 1898. They have since been introduced in a small number of other countries.", "question": "is an associates degree considered a college degree?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Magnesium citrate is a magnesium preparation in salt form with citric acid in a 1:1 ratio (1 magnesium atom per citrate molecule). The name ``magnesium citrate'' is ambiguous and sometimes may refer to other salts such as trimagnesium citrate which has a magnesium:citrate ratio of 3:2.", "question": "question: does magnesium citrate have citric acid in it?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "A game consists of a sequence of points played with the same player serving, and is won by the first side to have won at least four points with a margin of two points or more over their opponent. Normally the server's score is always called first and the opponent's score second. Score calling in tennis is unusual in that each point has a corresponding call that is different from its point value.", "question": "question: do you have to serve to score in tennis?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: In 2011, the Center for Science in the Public Interest sued General Mills over Fruit Roll-Ups, saying that their packaging and marketing was misleading because it presented the product as a nutritious, healthful, fruit-filled snack, despite having approximately the same nutritional profile as gummy bear candies. The lawsuit was settled out of court with General Mills agreeing not to put pictures of fruits on the labels, unless that fruit was actually present in that flavor of the Fruit Roll-Up, and to either stop claiming that the product is ``made with real fruit'', or to include in that potentially misleading statement the percentage of the Fruit Roll-Up that is made from real fruit. These changes took place in 2014.", "question": "are fruit roll ups made with real fruit?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "A season finale (British English: last in the season; Australian English: season final) is the final episode of a season of a television program. This is often the final episode to be produced for a few months or longer, and, as such, will try to attract viewers to continue watching when the series begins again.", "question": "does season finale mean the show is over?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The United States Open Championship, commonly known as the U.S. Open, is the annual open national championship of golf in the United States. It is the second of the four major championships in golf, and is on the official schedule of both the PGA Tour and the European Tour. Since 1898 the competition has been 72 holes of stroke play (4 rounds on an 18-hole course), with the winner being the player with the lowest total number of strokes. It is staged by the United States Golf Association (USGA) in mid-June, scheduled so that, if there are no weather delays, the final round is played on the third Sunday, which is Father's Day. The U.S. Open is staged at a variety of courses, set up in such a way that scoring is very difficult, with a premium placed on accurate driving.", "question": "is the us open played on the same course every year?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The Southern Nevada Zoological-Botanical Park, informally known as the Las Vegas Zoo, was a 3-acre (1.2 ha), nonprofit Zoological park and botanical garden located in Las Vegas, Nevada that closed in September 2013. It was located northwest of the Las Vegas Strip, about 15 minutes away. It focused primarily on the education of desert life and habitat protection. Its mission statement was to ``educate and entertain the public by displaying a variety of plants and animals''. An admission fee was charged. The park included a small gem exhibit area and a small gift shop at the main exit. The gift shop and admission fees helped support the zoo.", "question": "is there a zoo in las vegas nevada?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: web form\n  body: In 1866, at the behest of Chief Justice Chase, Congress passed an act providing that the next three justices to retire would not be replaced, which would thin the bench to seven justices by attrition. Consequently, one seat was removed in 1866 and a second in 1867. In 1869, however, the Circuit Judges Act returned the number of justices to nine, where it has since remained.", "question": "question: can we have more than 9 supreme court justices?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: Oslo Airport Station (Norwegian: Oslo lufthavn stasjon), also known as Gardermoen Station, is a railway station located in the airport terminal building of Oslo Airport, Gardermoen in Norway. Located on the Gardermoen Line, it is served by the Airport Express Trains, express trains to Trondheim and Oslo, regional trains to Lillehammer and Skien (via Oslo) and commuter trains to Eidsvoll and Kongsberg (via Oslo).", "question": "is there a train station at oslo airport?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: The fourteenth season of the American television medical drama Grey's Anatomy was ordered on February 10, 2017, by American Broadcasting Company (ABC), and premiered on September 28, 2017 with a special two-hour premiere. The season will consist of 24 episodes, with the season's seventh episode marking the 300th episode for the series overall. The season is produced by ABC Studios, in association with Shondaland Production Company and The Mark Gordon Company; the showrunners being Krista Vernoff and William Harper.", "question": "is there a season 14 of grey's anatomy?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "The mishap in The Guardian where Randall loses his crew is loosely based on an actual U.S. Coast Guard aviation mishap in Alaska. The aircraft was an HH-3F Pelican (USCG variant of the Jolly Green Giant) instead of the HH-60J Jayhawk (USCG variant of the Blackhawk/Seahawk) pictured in the movie.", "question": "is the movie the guardian based on a true story?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The Houston Astros are an American professional baseball team based in Houston, Texas. The Astros compete in Major League Baseball (MLB) as a member club of the American League (AL) West division, having moved to the division in 2013 after spending their first 51 seasons in the National League (NL). The Astros have played their home games at Minute Maid Park since 2000.", "question": "did the astros used to be in the national league?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: email\n  body: The Ring of Fire is a direct result of plate tectonics: the movement and collisions of lithospheric plates. The eastern section of the ring is the result of the Nazca Plate and the Cocos Plate being subducted beneath the westward-moving South American Plate. The Cocos Plate is being subducted beneath the Caribbean Plate, in Central America. A portion of the Pacific Plate and the small Juan de Fuca Plate are being subducted beneath the North American Plate. Along the northern portion, the northwestward-moving Pacific plate is being subducted beneath the Aleutian Islands arc. Farther west, the Pacific plate is being subducted along the Kamchatka Peninsula arcs on south past Japan. The southern portion is more complex, with a number of smaller tectonic plates in collision with the Pacific plate from the Mariana Islands, the Philippines, Bougainville, Tonga, and New Zealand; this portion excludes Australia, since it lies in the center of its tectonic plate. Indonesia lies between the Ring of Fire along the northeastern islands adjacent to and including New Guinea and the Alpide belt along the south and west from Sumatra, Java, Bali, Flores, and Timor.", "question": "is australia part of the ring of fire?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: Northern Ireland (Irish: Tuaisceart Éireann (ˈt̪ɣuəʃcəɾɣt̪ɣ ˈeːɾjən̪ɣ) ( listen); Ulster-Scots: Norlin Airlann) is a part of the United Kingdom in the north-east of the island of Ireland, variously described as a country, province or region. Northern Ireland shares a border to the south and west with the Republic of Ireland. In 2011, its population was 1,810,863, constituting about 30% of the island's total population and about 3% of the UK's population. Established by the Northern Ireland Act 1998 as part of the Good Friday Agreement, the Northern Ireland Assembly holds responsibility for a range of devolved policy matters, while other areas are reserved for the British government. Northern Ireland co-operates with the Republic of Ireland in some areas, and the Agreement granted the Republic the ability to ``put forward views and proposals'' with ``determined efforts to resolve disagreements between the two governments''.", "question": "is northern ireland the same as republic of ireland?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "On August 7, 2018, E! and WWE announced that Total Bellas had been renewed for a fourth season.", "question": "will there be a total bellas season 4?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: chat\n  body: A perfectly inelastic collision occurs when the maximum amount of kinetic energy of a system is lost. In a perfectly inelastic collision, i.e., a zero coefficient of restitution, the colliding particles stick together. In such a collision, kinetic energy is lost by bonding the two bodies together. This bonding energy usually results in a maximum kinetic energy loss of the system. It is necessary to consider conservation of momentum: (Note: In the sliding block example above, momentum of the two body system is only conserved if the surface has zero friction. With friction, momentum of the two bodies is transferred to the surface that the two bodies are sliding upon. Similarly, if there is air resistance, the momentum of the bodies can be transferred to the air.) The equation below holds true for the two-body (Body A, Body B) system collision in the example above. In this example, momentum of the system is conserved because there is no friction between the sliding bodies and the surface.", "question": "is kinetic energy conserved in perfectly inelastic collisions?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Elderflower cordial is a soft drink made largely from a refined sugar and water solution and uses the flowers of the European elderberry, (Sambucus nigra L.). Historically the cordial has been popular in North Western Europe where it has a strong Victorian heritage. However, versions of an elderflower cordial recipe can be traced back to Roman times. Nowadays it can be found in almost all of the former Roman Empire territory, predominantly in Central Europe, especially in England, Germany, Austria, Slovenia, Romania, Hungary and Slovakia, where people have acquired a special taste for it and still make it in the traditional way. In some countries the drink can be found as an aromatic syrup, sold as a concentrated squash that is mixed with still or sparkling water. Elderflower pressé is a premixed form of this.", "question": "is elderflower cordial the same as elderflower syrup?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Along with his friend Alistair and Tess's coach Tink, Charlie takes a boat to find her. The following sunset, Charlie misses his game with Sam. As Charlie confesses his love for his departed sibling, Sam tells Charlie that he loves him back and moves on from the living world. He appears to Charlie as a shooting star in the sky to reveal Tess' location. The group finds Tess' wrecked boat along with her lying on the rocks. Charlie uses his body heat to keep Tess warm until they are found by the Coast Guard.", "question": "question: is tess carroll died in charlie st cloud?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Corinthian leather is a term coined by the advertising agency Bozell to describe the upholstery used in certain Chrysler luxury vehicles. The term first appeared in advertising in 1974. Although the term suggests that the product has a relationship to or origination from Corinth, there is no relationship; the term is merely a marketing concept.", "question": "is there such a thing as corinthian leather?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The term ``Darwinian fitness'' can be used to make clear the distinction with physical fitness. Fitness does not include a measure of survival or life-span; Herbert Spencer's well-known phrase ``survival of the fittest'' should be interpreted as: ``Survival of the form (phenotypic or genotypic) that will leave the most copies of itself in successive generations.''", "question": "does fitness(as used in biology) and survival have the same meaning?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Volkswagen AG (German: (ˈfɔlksˌvaːgn̩)), known internationally as the Volkswagen Group, is a German multinational automotive manufacturing company headquartered in Wolfsburg, Lower Saxony, Germany and indirectly majority owned by the Austrian Porsche-Piech family. It designs, manufactures and distributes passenger and commercial vehicles, motorcycles, engines, and turbomachinery and offers related services including financing, leasing and fleet management. In 2016, it was the world's largest automaker by sales, overtaking Toyota and keeping this title in 2017, selling 10.7 million vehicles. It has maintained the largest market share in Europe for over two decades. It ranked sixth in the 2017 Fortune Global 500 list of the world's largest companies. Volkswagen Group sells passenger cars under the Audi, Bentley, Bugatti, Lamborghini, Porsche, SEAT, Škoda and Volkswagen marques; motorcycles under the Ducati brand; and commercial vehicles under the marques MAN, Scania, and Volkswagen Commercial Vehicles. It is divided into two primary divisions, the Automotive Division and the Financial Services Division, and as of 2008 had approximately 342 subsidiary companies. VW also has two major joint-ventures in China (FAW-Volkswagen and SAIC Volkswagen). The company has operations in approximately 150 countries and operates 100 production facilities across 27 countries.", "question": "are audi and volkswagen made by the same company?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: New York City is split up into five boroughs, which are the Bronx, Brooklyn, Manhattan, Queens, and Staten Island. Each borough has the same boundaries as a county of the state. The county governments were dissolved when the city consolidated in 1898, along with all city, town, and village governments within each county. The term borough was adopted to describe a unique form of governmental administration for each of the five fundamental constituent parts of the newly consolidated city.", "question": "is new york city and manhattan the same thing?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: web form\n  body: The primary difficulty in completing the challenge lies in the limited capacity of the stomach. Generally, the stomach can hold only half a gallon (1.9 L). Stretch receptors in the organ sense when its limit is reached, triggering a vomit reflex that swiftly empties the stomach. Moreover, drinking a gallon of milk is more difficult than drinking a gallon of water. The fat and protein in milk each inhibit the stomach from releasing its contents into the small intestine, forcing more of the liquid to remain in the stomach. In turn, the action of gastric acid and proteases in the stomach cause proteins in the milk to unravel and expand the liquid into a thick semi-solid substance, further reducing the amount of fluid that can be held in the stomach without being regurgitated.", "question": "can drinking too much milk make you throw up?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "The pardon power of the President extends only to an offense recognizable under federal law. However, the governors of most of the 50 states have the power to grant pardons or reprieves for offenses under state criminal law. In other states, that power is committed to an appointed agency or board, or to a board and the governor in some hybrid arrangement (in some states the agency is merged with that of the parole board, as in the Oklahoma Pardon and Parole Board).", "question": "can the president pardon someone for a state crime?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "On 15 December 2014, the official music video for ``The Nights'' was released on YouTube and premiered on the front page of Yahoo Music. The video was produced, directed by, and stars ``professional life liver'' Rory Kramer, who filmed an exuberant action-packed recollection of his own life on roller coasters, surfing, snowboarding, skateboarding, balloon flying, making a four door convertible out of a Toyota, etc. -- living a life to be remembered.", "question": "is avicii the guy in the nights video?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Spain has two time zones and observes daylight saving time. Spain mainly uses Central European Time (GMT+01:00) and Central European Summer Time (GMT+02:00) in Peninsular Spain, the Balearic Islands, Ceuta, Melilla and plazas de soberanía. In the Canary Islands, the time zone is Western European Time (GMT±00:00) and Western European Summer Time (GMT+01:00). Daylight saving time is observed from the last Sunday in March (01:00 GMT) to the last Sunday in October (01:00 GMT) throughout Spain.", "question": "is spain all in the same time zone?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Greece were subsequently drawn against Croatia in the play-off round, where they were knocked out over two legs; a 4--1 away defeat set the tone for Greece's campaign, and in the second leg they drew a blank in a 0--0 stalemate against the Croats to signify the end of their World Cup hopes. Kostas Mitroglou finished as Greece's top scorer throughout their campaign, scoring six goals.", "question": "question: is greece not in the world cup 2018?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Indiana Jones and the Temple of Doom is a 1984 American action-adventure film directed by Steven Spielberg. It is the second installment in the Indiana Jones franchise and a prequel to the 1981 film Raiders of the Lost Ark, featuring Harrison Ford reprising his role as the title character. After arriving in North India, Indiana Jones is asked by desperate villagers to find a mystical stone and rescue their children from a Thuggee cult practicing child slavery, black magic and ritual human sacrifice in honor of the goddess Kali.", "question": "is indiana jones temple of doom a prequel?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "In December of 2015, Bad Lip Reading simultaneously released three new videos, one for each of the three films in the original Star Wars trilogy. These videos found BLR using guest voices for the first time, featuring Jack Black as Darth Vader, Maya Rudolph as Princess Leia, and Bill Hader in multiple roles. The Empire Strikes Back BLR video featured a scene of Yoda singing to Luke about an unfortunate encounter with a seagull on the beach. BLR would later expand this scene into a full-length standalone song known as ``Seagulls! (Stop It Now)'', which was released in November 2016 (eventually hitting #1 on the Billboard Comedy Digital Tracks chart.) As of late 2017, the ``Seagulls!'' video is Bad Lip Reading's second most viewed YouTube upload, and most popular musical production. In the song, Yoda sings to Luke Skywalker about the dangers posed by vicious seagulls if one dares to go to the beach. Mark Hamill, who played Luke Skywalker in the Star Wars films, publicly praised ``Seagulls!'' (and Bad Lip Reading in general) while speaking at Star Wars Celebration in 2017: ``I love them, and I showed Carrie (Fisher) the Yoda one... we were dying. I showed it to her in her trailer. She loved it. I retweeted it... and (BLR) contacted me and said 'Do you want to do Bad Lip Reading?' And I said, 'I'd love to...'''. Hamill and Bad Lip Reading would go on to collaborate on Bad Lip Reading's version of The Force Awakens, with Hamill providing the voice of Han Solo.", "question": "is seagulls stop it now a real song?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: With secularization of the mission in 1834, no religious services were held and the Luiseño were left behind by the fleeing Franciscan padres. The Mission's religious services restarted in 1893, when two Mexican priests were given permission to restore the Mission as a Franciscan college. Father Joseph O'Keefe was assigned as an interpreter for the monks. It was he who began to restore the old Mission in 1895. The cuadrángulo (quadrangle) and church were completed in 1905. San Luis Rey College was opened as a seminary in 1950, but closed in 1969.", "question": "was san luis rey de francia always a mission?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "In 1935, the Supreme Court overturned five of President Franklin Roosevelt's executive orders (6199, 6204, 6256, 6284, 6855). Executive Order 12954, issued by President Bill Clinton in 1995, attempted to prevent the federal government from contracting with organizations that had strike-breakers on the payroll; a federal appeals court subsequently ruled that the order conflicted with the National Labor Relations Act, and invalidated the order.", "question": "can the supreme court do anything to stop an executive order?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: Nineteen men have been awarded the Medal of Honor twice. The first two-time Medal of Honor recipient was Thomas Custer (brother of George Armstrong Custer) for two separate actions that took place several days apart during the American Civil War.", "question": "has anyone been awarded 2 medals of honor?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "While called bonds, these obligations to protect an employer from employee-dishonesty losses are really insurance policies. These insurance policies protect from losses of company monies, securities, and other property from employees who have a manifest intent to i) cause the company to sustain a loss and ii) obtain an improper financial benefit, either for themselves or another party. There are also many other coverage extensions available through the purchase of additional insuring agreements. These are common to most crime insurance policies (burglary, fire, general theft, computer theft, disappearance, fraud, forgery, etc.) and are designed to further protect specific company assets.", "question": "is fidelity bond the same as crime insurance?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "A bagel and cream cheese (also known as bagel with cream cheese) is a common food pairing in American cuisine, the cuisine of New York City, and American Jewish cuisine, consisting in its basic form of an open-faced sandwich made of a bagel spread with cream cheese. The bagel is typically sliced into two pieces, and can be served as-is or toasted. The basic bagel with cream cheese serves as the base for other sandwiches such as the ``lox and schmear'', a staple of delicatessens in the New York area, and across the U.S.", "question": "is a bagel with cream cheese a sandwich?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "The Eye of Agamotto (/ˈæɡəmɒtoʊ/) is a fictional mystical item appearing in American comic books published by Marvel Comics and in their Marvel Cinematic Universe films, with its first appearance in Doctor Strange. The item appears in publications in particular those featuring Doctor Strange. The Eye of Agamotto is the name commonly given to the amulet Strange wears on his chest, though the Eye actually resides within the amulet and is released from time to time. Created by writer Stan Lee and artist Steve Ditko, it first appeared in ``The Origin of Dr. Strange'', an eight-page story in Strange Tales #115 (December 1963). In designing the Eye, Ditko drew inspiration from the real world charm The All Seeing Eye of the Buddha, known among Buddhists as The Amulet of Snail Martyrs, a Nepali symbol meant to protect its wearer against evil. In film, the Eye contains the Time Stone, one of the fictional universe's Infinity stones, diverging from the comics' continuity where the Time Gem is owned by an ancient being named Ord Zyonz.", "question": "is the eye of agamotto the time stone?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: Peptidoglycan, also known as murein, is a polymer consisting of sugars and amino acids that forms a mesh-like layer outside the plasma membrane of most bacteria, forming the cell wall. The sugar component consists of alternating residues of β-(1,4) linked N-acetylglucosamine (NAG) and N-acetylmuramic acid (NAM) . Attached to the N-acetylmuramic acid is a peptide chain of three to five amino acids. The peptide chain can be cross-linked to the peptide chain of another strand forming the 3D mesh-like layer. Peptidoglycan serves a structural role in the bacterial cell wall, giving structural strength, as well as counteracting the osmotic pressure of the cytoplasm. A common misconception is that peptidoglycan gives the cell its shape; however, whereas peptidoglycan helps maintain the structural strength of the cell, it is actually the MreB protein that facilitates cell shape. Peptidoglycan is also involved in binary fission during bacterial cell reproduction.", "question": "do all bacteria have peptidoglycan in their cell walls?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "A golden match, in which an opponent does not lose a single point in an entire match, has only been recorded three times in the history of competitive tennis, and never in a best of 5 set match. Hazel Wightman of the United States recorded the first competitive golden match in 1910. It took over a century for the feat to be repeated, and then it occurred twice in the span of 42 days, first by Benjamin Tullou of France on 3 September 2016 at the 2016 France F17 Futures qualifying tournament, and then on 15 October 2016 by Joffrey de Schepper, also of France at the 2016 France F23 Futures qualifying event in Rodez, France. The unfortunate opponent to both of these men in their golden matches was a 55-year-old amateur, Tomas Fabian of the Czech Republic, who failed to win a single game in five different matches in the same event over two seasons. Mr. de Schepper did allow Fabian an ``honor point'' by deliberately hitting a ball in the last game out, but he is still generally credited with a golden match.", "question": "question: has there ever been a perfect tennis match?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Freshwater sharks are sharks able to live in freshwater lakes and rivers, including:", "question": "is there such thing as fresh water sharks?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: The best result for the United States in a World Cup came in 1930 when they reached the semifinals. The best result in the modern era is the 2002 World Cup, when the U.S. reached the quarterfinals. The worst result in the modern era was a first round elimination in 1990, 1998, and 2006.", "question": "did us ever win the world cup soccer?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The word ``mineral'' in ``mineral spirits'' or ``mineral turpentine'' is meant to distinguish it from distilled spirits (distilled directly from fermented grains and fruit) or from true turpentine (distilled tree resin).", "question": "is turpentine and white spirit the same thing?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The Korean language has changed between the two states due to the length of time that North and South Korea have been separated.", "question": "does north and south korea speak the same?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Daylight saving time in the United States is the practice of setting the clock forward by one hour during the warmer part of the year, so that evenings have more daylight and mornings have less. Most areas of the United States observe daylight saving time (DST), the exceptions being Arizona (except for the Navajo, who do observe daylight saving time on tribal lands), Hawaii, and the overseas territories of American Samoa, Guam, the Northern Mariana Islands, Puerto Rico, and the United States Virgin Islands. The Uniform Time Act of 1966 established the system of uniform Daylight Saving Time throughout the US.", "question": "does all of the us do daylight savings?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The U.S. Passport Card is the de facto national identification card of the United States and a limited travel document issued by the federal government of the United States in the size of a credit card. Like a U.S. passport book, the passport card is only issued to U.S. citizens and U.S. nationals exclusively by the U.S. Department of State and is compliant to the standards for identity documents set by the REAL ID Act and can be used as proof of U.S. citizenship. The passport card's intended primary purpose is for identification and to allow cardholders to travel by domestic air flights within the United States and to enter and exit the United States via land and sea between member states of the Western Hemisphere Travel Initiative (WHTI). However, the passport card cannot be used for international air travel.", "question": "can you travel internationally with a passport card?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "All rounds are best-of-seven series. Series are played in a 2--2--1--1--1 format, meaning the team with home-court advantage hosts games 1, 2, 5, and 7, while their opponent hosts games 3, 4, and 6, with games 5--7 being played if needed. This format has been used since 2014, after NBA team owners unanimously voted to change from a 2--3--2 format on October 23, 2013.", "question": "is nba playoffs 2-3-2?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "- role: customer\n  content: Guido maintains this story right until the end when, in the chaos of shutting down the camp as the Allied forces approach, he tells his son to stay in a box until everybody has left, this being the final task in the competition before the promised tank is his. Guido goes to find Dora, but he is caught by a German soldier. An officer makes the decision to execute Guido, who is led off by the soldier. While he is walking to his death, Guido passes by Giosuè one last time, still in character and playing the game. Guido is then shot and left for dead in an alleyway. The next morning, Giosuè emerges from the sweat-box, just as a US Army unit led by a Sherman tank arrives and the camp is liberated. Giosuè is overjoyed about winning the game, and an American soldier allows Giosuè to ride on the tank. While travelling to safety, Giosuè soon spots Dora in the procession leaving the camp and reunites with his mother. While the young Giosuè excitedly tells his mother about how he had won a tank, just as his father had promised, the adult Giosuè, in an overheard monologue, reminisces on the sacrifices his father made for him.", "question": "question: does the little boy die in life is beautiful?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "Although ``'Till I Collapse'' was not released as a single, when the single ``Shake That'' (also featuring Nate Dogg) was released in 2006, several Eminem songs re-charted that same week, including this one. It charted in the United Kingdom at number 192 on 15 April 2006. In 2008, it appeared in HBO's Oscar de la Hoya -- Manny Pacquiao 24/7. In 2009, it was used in an advert for the then-upcoming game Call of Duty: Modern Warfare 2. It raised digital download sales of the song worldwide considerably, but in Britain the song sold so many copies after the advert aired that it re-charted that week (21 November 2009) at number 73, a new peak. During the 2010--11 NBA season, the song was used during the Cleveland Cavaliers' team introductions. Shane Mosley used this song as an entrance theme with his bout with Floyd Mayweather as did Shane Carwin for his bout against Junior dos Santos. Major League Baseball pitcher Jesse Litsch used the song as his entrance music during the 2011 season. The song has also been used in the credits of the Season 8 premiere of Entourage. It was also used in September 2011 in the trailer and soundtrack for the film Real Steel, and in trailers and TV spots for the Oliver Stone-directed film Savages.", "question": "was till i collapse made for real steel?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: web form\n  body: The Parkers is an American sitcom that aired on UPN from August 30, 1999, to May 10, 2004. A spin-off of UPN's Moesha, The Parkers features the mother-daughter team of Nikki (played by Mo'Nique) and Kim Parker (played by Countess Vaughn).", "question": "was the parkers a spin off of moesha?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "- role: customer\n  content: Reese's Peanut Butter Cups are the No. 1 selling candy brand in the United States and consist of a milk, white, or dark chocolate cup filled with peanut butter, marketed by The Hershey Company. They were created by H.B. Reese, a former dairy farmer and shipping foreman for Milton S. Hershey. Reese left his job as a shipping foreman for The Hershey Company to start his own candy business.", "question": "is there peanut butter in reese's peanut butter cups?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: chat\n  body: The Cathedral Church of Saint Peter and Saint Paul in the City and Diocese of Washington, commonly known as Washington National Cathedral, is a cathedral of the Episcopal Church located in Washington, D.C., the capital of the United States. The structure is of Neo-Gothic design closely modeled on English Gothic style of the late fourteenth century. It is both the second-largest church building in the United States, and the fourth-tallest structure in Washington, D.C. The cathedral is the seat of both the Presiding Bishop of the Episcopal Church, Michael Bruce Curry, and the Bishop of the Diocese of Washington, Mariann Edgar Budde. Over 270,000 people visit the structure annually.", "question": "is the national cathedral in washington dc catholic?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "- role: customer\n  content: Since 1927, Australia and Ireland have competed against each other in rugby union in 36 matches, Australia having won 22, Ireland 13, with 1 draw. Their first meeting was on 12 November 1927, and was won 5-3 by Australia. Their most recent meeting took place at Allianz Stadium, Sydney on 23 June 2018 and was won 20 pts to 16 by Ireland.", "question": "has ireland ever beaten the wallabies in australia?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Depending on the context, a dependent variable is sometimes called a ``response variable'', ``regressand'', ``criterion'', ``predicted variable'', ``measured variable'', ``explained variable'', ``experimental variable'', ``responding variable'', ``outcome variable'', ``output variable'' or ``label''.", "question": "is outcome variable the same as dependent variable?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Alpha-gal allergy, also known as meat allergy or mammalian meat allergy (MMA), is a reaction to galactose-alpha-1,3-galactose (alpha-gal), whereby the body is overloaded with immunoglobulin E (IgE) antibodies on contact with the carbohydrate. The alpha-gal molecule is found in all mammals apart from Old World monkeys and the apes, which include humans. Anti-gal is a human natural antibody that interacts specifically with the mammalian carbohydrate structure gal alpha 1-3Gal beta 1-4GlcNAc-R, termed, the alpha-galactosyl epitope. Whereas anti-gal is abundant in humans, apes, and Old World monkeys, it is absent from New World monkeys, prosimians, and nonprimate mammals.", "question": "is there such a thing as meat allergy?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Texas is the second-largest U.S. state, after Alaska, with an area of 268,820 square miles (696,200 km). Though 10% larger than France and almost twice as large as Germany or Japan, it ranks only 27th worldwide amongst country subdivisions by size. If it were an independent country, Texas would be the 40th largest behind Chile and Zambia.", "question": "is the state of texas bigger than germany?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "The Leaning Tower of Pisa (Italian: Torre pendente di Pisa) or simply the Tower of Pisa (Torre di Pisa (ˈtorre di ˈpiːza)) is the campanile, or freestanding bell tower, of the cathedral of the Italian city of Pisa, known worldwide for its unintended tilt. The tower is situated behind the Pisa Cathedral and is the third oldest structure in the city's Cathedral Square (Piazza del Duomo), after the cathedral and the Pisa Baptistry.", "question": "was leaning tower of pisa supposed to lean?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: The earliest notable rock-and-roll performance at Red Rocks was by The Beatles on August 26, 1964, the only concert not sold out during their US-tour. When Ringo Starr returned to Red Rocks with his All-Starr Band on June 28, 2000, he asked if anyone in the crowd had been at the Beatles concert thirty-six years earlier. On August 26, 2004, the East-Coast-based Beatles-tribute band, ``1964'' was flown to Denver to re-enact the Beatles concert held at the site exactly forty-years earlier to the date. The beautiful and unique setting has led to the venue becoming a favorite for many performers. Jimi Hendrix played at Red Rocks on September 1, 1968, along with Vanilla Fudge and Soft Machine.", "question": "did the beatles ever play at red rocks?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Production began in late February 2008 in Boston. Principal photography took place at the Burlington Mall in Burlington, Massachusetts after being denied a permit from Willowbrook Mall in Wayne, New Jersey. From late February until mid-April, the mall and its stores were decorated with Christmas decorations, and there was a large prop ball-pit in the main foyer of the mall near the Sears branch, and a Santa's Village at the opposite end near the Macy's branch where the mall usually puts its own Santa's Village. Interior filming took place mostly at night. Some of the aerial stunts, such as Blart being attacked in the scenic elevator, were performed at the South Shore Plaza in Braintree, MA, as the Burlington Mall's construction did not allow for some of these stunts.", "question": "was mall cop filmed at mall of america?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "The 2018 UEFA Champions League Final was the final match of the 2017--18 UEFA Champions League, the 63rd season of Europe's premier club football tournament organised by UEFA, and the 26th season since it was renamed from the European Cup to the UEFA Champions League. It was played at the NSC Olimpiyskiy Stadium in Kiev, Ukraine on 26 May 2018, between Spanish side and defending champions Real Madrid, who had won the competition in each of the last two seasons, and English side Liverpool.", "question": "is the uefa champions league final one game?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "With the entry of the United States into World War II, several major league baseball executives started a new professional league with women players in order to maintain baseball in the public eye while the majority of able men were away. The founders included Philip K. Wrigley, Branch Rickey and Paul V. Harper. They feared that Major League Baseball might even temporarily cease due to the war because of the loss of talent, as well as restrictions on team travel due to gasoline rationing.", "question": "was there a women's baseball league during wwii?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "In International law a stateless person is someone who is ``not considered as a national by any state under the operation of its law''. Some stateless persons are also refugees. However, not all refugees are stateless, and many persons who are stateless have never crossed an international border.", "question": "question: can a person be a citizen of no country?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Get Rich or Die Tryin' is a 2005 American biopic crime film starring 50 Cent, in his feature film acting debut. It was released on November 9, 2005, and was known as Locked and Loaded during production. Similar to the 2002 Eminem film 8 Mile, which it used as a template, the film is loosely based on Cent's own life and was directed by Jim Sheridan. The name of the film is shared with 50 Cent's 2003 debut album of the same name.", "question": "is the movie get rich or die tryin based on 50 cent's life?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The passage supports a yes answer"}, {"id": "no", "text": "No: The passage supports a no answer or does not say"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "CSF glucose or glycorrhachia is a measurement used to determine the concentration of glucose in cerebrospinal fluid (CSF).", "question": "does cerebral spinal fluid have glucose in it?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "ticket:\n  channel: email\n  body: The character appears in various Marvel Cinematic Universe films, including The Avengers (2012), portrayed by Damion Poitier, and Guardians of the Galaxy (2014), Avengers: Age of Ultron (2015), Avengers: Infinity War (2018), and the fourth Avengers film (2019), portrayed by Josh Brolin through voice and motion capture. The character has appeared in various comic adaptations, including animated television series, arcade, and video games.", "question": "was thanos in the first guardians of the galaxy?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Cross listing of shares is when a firm lists its equity shares on one or more foreign stock exchange in addition to its domestic exchange. This concept is distinctly different than examples such as: American Depositary Receipt (ADR), European Depositary Receipt (EDR), global depository receipt (GDR) (also referred to as international depository receipt), and Global Registered Shares (GRS).", "question": "can a company be listed in different countries?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "document: In 2011, Polaris Industries purchased Indian Motorcycles and moved operations from North Carolina and merged them into their existing facilities in Minnesota and Iowa. Since August 2013, Polaris has marketed multiple modern Indian motorcycles that reflect Indian's traditional styling.", "question": "is the indian motorcycle made in united states?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Following consecutive losses to Mexico and Costa Rica in the opening games of the final round of qualification for the 2018 FIFA World Cup, Klinsmann was removed as national team coach and technical director and replaced by previous U.S. manager Bruce Arena. World Cup qualification resumed on March 24, 2017, where Arena and his team had a record 6--0 win over Honduras. Four days later, the team traveled to Panama City, drawing Panama 1--1. After beating Trinidad and Tobago 2--0, the U.S. got their third ever result in World Cup Qualification at the Estadio Azteca when they drew 1--1 against Mexico. In July 2017, the U.S. won their sixth CONCACAF Gold Cup with a 2--1 win over Jamaica in the final. Following an agonizing 2--1 defeat to Trinidad and Tobago on October 10, 2017, the U.S. failed to qualify for the 2018 World Cup, missing the tournament for the first time since 1986. On October 13, 2017, Arena resigned. Many pundits and analysts called this the worst result and worst performance in the history of the national team.", "question": "does us have a team in the world cup?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "boolq"}
{"request": {"context": "San Juan, as a settlement of the Spanish Empire, was used by merchant and military ships traveling from Spain as the first stopover in the Americas. Because of its prominence in the Caribbean, a network of fortifications was built to protect the transports of gold and silver from the New World to Europe. Because of the rich cargoes, San Juan became a target of the foreign powers of the time.", "question": "is san juan puerto rico in the caribbean?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "boolq"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Born to coach For the reason, with apologies to Michael Vick, look no further than the third-youngest head coach in the NFL. James Lawrence Mora, the son, is already starting to look suspiciously like father James Earnest", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Born to coach For the reason, with apologies to Michael Vick, look no further than the third-youngest head coach in the NFL. James Lawrence Mora, the son, is already starting to look suspiciously like father James Earnest", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Born to coach For the reason, with apologies to Michael Vick, look no further than the third-youngest head coach in the NFL. James Lawrence Mora, the son, is already starting to look suspiciously like father James Earnest", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Clijsters and Hewitt reach break point There are two consolations for disillusioned tennis romantics upset by yesterday #39;s news of the split of Lleyton Hewitt and Kim Clijsters four months before their scheduled marriage.", "question": "question: What is the topic of this article?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: email\n  body: Clijsters and Hewitt reach break point There are two consolations for disillusioned tennis romantics upset by yesterday #39;s news of the split of Lleyton Hewitt and Kim Clijsters four months before their scheduled marriage.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Clijsters and Hewitt reach break point There are two consolations for disillusioned tennis romantics upset by yesterday #39;s news of the split of Lleyton Hewitt and Kim Clijsters four months before their scheduled marriage.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Diesels, Hybrids Fated to Wed Two leading technologies used in fuel-efficient vehicles seem destined to unite. Industry experts say joining hybrid motors with diesel engines would result in the greenest mainstream vehicles ever, and the initial tests are promising.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Diesels, Hybrids Fated to Wed Two leading technologies used in fuel-efficient vehicles seem destined to unite. Industry experts say joining hybrid motors with diesel engines would result in the greenest mainstream vehicles ever, and the initial tests are promising.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Diesels, Hybrids Fated to Wed Two leading technologies used in fuel-efficient vehicles seem destined to unite. Industry experts say joining hybrid motors with diesel engines would result in the greenest mainstream vehicles ever, and the initial tests are promising.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Dollar Mired Near Lows Before Jobs Data  LONDON (Reuters) - The dollar teetered just above nine-year  lows on a trade-weighted basis on Friday as investors waited  for key U.S. jobs data before deciding whether to extend the  greenback's recent decline.", "question": "question: What is the topic of this article?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Dollar Mired Near Lows Before Jobs Data  LONDON (Reuters) - The dollar teetered just above nine-year  lows on a trade-weighted basis on Friday as investors waited  for key U.S. jobs data before deciding whether to extend the  greenback's recent decline.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Dollar Mired Near Lows Before Jobs Data  LONDON (Reuters) - The dollar teetered just above nine-year  lows on a trade-weighted basis on Friday as investors waited  for key U.S. jobs data before deciding whether to extend the  greenback's recent decline.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Lima gem ends LA drought Jose Lima came to the Los Angeles Dodgers in February as a journeyman pitcher with a 71-77 win-loss record, a 5.13 ERA and a reputation as one of baseball #39;s hot dogs.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "Lima gem ends LA drought Jose Lima came to the Los Angeles Dodgers in February as a journeyman pitcher with a 71-77 win-loss record, a 5.13 ERA and a reputation as one of baseball #39;s hot dogs.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Lima gem ends LA drought Jose Lima came to the Los Angeles Dodgers in February as a journeyman pitcher with a 71-77 win-loss record, a 5.13 ERA and a reputation as one of baseball #39;s hot dogs.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Intel cuts Pentium 4 prices The newest P4 chips drop in price by 18 percent to 35 percent; a host of other chips are cheaper now as well.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Intel cuts Pentium 4 prices The newest P4 chips drop in price by 18 percent to 35 percent; a host of other chips are cheaper now as well.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Intel cuts Pentium 4 prices The newest P4 chips drop in price by 18 percent to 35 percent; a host of other chips are cheaper now as well.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: U.S. Treasuries Inch Up, Await Data  LONDON (Reuters) - U.S. Treasury prices inched higher on  Friday, with a rally in Japanese government bond (JGB) prices  helping the market recover some ground from the previous day's  sell-off.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: U.S. Treasuries Inch Up, Await Data  LONDON (Reuters) - U.S. Treasury prices inched higher on  Friday, with a rally in Japanese government bond (JGB) prices  helping the market recover some ground from the previous day's  sell-off.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: U.S. Treasuries Inch Up, Await Data  LONDON (Reuters) - U.S. Treasury prices inched higher on  Friday, with a rally in Japanese government bond (JGB) prices  helping the market recover some ground from the previous day's  sell-off.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Calif. Aims to Limit Farm-Related Smog (AP) AP - Southern California's smog-fighting agency went after emissions of the bovine variety Friday, adopting the nation's first rules to reduce air pollution from dairy cow manure.", "question": "question: What is the topic of this article?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Calif. Aims to Limit Farm-Related Smog (AP) AP - Southern California's smog-fighting agency went after emissions of the bovine variety Friday, adopting the nation's first rules to reduce air pollution from dairy cow manure.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Calif. Aims to Limit Farm-Related Smog (AP) AP - Southern California's smog-fighting agency went after emissions of the bovine variety Friday, adopting the nation's first rules to reduce air pollution from dairy cow manure.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Md. Board Meeting Worries Democrats Republican-dominated election board met behind closed doors in deliberations that Democrats feared were aimed at ousting Elections Administrator Linda H. Lamone.<BR>\\<FONT face=\"verdana,MS Sans Serif,arial,helvetica\" size=\"-2\"\\ color=\"#666666\"><B>-The Washington Post</B></FONT>", "question": "question: What is the topic of this article?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Md. Board Meeting Worries Democrats Republican-dominated election board met behind closed doors in deliberations that Democrats feared were aimed at ousting Elections Administrator Linda H. Lamone.<BR>\\<FONT face=\"verdana,MS Sans Serif,arial,helvetica\" size=\"-2\"\\ color=\"#666666\"><B>-The Washington Post</B></FONT>", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Md. Board Meeting Worries Democrats Republican-dominated election board met behind closed doors in deliberations that Democrats feared were aimed at ousting Elections Administrator Linda H. Lamone.<BR>\\<FONT face=\"verdana,MS Sans Serif,arial,helvetica\" size=\"-2\"\\ color=\"#666666\"><B>-The Washington Post</B></FONT>", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Not exactly an idiotic idea This should give pause to anyone who thought the Red Sox might be interested in toning down their image as idiots: They've made a serious contract offer to David Wells.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Not exactly an idiotic idea This should give pause to anyone who thought the Red Sox might be interested in toning down their image as idiots: They've made a serious contract offer to David Wells.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Not exactly an idiotic idea This should give pause to anyone who thought the Red Sox might be interested in toning down their image as idiots: They've made a serious contract offer to David Wells.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "New Crew Prepares For Space Station Duty CAPE CANAVERAL, Fla. -- A new crew is aboard the International Space Station Wednesday preparing to take over command of the orbiting outpost.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "New Crew Prepares For Space Station Duty CAPE CANAVERAL, Fla. -- A new crew is aboard the International Space Station Wednesday preparing to take over command of the orbiting outpost.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "New Crew Prepares For Space Station Duty CAPE CANAVERAL, Fla. -- A new crew is aboard the International Space Station Wednesday preparing to take over command of the orbiting outpost.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: DEBKAfile Special Analysis Before deporting him to Lebanon in 1991, the late Yitzhak Rabin called Ezz-Eldin Sheikh al-Khalil the snakes head, singling him out as the terror master who raised and handled Hamas most accomplished terror operatives, Adnan al Hool and", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: DEBKAfile Special Analysis Before deporting him to Lebanon in 1991, the late Yitzhak Rabin called Ezz-Eldin Sheikh al-Khalil the snakes head, singling him out as the terror master who raised and handled Hamas most accomplished terror operatives, Adnan al Hool and", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: DEBKAfile Special Analysis Before deporting him to Lebanon in 1991, the late Yitzhak Rabin called Ezz-Eldin Sheikh al-Khalil the snakes head, singling him out as the terror master who raised and handled Hamas most accomplished terror operatives, Adnan al Hool and", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Vodafone Drops on Report It Supports Bid for Sprint (Update2) Shares in Vodafone Group Plc, the world #39;s largest mobile-phone operator, dropped after The Wall Street Journal said the company is considering bidding with US partner Verizon Communications Inc.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Vodafone Drops on Report It Supports Bid for Sprint (Update2) Shares in Vodafone Group Plc, the world #39;s largest mobile-phone operator, dropped after The Wall Street Journal said the company is considering bidding with US partner Verizon Communications Inc.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Vodafone Drops on Report It Supports Bid for Sprint (Update2) Shares in Vodafone Group Plc, the world #39;s largest mobile-phone operator, dropped after The Wall Street Journal said the company is considering bidding with US partner Verizon Communications Inc.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Hampton Start Is Pushed Back Again (AP) AP - Atlanta left-hander Mike Hampton was not able to pitch for the Braves on Wednesday, still bothered by a stiff neck that kept him out of his scheduled start Monday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "Hampton Start Is Pushed Back Again (AP) AP - Atlanta left-hander Mike Hampton was not able to pitch for the Braves on Wednesday, still bothered by a stiff neck that kept him out of his scheduled start Monday.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Hampton Start Is Pushed Back Again (AP) AP - Atlanta left-hander Mike Hampton was not able to pitch for the Braves on Wednesday, still bothered by a stiff neck that kept him out of his scheduled start Monday.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Microsoft offers SP2 compatibility guide Security-focused Windows XP update can be tough on applications. Guidelines are meant to help professionals \"test and mitigate.\"", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: email\n  body: Microsoft offers SP2 compatibility guide Security-focused Windows XP update can be tough on applications. Guidelines are meant to help professionals \"test and mitigate.\"", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Microsoft offers SP2 compatibility guide Security-focused Windows XP update can be tough on applications. Guidelines are meant to help professionals \"test and mitigate.\"", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Congressman Spratt wants Fed to US Representative John Spratt of South Carolina said the Federal Reserve should go lightly #39; #39; on raising the benchmark interest rate because of the economy.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Congressman Spratt wants Fed to US Representative John Spratt of South Carolina said the Federal Reserve should go lightly #39; #39; on raising the benchmark interest rate because of the economy.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Congressman Spratt wants Fed to US Representative John Spratt of South Carolina said the Federal Reserve should go lightly #39; #39; on raising the benchmark interest rate because of the economy.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Automakers work on fuel cell vehicles General Motors (GM) and Chinese partner Shanghai Automotive Industry Corp (SAIC) on Saturday signed a joint development and commercialization agreement on hybrid and fuel cell", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Automakers work on fuel cell vehicles General Motors (GM) and Chinese partner Shanghai Automotive Industry Corp (SAIC) on Saturday signed a joint development and commercialization agreement on hybrid and fuel cell", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Automakers work on fuel cell vehicles General Motors (GM) and Chinese partner Shanghai Automotive Industry Corp (SAIC) on Saturday signed a joint development and commercialization agreement on hybrid and fuel cell", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Falcons not cruising at 4-0; they #39;re working Jim Mora thought his team deserved a little something special. His Atlanta Falcons, with a thorough 27-10 pounding of the Carolina Panthers, had just extended their record to 4-0 for the first time since 1986.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Falcons not cruising at 4-0; they #39;re working Jim Mora thought his team deserved a little something special. His Atlanta Falcons, with a thorough 27-10 pounding of the Carolina Panthers, had just extended their record to 4-0 for the first time since 1986.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Falcons not cruising at 4-0; they #39;re working Jim Mora thought his team deserved a little something special. His Atlanta Falcons, with a thorough 27-10 pounding of the Carolina Panthers, had just extended their record to 4-0 for the first time since 1986.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "FDA stifled dangerous Vioxx results - expert Washington - An expert with the United States Food and Drug Administration (FDA) has said on Thursday he was pressured by his agency to stifle study results showing the potential dangers of the anti-inflammatory drug Vioxx.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "FDA stifled dangerous Vioxx results - expert Washington - An expert with the United States Food and Drug Administration (FDA) has said on Thursday he was pressured by his agency to stifle study results showing the potential dangers of the anti-inflammatory drug Vioxx.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "FDA stifled dangerous Vioxx results - expert Washington - An expert with the United States Food and Drug Administration (FDA) has said on Thursday he was pressured by his agency to stifle study results showing the potential dangers of the anti-inflammatory drug Vioxx.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Cheney: Kerry 'Wrong Choice' for President (AP) AP - Vice President Dick Cheney said Tuesday that the nation faces the threat of another terrorist attack if voters make the \"wrong choice\" on Election Day, suggesting that Sen. John Kerry would follow a pre-Sept. 11 policy of reacting defensively.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Cheney: Kerry 'Wrong Choice' for President (AP) AP - Vice President Dick Cheney said Tuesday that the nation faces the threat of another terrorist attack if voters make the \"wrong choice\" on Election Day, suggesting that Sen. John Kerry would follow a pre-Sept. 11 policy of reacting defensively.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Cheney: Kerry 'Wrong Choice' for President (AP) AP - Vice President Dick Cheney said Tuesday that the nation faces the threat of another terrorist attack if voters make the \"wrong choice\" on Election Day, suggesting that Sen. John Kerry would follow a pre-Sept. 11 policy of reacting defensively.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Same-sex divorce rules still hazy Now that an Ontario couple has been given Canada #39;s first same-sex divorce, experts are divided over just how easy it will be for gays and lesbians in other provinces to end their marriages.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Same-sex divorce rules still hazy Now that an Ontario couple has been given Canada #39;s first same-sex divorce, experts are divided over just how easy it will be for gays and lesbians in other provinces to end their marriages.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Same-sex divorce rules still hazy Now that an Ontario couple has been given Canada #39;s first same-sex divorce, experts are divided over just how easy it will be for gays and lesbians in other provinces to end their marriages.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Schrder adopts Russian orphan Three-year-old Victoria, from St Petersburg, has been living at the Schrders #39; family home in Hanover in northern Germany for several weeks.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Schrder adopts Russian orphan Three-year-old Victoria, from St Petersburg, has been living at the Schrders #39; family home in Hanover in northern Germany for several weeks.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Schrder adopts Russian orphan Three-year-old Victoria, from St Petersburg, has been living at the Schrders #39; family home in Hanover in northern Germany for several weeks.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "3 police officials charged over Beslan siege ROSTOV-ON-DON, RUSSIA - Three Russian police officers have been charged with criminal negligence in connection with the Beslan school hostage-taking that left 360 people dead, almost half of them children.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "3 police officials charged over Beslan siege ROSTOV-ON-DON, RUSSIA - Three Russian police officers have been charged with criminal negligence in connection with the Beslan school hostage-taking that left 360 people dead, almost half of them children.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "3 police officials charged over Beslan siege ROSTOV-ON-DON, RUSSIA - Three Russian police officers have been charged with criminal negligence in connection with the Beslan school hostage-taking that left 360 people dead, almost half of them children.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "A9 Offers Search Results From Five Sources A9 Offers Search Results From Five Sources\\\\A9, the search engine from Amazon.com, has relaunched its search engine. It now offers search results from several different sources, including the IMDB and of course, Amazon.com. \\\\I decided to search for Duke Ellington. \"Duke Ellington\" brought about 156,000 results (less than half the ...", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "A9 Offers Search Results From Five Sources A9 Offers Search Results From Five Sources\\\\A9, the search engine from Amazon.com, has relaunched its search engine. It now offers search results from several different sources, including the IMDB and of course, Amazon.com. \\\\I decided to search for Duke Ellington. \"Duke Ellington\" brought about 156,000 results (less than half the ...", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "A9 Offers Search Results From Five Sources A9 Offers Search Results From Five Sources\\\\A9, the search engine from Amazon.com, has relaunched its search engine. It now offers search results from several different sources, including the IMDB and of course, Amazon.com. \\\\I decided to search for Duke Ellington. \"Duke Ellington\" brought about 156,000 results (less than half the ...", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "FCC says allowing cable TV subscribers to choose their channels <b>...</b> Federal regulators rejected on Friday the idea that allowing cable TV subscribers to pay only for channels they want would lower high cable bills.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "FCC says allowing cable TV subscribers to choose their channels <b>...</b> Federal regulators rejected on Friday the idea that allowing cable TV subscribers to pay only for channels they want would lower high cable bills.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "FCC says allowing cable TV subscribers to choose their channels <b>...</b> Federal regulators rejected on Friday the idea that allowing cable TV subscribers to pay only for channels they want would lower high cable bills.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "EA Signs Five-Year Exclusive NFL Deal Electronic Arts announced an exclusive licensing relationships with the National Football League and PLAYERS INC to develop, publish and distribute interactive football games.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "EA Signs Five-Year Exclusive NFL Deal Electronic Arts announced an exclusive licensing relationships with the National Football League and PLAYERS INC to develop, publish and distribute interactive football games.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "EA Signs Five-Year Exclusive NFL Deal Electronic Arts announced an exclusive licensing relationships with the National Football League and PLAYERS INC to develop, publish and distribute interactive football games.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Study: 39 Million Americans In Working Poor Families WASHINGTON -- A new report indicates that one in every five US jobs pays less than a poverty-level wage for a family of four. As a result, nearly 39 million Americans, including 20 million children, are members", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Study: 39 Million Americans In Working Poor Families WASHINGTON -- A new report indicates that one in every five US jobs pays less than a poverty-level wage for a family of four. As a result, nearly 39 million Americans, including 20 million children, are members", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Study: 39 Million Americans In Working Poor Families WASHINGTON -- A new report indicates that one in every five US jobs pays less than a poverty-level wage for a family of four. As a result, nearly 39 million Americans, including 20 million children, are members", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Steelers Look Super The Steelers have all the ingredients to make a run for their fifth Super Bowl title while the NFC trots out its weakest set of challengers in memory.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "Steelers Look Super The Steelers have all the ingredients to make a run for their fifth Super Bowl title while the NFC trots out its weakest set of challengers in memory.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Steelers Look Super The Steelers have all the ingredients to make a run for their fifth Super Bowl title while the NFC trots out its weakest set of challengers in memory.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Is Apple Photogenic? With competitors avidly trying to nibble at the iPod #39;s market share, Apple (Nasdaq: AAPL) has released its ostensibly new and improved version.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Is Apple Photogenic? With competitors avidly trying to nibble at the iPod #39;s market share, Apple (Nasdaq: AAPL) has released its ostensibly new and improved version.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Is Apple Photogenic? With competitors avidly trying to nibble at the iPod #39;s market share, Apple (Nasdaq: AAPL) has released its ostensibly new and improved version.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: First credit rating for Serbia  19:50 November 01  Dow Jones LONDON -- Monday -- Serbia reached a milestone on the road to economic stability Monday, as its first-ever credit rating opened the way for a return to international credit markets.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: email\n  body: First credit rating for Serbia  19:50 November 01  Dow Jones LONDON -- Monday -- Serbia reached a milestone on the road to economic stability Monday, as its first-ever credit rating opened the way for a return to international credit markets.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: First credit rating for Serbia  19:50 November 01  Dow Jones LONDON -- Monday -- Serbia reached a milestone on the road to economic stability Monday, as its first-ever credit rating opened the way for a return to international credit markets.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Comcast Posts Smaller 3Q Profit Cable giant Comcast Corp. on Wednesday posted a smaller third-quarter profit that missed Wall Street expectations, but said digital cable and high-speed Internet subscriptions continued to grow during the period.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Comcast Posts Smaller 3Q Profit Cable giant Comcast Corp. on Wednesday posted a smaller third-quarter profit that missed Wall Street expectations, but said digital cable and high-speed Internet subscriptions continued to grow during the period.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Comcast Posts Smaller 3Q Profit Cable giant Comcast Corp. on Wednesday posted a smaller third-quarter profit that missed Wall Street expectations, but said digital cable and high-speed Internet subscriptions continued to grow during the period.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Nepal Seeks Talks to End Rebel Blockade of Capital  KATHMANDU (Reuters) - The fear of attack kept most vehicles  off roads leading to Nepal's capital for a second day on  Thursday as authorities sought talks to end a siege called by  Maoist insurgents.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Nepal Seeks Talks to End Rebel Blockade of Capital  KATHMANDU (Reuters) - The fear of attack kept most vehicles  off roads leading to Nepal's capital for a second day on  Thursday as authorities sought talks to end a siege called by  Maoist insurgents.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Nepal Seeks Talks to End Rebel Blockade of Capital  KATHMANDU (Reuters) - The fear of attack kept most vehicles  off roads leading to Nepal's capital for a second day on  Thursday as authorities sought talks to end a siege called by  Maoist insurgents.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Update 1: Ex-Ahold CEO Says He #39;s Settled With SEC Global grocery retailer Ahold NV and its former chief executive have reached settlements with the US Securities and Exchange Commission over charges related to a \\$1 billion overstatement of earnings, they said Wednesday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Update 1: Ex-Ahold CEO Says He #39;s Settled With SEC Global grocery retailer Ahold NV and its former chief executive have reached settlements with the US Securities and Exchange Commission over charges related to a \\$1 billion overstatement of earnings, they said Wednesday.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Update 1: Ex-Ahold CEO Says He #39;s Settled With SEC Global grocery retailer Ahold NV and its former chief executive have reached settlements with the US Securities and Exchange Commission over charges related to a \\$1 billion overstatement of earnings, they said Wednesday.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Symantec warns of weakness in its firewall and gateway products Security specialist Symantec has admitted to a number of vulnerabilities in its firewall and gateway products. The weaknesses make them liable to denial of service attacks and other compromises.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Symantec warns of weakness in its firewall and gateway products Security specialist Symantec has admitted to a number of vulnerabilities in its firewall and gateway products. The weaknesses make them liable to denial of service attacks and other compromises.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Symantec warns of weakness in its firewall and gateway products Security specialist Symantec has admitted to a number of vulnerabilities in its firewall and gateway products. The weaknesses make them liable to denial of service attacks and other compromises.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Oil Companies In Nigeria Say They Won #39;t Give In To Threats Major oil companies operating in Nigeria #39;s oil-rich southern region say they will not give in to threats of attacks on their facilities and employees by militias.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: what: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Oil Companies In Nigeria Say They Won #39;t Give In To Threats Major oil companies operating in Nigeria #39;s oil-rich southern region say they will not give in to threats of attacks on their facilities and employees by militias.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Oil Companies In Nigeria Say They Won #39;t Give In To Threats Major oil companies operating in Nigeria #39;s oil-rich southern region say they will not give in to threats of attacks on their facilities and employees by militias.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "SAP software exposes shipper's financial errors The installation of SAP financial software at a major London-based container transport firm exposed flaws in the company's accounting systems and processes, forcing it to restate its earnings.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "SAP software exposes shipper's financial errors The installation of SAP financial software at a major London-based container transport firm exposed flaws in the company's accounting systems and processes, forcing it to restate its earnings.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "SAP software exposes shipper's financial errors The installation of SAP financial software at a major London-based container transport firm exposed flaws in the company's accounting systems and processes, forcing it to restate its earnings.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Sudan agrees peace plan after Blair sets deadline Sudan agreed to a five-point peace plan for the war-torn region of Darfur yesterday after Tony Blair set a three-month deadline for an end to the long-running conflict.", "question": "question: What is the topic of this article?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Sudan agrees peace plan after Blair sets deadline Sudan agreed to a five-point peace plan for the war-torn region of Darfur yesterday after Tony Blair set a three-month deadline for an end to the long-running conflict.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Sudan agrees peace plan after Blair sets deadline Sudan agreed to a five-point peace plan for the war-torn region of Darfur yesterday after Tony Blair set a three-month deadline for an end to the long-running conflict.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Cash America shuffles assets, sets special dividend WASHINGTON (CBS.MW) -- Cash America International (PWN) said it #39;s reached a deal to acquire privately owned SuperPawn, operator of a 41-store chain of pawn shops in the US including 21 locations in Las Vegas.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: what: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Cash America shuffles assets, sets special dividend WASHINGTON (CBS.MW) -- Cash America International (PWN) said it #39;s reached a deal to acquire privately owned SuperPawn, operator of a 41-store chain of pawn shops in the US including 21 locations in Las Vegas.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Cash America shuffles assets, sets special dividend WASHINGTON (CBS.MW) -- Cash America International (PWN) said it #39;s reached a deal to acquire privately owned SuperPawn, operator of a 41-store chain of pawn shops in the US including 21 locations in Las Vegas.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: \\$70 Billion Increase in War Funding Sought The Bush administration intends to seek the emergency funding for the wars in Iraq and Afghanistan early next year, officials said on Monday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: \\$70 Billion Increase in War Funding Sought The Bush administration intends to seek the emergency funding for the wars in Iraq and Afghanistan early next year, officials said on Monday.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: \\$70 Billion Increase in War Funding Sought The Bush administration intends to seek the emergency funding for the wars in Iraq and Afghanistan early next year, officials said on Monday.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Coalition asks US Congress to kill copyright bill WASHINGTON - A coalition of technology and advocacy groups on Friday asked the U.S. Senate to kill copyright legislation that might result in jail time for people who trade copyrighted files online.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Coalition asks US Congress to kill copyright bill WASHINGTON - A coalition of technology and advocacy groups on Friday asked the U.S. Senate to kill copyright legislation that might result in jail time for people who trade copyrighted files online.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Coalition asks US Congress to kill copyright bill WASHINGTON - A coalition of technology and advocacy groups on Friday asked the U.S. Senate to kill copyright legislation that might result in jail time for people who trade copyrighted files online.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Yukos warns it oil output is lagging Beleaguered Russian energy giant Yukos has warned that it will not produce as much oil as expected this year. It blames bailiffs who are draining its bank accounts to pay its potentially ruinous tax bill.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Yukos warns it oil output is lagging Beleaguered Russian energy giant Yukos has warned that it will not produce as much oil as expected this year. It blames bailiffs who are draining its bank accounts to pay its potentially ruinous tax bill.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Yukos warns it oil output is lagging Beleaguered Russian energy giant Yukos has warned that it will not produce as much oil as expected this year. It blames bailiffs who are draining its bank accounts to pay its potentially ruinous tax bill.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "China wary at Taiwan poll result China's media responds cautiously to the election setback suffered by Taiwan's pro-independence DPP.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "China wary at Taiwan poll result China's media responds cautiously to the election setback suffered by Taiwan's pro-independence DPP.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "China wary at Taiwan poll result China's media responds cautiously to the election setback suffered by Taiwan's pro-independence DPP.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Mr Downer shoots his mouth off Just what Alexander Downer was thinking when he declared on radio last Friday that  quot;they could fire a missile from North Korea to Sydney quot; is unclear. The provocative remark, just days before his arrival yesterday on his second visit to the North Korean ...", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: email\n  body: Mr Downer shoots his mouth off Just what Alexander Downer was thinking when he declared on radio last Friday that  quot;they could fire a missile from North Korea to Sydney quot; is unclear. The provocative remark, just days before his arrival yesterday on his second visit to the North Korean ...", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Mr Downer shoots his mouth off Just what Alexander Downer was thinking when he declared on radio last Friday that  quot;they could fire a missile from North Korea to Sydney quot; is unclear. The provocative remark, just days before his arrival yesterday on his second visit to the North Korean ...", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Two Wizards face possible suspensions The Washington Wizards #39; Brendan Haywood and Larry Hughes could face suspensions for their part in a fight during Monday night #39;s preseason game against the Bulls in Chicago.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Two Wizards face possible suspensions The Washington Wizards #39; Brendan Haywood and Larry Hughes could face suspensions for their part in a fight during Monday night #39;s preseason game against the Bulls in Chicago.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Two Wizards face possible suspensions The Washington Wizards #39; Brendan Haywood and Larry Hughes could face suspensions for their part in a fight during Monday night #39;s preseason game against the Bulls in Chicago.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Governor #39;s proposal: New game, same strategy If Gov. Rod Blagojevich #39;s proposal to crack down on violent video game sales sounds familiar, look no further than the man he beat to become Illinois #39; chief executive.", "question": "question: What is the topic of this article?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Governor #39;s proposal: New game, same strategy If Gov. Rod Blagojevich #39;s proposal to crack down on violent video game sales sounds familiar, look no further than the man he beat to become Illinois #39; chief executive.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Governor #39;s proposal: New game, same strategy If Gov. Rod Blagojevich #39;s proposal to crack down on violent video game sales sounds familiar, look no further than the man he beat to become Illinois #39; chief executive.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Kmart to Sell 18 Stores to Home Depot  NEW YORK (Reuters) - Retailer Kmart Holdings Corp. <A HREF=\"http://www.investor.reuters.com/FullQuote.aspx?ticker=KMRT.O target=/stocks/quickinfo/fullquote\">KMRT.O</A>  on Monday said it finalized a deal to sell 18 of its stores to  Home Depot Inc. <A HREF=\"http://www.investor.reuters.com/FullQuote.aspx?ticker=HD.N target=/stocks/quickinfo/fullquote\">HD.N</A> for \\$271 million.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: what: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Kmart to Sell 18 Stores to Home Depot  NEW YORK (Reuters) - Retailer Kmart Holdings Corp. <A HREF=\"http://www.investor.reuters.com/FullQuote.aspx?ticker=KMRT.O target=/stocks/quickinfo/fullquote\">KMRT.O</A>  on Monday said it finalized a deal to sell 18 of its stores to  Home Depot Inc. <A HREF=\"http://www.investor.reuters.com/FullQuote.aspx?ticker=HD.N target=/stocks/quickinfo/fullquote\">HD.N</A> for \\$271 million.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Kmart to Sell 18 Stores to Home Depot  NEW YORK (Reuters) - Retailer Kmart Holdings Corp. <A HREF=\"http://www.investor.reuters.com/FullQuote.aspx?ticker=KMRT.O target=/stocks/quickinfo/fullquote\">KMRT.O</A>  on Monday said it finalized a deal to sell 18 of its stores to  Home Depot Inc. <A HREF=\"http://www.investor.reuters.com/FullQuote.aspx?ticker=HD.N target=/stocks/quickinfo/fullquote\">HD.N</A> for \\$271 million.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Dell Offers SUSE on Servers Dell (Quote, Chart) officials announced Wednesday an agreement with Linux distributor Novell (Quote, Chart) to distribute and support SUSE Enterprise Server 9 on its single- and dual-processor line of servers.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Dell Offers SUSE on Servers Dell (Quote, Chart) officials announced Wednesday an agreement with Linux distributor Novell (Quote, Chart) to distribute and support SUSE Enterprise Server 9 on its single- and dual-processor line of servers.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Dell Offers SUSE on Servers Dell (Quote, Chart) officials announced Wednesday an agreement with Linux distributor Novell (Quote, Chart) to distribute and support SUSE Enterprise Server 9 on its single- and dual-processor line of servers.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Russian atmosphere hard for Westerners The government has eviscerated Russia #39;s Western-style oil company, Yukos, in what has been widely viewed as political payback.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Russian atmosphere hard for Westerners The government has eviscerated Russia #39;s Western-style oil company, Yukos, in what has been widely viewed as political payback.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Russian atmosphere hard for Westerners The government has eviscerated Russia #39;s Western-style oil company, Yukos, in what has been widely viewed as political payback.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Banks seek court ruling over F1 Three banks go to the High Court in London seeking a ruling which could lead to Bernie Ecclestone losing control of Formula One racing.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Banks seek court ruling over F1 Three banks go to the High Court in London seeking a ruling which could lead to Bernie Ecclestone losing control of Formula One racing.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Banks seek court ruling over F1 Three banks go to the High Court in London seeking a ruling which could lead to Bernie Ecclestone losing control of Formula One racing.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Ancelotti demands more from  #39;world #39;s best defence #39; AC Milan coach Carlo Ancelotti said he expects better from his defence after the shock 2-1 home defeat to promoted Messina on Wednesday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "Ancelotti demands more from  #39;world #39;s best defence #39; AC Milan coach Carlo Ancelotti said he expects better from his defence after the shock 2-1 home defeat to promoted Messina on Wednesday.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Ancelotti demands more from  #39;world #39;s best defence #39; AC Milan coach Carlo Ancelotti said he expects better from his defence after the shock 2-1 home defeat to promoted Messina on Wednesday.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Intel slashes Itanium prices as Madison looms Intel has slashed prices across the board as it prepares to get behind new processor lines due this autumn. The Itanium server line has seen cuts of over 30 per cent, while prices for Intel #39;s fastest business", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Intel slashes Itanium prices as Madison looms Intel has slashed prices across the board as it prepares to get behind new processor lines due this autumn. The Itanium server line has seen cuts of over 30 per cent, while prices for Intel #39;s fastest business", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Intel slashes Itanium prices as Madison looms Intel has slashed prices across the board as it prepares to get behind new processor lines due this autumn. The Itanium server line has seen cuts of over 30 per cent, while prices for Intel #39;s fastest business", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Charges reduced for Iraq jail MP MANNHEIM, Germany -- A US military policewoman accused in the Abu Ghraib prison abuse scandal had the charges against her reduced yesterday as a set of pretrial hearings wrapped up at an American base in Germany.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Charges reduced for Iraq jail MP MANNHEIM, Germany -- A US military policewoman accused in the Abu Ghraib prison abuse scandal had the charges against her reduced yesterday as a set of pretrial hearings wrapped up at an American base in Germany.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Charges reduced for Iraq jail MP MANNHEIM, Germany -- A US military policewoman accused in the Abu Ghraib prison abuse scandal had the charges against her reduced yesterday as a set of pretrial hearings wrapped up at an American base in Germany.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: HP Shifting Last of Itanium Engineers Hewlett-Packard Co. (HPQ.N: Quote, Profile, Research) and Intel Corp. (INTC.O: Quote, Profile, Research) on Wednesday ended their 10-year partnership to co-develop the Itanium chip", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: HP Shifting Last of Itanium Engineers Hewlett-Packard Co. (HPQ.N: Quote, Profile, Research) and Intel Corp. (INTC.O: Quote, Profile, Research) on Wednesday ended their 10-year partnership to co-develop the Itanium chip", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: HP Shifting Last of Itanium Engineers Hewlett-Packard Co. (HPQ.N: Quote, Profile, Research) and Intel Corp. (INTC.O: Quote, Profile, Research) on Wednesday ended their 10-year partnership to co-develop the Itanium chip", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Inter Milan #39;s Adriano apologises for dismissal Inter Milan striker Adriano has asked fans to forgive him after he was sent-off in the 0-0 draw against Valencia on Tuesday night.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "Inter Milan #39;s Adriano apologises for dismissal Inter Milan striker Adriano has asked fans to forgive him after he was sent-off in the 0-0 draw against Valencia on Tuesday night.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Inter Milan #39;s Adriano apologises for dismissal Inter Milan striker Adriano has asked fans to forgive him after he was sent-off in the 0-0 draw against Valencia on Tuesday night.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Montgomerie, Woods, Furyk Tied at Target (AP) AP - Colin Montgomerie was thrilled to get an invitation from Tiger Woods to play in his year-end tournament with 15 of the best players in golf. Even better was matching Woods' score.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Montgomerie, Woods, Furyk Tied at Target (AP) AP - Colin Montgomerie was thrilled to get an invitation from Tiger Woods to play in his year-end tournament with 15 of the best players in golf. Even better was matching Woods' score.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Montgomerie, Woods, Furyk Tied at Target (AP) AP - Colin Montgomerie was thrilled to get an invitation from Tiger Woods to play in his year-end tournament with 15 of the best players in golf. Even better was matching Woods' score.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Google scores first-day bump of 18 (USATODAY.com) USATODAY.com - Even a big first-day jump in shares of Google (GOOG) couldn't quiet debate over whether the Internet search engine's contentious auction was a hit or a flop.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Google scores first-day bump of 18 (USATODAY.com) USATODAY.com - Even a big first-day jump in shares of Google (GOOG) couldn't quiet debate over whether the Internet search engine's contentious auction was a hit or a flop.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Google scores first-day bump of 18 (USATODAY.com) USATODAY.com - Even a big first-day jump in shares of Google (GOOG) couldn't quiet debate over whether the Internet search engine's contentious auction was a hit or a flop.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "It may be end of line for narrow track Hurricane forecasters debate the usefulness of the  quot;skinny line quot; in tracking maps, and look at more accurate alternatives.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "It may be end of line for narrow track Hurricane forecasters debate the usefulness of the  quot;skinny line quot; in tracking maps, and look at more accurate alternatives.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "It may be end of line for narrow track Hurricane forecasters debate the usefulness of the  quot;skinny line quot; in tracking maps, and look at more accurate alternatives.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: British Airways to shed Qantas londonBritish Airways Plc, Europe #39;s second-biggest airline, will sell its 18 per cent stake in Qantas Airways Ltd. worth 427 million or about \\$980 million (Canadian) to cut debt ahead of possible acquisitions in Europe.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: British Airways to shed Qantas londonBritish Airways Plc, Europe #39;s second-biggest airline, will sell its 18 per cent stake in Qantas Airways Ltd. worth 427 million or about \\$980 million (Canadian) to cut debt ahead of possible acquisitions in Europe.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: British Airways to shed Qantas londonBritish Airways Plc, Europe #39;s second-biggest airline, will sell its 18 per cent stake in Qantas Airways Ltd. worth 427 million or about \\$980 million (Canadian) to cut debt ahead of possible acquisitions in Europe.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Dyke reopens WMD row Former BBC chief Greg Dyke has reopened the row over Tony Blair #39;s decision to go to war with Iraq. Dyke was forced to resign from his post, along with former BBC chairman Gavyn Davies, last January after Lord", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Dyke reopens WMD row Former BBC chief Greg Dyke has reopened the row over Tony Blair #39;s decision to go to war with Iraq. Dyke was forced to resign from his post, along with former BBC chairman Gavyn Davies, last January after Lord", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Dyke reopens WMD row Former BBC chief Greg Dyke has reopened the row over Tony Blair #39;s decision to go to war with Iraq. Dyke was forced to resign from his post, along with former BBC chairman Gavyn Davies, last January after Lord", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Friday is all right for fighting Tonight will be a busy one on the local fight scene with two cards. At the Bayside Expo Center, Ray Oliveira will take on Hicklet Lau for the vacant International Boxing Union welterweight title. On the same card, heavyweight prospect Matt Godfrey (4-0, 2 KOs) of Providence will face Andrew Hutchinson.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Friday is all right for fighting Tonight will be a busy one on the local fight scene with two cards. At the Bayside Expo Center, Ray Oliveira will take on Hicklet Lau for the vacant International Boxing Union welterweight title. On the same card, heavyweight prospect Matt Godfrey (4-0, 2 KOs) of Providence will face Andrew Hutchinson.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Friday is all right for fighting Tonight will be a busy one on the local fight scene with two cards. At the Bayside Expo Center, Ray Oliveira will take on Hicklet Lau for the vacant International Boxing Union welterweight title. On the same card, heavyweight prospect Matt Godfrey (4-0, 2 KOs) of Providence will face Andrew Hutchinson.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Toronto Raptors Team Report - November 20 (Sports Network) - The Toronto Raptors found themselves on the wrong end of a 101-94 decision against the red-hot Seattle SuperSonics on Friday at the Air Canada Centre.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "Toronto Raptors Team Report - November 20 (Sports Network) - The Toronto Raptors found themselves on the wrong end of a 101-94 decision against the red-hot Seattle SuperSonics on Friday at the Air Canada Centre.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Toronto Raptors Team Report - November 20 (Sports Network) - The Toronto Raptors found themselves on the wrong end of a 101-94 decision against the red-hot Seattle SuperSonics on Friday at the Air Canada Centre.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Disgraced Greek Sprinters Drug Tested by WADA  ATHENS (Reuters) - Greek sprinters Costas Kenteris and  Katerina Thanou have been dope tested by doctors from the World  Anti-Doping Agency, an official said Tuesday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "Disgraced Greek Sprinters Drug Tested by WADA  ATHENS (Reuters) - Greek sprinters Costas Kenteris and  Katerina Thanou have been dope tested by doctors from the World  Anti-Doping Agency, an official said Tuesday.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Disgraced Greek Sprinters Drug Tested by WADA  ATHENS (Reuters) - Greek sprinters Costas Kenteris and  Katerina Thanou have been dope tested by doctors from the World  Anti-Doping Agency, an official said Tuesday.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Microsoft Now Leads in PDA, Embedded OS Two new studies show Microsoft (Quote, Chart) is now leading both the embedded operating system category as well as in PDAs. According to statistics by research firm Gartner (Quote, Chart), Microsoft #39;s Windows", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Microsoft Now Leads in PDA, Embedded OS Two new studies show Microsoft (Quote, Chart) is now leading both the embedded operating system category as well as in PDAs. According to statistics by research firm Gartner (Quote, Chart), Microsoft #39;s Windows", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Microsoft Now Leads in PDA, Embedded OS Two new studies show Microsoft (Quote, Chart) is now leading both the embedded operating system category as well as in PDAs. According to statistics by research firm Gartner (Quote, Chart), Microsoft #39;s Windows", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Japan GDP Hurts Yen, U.S. Trade Data Eyed  LONDON (Reuters) - The yen fell against other major  currencies on Friday on a surprising downward revision to  Japanese growth, while the dollar hit three-week lows against  the euro on worries about the U.S. trade deficit.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Japan GDP Hurts Yen, U.S. Trade Data Eyed  LONDON (Reuters) - The yen fell against other major  currencies on Friday on a surprising downward revision to  Japanese growth, while the dollar hit three-week lows against  the euro on worries about the U.S. trade deficit.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Japan GDP Hurts Yen, U.S. Trade Data Eyed  LONDON (Reuters) - The yen fell against other major  currencies on Friday on a surprising downward revision to  Japanese growth, while the dollar hit three-week lows against  the euro on worries about the U.S. trade deficit.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Google and Microsft Getting Close Google and Microsft Getting Close\\\\Microsoft partnering with Google? Well sort of, an article released yesterday details the relationship between the two, and the use of Google Deskbar in Microsoft's Partner Pack for Windows, \"a collection of Microsoft and third-party products released last week that Microsoft describes on its Web site ...", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Google and Microsft Getting Close Google and Microsft Getting Close\\\\Microsoft partnering with Google? Well sort of, an article released yesterday details the relationship between the two, and the use of Google Deskbar in Microsoft's Partner Pack for Windows, \"a collection of Microsoft and third-party products released last week that Microsoft describes on its Web site ...", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Google and Microsft Getting Close Google and Microsft Getting Close\\\\Microsoft partnering with Google? Well sort of, an article released yesterday details the relationship between the two, and the use of Google Deskbar in Microsoft's Partner Pack for Windows, \"a collection of Microsoft and third-party products released last week that Microsoft describes on its Web site ...", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Minn. Test Drives New License Technology (AP) AP - Minnesota next week will begin issuing a first-of-its-kind driver's license designed to thwart counterfeiters  #151; an issue that has taken on greater urgency since the Sept. 11 attacks.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Minn. Test Drives New License Technology (AP) AP - Minnesota next week will begin issuing a first-of-its-kind driver's license designed to thwart counterfeiters  #151; an issue that has taken on greater urgency since the Sept. 11 attacks.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Minn. Test Drives New License Technology (AP) AP - Minnesota next week will begin issuing a first-of-its-kind driver's license designed to thwart counterfeiters  #151; an issue that has taken on greater urgency since the Sept. 11 attacks.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Haywood suspended for three games NEW YORK - Brendan Haywood of the Washington Wizards was suspended for three games by the NBA yesterday for fighting during a pre-season game against the Chicago Bulls.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: email\n  body: Haywood suspended for three games NEW YORK - Brendan Haywood of the Washington Wizards was suspended for three games by the NBA yesterday for fighting during a pre-season game against the Chicago Bulls.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Haywood suspended for three games NEW YORK - Brendan Haywood of the Washington Wizards was suspended for three games by the NBA yesterday for fighting during a pre-season game against the Chicago Bulls.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Today's schedule College soccer: MEN -- Curry at Emerson, 4 p.m.; WOMEN -- Mount Ida at Curry, 3:30 p.m.", "question": "question: What is the topic of this article?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: email\n  body: Today's schedule College soccer: MEN -- Curry at Emerson, 4 p.m.; WOMEN -- Mount Ida at Curry, 3:30 p.m.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: Today's schedule College soccer: MEN -- Curry at Emerson, 4 p.m.; WOMEN -- Mount Ida at Curry, 3:30 p.m.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "In addition, special service areas are funded for two populations with special needs - Native Americans and migrant workers.", "question": "Hypothesis: \"Native Americans and migrant workers do not have any special areas. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "agencies' operating trust, enterprise and internal service funds) are required to produce auditable financial statements.", "question": "Hypothesis: \"Agencies have no operating trust and produce little to no auditable financial statements.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "Kicked out of the house when she was only 16 (she was called Suzie in those days), Roy went to Delhi and then to architecture school, supporting herself by selling empty milk bottles (some say beer bottles).", "question": "Hypothesis: \"Roy was given thousands of dollars.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "okay movies i've i haven't seen too many lately i have kids and we went and saw The Rescuers Down Under over the the break do do you have kids you take to movies or", "question": "Hypothesis: \"I took my kids to see the movie The Rescuers Down Under.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: When Jesus was born in about 4 b.c. , Joseph and Mary escaped Herod's paranoia by fleeing into Egypt with the new-born infant.", "question": "question: Hypothesis: \"The flight to Egypt and the precise timeline have been debated by historians for centuries.\" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "For a half millennium or more, Madrid idled as a provincial backwater, rarely noticed on the arid central plains of Castile, until Felipe II plucked it from his royal cap in 1561 and proclaimed it the capital of Spain.", "question": "Hypothesis: \"After Madrid became the capital of Spain, there were massive economic advantages for the region.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "In that case, price discrimination can survive.", "question": "Hypothesis: \"In that circumstance, discrimination in price is fine.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "The bridge would work for a very short time but the stream isn't a clear defense.", "question": "Hypothesis: \"The bridge would work temporarily.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Bars with views and live music include Sky Lounge in the Sheraton Hotel and Towers, Tsim Sha Tsui; and Cyrano in the Island Shangri-La in Pacific Place.", "question": "Hypothesis: \"It is not far to go to find good drink, gorgeous views, and live music. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "No, I exclaimed, astonished.", "question": "Hypothesis: \"\"No!\" I cried out in shock. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Also, other sorbent-based approaches in development may prove in time to be preferable to ACI, making the use of ACI only a conservative assumption.", "question": "Hypothesis: \"Sorbent-based approaches in development may be preferable to ACl.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "According to Jane Langmuir, director of the project, water and heat come together and create a totally new appliance.", "question": "Hypothesis: \"Jane Langmuir was the one who conceived of this project.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: email\n  body: The draft treaty was Tommy's bait.", "question": "Hypothesis: \"Tommy took the bait of the treaty.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "The spear missed Vrenna by only a hand-span.", "question": "Hypothesis: \"The weapon was very sharp.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: chat\n  body: yeah well i was surprised at the the way they drafted last year they didn't really didn't go for the uh big offensive lineman or the defensive lineman they're going for the skilled positions so quarterbacks they really", "question": "Hypothesis: \"The way they drafted last year was a surprise to me.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: The pope, suggesting that Gen.", "question": "Hypothesis: \"Gen is being suggested by the Pope. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: They capitalized on the natural resources by using the salt to cure fish, which they exported to their home country.", "question": "Hypothesis: \"The use of salt on meats was revolutionary. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "yeah that's where i got to too the first i got chills up and down when i heard the on the radio and the first time they started doing the bombing", "question": "Hypothesis: \"When I heard that on the radio I got chills and the beginning of the bombing.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "The interior of the palace is very dark, and the use of flash is forbidden, so photographers should think twice before paying the extra fee for bringing in a camera or video equipment.", "question": "Hypothesis: \"Think hard about whether or not you want to bring a camera, there is an extra fee and no flash allowed.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: It is housed in a Martello A series of such towers, some 12 m (40 ft) high and 2.5 m (8 ft) thick, were constructed along the coast at the beginning of the 19th century to guard against invasion by Napoleon.", "question": "Hypothesis: \"In total, seven towers were built along the coast, and tourists can visit all of them.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: In Texas, the legislature was instrumental in effecting changes to the state's benefit programs through provisions in several pieces of legislation.", "question": "Hypothesis: \"The legislature was instrumental in effecting changes to the benefit program.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: i know that i didn't much uh-huh oh", "question": "Hypothesis: \"I didn't much.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "The book is a parody of Bartlett's , serving up quotes from Lincoln, Jefferson, and Roger Rosenblatt with equal pomposity.", "question": "Hypothesis: \"The book is a parody of Patterson's and has quotes from Adele and George Clooney. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "and uh my daughter gets irate when i when i do that because you know she's a teenager", "question": "Hypothesis: \"My daughter does sometimes have reason to be upset.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "In this enclosed but airy building, you'll find ladies with large machetes expertly chopping off hunks of kingfish, tuna, or shark for eager buyers.", "question": "Hypothesis: \"Large machetes are used to cut the fish up for buyers.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: chat\n  body: [Requires free registration.", "question": "Hypothesis: \"The registration is free.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "His plan was a simple a symmetrical design with straight streets and grand squares.", "question": "Hypothesis: \"His plan had a haphazard and crooked design for streets.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "i've yeah i've done it before and when i was in high in high school and college and thoroughly enjoyed it and and it's really a a blast my wife hates it but that's the way life is i guess", "question": "question: Hypothesis: \"I've never done it and don't think I would like it. \" How does it relate to the premise?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "I am so constituted as to be unable to give away money with any satisfaction until I have made the most careful inquiry as to the worthiness of the cause.", "question": "Hypothesis: \"Many charities are spend their money very unwisely.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "The great attraction of the church is the splendid exterior, which is crowned by golden onion-shaped cupolas.", "question": "question: Hypothesis: \"Most people come to the church to see the beautiful exterior.\" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "However, the WRAP States may unanimously petition the Administrator to determine that the total emissions of affected EGUs are reasonably projected to exceed 271,000 tons in 2018 or a later year and to make affected EGUs subject to the requirements of the new WRAP trading program.", "question": "Hypothesis: \"The WRAP States may unanimously petition the Administrator to overturn the smoking ban.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "Since the system would automatically verify all receipts and acceptances prior to invoice payment authorization, there would be no need to authorize payment prior to verification of receipt.", "question": "Hypothesis: \"The new system is computer based and includes customer credit card information.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "that's hilarious to to get that jack off that's right oh that's a funny story", "question": "Hypothesis: \"I will enjoy telling that story.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "- role: customer\n  content: Also, considerable sums are spent by the Postal Service analyzing the costs associated with worksharing, and mailers/competitors incur considerable expense litigating their positions on worksharing before the Postal Rate Commission.", "question": "Hypothesis: \"The Postal Service spends considerable sums on cost analysis.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Each individual's survival curve, or the probability of surviving beyond a given age, should shift as a result of an environmental quality improvement.", "question": "Hypothesis: \"Environmental quality should shift everyone's survival curve.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "- role: customer\n  content: uh i really i miss college i had a good time", "question": "Hypothesis: \"I enjoyed my time in university. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "The Balanced Scorecard Institute is a web clearinghouse for managers to exchange information, ideas, and lessons learned in building strategic management systems using the balanced scorecard approach.", "question": "Hypothesis: \"Managers can exchange ideas and information about management systems on the Balanced Scorecard Institute website.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "The last stages of uploading are like a mental dry-heave.", "question": "question: Hypothesis: \"There's really no discernible feeling when to comes to uploading.\" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "Because of limited resources, local legal services programs are forced to turn away tens of thousands of people with critical legal problems.", "question": "Hypothesis: \"If the resources were there, it would be unthinkable for these programs to be turning so many people away.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "In the Blue Mountain National Park and the John Crow National Park, which together cover 78,200 hectares (193, 200 acres), conservationists are attempting to halt the encroachment of local farmers and loggers.", "question": "Hypothesis: \"Blue mountain National Park is preventing farmers from working there because the park already has farmers.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: and uh oh i guess an hour into my somewhat sleep a guy woke me up and uh said you'd better get out of the the tent they're they're liable to come down several of the others had already come down blown down they hadn't blown away but they had flattened", "question": "Hypothesis: \"A guy told me to get out because the tents were being flattened.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "3 It should be noted that the toxicity (LC50) of a sample observed in a range-finding test may be significantly different from the toxicity observed in the follow-up chronic definitive test  (1) the definitive test is longer; and (2) the test may be performed with a sample collected at a different time, and possibly differing significantly in the level of toxicity.", "question": "Hypothesis: \"The toxicity of a sample in the range-finding test will be exactly the same as the toxicity in the follow-up test.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "right right well you know i think uh i think it's going to happen i don't know i don't know what else i could suggest to them you know if they ask me what should we do i don't know i wouldn't know what else to suggest to them just education start with these little kids you know and like you said you know start making it practice you know start showing all the street signs and all the cars of course i think all the cars are manufactured that way they aren't aren't all of them most o f the new ones i'm seeing are are made with miles per hour and kilometers on them", "question": "Hypothesis: \"Education will make it happen.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "In addition, we supported the creation of a 250-page Poverty Law Manual that introduces advocates to the fundamentals of poverty law.", "question": "Hypothesis: \"The manual has increased the utilization of poverty law services.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "oh yeah IBM uh i mean uh a lot of people use human factors folks but IBM is what i'm looking at right now", "question": "question: Hypothesis: \"I'm looking at IBM right now but I've looked at tons of other things.\" How does it relate to the premise?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "Something in his mind seemed also to have developed a \"tan\" that let him face the bite of chance without flinching.", "question": "Hypothesis: \"Despite all his experiences he still flinched at the prospect of chance.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "Castlerigg near Keswick is the best example.", "question": "Hypothesis: \"A good example would be Keswick near Castlerigg.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "of course you could annex Cuba but they wouldn't like that a bit", "question": "Hypothesis: \"Cubans would go up in arms if we tried to annex Cuba.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "\"So your girl writes that your little farewell activity didn't fare so well, eh?\" he chortled.", "question": "Hypothesis: \"Your little girl wrote about how well your farewell activity went.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Don't remember.", "question": "question: Hypothesis: \"I do not remember.\" How does it relate to the premise?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: web form\n  body: yeah so i i trotted back to the car rather quickly uh jumped in went home and took a hot shower and changed clothes and went back", "question": "Hypothesis: \"I did not even stop to have anything to eat.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "Local boy Gates wisely built his 45,000-square-foot castle in suburban Seattle.", "question": "Hypothesis: \"Gates built his castle in the Seattle are because he likes the weather.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "On the window above the sink a small container is stuffed with bits of leftovers--the red berries of barberry, small twigs of willow, cuttings of hinoki cypress with its fruits attached, and the pendulous leathery seed pods of wisteria.", "question": "Hypothesis: \"The container is empty and on the buffet.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "probably yeah i would imagine the judge could throw it out", "question": "Hypothesis: \"I would guess that the judge would be able to toss that out.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: Under Ferdinand and Isabella, Spain underwent a dramatic transformation.", "question": "Hypothesis: \"Ferdinand started his transformation by emancipating the peasant class.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "really oh i thought it was great yeah", "question": "question: Hypothesis: \"That was horrible\" How does it relate to the premise?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "Three more days went by in dreary inaction.", "question": "question: Hypothesis: \"The next three days were packed with action.\" How does it relate to the premise?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: chat\n  body: The panels are to collect advice and recommendations from representatives of affected small entities as part of their deliberative process.", "question": "Hypothesis: \"The panels will collect advice, along with data from representatives of the affected entities.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "But it just might be because he's afraid he'll lose his No.", "question": "Hypothesis: \"He might be afraid he'll lose his No.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Ocho Rios is Spanish for  eight rivers,  but this name is not descriptive of the area.", "question": "Hypothesis: \"Ocho Rios means pink penguins in Spanish, and this name describes the area.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "The woman rolled and drew two spears before the horse had rolled and broken the rest.", "question": "Hypothesis: \"They were rolling in piles of money. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "The renowned Theban queen Nefertari, wife of Ramses II, has the most ornate tomb (number 66) but it is not always accessible.", "question": "Hypothesis: \"Though it's not always accessible, the most ornate tomb (number 66) is of the renowned Theban queen Nefertari nestled between much simpler ones.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: chat\n  body: In this case, shareholders can pay twice for the sins of others.", "question": "Hypothesis: \"shareholders can't pay twice for the sins of others.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "Tracking down the tiger is a subtle affair, and requires a degree of dedication, calm, and stealth.", "question": "Hypothesis: \"Searching for tigers requires great skill.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: findings, the Administrator has determined that an environmental impact statement need not be prepared.", "question": "Hypothesis: \"An environmental impact statement is not useful to the administrator in anyway.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "A conventional siege was useless against such a seemingly impregnable rock, however, and with so much food and water the Zealots could not be starved into submission.", "question": "Hypothesis: \"The siege was very effective, and the Zealots began to starve to death.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: Lincoln glared.", "question": "Hypothesis: \"The man was angry.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: web form\n  body: and uh you know it's like they they consider that but it would be the same way here you know it's like if if you had to do it you know you have a big sign i'm sorry i don't get paid you know", "question": "Hypothesis: \"If I were somewhere else I would be getting paid. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: email\n  body: um i've visited the Wyoming area i'm not sure exactly where Dances with Wolves was filmed", "question": "Hypothesis: \"I don't know even though I visited the area.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "- role: customer\n  content: Using a threestep development planning process, managers assess their current capabilities, determine their specific development needs, and build and execute a development plan.", "question": "question: Hypothesis: \"The threestep planning process examines years of development, even though the number of steps is low.\" How does it relate to the premise?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: The regime's response of ferocious repression plus numerous other ineptitudes led to a third revolution in 1848, with the Bonapartists, led by Napoleon's nephew, emerging triumphant.", "question": "Hypothesis: \"There were only two revolutions.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: This was the saturation and 125-piece walk sequence Enhanced Carrier Route mail volume in 1996.", "question": "Hypothesis: \"The Enhanced Carrier Route was introduced prior to 1997.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "(And yes, he has said a few things that can, with some effort, be construed as support for supply-side economics.)", "question": "Hypothesis: \"He has begun working on construing the things as support for supply-side economics.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "- role: customer\n  content: On the easternmost tip of Jamaica stands Morant Point Lighthouse, built in 1841.", "question": "Hypothesis: \"Morant Point Lighthouse is in Mexico.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "My bottom line is that I would recommend the book to students and colleagues and I hope it does well, despite its anti-intellectual p.c.", "question": "Hypothesis: \"Even though this book has flaws, I think it's a good thing.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Took forever.", "question": "Hypothesis: \"Was quick\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: chat\n  body: To be sure, not all auctions are rip-offs.", "question": "Hypothesis: \"Not all auctions sell high priced goods.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: email\n  body: Two of them saw Thorn coming.", "question": "question: Hypothesis: \"Thorn was seen coming to battle by two of them.\" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "Ah, yes, actually, two weeks ago we had a very similar situation, the captain alertly added and quickly changed the subject, 'What's important now is that you get ready for about 2 minutes in the state of weightlessness, and not some Slovakian satellite from two weeks ago.", "question": "question: Hypothesis: \"He was not slow to change the subject but before he did he added that there was a similar situation a couple weeks before. \" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Workers are also represented in civil rights and retaliation claims.", "question": "Hypothesis: \"Some workers are represented in civil rights and retaliation claims.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "a cockamamie tone poem pitched precipitously between swoony lyricism and violent catastrophe ... the most aggressively nerve-wracking and screamingly neurotic romantic comedy in cinema history .", "question": "question: What is the sentiment of this review sentence?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: every so often a movie comes along that confirms one 's worse fears about civilization as we know it .", "question": "question: What is the sentiment of this review sentence?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "the passions aroused by the discord between old and new cultures are set against the strange , stark beauty of the mideast desert , so lovingly and perceptively filmed that you can almost taste the desiccated air .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: a simmering psychological drama in which the bursts of sudden violence are all the more startling for the slow buildup that has preceded them .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "equal parts bodice-ripper and plodding costume drama .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "instead , we just get messy anger , a movie as personal therapy .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "aaliyah rarely dampens her diva persona enough to spark genuine chemistry with townsend .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "after that , it just gets stupid and maudlin .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "most impressive , though , is the film 's open-ended finale that refuses to entirely close its characters ' emotional wounds .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "rain is a small treasure , enveloping the viewer in a literal and spiritual torpor that is anything but cathartic .", "question": "question: What is the sentiment of this review sentence?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "technically , the film is about as interesting as an insurance commercial .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "makmalbaf follows a resolutely realistic path in this uncompromising insight into the harsh existence of the kurdish refugees of iran 's borderlands .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: i wonder what the reaction of israelis will be to this supposedly evenhanded presentation .", "question": "question: What is the sentiment of this review sentence?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "the unique tug-of-war with viewer expectations is undeniable , if not a pleasure in its own right .", "question": "question: What is the sentiment of this review sentence?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: lucas , take notes .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "a love for films shines through each frame and the era is recreated with obvious affection , scored to perfection with some tasty boogaloo beats .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "a pleasant romantic comedy .", "question": "question: What is the sentiment of this review sentence?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: or a profit .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "visits spy-movie territory like a novel you ca n't put down , examines a footnote to history seldom brought to light on the screen , and keeps you guessing from first frame to last .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "ticket:\n  channel: chat\n  body: for me , this opera is n't a favorite , so it 's a long time before the fat lady sings .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: it is intensely personal and yet -- unlike quills -- deftly shows us the temper of the times .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "ticket:\n  channel: chat\n  body: its underlying mythology is a hodgepodge of inconsistencies that pose the question : since when did dumb entertainment have to be this dumb ?", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: expect to be reminded of other , better films , especially seven , which director william malone slavishly copies .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "from the big giant titles of the opening credits to elmer bernstein 's perfectly melodic score , haynes gets just about everything right .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: proof that a thriller can be sleekly shot , expertly cast , paced with crisp professionalism ... and still be a letdown if its twists and turns hold no more surprise than yesterday 's weather report .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: the whole thing plays out with the drowsy heaviness of synchronized swimmer wearing a wool wetsuit .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "high on melodrama .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: what kids will discover is a new collectible .", "question": "question: What is the sentiment of this review sentence?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: whether seen on a 10-inch television screen or at your local multiplex , the edge-of-your-seat , educational antics of steve irwin are priceless entertainment .", "question": "question: What is the sentiment of this review sentence?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "... an agreeable time-wasting device -- but george pal 's low-tech 1960 version still rules the epochs .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "there is no insight into the anguish of heidi 's life -- only a depiction of pain , today 's version of greek tragedy , the talk-show guest decrying her fate .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: writer\\/director john mckay ignites some charming chemistry between kate and jed but , when he veers into sodden melodrama , punctuated by violins , it 's disastrous and kate 's jealous female friends become downright despicable .", "question": "question: What is the sentiment of this review sentence?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "apparently kissing leads to suicide attempts and tragic deaths .", "question": "question: What is the sentiment of this review sentence?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: the film 's sharp , often mischievous sense of humor will catch some off guard ...", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "city by the sea is the cinematic equivalent of defensive driving : it 's careful , conscientious and makes no major mistakes .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: the backyard battles you staged with your green plastic army men were more exciting and almost certainly made more sense .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "a yarn that respects the marvel version without becoming ensnared by it .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: a heavy reliance on cgi technology is beginning to creep into the series .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "had anyone here done anything remotely intelligent , we all could have stopped watching long ago .", "question": "question: What is the sentiment of this review sentence?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "director ferzan ozpetek creates an interesting dynamic with the members of this group , who live in the same apartment building .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "ticket:\n  channel: chat\n  body: tim story 's not there yet - but ` barbershop ' shows he 's on his way .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "so clichéd that , at one point , they literally upset an apple cart .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "nair stuffs the film with dancing , henna , ornamentation , and group song , but her narrative clichés and telegraphed episodes smell of old soap opera .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: showtime is closer to slowtime .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "a dreary , incoherent , self-indulgent mess of a movie in which a bunch of pompous windbags drone on inanely for two hours ... a cacophony of pretentious , meaningless prattle .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "an engaging overview of johnson 's eccentric career .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "a very funny movie .", "question": "question: What is the sentiment of this review sentence?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "daring , mesmerizing and exceedingly hard to forget .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "the film is exhilarating to watch because sandler , liberated from the constraints of formula , reveals unexpected depths as an actor .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: just a bloody mess .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "a trite psychological thriller designed to keep the audience guessing and guessing -- which is not to be confused with suspecting -- until it comes time to wrap things up and send the viewers home .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "ticket:\n  channel: chat\n  body: the worst kind of independent ; the one where actors play dress down hicks and ponderously mope around trying to strike lightning as captured by their 1970s predecessors", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: dialogue-heavy and too cerebral for its own good -- or , at any rate , too cerebral for its racy subject matter .", "question": "question: What is the sentiment of this review sentence?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: this limp gender-bender-baller from a first-time director and rookie screenwriter steals wholesale from that 1982 's tootsie , forgetting only to retain a single laugh .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "the disarming cornball atmosphere has a way of infecting the entire crowd as the film rolls on .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "philip k. dick must be turning in his grave , along with my stomach .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "ticket:\n  channel: chat\n  body: this series should have died long ago , but they keep bringing it back another day as punishment for paying money to see the last james bond movie .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "no. .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "a deceivingly simple film , one that grows in power in retrospect .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "just pound away .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "about as satisfying and predictable as the fare at your local drive through .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "a thoughtful , moving piece that faces difficult issues with honesty and beauty .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: focuses on joan 's raging hormones and sledgehammers the audience with spanish inquisitions about her `` madness '' so much that i became mad that i wasted 123 minutes and $ 9.50 on this 21st century torture device .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "ticket:\n  channel: web form\n  body: suffocated at conception by its munchausen-by-proxy mum .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "münch 's genuine insight makes the film 's occasional overindulgence forgivable .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "the movie feels like it 's going to be great , and it carries on feeling that way for a long time , but takeoff just never happens .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "ultimately , it ponders the reasons we need stories so much .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: never mind whether you buy the stuff about barris being a cia hit man .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "or some damn thing .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "ticket:\n  channel: chat\n  body: there are slow and repetitive parts , but it has just enough spice to keep it interesting .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "a wildly funny prison caper .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "it 's almost impossible not to be moved by the movie 's depiction of sacrifice and its stirring epilogue in post-soviet russia .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "sst5"}
{"request": {"context": "there is not an ounce of honesty in the entire production .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: a potent allegorical love story .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "as adapted by kevin molony from simon leys ' novel `` the death of napoleon '' and directed by alan taylor , napoleon 's journey is interesting but his parisian rebirth is stillborn", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "- role: customer\n  content: sound the trumpets : for the first time since desperately seeking susan , madonna does n't suck as an actress .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: this is an hour and a half of daydreaming .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: but i was n't .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "... with the candy-like taste of it fading faster than 25-cent bubble gum , i realized this is a throwaway movie that wo n't stand the test of time .", "question": "What is the sentiment of this review sentence?", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "sst5"}
{"request": {"context": "the plot is straight off the shelf , the performances are television - caliber and the message of providing solace through deception is a little creepy .", "question": "question: What is the sentiment of this review sentence?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "very negative"}, {"id": "1", "text": "negative"}, {"id": "2", "text": "neutral"}, {"id": "3", "text": "positive"}, {"id": "4", "text": "very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "sst5"}
{"request": {"context": "document: My God! This place keeps getting better and better!!! Even when they're so busy that the line is out the door around the corner!!!!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: My God! This place keeps getting better and better!!! Even when they're so busy that the line is out the door around the corner!!!!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "BEWARE! DO NOT USE THEM! They held my things hostage on the truck until I paid them IN CASH an estimate double of what it took them to load it...It always takes less time to UNload. I called the company and they told me if you want your stuff pay them and if they take less time they will give you it back, they did not! I was overcharged $660 and they broke a lot of my dishes and broke my kitchen table legs and scraped up furniture and ruined my 2 beautiful rolled arm couches by standing them UP on the rolled arms! I asked them not to when i saw how they were loading it and they told me to mind my own business they know what they are doing! I called the company and they did NOTHING. They also took 15 minutes breaks every hour and a half hour lunch all of which I PAID THEM HOURLY FOR! No one returns my calls and even though I paid for insurance their insurance company has never called me and On Our Way only has a receptionist and you can never speak to anyone else and no one ever returns your calls. I have filed with the BBB and attorney generals office.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "BEWARE! DO NOT USE THEM! They held my things hostage on the truck until I paid them IN CASH an estimate double of what it took them to load it...It always takes less time to UNload. I called the company and they told me if you want your stuff pay them and if they take less time they will give you it back, they did not! I was overcharged $660 and they broke a lot of my dishes and broke my kitchen table legs and scraped up furniture and ruined my 2 beautiful rolled arm couches by standing them UP on the rolled arms! I asked them not to when i saw how they were loading it and they told me to mind my own business they know what they are doing! I called the company and they did NOTHING. They also took 15 minutes breaks every hour and a half hour lunch all of which I PAID THEM HOURLY FOR! No one returns my calls and even though I paid for insurance their insurance company has never called me and On Our Way only has a receptionist and you can never speak to anyone else and no one ever returns your calls. I have filed with the BBB and attorney generals office.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: So many great reviews. Friends who live or have lived in Pittsburgh rave about this place. It was supposed to be THE PLACE for breakfast and brunch in this city. I first visited this place on a short Pgh Apt hunting trip back in April 2013. Went in, got excited, as the place was packed with people. It had the classic diner feel. It had to be good. Sadly, it wasn't. Not wanting to give up hope, I went back to Pamela's the next day, and went with the corned beef hash, since many yelpers had mentioned it. Again, disappointed. Having settled in Pgh for a few months now, I decided to give Pamela's a third chance recently. *sigh. I don't get how this place has such high yelp ratings.\\n\\nFood = (6.5/10) = As mentioned above, my first visit I tried the western omelet. It was just ok. Not well seasoned, and the cheese was meh. Quantity wise, you do get a huge amount of food for what you pay for. Second trip was the corned beef hash trip. Really don't understand what is so great about this dish. My third trip I tried the tex-mex omelet. Again, eggs under seasoned, and cheese was meh. What bothered me the most was the \\\"guacamole.\\\" It's more like avocado paste with mayonnaise", "question": "question: How many stars did this reviewer give?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: So many great reviews. Friends who live or have lived in Pittsburgh rave about this place. It was supposed to be THE PLACE for breakfast and brunch in this city. I first visited this place on a short Pgh Apt hunting trip back in April 2013. Went in, got excited, as the place was packed with people. It had the classic diner feel. It had to be good. Sadly, it wasn't. Not wanting to give up hope, I went back to Pamela's the next day, and went with the corned beef hash, since many yelpers had mentioned it. Again, disappointed. Having settled in Pgh for a few months now, I decided to give Pamela's a third chance recently. *sigh. I don't get how this place has such high yelp ratings.\\n\\nFood = (6.5/10) = As mentioned above, my first visit I tried the western omelet. It was just ok. Not well seasoned, and the cheese was meh. Quantity wise, you do get a huge amount of food for what you pay for. Second trip was the corned beef hash trip. Really don't understand what is so great about this dish. My third trip I tried the tex-mex omelet. Again, eggs under seasoned, and cheese was meh. What bothered me the most was the \\\"guacamole.\\\" It's more like avocado paste with mayonnaise", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "What does a chef, such as Gordon Ramsay, recipient of 14 Michelin stars, three for his flagship London restaurant alone, serves at his new venture in Montreal, a city renowned for its famous chefs and restaurants?\\n\\nChicken! BBQ chicken, to be precise!\\n\\nTurns out chef Ramsay took over a space formerly occupied by a decades-old BBQ joint, the Laurier BBQ, and revamped the old building, giving it new life with a makeover complete with some very young, attentive, and attractive staff, as well as, modern fixtures and equipment.\\n\\nYet, he kept the old menu with rotisserie chicken as the primary focus. You can also order other comfort-food items such as burgers, grill-cheese sandwich, etc.,with the most expensive items being a whole chicken for $32 and a 16-oz ribeye for $28. Thats a steal, in my mind.\\n\\nI managed to make a reservation a couple of weeks ago from Calgary. They'll only take reservations for groups of six or more. Everyone else will just have to wait.\\n\\nWhen we arrived this evening, there were already a dozen or more people waiting for tables. We were sat right away with water offered from milk bottles that had cucumber slices in them. I couldn't taste the cucumber but it was a nice touch anyways. Also at each table was a jar of dill pickles which you help yourself", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "What does a chef, such as Gordon Ramsay, recipient of 14 Michelin stars, three for his flagship London restaurant alone, serves at his new venture in Montreal, a city renowned for its famous chefs and restaurants?\\n\\nChicken! BBQ chicken, to be precise!\\n\\nTurns out chef Ramsay took over a space formerly occupied by a decades-old BBQ joint, the Laurier BBQ, and revamped the old building, giving it new life with a makeover complete with some very young, attentive, and attractive staff, as well as, modern fixtures and equipment.\\n\\nYet, he kept the old menu with rotisserie chicken as the primary focus. You can also order other comfort-food items such as burgers, grill-cheese sandwich, etc.,with the most expensive items being a whole chicken for $32 and a 16-oz ribeye for $28. Thats a steal, in my mind.\\n\\nI managed to make a reservation a couple of weeks ago from Calgary. They'll only take reservations for groups of six or more. Everyone else will just have to wait.\\n\\nWhen we arrived this evening, there were already a dozen or more people waiting for tables. We were sat right away with water offered from milk bottles that had cucumber slices in them. I couldn't taste the cucumber but it was a nice touch anyways. Also at each table was a jar of dill pickles which you help yourself", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "I had called weeks in advance asking for the common table for my daughters birthday dinner. I was told that if we got there early we would be able to sit there. Three days before the birthday, I called to verify everything and was told that he did not want to hold the table for a bunch of ladies who would sit there all night when clearly , since the restaurant was sold out, he could \\\"turn that table \\\" three times and make $2000. He offered me a private room upstairs for a minimum $2000 instead of saying since we have nothing booked for upstairs I will let you have that. I had already invited 12 women to this dinner and had to change everything at the last minute due to the owners greed. I will never eat at this restaurant and would warn others that he is not someone who has a good moral ethic.", "question": "question: How many stars did this reviewer give?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "I had called weeks in advance asking for the common table for my daughters birthday dinner. I was told that if we got there early we would be able to sit there. Three days before the birthday, I called to verify everything and was told that he did not want to hold the table for a bunch of ladies who would sit there all night when clearly , since the restaurant was sold out, he could \\\"turn that table \\\" three times and make $2000. He offered me a private room upstairs for a minimum $2000 instead of saying since we have nothing booked for upstairs I will let you have that. I had already invited 12 women to this dinner and had to change everything at the last minute due to the owners greed. I will never eat at this restaurant and would warn others that he is not someone who has a good moral ethic.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: Played here on 9/7/13 and the course was good! Some very challenging holes with a couple demanding landing areas from the tee box. The greens were all in pretty good shape, although there were several patches on a few fairways that had little to no grass. It was tough to read some of the greens - sometimes I would read a break and it would go straight, then other times it looks fairly straight and would break several feet. \\n\\nIn reply to another review, all of the water containers were full of cold water. \\n\\nOne of the carts in our group did run dead on the 17th tee box, so we pushed it with the other cart the rest of the way. It did take a long time to play our round because we were backed up behind people who looked like they were playing golf for the first time. \\n\\nOverall, I would play here again. Challenging course with cheap greens fees.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: Played here on 9/7/13 and the course was good! Some very challenging holes with a couple demanding landing areas from the tee box. The greens were all in pretty good shape, although there were several patches on a few fairways that had little to no grass. It was tough to read some of the greens - sometimes I would read a break and it would go straight, then other times it looks fairly straight and would break several feet. \\n\\nIn reply to another review, all of the water containers were full of cold water. \\n\\nOne of the carts in our group did run dead on the 17th tee box, so we pushed it with the other cart the rest of the way. It did take a long time to play our round because we were backed up behind people who looked like they were playing golf for the first time. \\n\\nOverall, I would play here again. Challenging course with cheap greens fees.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "There are plenty of reasons as to why I probably will never visit Stratosphere again, and why I had to check out two nights earlier:\\n\\nArea/Location: The Stratosphere doesn't feel as if it's even on the strip. One night when I was coming back from a El Nopal, people that were homeless and what seemed to be were drugs, approached me in a hostile manner. This occurred not once, but twice. Once going to El Nopal, and the second coming back. When heading to the restaurant, the first person got so close to me with alcohol on his breath and seemed began to yell at me to \\\"Want me to tap that a** girl?\\\". The second time coming back, another person came at me and grabbed my arm and asked me to, \\\"Help me him out?\\\". This is unacceptable, due to it being less than half a block away from the hotel. Added security should be a main concern to let guests feel as if they are safe.\\n\\nFront Desk Personnel - I did NOT feel welcome AT ALL when I checked in. The attendant did not ask how I was doing/how my day was. The vibe to begin with did not start my trip well. When I ended up leaving two days earlier, the attendant didn't even ask me how my", "question": "question: How many stars did this reviewer give?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "There are plenty of reasons as to why I probably will never visit Stratosphere again, and why I had to check out two nights earlier:\\n\\nArea/Location: The Stratosphere doesn't feel as if it's even on the strip. One night when I was coming back from a El Nopal, people that were homeless and what seemed to be were drugs, approached me in a hostile manner. This occurred not once, but twice. Once going to El Nopal, and the second coming back. When heading to the restaurant, the first person got so close to me with alcohol on his breath and seemed began to yell at me to \\\"Want me to tap that a** girl?\\\". The second time coming back, another person came at me and grabbed my arm and asked me to, \\\"Help me him out?\\\". This is unacceptable, due to it being less than half a block away from the hotel. Added security should be a main concern to let guests feel as if they are safe.\\n\\nFront Desk Personnel - I did NOT feel welcome AT ALL when I checked in. The attendant did not ask how I was doing/how my day was. The vibe to begin with did not start my trip well. When I ended up leaving two days earlier, the attendant didn't even ask me how my", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "This is your typical Royal Mile pub..ish. It's a great location, and so tourists always find their way in here, but it's a good place to find your way into! It's a nice, friendly pub with good service and good food! I took my vegetarian friend here once for the vegetarian haggis, and I think I preferred it to the real one!\\n\\nBut, with every good thing there has to be a catch. And there is...A few years ago there was a murder right outside The World's End, and as a result there have been countless ghost stories about what happened and the lingering spirit. I don't know about you, but that sort of stuff does spook me a wee bitty...", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "This is your typical Royal Mile pub..ish. It's a great location, and so tourists always find their way in here, but it's a good place to find your way into! It's a nice, friendly pub with good service and good food! I took my vegetarian friend here once for the vegetarian haggis, and I think I preferred it to the real one!\\n\\nBut, with every good thing there has to be a catch. And there is...A few years ago there was a murder right outside The World's End, and as a result there have been countless ghost stories about what happened and the lingering spirit. I don't know about you, but that sort of stuff does spook me a wee bitty...", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "I will admit that upon entering I expected a cool little Montreal diner with character...I was mistaken. It seemed like a touristy restaurant chain with mediocre food...wait, you probably knew that.\\n\\nThis is a restaurant that you'd find in any suburban mall in Canada...not overly exciting, and if you are downtown in Montreal go someplace else! On the positive side, lots of pictures of Celine Dion. \\n\\nOn the serious positive side though...it is a good palce for kids. Lots of other kids, big place, and the menu is reasonably priced.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "I will admit that upon entering I expected a cool little Montreal diner with character...I was mistaken. It seemed like a touristy restaurant chain with mediocre food...wait, you probably knew that.\\n\\nThis is a restaurant that you'd find in any suburban mall in Canada...not overly exciting, and if you are downtown in Montreal go someplace else! On the positive side, lots of pictures of Celine Dion. \\n\\nOn the serious positive side though...it is a good palce for kids. Lots of other kids, big place, and the menu is reasonably priced.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Nice Irish bar but crazy expensive. Worth a visit for a beer and then punch out. They usually have decent live music.", "question": "question: How many stars did this reviewer give?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "Nice Irish bar but crazy expensive. Worth a visit for a beer and then punch out. They usually have decent live music.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "just had lunch here today and ordered the shoarma combo (chicken and gyros) and it was delish!!! the chicken was season just the way i like it: not overly seasoned and not too strong, just right!!! the gyros was nice and moist... i ordered it with the hommus as a side and it was served with plenty of pita!!! i definetly did not leave hungry! especially since we also got baklava for dessert which was amazing!!!!\\n\\ni will be back here very shortly!!!!!!!!!!!!!!!!!!!!!!!!!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "just had lunch here today and ordered the shoarma combo (chicken and gyros) and it was delish!!! the chicken was season just the way i like it: not overly seasoned and not too strong, just right!!! the gyros was nice and moist... i ordered it with the hommus as a side and it was served with plenty of pita!!! i definetly did not leave hungry! especially since we also got baklava for dessert which was amazing!!!!\\n\\ni will be back here very shortly!!!!!!!!!!!!!!!!!!!!!!!!!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "While in town on business, I had an early dinner appointment open up, so I decided to come to Planet Hollywood so I could eat & maybe do some shopping as well before heading back to the airport. I looked up the restaurants online & inteded on going to Yolo's (a Mexican cantina inside the casino), but as I was walking through the Miracle Mile shops, I came across this place & started craving Italian.\\n\\nThe ambiance is nice. They have a setting for most every need... long & secluded tables for large groups to make it feel family-style, regular seating inside, bar seating with a TV, or patio seating \\\"outside\\\" the restaurant to people watch. The music is kinda loud coming from the Miracle Mile walkway & the A/C was up way too high, so it was freezing cold, but the decor is a nice cross between olde world Italia & contemporary flare, so, overall, it was pleasant.\\n\\nI came around 3pm, which is after the lunch crowd & before the dinner crowd, so it was pretty empty. They were still serving off the lunch menu, which I'm glad about, because it was a tad bit pricy, so I can imagine what their dinner prices are like.\\n\\nAs for the food..... delish!! I ordered the Paglia e Fieno which is made with", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "While in town on business, I had an early dinner appointment open up, so I decided to come to Planet Hollywood so I could eat & maybe do some shopping as well before heading back to the airport. I looked up the restaurants online & inteded on going to Yolo's (a Mexican cantina inside the casino), but as I was walking through the Miracle Mile shops, I came across this place & started craving Italian.\\n\\nThe ambiance is nice. They have a setting for most every need... long & secluded tables for large groups to make it feel family-style, regular seating inside, bar seating with a TV, or patio seating \\\"outside\\\" the restaurant to people watch. The music is kinda loud coming from the Miracle Mile walkway & the A/C was up way too high, so it was freezing cold, but the decor is a nice cross between olde world Italia & contemporary flare, so, overall, it was pleasant.\\n\\nI came around 3pm, which is after the lunch crowd & before the dinner crowd, so it was pretty empty. They were still serving off the lunch menu, which I'm glad about, because it was a tad bit pricy, so I can imagine what their dinner prices are like.\\n\\nAs for the food..... delish!! I ordered the Paglia e Fieno which is made with", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "It smells nice.\\n\\nIt's inexpensive.\\n\\nIt makes a sly dig at the recipient's personal hygiene.\\n\\nAnd this is yet another place where you can pick up gifts for any menopausal women who make it onto your Xmas gift-buying list.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "It smells nice.\\n\\nIt's inexpensive.\\n\\nIt makes a sly dig at the recipient's personal hygiene.\\n\\nAnd this is yet another place where you can pick up gifts for any menopausal women who make it onto your Xmas gift-buying list.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: One star minus one star = zero stars!! Please let me help you if you are thinking about eating here: DONT! I am an avid connesieur of buffets and this place is a hot mess!! I was put off immediately by the uncleanliness but we proceeded, watered down crab, amnesia salad made with mayonnaise, mushy food all around...don't eat here ever, waste of money! They have a sign that says they wool", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: One star minus one star = zero stars!! Please let me help you if you are thinking about eating here: DONT! I am an avid connesieur of buffets and this place is a hot mess!! I was put off immediately by the uncleanliness but we proceeded, watered down crab, amnesia salad made with mayonnaise, mushy food all around...don't eat here ever, waste of money! They have a sign that says they wool", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "I'm all for \\\"personal service\\\", but it can get out of hand in a hurry.\\n\\nI was here on a Saturday afternoon, admittedly a busier time for any establishment. The guy who appeared to be the manager, as he was wearing a different outfit than the other employees, greeted me as I walked in. Including him, there were 4 or 5 employees and each was helping other customers. So I started walking around, looking at the merchandise. Not such a great selection, and not such great prices, but better than Sports Chalet (selection, not price). \\n\\nLo and behold, I found the same running shoe I had been wearing previously and was already very happy with. It was $10 more expensive here than where I had originally gotten it 8 months ago, Marathon Sports in Boston. Interesting, because you'd figure 8 months worth of new styles would have devalued these a bit.\\n\\nSo I'm an easy sale - 5 minutes to grab my size out of the back and ring me up. But I had to stand around and wait for someone to help me. And wait. And wait. All of the employees were feigning actually helping customers but were really shooting the shit about topics as far ranging as personal style and Bartlesville, OK. After patiently standing around for 20 minutes (but", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "I'm all for \\\"personal service\\\", but it can get out of hand in a hurry.\\n\\nI was here on a Saturday afternoon, admittedly a busier time for any establishment. The guy who appeared to be the manager, as he was wearing a different outfit than the other employees, greeted me as I walked in. Including him, there were 4 or 5 employees and each was helping other customers. So I started walking around, looking at the merchandise. Not such a great selection, and not such great prices, but better than Sports Chalet (selection, not price). \\n\\nLo and behold, I found the same running shoe I had been wearing previously and was already very happy with. It was $10 more expensive here than where I had originally gotten it 8 months ago, Marathon Sports in Boston. Interesting, because you'd figure 8 months worth of new styles would have devalued these a bit.\\n\\nSo I'm an easy sale - 5 minutes to grab my size out of the back and ring me up. But I had to stand around and wait for someone to help me. And wait. And wait. All of the employees were feigning actually helping customers but were really shooting the shit about topics as far ranging as personal style and Bartlesville, OK. After patiently standing around for 20 minutes (but", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "The concept of Ramen is very simple and quite delightful. You get \\\"there\\\", order your Ramen, and eat your Ramen. In Japan, the concept is cool because usually you order and pay through a machine (like an ATM) and everything is done rapidly and orderly. \\n\\nThus, my surprise at the complete lack of service of Ramen-Ya. Ordering a Ramen soup took nearly 20 minutes. \\n\\nThe Noodle is the key to a good Ramen soup, Broth being the second ingredient. I would've expected something quite good coming out of Ramen-Ya but unfortunately the noodles were plain and tasteless. Poor texture, no spring to them and difficult to noisily suck \\\"in\\\". \\n\\nThe Broth was good however, a mix of miso and chicken fond. Enough taste to finish and not too salty to require additional water. \\n\\nThe fillings (porc slabs and vegies) were poor in taste and quantity, making the overall Ramen experience a big mEh. At least the egg wasn't overcooked. \\n\\nTook the better part of an hour to eat a simple Ramen. After which, being still hungry, we asked for the menu, but were unable to re-order ( we got forgotten i suppose...). So we forgot to tip in return. \\n\\nSad to see this place so busy with the hispter vibe of the plateau, but fail at the simpliest of task.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "The concept of Ramen is very simple and quite delightful. You get \\\"there\\\", order your Ramen, and eat your Ramen. In Japan, the concept is cool because usually you order and pay through a machine (like an ATM) and everything is done rapidly and orderly. \\n\\nThus, my surprise at the complete lack of service of Ramen-Ya. Ordering a Ramen soup took nearly 20 minutes. \\n\\nThe Noodle is the key to a good Ramen soup, Broth being the second ingredient. I would've expected something quite good coming out of Ramen-Ya but unfortunately the noodles were plain and tasteless. Poor texture, no spring to them and difficult to noisily suck \\\"in\\\". \\n\\nThe Broth was good however, a mix of miso and chicken fond. Enough taste to finish and not too salty to require additional water. \\n\\nThe fillings (porc slabs and vegies) were poor in taste and quantity, making the overall Ramen experience a big mEh. At least the egg wasn't overcooked. \\n\\nTook the better part of an hour to eat a simple Ramen. After which, being still hungry, we asked for the menu, but were unable to re-order ( we got forgotten i suppose...). So we forgot to tip in return. \\n\\nSad to see this place so busy with the hispter vibe of the plateau, but fail at the simpliest of task.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Very nice staff. Clean and modern decor. I believe they take all insurances. Dr Hanks has a great bedside manner.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "Very nice staff. Clean and modern decor. I believe they take all insurances. Dr Hanks has a great bedside manner.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Great food, good atmosphere, just a little bit pretentious.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "Great food, good atmosphere, just a little bit pretentious.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: Smokehouse beef brisket and cheddar is the absolute best sub ever!!!! This may be blasphemy, but the brisket n BBQ sauce in this sandwich rivals that of any BBQ joint I've ever been to. Yes, it's that damn good!! Go and get one... NOW!!!", "question": "question: How many stars did this reviewer give?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: Smokehouse beef brisket and cheddar is the absolute best sub ever!!!! This may be blasphemy, but the brisket n BBQ sauce in this sandwich rivals that of any BBQ joint I've ever been to. Yes, it's that damn good!! Go and get one... NOW!!!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "The food here is definitely subpar. I ordered a hard shell shredded chicken taco, and it was unappealing. It had no flavor, and the shells were soggy. The chicken was flavored with salsa, but it tasted like it was flavored with some cheap tomato sauce. The rice and beans were unremarkable as well. The only good thing about the meal were the chips.\\n Unbelievable to me how the Phoenix area is lacking in decent Mexican restaurants. With such a large Hispanic population, I would think there would be a better selection.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "The food here is definitely subpar. I ordered a hard shell shredded chicken taco, and it was unappealing. It had no flavor, and the shells were soggy. The chicken was flavored with salsa, but it tasted like it was flavored with some cheap tomato sauce. The rice and beans were unremarkable as well. The only good thing about the meal were the chips.\\n Unbelievable to me how the Phoenix area is lacking in decent Mexican restaurants. With such a large Hispanic population, I would think there would be a better selection.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: The d\\u00e9cor is simple but upscale, service is very good, and the price is way high for the tiniest plates I've ever had, but this is some of the best food I've ever had! Just a beautiful exotic dance of familiar flavors, warm and melting in your mouth. The steak melted on my tongue! Where did it go? Just slid down my throat! Sweet Jesus! Went there on a date, spent over a hundred bucks, ordering plate after plate of food that made me cry for what I've missed all my life. Do I still think it's over priced? Yes, because I haven't been back since this time last year! Just too much to pay and still have no leftovers. FYI, I'm 5'8 with a 27 in waist, no fatty but I expect to be fed! Perhaps I also fear that our next encounter cannot top the first, so I savor this sweet memory...", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "ticket:\n  channel: chat\n  body: The d\\u00e9cor is simple but upscale, service is very good, and the price is way high for the tiniest plates I've ever had, but this is some of the best food I've ever had! Just a beautiful exotic dance of familiar flavors, warm and melting in your mouth. The steak melted on my tongue! Where did it go? Just slid down my throat! Sweet Jesus! Went there on a date, spent over a hundred bucks, ordering plate after plate of food that made me cry for what I've missed all my life. Do I still think it's over priced? Yes, because I haven't been back since this time last year! Just too much to pay and still have no leftovers. FYI, I'm 5'8 with a 27 in waist, no fatty but I expect to be fed! Perhaps I also fear that our next encounter cannot top the first, so I savor this sweet memory...", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "As I have been to the Emeril Delmonico restaurant in New Orleans and enjoyed it immensely, I decided to have dinner at the Delmonico Steakhouse located in the Venetian Resort Hotel & Casino where I was attending the Phantom of the Opera later that evening (incredible show by the way!). What you'll find is a variety of food selections with Creole influences. \\n\\nFirst the menu prices are expensive ($$$$) but you are there for the intimate and fine dining experience and should be expecting to pay those prices. What I didn't expect was to be dressed up and have an individual in shorts, sandals, and a Baltimore Colts jersey seated at an adjacent table to me. Kind of lowered my view of this establishment being world class if you know what I mean.\\n\\nI started with the Lobster Bisque which was just superb but did lack the \\\"Creole\\\" twist I was expecting (The BAM factor). Only thing that was a little of an inconvenience was the lobster pieces were quite large and were hard to cut with my spoon. The wife selected the Organic Baby Mixed Greens Salad Creole Spiced Croutons, Sherry Vinaigrette, Shaved Manchego Cheese Roasted Teardrop Tomatoes and Shaved Red Onion. I had a taste and it was very good. The different flavors were unique and distinctive.\\n\\nThe main course", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "As I have been to the Emeril Delmonico restaurant in New Orleans and enjoyed it immensely, I decided to have dinner at the Delmonico Steakhouse located in the Venetian Resort Hotel & Casino where I was attending the Phantom of the Opera later that evening (incredible show by the way!). What you'll find is a variety of food selections with Creole influences. \\n\\nFirst the menu prices are expensive ($$$$) but you are there for the intimate and fine dining experience and should be expecting to pay those prices. What I didn't expect was to be dressed up and have an individual in shorts, sandals, and a Baltimore Colts jersey seated at an adjacent table to me. Kind of lowered my view of this establishment being world class if you know what I mean.\\n\\nI started with the Lobster Bisque which was just superb but did lack the \\\"Creole\\\" twist I was expecting (The BAM factor). Only thing that was a little of an inconvenience was the lobster pieces were quite large and were hard to cut with my spoon. The wife selected the Organic Baby Mixed Greens Salad Creole Spiced Croutons, Sherry Vinaigrette, Shaved Manchego Cheese Roasted Teardrop Tomatoes and Shaved Red Onion. I had a taste and it was very good. The different flavors were unique and distinctive.\\n\\nThe main course", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "We've been eating here since the place opened about 3 years ago. The food has always been good for counter service diner style food and its usually 4 to 5 stars. Never had a problem with quality or value for price. I personally love the pastrami burger and country omelette. The place reminds me of the counter service diners I've been to in downtown Chicago in many ways (anyone reading this old enough to remember the \\\"cheeseburger\\\"sketch on SNL??).\\n\\nHOWEVER- Service is something that could improve. They seem to go through staff like paper towels. I think that may be part of the issue and its a sign of a core issue in management/ownership. Ordering at counter is usually not a bad experience, but I have to agree, that Jim's wife is not a warm and fuzzy person. I have been working in service for the last 30 years and I wouldn't have lasted that long if I I wasn't welcoming and accommodating to my guests. I don't frequent another area diner at Greenway and Reems for that very reason- poor customer service. \\n\\n Yesterday was my worst experience there ever. It was very busy, which you would expect for 10AM Saturday. My 7 year old son really wanted to have breakfast there, so despite the crowd, we ordered. Every table", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "We've been eating here since the place opened about 3 years ago. The food has always been good for counter service diner style food and its usually 4 to 5 stars. Never had a problem with quality or value for price. I personally love the pastrami burger and country omelette. The place reminds me of the counter service diners I've been to in downtown Chicago in many ways (anyone reading this old enough to remember the \\\"cheeseburger\\\"sketch on SNL??).\\n\\nHOWEVER- Service is something that could improve. They seem to go through staff like paper towels. I think that may be part of the issue and its a sign of a core issue in management/ownership. Ordering at counter is usually not a bad experience, but I have to agree, that Jim's wife is not a warm and fuzzy person. I have been working in service for the last 30 years and I wouldn't have lasted that long if I I wasn't welcoming and accommodating to my guests. I don't frequent another area diner at Greenway and Reems for that very reason- poor customer service. \\n\\n Yesterday was my worst experience there ever. It was very busy, which you would expect for 10AM Saturday. My 7 year old son really wanted to have breakfast there, so despite the crowd, we ordered. Every table", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: Prickly pear iced tea, I REPEAT TRY THE PRICKLY PEAR ICED TEA. RIGHT. NOW. The chai tea blew my mind, might have surpassed Lux's (just might have). Tried an apple fritter ball and went to heaven! Okay on a serious note, this is a cute little vegan coffee shop that provides vegan pastries, ice cream (yes to my lactose intolerant friends!), and food. The shop is cute, the two girls that were running the show behind the counter were kickin butt and takin names since they were slammed and they were super helpful to us Nami virgins (my husband and I). We will definitely be back to try the ice cream because we kept on drooling seeing all the people walk by with these amazing looking cups nestled in their hands. OH JYAHHHH.....", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: Prickly pear iced tea, I REPEAT TRY THE PRICKLY PEAR ICED TEA. RIGHT. NOW. The chai tea blew my mind, might have surpassed Lux's (just might have). Tried an apple fritter ball and went to heaven! Okay on a serious note, this is a cute little vegan coffee shop that provides vegan pastries, ice cream (yes to my lactose intolerant friends!), and food. The shop is cute, the two girls that were running the show behind the counter were kickin butt and takin names since they were slammed and they were super helpful to us Nami virgins (my husband and I). We will definitely be back to try the ice cream because we kept on drooling seeing all the people walk by with these amazing looking cups nestled in their hands. OH JYAHHHH.....", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "This place is overrated. I was excited to come here after hearing all the hype. I expected much better quality for the price. We stayed on the 49th floor of the west tower and as soon as we got out of the elevator, it stank like feet and wet dog. The decor was ugly and looked as though it was thrown together in a rush. Our bathroom wallpaper didn't have clean edges and looked about ready to start peeling off. Tsk tsk.\\n\\nWe hung out at the Bamboo pool which got pretty crowded by 1pm on a Monday. We ordered a couple of Bloody Mary's and charged it on a credit card. I was flabbergasted when the waitress came back and the bar said that my credit card was declined. I called the credit card company and they said that I had enough credit on the card and that the Cosmo poolbar charged the card 4 times! I spent 30 sweaty minutes on the phone with the credit card company and the waitress trying to get the charges reversed. The waitress was cooperative, sweet, and real apologetic and said that their system must have gone down. Not a good way to start my pool day but the drinks were really good and I ended up ordering a couple more times anyway,", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "This place is overrated. I was excited to come here after hearing all the hype. I expected much better quality for the price. We stayed on the 49th floor of the west tower and as soon as we got out of the elevator, it stank like feet and wet dog. The decor was ugly and looked as though it was thrown together in a rush. Our bathroom wallpaper didn't have clean edges and looked about ready to start peeling off. Tsk tsk.\\n\\nWe hung out at the Bamboo pool which got pretty crowded by 1pm on a Monday. We ordered a couple of Bloody Mary's and charged it on a credit card. I was flabbergasted when the waitress came back and the bar said that my credit card was declined. I called the credit card company and they said that I had enough credit on the card and that the Cosmo poolbar charged the card 4 times! I spent 30 sweaty minutes on the phone with the credit card company and the waitress trying to get the charges reversed. The waitress was cooperative, sweet, and real apologetic and said that their system must have gone down. Not a good way to start my pool day but the drinks were really good and I ended up ordering a couple more times anyway,", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: The waitress was great, the food was ok, and the hostess was terrible! The manager and hostess sat 2 groups ahead of us that came in after us! The manager gave an excuse that she can't sit too many people at once in one section. There were only 2 in our party! No true apology nor did they offer to make up the inconvenience. I would never go back!!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: The waitress was great, the food was ok, and the hostess was terrible! The manager and hostess sat 2 groups ahead of us that came in after us! The manager gave an excuse that she can't sit too many people at once in one section. There were only 2 in our party! No true apology nor did they offer to make up the inconvenience. I would never go back!!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "When we arrived we were told there was a 45 minute wait. I looked around at all the empty tables... Hmm.. So where are all these people and where are they waiting?\\n\\nShe points me next door to a really cool and swanky lounge. I couldn't tell if this was an extension of the restaurant or a separate entity. Either way it was pretty cool. We sat down and ordered a drink, then not 5 minutes later the hostess came in and told us table was ready. Now I can't really complain that our 45 minute wait turned in to a 5 minute wait, but honestly with all the empty tables in the place it felt as if they were trying to turn people away. \\n\\nThe starter bread was fresh and the pesto was divine. We ordered the eggplant rollatini to start and were sorely disappointed at the mushy mess placed in front of us. It had the consistency of soggy enchiladas and try as I might I could not find eggplant through all the cheese. \\n\\nI ordered a salad and it was forgotten, I asked for it again after we got our main and it was forgotten. The main was a cavatelli something: Pasta, tomatoes, bell pepper, onion and sausage. It was decent, but I could have made it better", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "When we arrived we were told there was a 45 minute wait. I looked around at all the empty tables... Hmm.. So where are all these people and where are they waiting?\\n\\nShe points me next door to a really cool and swanky lounge. I couldn't tell if this was an extension of the restaurant or a separate entity. Either way it was pretty cool. We sat down and ordered a drink, then not 5 minutes later the hostess came in and told us table was ready. Now I can't really complain that our 45 minute wait turned in to a 5 minute wait, but honestly with all the empty tables in the place it felt as if they were trying to turn people away. \\n\\nThe starter bread was fresh and the pesto was divine. We ordered the eggplant rollatini to start and were sorely disappointed at the mushy mess placed in front of us. It had the consistency of soggy enchiladas and try as I might I could not find eggplant through all the cheese. \\n\\nI ordered a salad and it was forgotten, I asked for it again after we got our main and it was forgotten. The main was a cavatelli something: Pasta, tomatoes, bell pepper, onion and sausage. It was decent, but I could have made it better", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Love the Mac and Cheese.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "Love the Mac and Cheese.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Horrible taco place. Do not eat here. We ordered pastor and asada tacos, asada fries and some chicken taquitos.\\n\\nThe pastor was flavorless, just tasted like pork. The asada was also flavorless and had a lot of gristle in it, it was actually hard to eat. Which made the asada fries suck. The fries had cheese sauce instead of shredded cheese. I like a combination of both. Chicken taquitos were the best part of the meal and that's not saying much. How can u screw up a taquito, it's just stuffed and fried. \\n\\nWill never be back and I will steer people away.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "Horrible taco place. Do not eat here. We ordered pastor and asada tacos, asada fries and some chicken taquitos.\\n\\nThe pastor was flavorless, just tasted like pork. The asada was also flavorless and had a lot of gristle in it, it was actually hard to eat. Which made the asada fries suck. The fries had cheese sauce instead of shredded cheese. I like a combination of both. Chicken taquitos were the best part of the meal and that's not saying much. How can u screw up a taquito, it's just stuffed and fried. \\n\\nWill never be back and I will steer people away.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "This is great! I've never had so much fun! We rented tubes and made sure to bring sheets to cover the tubes (so you don't burn because they are black) or bring your own light colored tubes). We also brought coolers with food and drinks (you can bring beer, too I think). There were a few rapids where we went down really fast which was great! People throw marshmallows. I got a great tan, make sure to get spray on sunscreen. There is 1 restroom down the river. I'd recommend avoiding spring break because college students will flash (men & women).", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "This is great! I've never had so much fun! We rented tubes and made sure to bring sheets to cover the tubes (so you don't burn because they are black) or bring your own light colored tubes). We also brought coolers with food and drinks (you can bring beer, too I think). There were a few rapids where we went down really fast which was great! People throw marshmallows. I got a great tan, make sure to get spray on sunscreen. There is 1 restroom down the river. I'd recommend avoiding spring break because college students will flash (men & women).", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "The best thing about this \\\"bar\\\" was the band and the chick bartenders that were nice and made a great cosmo. The worst thing was the actual bar itself. It's so small, and there's not much seating. I guess it's a cool idea. Upstairs, dark, small. Lol, but I thought the bouncer or whatever he was-door guy seemed like he didn't want to be there. Maybe cuz he was stuck outside on the stairs all night. The people there were mostly rude. We did manage to kind of create a dance floor where there wasn't one and then it got fun. But again, not a lot of room to dance. We went on a Sunday night. So perhaps a Friday or Saturday would have a different vibe and crowd. Overall kind of fun for a casual drink or maybe a good place to have a couple drinks before you go out somewhere else. ; )", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "The best thing about this \\\"bar\\\" was the band and the chick bartenders that were nice and made a great cosmo. The worst thing was the actual bar itself. It's so small, and there's not much seating. I guess it's a cool idea. Upstairs, dark, small. Lol, but I thought the bouncer or whatever he was-door guy seemed like he didn't want to be there. Maybe cuz he was stuck outside on the stairs all night. The people there were mostly rude. We did manage to kind of create a dance floor where there wasn't one and then it got fun. But again, not a lot of room to dance. We went on a Sunday night. So perhaps a Friday or Saturday would have a different vibe and crowd. Overall kind of fun for a casual drink or maybe a good place to have a couple drinks before you go out somewhere else. ; )", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "This mammoth furniture/homegoods store can be daunting... and you can waste away hours on end in here looking at everything from door knobs to silverware to silverware to lights. **ADVICE-print out a list FIRST, you can do so at www.ikea.com! AND you don't have to go through the showroom/display room first either, you can skip ahead to the \\\"meat\\\" of the store if you just go to the left and/or downstairs from the cafeteria (they have really good food! and it's CHEAP!). \\n\\nAlso-when you go to write the numbers down off the item you want on your list IN STORE-use the numbers that look like an IP address (example: 201.846.47) and write down the isle and bin numbers... you have to find your items in the warehouse portion before checkout and this makes your life so much easier!!!\\n\\nWe found some unbelievably good deals and the instructions are so easy to follow to put your new furniture/accessories together! Can't wait to go back and check out their holiday decorations! Love this place!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "This mammoth furniture/homegoods store can be daunting... and you can waste away hours on end in here looking at everything from door knobs to silverware to silverware to lights. **ADVICE-print out a list FIRST, you can do so at www.ikea.com! AND you don't have to go through the showroom/display room first either, you can skip ahead to the \\\"meat\\\" of the store if you just go to the left and/or downstairs from the cafeteria (they have really good food! and it's CHEAP!). \\n\\nAlso-when you go to write the numbers down off the item you want on your list IN STORE-use the numbers that look like an IP address (example: 201.846.47) and write down the isle and bin numbers... you have to find your items in the warehouse portion before checkout and this makes your life so much easier!!!\\n\\nWe found some unbelievably good deals and the instructions are so easy to follow to put your new furniture/accessories together! Can't wait to go back and check out their holiday decorations! Love this place!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: Average location. My order was incorrect as was about 5 out of the next 8 I witnessed.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: Average location. My order was incorrect as was about 5 out of the next 8 I witnessed.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: Horrible Service. Extremely slow to seat us... and feed us... and water us... and bill us... slooooow.\\nWe won't be going back.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: Horrible Service. Extremely slow to seat us... and feed us... and water us... and bill us... slooooow.\\nWe won't be going back.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: My husband really likes this place and I think they do a couple things really well-Chicken Parmigiana, Caesar salad and bread (an important part of an Italian meal experience). He gets the Veal Parmigiana or Clam Linguine and always enjoys it. The other things I have tried aren't to my liking, but I think this restaurant is worth a shot.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: My husband really likes this place and I think they do a couple things really well-Chicken Parmigiana, Caesar salad and bread (an important part of an Italian meal experience). He gets the Veal Parmigiana or Clam Linguine and always enjoys it. The other things I have tried aren't to my liking, but I think this restaurant is worth a shot.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "So I went here for lunch the other day with a couple of friends. The food was really good, some of the best thai food I've had in phoenix. I got the drunken noodles and they had a bunch of delicious fresh vegetables and I ordered it medium spicy, and it really was a true medium spicy, not too weak and not too strong. The soup that comes with lunch is really weird... kind of sweet and kind of spicy.... not the best soup ever, so that knocked off a star, but other than that, I thought the food was very good. The prices were a little bit higher than at other Thai food places in the area, but I am willing to pay a bit more for better quality. I will definitely be back.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "So I went here for lunch the other day with a couple of friends. The food was really good, some of the best thai food I've had in phoenix. I got the drunken noodles and they had a bunch of delicious fresh vegetables and I ordered it medium spicy, and it really was a true medium spicy, not too weak and not too strong. The soup that comes with lunch is really weird... kind of sweet and kind of spicy.... not the best soup ever, so that knocked off a star, but other than that, I thought the food was very good. The prices were a little bit higher than at other Thai food places in the area, but I am willing to pay a bit more for better quality. I will definitely be back.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "If you are in a pinch for some quick food while at the hotel this is not a bad choice. I had a sandwich from the deli - the bread was fresh, meat tasty and cooked just right. Unfortunately you pay hotel prices for a small portion.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "If you are in a pinch for some quick food while at the hotel this is not a bad choice. I had a sandwich from the deli - the bread was fresh, meat tasty and cooked just right. Unfortunately you pay hotel prices for a small portion.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Cancun is not very close to the Strip, but it's surprisingly convenient for its far location. Chipotle, Food4Less, and other popular diners/cafes are located within walking distance. \\n\\nI have roomed here almost every time I visit Vegas. The rooms are extremely well-kept, with earthy furnishings and modern accents... I wouldn't call it anything like home, but why else am I on vacation? I don't want to feel as though I'm home!\\n\\nI recall the pool was quite roomy; when I used to swim often, I loved that it wasn't a kiddie pool I could swim across in six seconds or so. The slide is definitely appropriate for older children, though. \\n\\nThe \\\"adults only\\\" gameroom is open to children as long as they look somewhat responsible... I know I don't really pass for 18+ and neither does my friend, yet we always manage to play several rounds of pool. Nobody ever really checks.\\n\\nDo try snagging the penthouse. It feels, at times, more luxurious than home.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "Cancun is not very close to the Strip, but it's surprisingly convenient for its far location. Chipotle, Food4Less, and other popular diners/cafes are located within walking distance. \\n\\nI have roomed here almost every time I visit Vegas. The rooms are extremely well-kept, with earthy furnishings and modern accents... I wouldn't call it anything like home, but why else am I on vacation? I don't want to feel as though I'm home!\\n\\nI recall the pool was quite roomy; when I used to swim often, I loved that it wasn't a kiddie pool I could swim across in six seconds or so. The slide is definitely appropriate for older children, though. \\n\\nThe \\\"adults only\\\" gameroom is open to children as long as they look somewhat responsible... I know I don't really pass for 18+ and neither does my friend, yet we always manage to play several rounds of pool. Nobody ever really checks.\\n\\nDo try snagging the penthouse. It feels, at times, more luxurious than home.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: If you are looking for beer....stop by the pub! The Pub has a ENORMOUS beer menu. We didn't stop in for food, so I can't give any reviews about the grub.", "question": "question: How many stars did this reviewer give?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "ticket:\n  channel: web form\n  body: If you are looking for beer....stop by the pub! The Pub has a ENORMOUS beer menu. We didn't stop in for food, so I can't give any reviews about the grub.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: The food is Good But way too expensive for what you get. \\n\\nEssentially, this place serves elevated Chinese food. They make what seem to be traditional Chinese dishes with elevated ingredients. It sounds great, but I am not sure it was that much more amazing than what we would have gotten at our favorite Chinese restaurant back home. Our final bill for two came out to $170 with tip, and back home a similar meal would have been $45 at most. And to put it into perspective, we didn't order any of the more expensive items. We got a Beef Dish, A chicken dish, and an appetizer and a desert. All the dishes were good. I can understand that better ingredients warrant a higher price but this was a bit much. If the prices were more reasonable, I would have given it a higher rating.. \\n\\nI will admit that the service was amazing. There were multiple servers all concerned with every aspect of the meal. The decor was amazing, it almost seemed like a cirque du soleil Set.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: The food is Good But way too expensive for what you get. \\n\\nEssentially, this place serves elevated Chinese food. They make what seem to be traditional Chinese dishes with elevated ingredients. It sounds great, but I am not sure it was that much more amazing than what we would have gotten at our favorite Chinese restaurant back home. Our final bill for two came out to $170 with tip, and back home a similar meal would have been $45 at most. And to put it into perspective, we didn't order any of the more expensive items. We got a Beef Dish, A chicken dish, and an appetizer and a desert. All the dishes were good. I can understand that better ingredients warrant a higher price but this was a bit much. If the prices were more reasonable, I would have given it a higher rating.. \\n\\nI will admit that the service was amazing. There were multiple servers all concerned with every aspect of the meal. The decor was amazing, it almost seemed like a cirque du soleil Set.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Food was ok, but the service was awful. We asked for lemon with our water on the first and infrequent visit by our server and asked again at water delivery only to wait 10 minutes more. My wife is pregnant and when ordering a lemonade he actually chuckled. Entrees arrived and the server was no where to be found to see if we had what we needed. Turns out my steak wasn't delivered with a steak knife so I asked the guy who I'd seen make 4 rounds and figured was the manager, even though he never actually talked to any of the tables, for a knife since I couldn't seem to find my actual server. 5 minutes later I had what I needed to eat my meal. No doubt that the lack of service starts at the top. \\n\\nLike I said, food was ok, but way overshadowed by the lack of service. I would figure that a Ramsey restaurant would pride themselves on that front but i figure Gordon is too busy with TV shows and opening a plethora of joints while his stock is worth anything. Great corn soup with crab, smashed fingerlings are awesome, just wish the staff wasn't disaffected like their attire.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "Food was ok, but the service was awful. We asked for lemon with our water on the first and infrequent visit by our server and asked again at water delivery only to wait 10 minutes more. My wife is pregnant and when ordering a lemonade he actually chuckled. Entrees arrived and the server was no where to be found to see if we had what we needed. Turns out my steak wasn't delivered with a steak knife so I asked the guy who I'd seen make 4 rounds and figured was the manager, even though he never actually talked to any of the tables, for a knife since I couldn't seem to find my actual server. 5 minutes later I had what I needed to eat my meal. No doubt that the lack of service starts at the top. \\n\\nLike I said, food was ok, but way overshadowed by the lack of service. I would figure that a Ramsey restaurant would pride themselves on that front but i figure Gordon is too busy with TV shows and opening a plethora of joints while his stock is worth anything. Great corn soup with crab, smashed fingerlings are awesome, just wish the staff wasn't disaffected like their attire.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Every neighborhood needs an Irish pub, right?!!!!\\n\\nTurf is a solid 3.5 stars. Nice choice of pints on draught and everyone needs a Black & Tan from time to time. Always a lively environment and they had a good house band the night before St Patty's day.\\n\\nHave only eaten once and tried Boxty for the first time. It was a good hearty meal and they have a dog friendly patio.\\n\\nThey also have off track betting...hence the name...which makes for a lively environment when the races are on.\\n\\nHave always had friendly service even when we're the loudest people in the place.\\n\\nSlainte!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "Every neighborhood needs an Irish pub, right?!!!!\\n\\nTurf is a solid 3.5 stars. Nice choice of pints on draught and everyone needs a Black & Tan from time to time. Always a lively environment and they had a good house band the night before St Patty's day.\\n\\nHave only eaten once and tried Boxty for the first time. It was a good hearty meal and they have a dog friendly patio.\\n\\nThey also have off track betting...hence the name...which makes for a lively environment when the races are on.\\n\\nHave always had friendly service even when we're the loudest people in the place.\\n\\nSlainte!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "I'd give this place five stars, but they made me mad by firing two of their COOLEST employees! Grr! I do not concur with the company policy that lead to their joining the ranks of the unemployed, because they had some seriously top-notch recommendations for the adventurous beer drinker. It was through their recommendations that I sampled some of Lee's better offerings and their loss is sorely missed.\\n\\nOn the other hand, I AM a girl who enjoys herself some booze, so I will continue shopping here. However, I'm hard pressed to put a can of MGD or 'Bud' to my lips and actually enjoy. If I have any say in the matter what-so-ever, I'd do a jig and a half to have a Leinenkugels Sunset Wheat or a Hoegaarden, a Dogfish Head Raison D'Etre or even a Negro Modelo instead. I like beer, and I like beer with flavor. Not a donkey-punch to the tongue bitter, of course, but something with a distinctive flavor that sets it apart from the water. \\n\\nLee's has a vast selection of unique beers to choose from, including Delerium Nocturnum and Delirium Noel, which are both delicious. There are also lots of European imports and microbrew beers worth trying. I like that individual large bottles are available, making it easier to sample flavors that may", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "I'd give this place five stars, but they made me mad by firing two of their COOLEST employees! Grr! I do not concur with the company policy that lead to their joining the ranks of the unemployed, because they had some seriously top-notch recommendations for the adventurous beer drinker. It was through their recommendations that I sampled some of Lee's better offerings and their loss is sorely missed.\\n\\nOn the other hand, I AM a girl who enjoys herself some booze, so I will continue shopping here. However, I'm hard pressed to put a can of MGD or 'Bud' to my lips and actually enjoy. If I have any say in the matter what-so-ever, I'd do a jig and a half to have a Leinenkugels Sunset Wheat or a Hoegaarden, a Dogfish Head Raison D'Etre or even a Negro Modelo instead. I like beer, and I like beer with flavor. Not a donkey-punch to the tongue bitter, of course, but something with a distinctive flavor that sets it apart from the water. \\n\\nLee's has a vast selection of unique beers to choose from, including Delerium Nocturnum and Delirium Noel, which are both delicious. There are also lots of European imports and microbrew beers worth trying. I like that individual large bottles are available, making it easier to sample flavors that may", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Love this place! BEST AND COLDEST BEERS in Vegas! It is my (and my husband's) new favorite place to watch sports! And who doesn't love an AWESOME cold beer while watching your favorite sports team?! Their hot wings are great, hamburgers are super yummy, flavorful, and juicy. We've been here at least 3 times in the last week...especially since it's hockey playoff season! ;)", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "Love this place! BEST AND COLDEST BEERS in Vegas! It is my (and my husband's) new favorite place to watch sports! And who doesn't love an AWESOME cold beer while watching your favorite sports team?! Their hot wings are great, hamburgers are super yummy, flavorful, and juicy. We've been here at least 3 times in the last week...especially since it's hockey playoff season! ;)", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "First off, I asked for aisle seats live and in person at the box office. When we arrived, we found that we were indeed at the end of a row, but not an aisle. We had to climb over 12 people to get to our seats, which made it very uncomfortable when we walked out in the middle of the performance.... very boring.\\n\\nEvery seat in this theater-in-the-round has partially obstructed views\\n\\nDo not get me wrong, the acrobats are very talented and I am a big fan of Mystere, O and KA, but even the failed Elvis show was better than this.\\n\\nDo not waste your money!", "question": "question: How many stars did this reviewer give?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "First off, I asked for aisle seats live and in person at the box office. When we arrived, we found that we were indeed at the end of a row, but not an aisle. We had to climb over 12 people to get to our seats, which made it very uncomfortable when we walked out in the middle of the performance.... very boring.\\n\\nEvery seat in this theater-in-the-round has partially obstructed views\\n\\nDo not get me wrong, the acrobats are very talented and I am a big fan of Mystere, O and KA, but even the failed Elvis show was better than this.\\n\\nDo not waste your money!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Got the Rock Star Mani.. I love it..", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Got the Rock Star Mani.. I love it..", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: I'd give it zero stars if I could, based solely on service. The pizza was typical Pizza Hut--I don't think it ever tastes different. I called in my order on a Friday night and was told it would be 15 minutes. I got there right around then, paid (wasn't given a receipt), and was told my order was still in the oven. Okay, no big deal. I assume they'd let me know when it was done. that was a mistake!! After sitting there another 15 minutes (so, 30 minutes after I had originally called and was told it would be 15 minutes) I finally asked. They asked for my receipt--it was a different cashier--and looked annoyed at me that I didn't have it. She reluctantly went to check on my order and brought it back. When I told her how long I'd been sitting there waiting she said, \\\"Oh I didn't realize you were waiting.\\\" Oh really? You get a lot of people just hanging out here not waiting for a pizza? I can understand it being busy on a Friday night, but to not even apologize for their complete lack of service really ticked me off. We rarely order chain pizza anyway, but the next time I need to for some reason, it will not be from here!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: I'd give it zero stars if I could, based solely on service. The pizza was typical Pizza Hut--I don't think it ever tastes different. I called in my order on a Friday night and was told it would be 15 minutes. I got there right around then, paid (wasn't given a receipt), and was told my order was still in the oven. Okay, no big deal. I assume they'd let me know when it was done. that was a mistake!! After sitting there another 15 minutes (so, 30 minutes after I had originally called and was told it would be 15 minutes) I finally asked. They asked for my receipt--it was a different cashier--and looked annoyed at me that I didn't have it. She reluctantly went to check on my order and brought it back. When I told her how long I'd been sitting there waiting she said, \\\"Oh I didn't realize you were waiting.\\\" Oh really? You get a lot of people just hanging out here not waiting for a pizza? I can understand it being busy on a Friday night, but to not even apologize for their complete lack of service really ticked me off. We rarely order chain pizza anyway, but the next time I need to for some reason, it will not be from here!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: I had a horrible experience here! I am from Hawaii and usually get my nails done there but I am often in the Vegas area for work so I thought I would give this place a try. I am sorry that I did! I needed to take off and do a new set since my french nails had grown out. Instead of telling me that they did back fills, she took them off. First of all though, they did my pedicure. Normally, while doing my pedicure, most places that I have patroned will soak my nails to make it easier and faster to remove them later. Not this place! So, she starts to take off my nails using another nail tip. The place where I get my nails done in Hawaii does a really good job of bonding the acrylics to my natural nails so she had a hard time with taking them off. I have a pretty good tolerance for pain but after a while, I couldn't take it! She kept saying over and over again how this was the first time she had had any trouble taking off nails before. I mean constantly saying it to the point where I started to get irritated! I wanted to tell her to just shut her trap because she kept saying", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: I had a horrible experience here! I am from Hawaii and usually get my nails done there but I am often in the Vegas area for work so I thought I would give this place a try. I am sorry that I did! I needed to take off and do a new set since my french nails had grown out. Instead of telling me that they did back fills, she took them off. First of all though, they did my pedicure. Normally, while doing my pedicure, most places that I have patroned will soak my nails to make it easier and faster to remove them later. Not this place! So, she starts to take off my nails using another nail tip. The place where I get my nails done in Hawaii does a really good job of bonding the acrylics to my natural nails so she had a hard time with taking them off. I have a pretty good tolerance for pain but after a while, I couldn't take it! She kept saying over and over again how this was the first time she had had any trouble taking off nails before. I mean constantly saying it to the point where I started to get irritated! I wanted to tell her to just shut her trap because she kept saying", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Took the family out to this Macaroni Grill because we wanted to avoid the crazy wait at the Olive Garden in Surprise.\\n\\nWas able to get right in and be seated immediately which was nice. Service was prompt, efficient, and attentive.\\n\\nThe server apologized upon bringing out my dish, (spaghetti and meatballs) because the kitchen did not put enough meatballs on my dish and she said there would be a slight delay in getting them and that they were comping my meal from the ticket. Wow! I was impressed, because I really would not have minded a wait, so it was a nice and professional gesture.\\n\\nAnyways, overall the food was good, portions were insanely huge and as I write this I have my leftovers to finish for lunch. Overall, I think this location does a great job and has an interesting menu. \\n\\nEnjoy!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "Took the family out to this Macaroni Grill because we wanted to avoid the crazy wait at the Olive Garden in Surprise.\\n\\nWas able to get right in and be seated immediately which was nice. Service was prompt, efficient, and attentive.\\n\\nThe server apologized upon bringing out my dish, (spaghetti and meatballs) because the kitchen did not put enough meatballs on my dish and she said there would be a slight delay in getting them and that they were comping my meal from the ticket. Wow! I was impressed, because I really would not have minded a wait, so it was a nice and professional gesture.\\n\\nAnyways, overall the food was good, portions were insanely huge and as I write this I have my leftovers to finish for lunch. Overall, I think this location does a great job and has an interesting menu. \\n\\nEnjoy!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: MEAN people.. Our dog is a customer, called at 11:00AM on a Saturday, with our dog howling so loud that you could hear him a block away. We knew it was his time to put him down. However, Matthews refused because they were closing at noon. Can you believe that? They said to take him to an emergency clinic and we told them we could not afford that. We had already checked prices weeks before, because we knew it was getting close. We had already been sedating him and giving him pain meds. So,I called again at 11:30 to beg them to take him. While I was on the phone they mistook me for another customer and said that it was okay, Dr. Pritchett would wait to see their dog, which they were putting down. Now, that was biased! It was okay for them, but not for us. Obviously, Dr. Pritchard was already waiting.. I think this was absolutely MEAN, not do take him in. Where is the passion when you need it??", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "ticket:\n  channel: chat\n  body: MEAN people.. Our dog is a customer, called at 11:00AM on a Saturday, with our dog howling so loud that you could hear him a block away. We knew it was his time to put him down. However, Matthews refused because they were closing at noon. Can you believe that? They said to take him to an emergency clinic and we told them we could not afford that. We had already checked prices weeks before, because we knew it was getting close. We had already been sedating him and giving him pain meds. So,I called again at 11:30 to beg them to take him. While I was on the phone they mistook me for another customer and said that it was okay, Dr. Pritchett would wait to see their dog, which they were putting down. Now, that was biased! It was okay for them, but not for us. Obviously, Dr. Pritchard was already waiting.. I think this was absolutely MEAN, not do take him in. Where is the passion when you need it??", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "ticket:\n  channel: web form\n  body: I don't know what to say-I have been all over the world and this place is among the top three restaurants I've ever been to. The oyster selection is immense. We tried three varieties, all spectacular, but the one the server recommended (wildcat) was probably the best oyster I've ever had. \\n\\nI didn't know seafood could be this good on the east coast. I cannot recommend this place enough!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "ticket:\n  channel: web form\n  body: I don't know what to say-I have been all over the world and this place is among the top three restaurants I've ever been to. The oyster selection is immense. We tried three varieties, all spectacular, but the one the server recommended (wildcat) was probably the best oyster I've ever had. \\n\\nI didn't know seafood could be this good on the east coast. I cannot recommend this place enough!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Mango Habanero tacos. Amazing. The employees here saw that we were hungry, and they were slammed. I was so elated when they swung by and gave my boyfriend and I a total of 4 free meal coupons out of a thank you. A little patience goes a long way, and so does gratitude for your customers. Best Rubio's ever! :)", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "Mango Habanero tacos. Amazing. The employees here saw that we were hungry, and they were slammed. I was so elated when they swung by and gave my boyfriend and I a total of 4 free meal coupons out of a thank you. A little patience goes a long way, and so does gratitude for your customers. Best Rubio's ever! :)", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "The food and the service was really good. Best burgers in town. The stuff very was friendly.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "The food and the service was really good. Best burgers in town. The stuff very was friendly.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: Today at Brocach was a total miss. My boyfriend ordered the poutine with corn beef which came out so cold the cheese curds didn't melt into the fries. Corn beef had great flavor though. I ordered the crab cake eggs benedict. It was served barely warm and one of the crab cakes was about half the size of the other one. I later ordered a pancake from the menu and was told they took pancakes off the menu. When I asked why they were still on the menu if they weren't offering them anymore the server checked with the kitchen and they made the pancake. I was grateful but when the pancake was served it was half their normal size. Don't know what was up with Brocach today but they had the B or C Team working the kitchen.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: Today at Brocach was a total miss. My boyfriend ordered the poutine with corn beef which came out so cold the cheese curds didn't melt into the fries. Corn beef had great flavor though. I ordered the crab cake eggs benedict. It was served barely warm and one of the crab cakes was about half the size of the other one. I later ordered a pancake from the menu and was told they took pancakes off the menu. When I asked why they were still on the menu if they weren't offering them anymore the server checked with the kitchen and they made the pancake. I was grateful but when the pancake was served it was half their normal size. Don't know what was up with Brocach today but they had the B or C Team working the kitchen.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "The wait times were ridiculous. 4 people were ahead of our group in line, and it took an hour before we gave our orders. It took 15 minutes for the burgers to be made, which is pretty long for a place that seems like a fast food joint. \\n\\nThe worst part was the manager. The manager presented himself, and made no apologies about the long wait. He did not make any effort to make the customers happy (like offering complimentary drinks or something). When we voiced our displeasure, he left the restaurant, and did not come back. For the time he was there, he did not attempt to help the overwhelmed employees. \\n\\nAbsolutely no pride in his establishment and obviously no care for the customers.\\n\\nIn the end, the burger was average and overcooked. The bison burger is not worth 9 dollars.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "The wait times were ridiculous. 4 people were ahead of our group in line, and it took an hour before we gave our orders. It took 15 minutes for the burgers to be made, which is pretty long for a place that seems like a fast food joint. \\n\\nThe worst part was the manager. The manager presented himself, and made no apologies about the long wait. He did not make any effort to make the customers happy (like offering complimentary drinks or something). When we voiced our displeasure, he left the restaurant, and did not come back. For the time he was there, he did not attempt to help the overwhelmed employees. \\n\\nAbsolutely no pride in his establishment and obviously no care for the customers.\\n\\nIn the end, the burger was average and overcooked. The bison burger is not worth 9 dollars.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Glitz and glamour it isn't, but for a fair deal a one bedroom suite with a living room, pull out couch, and kitchenette right on the strip, this is your place. \\nThey describe it as \\\"snuggled away\\\" next to the Cosmo, I say it's practically hidden. This tiny, family owned spot is easy to miss but once you find it, you realize it's a pretty nice location; Easy walking distance to everything. It really has to be one of the best values if you have a big group as I did for a bachelorette party or you are counting your pennies and still want the popular location.\\nThe rooms aren't ugly or smelly and the other guests seem more or less respectable, but it's definitely bare bones place: tacky, tiny onsite pool, no casino, and no view (don't let that main picture fool you- my room looked at the service car driveway, not the Bellagio Fountains). This is truly just a place to sleep, eat left-overs in the morning, and pre-drink. We had a group of 8 that stayed in two different rooms and everyone had a place to crash at night and we stored our food and treats in the fridges so it worked. The beds and bathroom are just ok, nothing amazing but enough room for everyone. The beds", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "Glitz and glamour it isn't, but for a fair deal a one bedroom suite with a living room, pull out couch, and kitchenette right on the strip, this is your place. \\nThey describe it as \\\"snuggled away\\\" next to the Cosmo, I say it's practically hidden. This tiny, family owned spot is easy to miss but once you find it, you realize it's a pretty nice location; Easy walking distance to everything. It really has to be one of the best values if you have a big group as I did for a bachelorette party or you are counting your pennies and still want the popular location.\\nThe rooms aren't ugly or smelly and the other guests seem more or less respectable, but it's definitely bare bones place: tacky, tiny onsite pool, no casino, and no view (don't let that main picture fool you- my room looked at the service car driveway, not the Bellagio Fountains). This is truly just a place to sleep, eat left-overs in the morning, and pre-drink. We had a group of 8 that stayed in two different rooms and everyone had a place to crash at night and we stored our food and treats in the fridges so it worked. The beds and bathroom are just ok, nothing amazing but enough room for everyone. The beds", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "I was wary of another Asian market opening up in Phoenix because for several years, I was absolutely devoted to Lee Lee's. But Mekong Market won me over. Their produce is clean and fresh, and they have a great variety of, well, everything. Most recently, they also played a bunch of Michael Jackson music, so that was plus.", "question": "question: How many stars did this reviewer give?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "I was wary of another Asian market opening up in Phoenix because for several years, I was absolutely devoted to Lee Lee's. But Mekong Market won me over. Their produce is clean and fresh, and they have a great variety of, well, everything. Most recently, they also played a bunch of Michael Jackson music, so that was plus.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Both my wife and I ordered burgers. I had the pesto burger as seen on triple d and she had the cheeseburger with saut\\u00e9ed onions. I had the onion rings and she had the garlic fries. To be honest I expected more from the burger that was featured, it was ok, I was not blown away by it. However, the onion rings and fries were the bomb! My wife enjoyed her burger as well. Will return for sure.", "question": "question: How many stars did this reviewer give?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "Both my wife and I ordered burgers. I had the pesto burger as seen on triple d and she had the cheeseburger with saut\\u00e9ed onions. I had the onion rings and she had the garlic fries. To be honest I expected more from the burger that was featured, it was ok, I was not blown away by it. However, the onion rings and fries were the bomb! My wife enjoyed her burger as well. Will return for sure.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "The only place that I trust to do a great job on a pedicure, manicure and eyebrows. The standard pedicure includes a paraffin wax treatment that leaves your feet super smooth, also my nail polish always lasts a long time whenever I get my nails done here. Great prices and I am always satisfied with the end product, however, do be prepared to wait on Saturdays!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "The only place that I trust to do a great job on a pedicure, manicure and eyebrows. The standard pedicure includes a paraffin wax treatment that leaves your feet super smooth, also my nail polish always lasts a long time whenever I get my nails done here. Great prices and I am always satisfied with the end product, however, do be prepared to wait on Saturdays!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "I had a lunch here not long ago, but it was nothing exciting. It wasn't even the best Old Country Buffet I have visited. The food was very basic and it was hard for me to find things that I really enjoyed. Because of that I decided to eat healthier options that I don't fix on my own, so I suppose that was good in a way. I would say its a good place to go if you are looking for home cooked type foods, but don't want to cook yourself. Just keep in mind that you won't find food that is overly tasty, if at all, here.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "I had a lunch here not long ago, but it was nothing exciting. It wasn't even the best Old Country Buffet I have visited. The food was very basic and it was hard for me to find things that I really enjoyed. Because of that I decided to eat healthier options that I don't fix on my own, so I suppose that was good in a way. I would say its a good place to go if you are looking for home cooked type foods, but don't want to cook yourself. Just keep in mind that you won't find food that is overly tasty, if at all, here.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: I was so excited after a trip to NYC to learn that there was a place offering a Kronut in Charlotte. The flaky, buttery, layered goodness of a Kronut was in my home town!\\n\\nTHIS WAS NOT THE CASE. It was essentially a undercooked croissant, that was somehow dry on the outside, rolled in cinnamon and sugar. Nothing flaky about it. It wasn't even circular! Charlotte is just going to have to wait for another bakery to step up and make a Kronut the way it was intended.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: I was so excited after a trip to NYC to learn that there was a place offering a Kronut in Charlotte. The flaky, buttery, layered goodness of a Kronut was in my home town!\\n\\nTHIS WAS NOT THE CASE. It was essentially a undercooked croissant, that was somehow dry on the outside, rolled in cinnamon and sugar. Nothing flaky about it. It wasn't even circular! Charlotte is just going to have to wait for another bakery to step up and make a Kronut the way it was intended.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "This place was so crowded! We went on a tuesday night and it was absolutely packed, not just at the bar but at all the tables as well. My wife and I decided to give this place a try since it is just down the street of our new apartment and we were hoping it would make for a good alternative to our usual sushi place, Yama. Afterwards we decided it was an OK place, but the extra drive to Yama was worth it for the better quality food. \\n\\n\\n\\nOk, so the good parts first I think... first, all you can drink soda was a plus, most sushi places will just give you a can of soda but this place gave nice big glasses. Servers were also very quick on the refills, and since I can down a glass of soda or water very quickly during a meal I kept out waiters busy, lol.\\n\\nWe both got the AYCE at the sushi bar and once we got the attention of our sushi chef started ordering. Most of the food was OK, the baked green mussels were about average while the garlic albacore was delicious. My wife absolutely loved their special \\\"Sushi Bon\\\" dish, one of their new specials. For dessert my wife and I also recommend the lychee sorbet, very tasty.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "This place was so crowded! We went on a tuesday night and it was absolutely packed, not just at the bar but at all the tables as well. My wife and I decided to give this place a try since it is just down the street of our new apartment and we were hoping it would make for a good alternative to our usual sushi place, Yama. Afterwards we decided it was an OK place, but the extra drive to Yama was worth it for the better quality food. \\n\\n\\n\\nOk, so the good parts first I think... first, all you can drink soda was a plus, most sushi places will just give you a can of soda but this place gave nice big glasses. Servers were also very quick on the refills, and since I can down a glass of soda or water very quickly during a meal I kept out waiters busy, lol.\\n\\nWe both got the AYCE at the sushi bar and once we got the attention of our sushi chef started ordering. Most of the food was OK, the baked green mussels were about average while the garlic albacore was delicious. My wife absolutely loved their special \\\"Sushi Bon\\\" dish, one of their new specials. For dessert my wife and I also recommend the lychee sorbet, very tasty.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "\\\"Ok..... bare-able.... but not good\\\"\\n\\nBeen here many times... Keep trying to believe Big Bens will come thru.... Oh well\\n\\nFood is still par... Absolutely nothing to write home about.\\n\\nAnd the bar...How frustrating ..... Still charging way too much.\\n\\nWe truly tried, tried and tried again.... Good bye, Big Bens.", "question": "question: How many stars did this reviewer give?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "\\\"Ok..... bare-able.... but not good\\\"\\n\\nBeen here many times... Keep trying to believe Big Bens will come thru.... Oh well\\n\\nFood is still par... Absolutely nothing to write home about.\\n\\nAnd the bar...How frustrating ..... Still charging way too much.\\n\\nWe truly tried, tried and tried again.... Good bye, Big Bens.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Pretty much the only soul food in the stucco landscape of Scottsdale. The service and food is spot on for all things southern. Red velvet cake and grape koolaid are available here too. If you want some serious southern food, head to Mrs. White's Golden Rule Cafe (Lolo's grandma is Mrs. White). Love the pork chops and black eye peas! Both of these places are a local treasure!", "question": "question: How many stars did this reviewer give?\nfocus: Pick the single best fit.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "Pretty much the only soul food in the stucco landscape of Scottsdale. The service and food is spot on for all things southern. Red velvet cake and grape koolaid are available here too. If you want some serious southern food, head to Mrs. White's Golden Rule Cafe (Lolo's grandma is Mrs. White). Love the pork chops and black eye peas! Both of these places are a local treasure!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: Pho Mailan is a good restaurant with good service. I always get the Summer Rolls and Pho Meatball which both have great flavor. I usually go in on a Sunday evening as they have the football game on a flat screen. Glad there is one near home now. I will definitly be back", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: Pho Mailan is a good restaurant with good service. I always get the Summer Rolls and Pho Meatball which both have great flavor. I usually go in on a Sunday evening as they have the football game on a flat screen. Glad there is one near home now. I will definitly be back", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Wow.... has this corner of Sunnyslope changed!\\n\\n10 years ago I worked in an office building across the street, at an Internet startup. The day we moved in, there was a double homicide at the Circle K on Dunlap and Central. After that, I brought my baseball bat to work every day, because I usually didn't leave until late at night when crack zombies congregated in the parking garage below the building. I called it \\n\\\"Louis,\\\" my coworker called it (very Un-PC) the Ethnic Cleanser. \\n\\nNow.... the ghetto elements are gone, and there is a wonderful wine bar with an even better patio.\\n\\nWe put down a bottle of the Rose - it was very, very tasty and drinkable. We went on a Sunday, all they serve then is their breakfast menu. Well... it rocked. I had the veggie and cheese omelette, my guest had the chorizo wrap. Both were superb! The service was attentive, the ambiance was awesome both indoors and outdoors. The patio is shaded by some giant mesquites, with comfortable couch and chair seating. \\n\\nI'll be back! Especially for the goat and sheep cheese plate, and to try some of the rest of their fantastic wine selection. Ole!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "Wow.... has this corner of Sunnyslope changed!\\n\\n10 years ago I worked in an office building across the street, at an Internet startup. The day we moved in, there was a double homicide at the Circle K on Dunlap and Central. After that, I brought my baseball bat to work every day, because I usually didn't leave until late at night when crack zombies congregated in the parking garage below the building. I called it \\n\\\"Louis,\\\" my coworker called it (very Un-PC) the Ethnic Cleanser. \\n\\nNow.... the ghetto elements are gone, and there is a wonderful wine bar with an even better patio.\\n\\nWe put down a bottle of the Rose - it was very, very tasty and drinkable. We went on a Sunday, all they serve then is their breakfast menu. Well... it rocked. I had the veggie and cheese omelette, my guest had the chorizo wrap. Both were superb! The service was attentive, the ambiance was awesome both indoors and outdoors. The patio is shaded by some giant mesquites, with comfortable couch and chair seating. \\n\\nI'll be back! Especially for the goat and sheep cheese plate, and to try some of the rest of their fantastic wine selection. Ole!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "The food at Davios is excellent, service is wonderful.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "The food at Davios is excellent, service is wonderful.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Pretty expensive considering the price of one cup of frozen yogurt is the price of a meal at most campus restaurants.\\n\\nA good variety of things you can add on. \\n\\nDon't like the bubble tea, far from what I had in chicago chinatown", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "Pretty expensive considering the price of one cup of frozen yogurt is the price of a meal at most campus restaurants.\\n\\nA good variety of things you can add on. \\n\\nDon't like the bubble tea, far from what I had in chicago chinatown", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Part of the Lettuce Entertain You group of restaurants, Cafe Ba Ba Reeba started out in Chicago, then opened a branch in Las Vegas. It specializes in tapas. Originally intended as bar snacks, the term now refers to small portions of food (at least in the United States). Choose a few and you have a meal; choose a bunch and you have a meal for a group of friends.\\n\\nIn addition to tapas, the menu offers paella and a few other items, but tapas are the stars. There are more than 50 choices, plus another dozen desserts. Cold tapas include serrano ham, olives and chicken salad; hot tapas include octopus, empanadas and roast dates with bacon.\\n\\nThe inside dining areas are dark: dark stained wood flooring, dark wood tables, moderate lighting. Loud guitar music plays; a Flamenco version of \\\"California Dreamin'\\\" was one of the more unusual selections. The outside area, facing the strip, seemed much more inviting, but it was too hot outside for me. Service was prompt; I ordered tapas one at a time, and they arrived pretty quickly.\\n\\nAt Cafe Ba Ba Reeba, tapas have been supersized. A typical dish could serve as a small appetizer for four people, or as an hors d'oeuvre for even more people. I was hard pressed to finish just three plates. Serrano ham, salchichon,", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "Part of the Lettuce Entertain You group of restaurants, Cafe Ba Ba Reeba started out in Chicago, then opened a branch in Las Vegas. It specializes in tapas. Originally intended as bar snacks, the term now refers to small portions of food (at least in the United States). Choose a few and you have a meal; choose a bunch and you have a meal for a group of friends.\\n\\nIn addition to tapas, the menu offers paella and a few other items, but tapas are the stars. There are more than 50 choices, plus another dozen desserts. Cold tapas include serrano ham, olives and chicken salad; hot tapas include octopus, empanadas and roast dates with bacon.\\n\\nThe inside dining areas are dark: dark stained wood flooring, dark wood tables, moderate lighting. Loud guitar music plays; a Flamenco version of \\\"California Dreamin'\\\" was one of the more unusual selections. The outside area, facing the strip, seemed much more inviting, but it was too hot outside for me. Service was prompt; I ordered tapas one at a time, and they arrived pretty quickly.\\n\\nAt Cafe Ba Ba Reeba, tapas have been supersized. A typical dish could serve as a small appetizer for four people, or as an hors d'oeuvre for even more people. I was hard pressed to finish just three plates. Serrano ham, salchichon,", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "- role: customer\n  content: Amazing....hyper clean, friendly and very nice overall. Plenty of relaxation and naked bodies for all. If you have a naked phobia this might not be the place for you or stay upstairs. I'm a regular especially in the dry salt room!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "- role: customer\n  content: Amazing....hyper clean, friendly and very nice overall. Plenty of relaxation and naked bodies for all. If you have a naked phobia this might not be the place for you or stay upstairs. I'm a regular especially in the dry salt room!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "from the music to the coffee to the furniture this place gets it, or at least gets it for me. i havent had a bad coffee there yet. the brownies are super rediculous good. the music is loud and not on the radio.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "from the music to the coffee to the furniture this place gets it, or at least gets it for me. i havent had a bad coffee there yet. the brownies are super rediculous good. the music is loud and not on the radio.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "We had a TCBY on campus at college, so when I found that they are now self serve I was surprised!...very similar to Menchies/YoForia... But glad, i like to pick a few different flavors and have the amount that I choose. They have great flavor and topping choices. \\nEverything still tastes the same as i remember, but now you self-serve.\\n\\nI didn't like that they don't have the tiny taste-tester cups like at the other Fro-Yo places- you never know if you are going to like a flavor based on the name!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "We had a TCBY on campus at college, so when I found that they are now self serve I was surprised!...very similar to Menchies/YoForia... But glad, i like to pick a few different flavors and have the amount that I choose. They have great flavor and topping choices. \\nEverything still tastes the same as i remember, but now you self-serve.\\n\\nI didn't like that they don't have the tiny taste-tester cups like at the other Fro-Yo places- you never know if you are going to like a flavor based on the name!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "We were excited for this new little Mexican addition to the south side. The service here is inattentive at best. We were left sitting at our table forever. No one seemed to know whose table was whose, nor did they seem to care. We finally asked for wait staff to bring us water, cutlery and a menu. Not good for a new place.", "question": "question: How many stars did this reviewer give?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "1", "ordinal": true, "source": "yelp"}
{"request": {"context": "We were excited for this new little Mexican addition to the south side. The service here is inattentive at best. We were left sitting at our table forever. No one seemed to know whose table was whose, nor did they seem to care. We finally asked for wait staff to bring us water, cutlery and a menu. Not good for a new place.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Best pizza in Charlotte (my opinion). The thin crust is really good- it's like a giant cracker. The sauce is not too thick and relatively sweet. Very generous with the pepperonis- they cover the whole pizza. Wait time is also super short. Call ahead pick-up usually gets a pie in 10-15 minutes. \\n\\nIf you live in an apartment, delivery might take a while, but I guess that depends on how intuitive the building numbers are (mine sucks). There's that, but pick-up is usually flawless.", "question": "question: How many stars did this reviewer give?\nfocus: Use only the information given.", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "Best pizza in Charlotte (my opinion). The thin crust is really good- it's like a giant cracker. The sauce is not too thick and relatively sweet. Very generous with the pepperonis- they cover the whole pizza. Wait time is also super short. Call ahead pick-up usually gets a pie in 10-15 minutes. \\n\\nIf you live in an apartment, delivery might take a while, but I guess that depends on how intuitive the building numbers are (mine sucks). There's that, but pick-up is usually flawless.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: I've only been here at night so far, and last night was only my second time. It's a great small town bar, everyone knows each other and they are all very friendly. If you find yourself in Maricopa at night and you're looking for the night scene this is it.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "ticket:\n  channel: chat\n  body: I've only been here at night so far, and last night was only my second time. It's a great small town bar, everyone knows each other and they are all very friendly. If you find yourself in Maricopa at night and you're looking for the night scene this is it.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "My husband and I were just at this restaurant for dinner last Saturday night. We go to Las Vegas several times a year and always eat at a highly reviewed restaurant.\\n\\nThe restaurant is beautiful with enough atmosphere yet enough quiet places. Our waitress was really knowledgeable and terrific. The bread basket was yummy and plentiful....although we would have liked to have been asked if we wanted more. My mojito and husband's peach margarita were refreshing. My husband had the chicken (($24) and I had the veal chop ($42). Mine included a tamale, my husbands just the chicken. With cocktails at $12-13 things get expensive fast...which we knew.\\n\\nMy veal chop was really really good as was my husband's chicken. BUT, when you spend $150 for 2 I really expect to be at the restaurant for 1.5-2 hours....fine dining. After an hour the busboy came by to clear my plate....I wasn't done and did not intend to be done as this was our evening out. After the third time I asked him to please stop asking me if I was done.\\n\\nSo, the price for quantity of food was 25% higher than needed. The food was excellent. And we disliked being rushed while paying dining prices. So we will not come back and revisit past restaurants such as 808 at Ceasars.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "My husband and I were just at this restaurant for dinner last Saturday night. We go to Las Vegas several times a year and always eat at a highly reviewed restaurant.\\n\\nThe restaurant is beautiful with enough atmosphere yet enough quiet places. Our waitress was really knowledgeable and terrific. The bread basket was yummy and plentiful....although we would have liked to have been asked if we wanted more. My mojito and husband's peach margarita were refreshing. My husband had the chicken (($24) and I had the veal chop ($42). Mine included a tamale, my husbands just the chicken. With cocktails at $12-13 things get expensive fast...which we knew.\\n\\nMy veal chop was really really good as was my husband's chicken. BUT, when you spend $150 for 2 I really expect to be at the restaurant for 1.5-2 hours....fine dining. After an hour the busboy came by to clear my plate....I wasn't done and did not intend to be done as this was our evening out. After the third time I asked him to please stop asking me if I was done.\\n\\nSo, the price for quantity of food was 25% higher than needed. The food was excellent. And we disliked being rushed while paying dining prices. So we will not come back and revisit past restaurants such as 808 at Ceasars.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "I'm neither of Italian parentage nor from an area with a large cultural population from the old country, so I can't speak to the true authenticity of Roma's. What I can say is I enjoyed my food immensely and the waitstaff was extremely cordial. I can understand why a small business may need to charge more to cover their expenses, though if I'm getting a basic pasta-and-sauce entree I would hope they consider making something that simple a little less costly. That's really my only complaint; this place is great and I will be stopping by for dinner again the next time I have an extended stay in Vegas.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "3", "ordinal": true, "source": "yelp"}
{"request": {"context": "I'm neither of Italian parentage nor from an area with a large cultural population from the old country, so I can't speak to the true authenticity of Roma's. What I can say is I enjoyed my food immensely and the waitstaff was extremely cordial. I can understand why a small business may need to charge more to cover their expenses, though if I'm getting a basic pasta-and-sauce entree I would hope they consider making something that simple a little less costly. That's really my only complaint; this place is great and I will be stopping by for dinner again the next time I have an extended stay in Vegas.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "Dorito Crusted Mac n Cheese $5 (3/5 NOMs). \\nVegas Brunch, Whenever I encounter a weird food experiment I just have to try it. This is like mixing my two favorite things! Doritos and Mac n Cheese. Overall the dish was good, but not amazing. I wish there was more doritos mixed with Mac n Cheese. I want the whole thing to be orange! Most likely if I come back, this is a one time order dish for me. \\n\\nBreakfast Burrito $10 (3/5 NOMs). \\nLets have giant Vegas brunch, Dam that thing is ginourmouse. I was very surprised how big this burrito was. Though the size was the only surprise in there. While there is a lot going inside, it was a bit weak. Tasted kind of bland to me. I do give them high points for adding crazy amount of bacon!", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "2", "ordinal": true, "source": "yelp"}
{"request": {"context": "Dorito Crusted Mac n Cheese $5 (3/5 NOMs). \\nVegas Brunch, Whenever I encounter a weird food experiment I just have to try it. This is like mixing my two favorite things! Doritos and Mac n Cheese. Overall the dish was good, but not amazing. I wish there was more doritos mixed with Mac n Cheese. I want the whole thing to be orange! Most likely if I come back, this is a one time order dish for me. \\n\\nBreakfast Burrito $10 (3/5 NOMs). \\nLets have giant Vegas brunch, Dam that thing is ginourmouse. I was very surprised how big this burrito was. Though the size was the only surprise in there. While there is a lot going inside, it was a bit weak. Tasted kind of bland to me. I do give them high points for adding crazy amount of bacon!", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: Free WiFi internet available.", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "4", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: Free WiFi internet available.", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "yes", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "document: My boyfriend , Jonny, and I went to Silverado Steakhouse only because we were already at the Southpoint Casino for a comedy show. We had no idea what we were getting into, so we had no preconceived notions or expectations. I ordered the beef short rib. It was swimming in salty gravy with what I am pretty sure was boxed mashed potatoes (and again with lots of salt). Jonny ordered the filet mingon. He asked for medium rare, but it was meant to be rare. I say meant to be because it was all pink inside, but no blood! It was bone dry and again very SALTY! We then ordered the cheesecake. Jonny asked if the deserts were pre-made.. The waiter responded kind of shocked that we would even ask that. The cheesecake was most definitely pre-made. The plating was beautiful, but the cheesecake was hard and extremely cold! The garnishes of raspberries, blueberries, and blackberries were not fresh. The stick of mint chocolate was delicious, however. Jonny called a manager over to tell him about our experience. The manager seemed unfazed and comped one of meal items without us even asking, and the bill was still over $75 without alcohol.. Which leads me to believe the manager is used to these complaints. The food was terrible. The service, however,", "question": "How many stars did this reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: terrible experience"}, {"id": "1", "text": "2 stars: poor"}, {"id": "2", "text": "3 stars: average"}, {"id": "3", "text": "4 stars: good"}, {"id": "4", "text": "5 stars: excellent"}]}, "expected_option_id": "0", "ordinal": true, "source": "yelp"}
{"request": {"context": "document: My boyfriend , Jonny, and I went to Silverado Steakhouse only because we were already at the Southpoint Casino for a comedy show. We had no idea what we were getting into, so we had no preconceived notions or expectations. I ordered the beef short rib. It was swimming in salty gravy with what I am pretty sure was boxed mashed potatoes (and again with lots of salt). Jonny ordered the filet mingon. He asked for medium rare, but it was meant to be rare. I say meant to be because it was all pink inside, but no blood! It was bone dry and again very SALTY! We then ordered the cheesecake. Jonny asked if the deserts were pre-made.. The waiter responded kind of shocked that we would even ask that. The cheesecake was most definitely pre-made. The plating was beautiful, but the cheesecake was hard and extremely cold! The garnishes of raspberries, blueberries, and blackberries were not fresh. The stick of mint chocolate was delicious, however. Jonny called a manager over to tell him about our experience. The manager seemed unfazed and comped one of meal items without us even asking, and the bill was still over $75 without alcohol.. Which leads me to believe the manager is used to these complaints. The food was terrible. The service, however,", "question": "Would this reviewer recommend the business?", "criteria": "", "options": [{"id": "yes", "text": "Yes: Clearly positive overall"}, {"id": "no", "text": "No: Negative or mixed"}]}, "expected_option_id": "no", "ordinal": false, "source": "yelp_yn"}
{"request": {"context": "ticket:\n  channel: email\n  body: What was President Lyndon Johnson 's reform program called ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What is supernova ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What is leukemia ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "How much was a ticket for the Titanic ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "Where is the Eiffel Tower ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: What is the name of the chocolate company in San Francisco ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the average weight of a Yellow Labrador ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "Who developed the Macintosh computer ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What are Canada 's two territories ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "What American composer wrote the music for `` West Side Story '' ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What chain store is headquartered in Bentonville , Arkansas ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "How many feet in a mile ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "document: Why does the moon turn orange ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the proper name for a female walrus ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the depth of the Nile river ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What strait separates North America from Asia ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "During which season do most thunderstorms occur ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What gasses are in the troposphere ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What are the two types of twins ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What is Susan B. Anthony 's birthday ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What are capers ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "document: Who lived in the Neuschwanstein castle ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What are cigarettes made of ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What day and month did John Lennon die ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Who was the first US President to ride in an automobile to his inauguration ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the most popular sport in Japan ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What are solar cells ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "George Bush purchased a small interest in which baseball team ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: email\n  body: What is an ulcer ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "Where are the British crown jewels kept ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "document: What do meteorologists do ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What does the word fortnight mean ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "document: What is home equity ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: What do you call a word that is spelled the same backwards and forwards ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "When is St. Patrick 's Day ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What is caffeine ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What year did WWII begin ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the difference between AM radio stations and FM radio stations ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "How do you measure earthquakes ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: What are spider veins ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What is carbon dioxide ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "How fast is alcohol absorbed ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "How long is the Columbia River in miles ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What is relative humidity ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "How far is the service line from the net in tennis ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What color is yak milk ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the distance in miles from the earth to the sun ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What does `` Sitting Shiva '' mean ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What is phenylalanine ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "When were William Shakespeare 's twins born ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "document: What hemisphere is the Philippines in ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "What county is Modesto , California in ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "document: Who was Galileo ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "document: What year did the NFL go on strike ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "document: Name a food high in zinc .", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What year did the Andy Griffith show begin ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the criterion for being legally blind ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What color does litmus paper turn when it comes into contact with a strong acid ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What is acid rain ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What river runs through Rowe , Italy ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the melting point of copper ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What is acetaminophen ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: email\n  body: What is foot and mouth disease ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the active ingredient in baking soda ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What year did the Milwaukee Braves become the Atlanta Braves ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What is nepotism ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What city 's newspaper is called `` The Star '' ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the life expectancy of a dollar bill ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What are the spots on dominoes called ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What is pulmonary fibrosis ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What was J.F.K. 's wife 's name ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the money they use in Zambia ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "What is Mardi Gras ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: What currency do they use in Brazil ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: Which comedian 's signature line is `` Can we talk '' ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "In the late 1700 's British convicts were used to populate which colony ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: email\n  body: How many gallons of water are there in a cubic foot ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: Where is the Little League Museum ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: Where did Howard Hughes die ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "What are pediatricians ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "Lake Brienz (German: Brienzersee) is a lake just north of the Alps in the Canton of Berne in Switzerland. It has a length of about 14 kilometres (8.7 mi) a width of 2.8 kilometres (1.7 mi) and a maximum depth of 260 metres (850 ft). Its area is 29.8 square kilometres (11.5 sq mi) and the surface is 564 metres (1850 ft) above the sea-level.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Endymion is the third science fiction novel by Dan Simmons in his Hyperion Cantos fictional universe. Centered around the new characters Aenea and Raul Endymion it has been well received like Hyperion and The Fall of Hyperion - within a year of its release the paperback edition had gone through five reprints. The novel was shortlisted for the 1997 Locus Award.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: M'Bizo is the sixteenth album by the jazz group the World Saxophone Quartet and their fourth on the Canadian Justin Time label. The album features performances by Hamiet Bluiett John Purcell Oliver Lake and David Murray with guests Ronnie Burrage Mario Canonge D.D. Jackson James Lewis Mabeleng Moholo Jimane Nelson and Jaribu Shahid.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Phillip Whitehead (30 May 1937 – 31 December 2005) was a British Labour politician television producer and writer.Born in Matlock Bath Derbyshire he was adopted by a local family and attended Lady Manners School in Bakewell and Exeter College at Oxford University where he obtained his BA degree.Whitehead went up to Oxford following in his adoptive parents' footsteps as a Conservative. He was President of the Oxford University Conservative Association and the Oxford Union in 1961.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Rayat Institute of Engineering and Information Technology (RIEIT)(Hindi: रयात अभियांत्रिकी एवं सूचना प्रौद्योगिकी संस्थान) is an academic engineering institution affiliated to Punjab Techncal University offering Engineering Courses at undergraduate and Graduate level leading to B.Tech and M.Tech degrees.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Thomas McKay (January 8 1839 – January 13 1912) was a Canadian politician.Born in Pictou County Nova Scotia the son of William McKay who emigrated from Sutherland Scotland McKay was educated in Pictou. In 1868 he married Jessie Blair. A merchant he was first elected to the Canadian House of Commons for Colchester in the 1874 general election. Unseated on petition in November 1874 he was re-elected and again in 1878.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Antonio Barbalonga or Barbalunga (1600 – 2 November 1649) also called Antonio Alberti was an Italian painter of the Baroque period. He was a member of the noble family of the Alberti born at Messina and was there instructed in painting by Simone Comandé. He went to Rome where he became a pupil of Domenichino whose style he imitated with great skill. Barbalonga executed a great number of paintings for churches his chief work being the Conversion of St. Paul for the convent church of St.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "artist", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Cane River Lake (French: Lac Rivière-de-Canne) is a 35 mi (56 km) oxbow lake formed from a portion of the Red River in Natchitoches Parish Louisiana United States. It runs throughout the Natchitoches' historic district to the south and is famous for the numerous plantations particularly Melrose being located on or near its banks.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "USS Henry R. Mallory (ID-1280) was a transport for the United States Navy during World War I. She was also sometimes referred to as USS H. R. Mallory or as USS Mallory. Before her Navy service she was USAT Henry R. Mallory as a United States Army transport ship. From her 1916 launch and after her World War I military service she was known as SS Henry R. Mallory for the Mallory Lines.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "meanoftransportation", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Kimi no Kakera (きみのカケラ) is a manga by Shin Takahashi that is focused on a thirteen-year-old girl by the name of Icoro. She is the princess of the Upper World a world where snow is always falling and even princesses like her are forced to wake up at 4 a.m. and go to bed at midnight learning and working the rest of the day. The Upper World is a country of night surrounded on four sides by towering walls and with perpetual below-freezing temperatures.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Ferrovie della Sardegna (Railways of Sardinia) know also as ARST Gestione FdS and with the acronym FdS was the regional railway network in the island of Sardinia Italy.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "company", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: email\n  body: Comfort Food: A Novel by Noah Ashenhurst contains a cast of characters: a romantic academic a self-assured young writer an enigmatic musician a slacker a wealthy mountaineer and a former heroin addict—characters whose lives intersect in the unique award-winning debut novel.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Dead Hooker in a Trunk is a 2009 Canadian exploitation film starring written produced and directed by twin sisters Jen Soska and Sylvia Soska also known as The Soska Sisters. The film is their feature film directorial debut and is distributed by IFC. The film features music by a variety of local Vancouver acts such as Craig James Fake Shark - Real Zombie! and CJ Wallis.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "film", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Interlaken Mill Bridge is an historic site spanning the Pawtuxet River at Arkwright in Coventry Rhode Island.The bridge was built in 1885 and added to the National Historic Register in 1978.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "building", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Montezuma's Ferrari is the second novel in Burt BS Levy's series about a 19-year-old New Jersey gas station mechanic growing up and coming of age while being sucked into the glamorous dangerous world of open-road sports car racing during the 1950s. The story begins just a week after The Last Open Road ends.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ACG New Zealand International College (ACG NZIC) is a private school owned by the Academic Colleges Group New Zealand . The school's curriculum provides pathways to tertiary study for international students. It has premises in Auckland City in the central business district. The school has been restructured since the 2005 ERO review as part of an endeavour to provide better tuition for international students.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "- role: customer\n  content: The Guards Themselves is an album by New Zealand band Minuit that was supposed to be released during early 2005. However during the production of The Guards Themselves lead singer Ruth Carr's left vocal cord was paralysed which delayed the production and therefore release of this album to 2006. According to specialists it was unsure if Ruth would ever be able to sing again.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Nättrabyån is a river in Sweden.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Croteau Lake is a lake located on Vancouver Island at the head of Browns River on Forbidden Plateau.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "- role: customer\n  content: The Pink sugarcane borer Pink stalk borer Shoot borer Sugarcane borer or Ramu shoot borer (Sesamia grisescens) is a moth of the Noctuidae family. It is found in Papua New Guinea Seram the Moluccas and New Britain.The larvae are a pest on Saccharum officinarum although they also feed on other plants including Saccharum robustum Saccharum spontaneum Saccharum edule Pennisetum purpureum and Panicum maximum.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Manor house in Podstolice (Polish: Dwór w Podstolicach) - historic manor house in Podstolice in Września Country in Greater Poland.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "building", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Eleutherodactylus longipes is a species of frog in the Leptodactylidae family.It is endemic to Mexico.Its natural habitats are temperate forests subtropical or tropical dry forests subtropical or tropical moist montane forests and caves.It is threatened by habitat loss.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Your Joy Is My Low is the debut EP by IAMX. It was released in 2004 in Austria during IAMX's first tour.The album was hand-numbered and limited to 222 copies.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: Betzenberg (Schönbuch) is a mountain of Baden-Württemberg Germany.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Kaori Shimizu (清水 香里 Shimizu Kaori) (born May 21 1983 Tokyo) is a Japanese voice actress. Although she started out voicing young female characters she has recently been typecast as deep-voiced women of experience with mostly calm manners.She is most known as Lain Iwakura in Serial Experiments Lain Hiyori Tamura in the anime version of Lucky Star Signum in Magical Girl Lyrical Nanoha and Lamia Loveless in Super Robot Wars", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "artist", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Metasia cyrnealis is a species of moth in the Crambidae family. It is found on Sardinia and Corsica.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "On ne change pas is Celine Dion's seventh home video release. It's a collection of her French music videos released on November 18 2005. It was the first time that Dion's greatest French videos were included on one DVD. On ne change pas also features over one hour of bonus material.However the DVD does not include the music videos for Délivre-moi Ne partez pas sans moi and Je lui dirai.On ne change pas reached number 5 on the French Music DVD Chart and spent there thirty weeks.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: email\n  body: Not a Feather but a Dot is an hour long documentary film on the history perceptions stereotypes and changes in the Indian American community. The film discusses topics such as the growth of Hinduism in the United States the origin of the stereotypes surrounding the Indian-American community the early Indian migrants and events that have shaped the Indian-American community and members of the Indian-American community that are changing traditional perceptions.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "film", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Arnold Sjöstrand (30 June 1903 – 1 February 1955) was a Swedish actor and film director. He appeared in 33 films between 1931 and 1952.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "artist", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "- role: customer\n  content: Kids in the Way is an album released by Kids in the Way.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Great Eastern Railway (GER) Class Y14 is a class of 0-6-0 steam locomotive. The LNER classified them J15.The Class Y14 was designed by T.W. Worsdell for both freight and passenger duties - a veritable 'maid of all work'. Introduced in July 1883 they were so successful that all the succeeding chief superintendents continued to build new batches down to 1913 with little design change the final total being 289. During World War I 43 of the engines served in France and Belgium.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "meanoftransportation", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "- role: customer\n  content: The Church Educational System (CES) of The Church of Jesus Christ of Latter-day Saints (LDS Church) consists of several institutions that provide religious and secular education for both Latter-day Saint and non-Latter-day Saint elementary secondary and post-secondary students and adult learners. Approximately 700000 individuals were enrolled in CES programs in 146 countries in 2011.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Oxalis priceae is a species of flowering plant in the woodsorrel family. It is native primarily to southeastern North America with a disjunct population being known from montane areas of Nuevo León Mexico. This species is found in dry rocky calcareous areas such as cedar glades and cliff faces but it is occasionally found in oak-pine woodlands and longleaf pine savanna as well.Oxalis priceae is a highly rhizomatous perennial herb that flowers in the spring.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "plant", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: Valley Springs School District is a public school district in Boone County Arkansas United States which serves the cities of Bellefonte Everton and Valley Springs along with surrounding unincorporated areas within Boone County.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Do Navio River is a river of Pernambuco state in eastern Brazil.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Bundoora Secondary College is a public secondary school for girls and boys in years 7 to 12 located in a quiet and leafy[citation needed] residential block on the corner of Balmoral Avenue and Moreton Crescent in Bundoora a suburb of Melbourne Victoria Australia. The school values are Relationships Respect Responsibility Resilience and Rigour.[citation needed]", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Mordellistena atriceps is a beetle in the Mordellistena genus which is in the Mordellidae family. It was described in 1882 by Smith.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Mark Hummel (born December 15 1955 New Haven Connecticut) is an American blues harmonica player vocalist songwriter and long-time bandleader of The Blues Survivors. Since 1991 Hummel has produced the Blues Harmonica Blowout tour of which he is also a featured performer. The shows have featured blues harmonica players such as James Cotton Carey Bell and Charlie Musselwhite.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "artist", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Myrmecia acuta is an Australian ant which belongs to the Myrmecia genus and is endemic to Australia usually found in Western Australia and some areas of South Australia. Myrmecia acuta was first described in 1991.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: A World Without Thieves (simplified Chinese: 天下无贼; traditional Chinese: 天下無賊; pinyin: Tiānxià Wú Zéi) is an award-winning Chinese action / drama film directed by Feng Xiaogang and starring Andy Lau Rene Liu Ge You and Li Bingbing. The film is an adaptation of a novelette of the same title by Zhao Benfu that was first published in 1999. The original story is moderately different from the film adaptation. The film was first released in Shanghai China on 5 December 2004.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "film", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: Clitoria fragrans is a rare species of flowering plant in the legume family known by the common name pigeon wings or sweet-scented pigeon wings. It is endemic to Central Florida where it was known most recently from 62 occurrences but no current estimates of the total global population are available. The plant is a federally listed threatened species of the United States.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "plant", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: web form\n  body: John Watts McCormick (December 20 1831 - June 25 1917) was a U.S. Representative from Ohio.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Delazian (Persian: دلازيان‎ also Romanized as Delāzīān Delāzeyān Delāzīyān Delāzīyān and Deliāzān; also known as Dalījān) is a village in Howmeh Rural District in the Central District of Semnan County Semnan Province Iran. At the 2006 census its population was 120 in 44 families.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "village", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: The Voodoo plot is the 72nd title of the Hardy Boys series written by Franklin W. Dixon.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: email\n  body: Fabric 57 is a 2011 album by Agoria. The album was released as part of the Fabric Mix Series.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: The Match Factory Girl (Finnish: Tulitikkutehtaan tyttö) is a 1990 Finnish-Swedish film written and directed by Aki Kaurismäki the final installment from his Proletariat Trilogy after his Shadows in Paradise and Ariel. It follows Iiris a young plain-looking factory worker living a lonely impoverished and uneventful life in late 1980s Finland. Iiris is played by Kati Outinen who had appeared in a number of other Kaurismäki films.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "film", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Rybie [ˈrɨbjɛ] is a village in the administrative district of Gmina Rejowiec within Chełm County Lublin Voivodeship in eastern Poland. It lies approximately 5 kilometres (3 mi) east of Rejowiec 13 km (8 mi) south-west of Chełm and 56 km (35 mi) east of the regional capital Lublin.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "village", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Kalmia latifolia commonly called mountain-laurelcalico-bush or spoonwood is a species of flowering plant in the blueberry family Ericaceae that is native to the eastern United States. Its range stretches from southern Maine south to northern Florida and west to Indiana and Louisiana. Mountain-laurel is the state flower of Connecticut and Pennsylvania. It is the namesake of the city of Laurel Mississippi (founded 1882).", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "plant", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Citrus unshiu is a seedless and easy-peeling citrus species also known as cold hardy mandarin satsuma mandarin satsuma orange Christmas orange[citation needed] and tangerine. It is probably of Japanese origin and introduced elsewhere.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "plant", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Colegio Almenar (English: Almenar School) is a Chilean high school located in San Vicente de Tagua Tagua Cachapoal Province Chile.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Light of Other Days is a science fiction short story by Bob Shaw. It was originally published in August 1966 in Analog Science Fiction and Fact. It was shortlisted for the Nebula Award for Best Short Story in 1966 and was shortlisted for the Hugo Award for Best Short Story in 1967. The story uses the idea of slow glass: glass through which light takes years to pass. Bob Shaw used this idea again in later stories.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Brittany Ferries is a French ferry company that runs ships between France the UK Ireland and Spain.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "company", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: Effervescing (foaled 1973 in Kentucky) is an American Thoroughbred racehorse. Effervescing was a stakes winner at the age 3 4 and 5 he was one of the first successful trainees by D. Wayne Lukas.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Ring of Scorpio is a 1990 Australian mini series. It was made with assistance from the Australian Film Finance Corporation BBC Television and the Nine Network and shooting took place in Morocco Spain Sydney and Broken Hill.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "film", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Live and Loud is a live video released by American grunge band Nirvana in September 2013. It was released as part of the 20th anniversary of the band's third and final studio album In Utero.It showcases the entirety of the band's December 1993 live performance at Pier 48 Seattle which was recorded by MTV for Live and Loud.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Vision of Judgment (1822) is a satirical poem in ottava rima by Lord Byron which depicts a dispute in Heaven over the fate of George III's soul. It was written in response to the Poet Laureate Robert Southey's A Vision of Judgement (1821) which had imagined the soul of king George triumphantly entering Heaven to receive his due.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Phacelia tanacetifolia is a species of phacelia known by the common name Lacy phacelia.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "plant", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: H. S. Pledge & Sons Ltd was a business engaged in the milling industry. The firm was started by Henry Sturgess Pledge who learnt his trade at the Black Mill Barham Kent United Kingdom.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "company", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Papa Wemba was born Jules Shungu Wembadio Pene Kikumba in 1949 in Lubefu (Sankuru District Belgian Congo). He is a Congolese rumba (later known as soukous) musician one of Africa's most popular musicians and prominent in world music.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "artist", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Andrew Lake is a lake on Adak Island part of the Aleutian Islands Alaska. It is a part of the Adak Naval Air Station and lies between Mount Adagdak and Mount Moffett. The lake is separated from the Bering Sea by a seawall.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Limacina is a genus of swimming predatory sea snails commonly known as sea butterflies in the family Limacinidae. This genus contains some of the world's most abundant gastropod species.Etymological meaning of the generic name Limacina is snail-like.As pelagic marine gastropods Limacina swim by flapping their parapodia inspiring the common name sea butterflies.Sea butterflies are part of the clade Thecosomata. Sea angels similar to Limacina are in the order Gymnosomata.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Al-Adiliyah Mosque (Arabic: جامع العادلية‎) is a mosque complex in Aleppo located to the west of the Citadel in Al-Jalloum district of the ancient city few meters away from Al-Saffahiyah mosque. The mosque was built by the Ottoman governor of Aleppo Muhammed Pasha in 1551 or 1557. It is considered to be one of the oldest mosques of the Ottoman period in Aleppo after the Khusruwiyah Mosque.The complex is built at the southern entrance of the covered suq of ancient Aleppo.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "building", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Le Crime ne paie pas (US title: Crime Does Not Pay UK title: Gentle Art of Murder) is a 1962 French drama film directed by Gérard Oury. The film stars Danielle Darrieux Michèle Morgan Edwige Feuillère and Annie Girardot. It is composed of four crime episodes: The Man on the Avenue (L'homme de l'avenue) The Hugues Case (L'affaire Hugues) The Mask (Le masque) and The Fenayrou Case (L'affaire Fenayrou).", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "film", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Brown Babbler (Turdoides plebejus) is a species of bird in the family Leiothrichidae. It is predominantly found in West Africa but ranging from the Gambia to Kenya. The species is common across its range. The species is also known as the Sudan Babbler.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "CompAir is an engineering and manufacturing company specialising in compressed air and gas systems. It is a division of NYSE-listed Gardner Denver.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "company", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Royal College of Chemistry (RCC) was a college originally based on Oxford Street in central London England. It operated between 1845 and 1872.The College was set up to teach practical chemistry. Many politicians donated funds to establish the college including Benjamin Disraeli William Gladstone and Robert Peel. It was also supported by Prince Albert.The first director was August Wilhelm von Hofmann. Frederick Augustus Abel studied under von Hofmann.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Piratini River (Uruguay River) is a river of Rio Grande do Sul state in southern Brazil.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Heterocharax is a genus of characins from South America with three currently described species: Heterocharax leptogrammus Toledo-Piza 2000 Heterocharax macrolepis C. H. Eigenmann 1912 Heterocharax virgulatus Toledo-Piza 2000", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Clusia osseocarpa is a species of flowering plant in the Clusiaceae family.It is found in Colombia and Panama.It is threatened by habitat loss.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "plant", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "HMS C18 was a British C class submarine built by HM Dockyard Chatham. She was laid down on 11 March 1907 and was commissioned on 23 July 1909.HMS C18 was sold on 26 May 1921 in Sunderland.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "meanoftransportation", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Darren Jackson (born 25 July 1966 in Edinburgh) is a Scottish former international footballer who played predominantly as a striker. After working as an agent he is now a coach at former club Dundee United.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "athlete", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: Kokopelli Records was a record label established by jazz flautist Herbie Mann during the 1990s. Mann had previously established Embryo Records during his tenure at Atlantic Records.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "company", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: Arthur Lesieur Desaulniers (February 9 1873 – July 16 1954) was a merchant and political figure in Quebec. He represented Champlain in the House of Commons of Canada from 1917 to 1930 as a Liberal.He was born in Louiseville Quebec the son of Alexis Lesieur Desaulniers and Oliva Pichette. In 1896 he married Hélène Gariépy. He was mayor of Sainte-Anne-de-la-Pérade from 1913 to 1919 and was warden for Champlain County in 1917.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: Freedom State 2006 film written and directed by Cullen Hoback.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "film", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: email\n  body: Unaccompanied Sonata is a short story by Orson Scott Card first published in the March 1979 issue of Omni magazine. It appears in his short story collections Unaccompanied Sonata and Other Stories and Maps in a Mirror. It was nominated in 1979 for the Nebula Award for Best Short Story and in 1980 for the Hugo Award for Best Short Story.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: The second USS Smith (DD–378) was a Mahan-class destroyer in the United States Navy before and during World War II. She was named for Lieutenant Joseph B. Smith USN. Smith was the senior officer aboard USS Congress and killed when CSS Virginia sunk her.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "meanoftransportation", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Renaldo Antonio Turnbull (born January 5 1966) is a former professional American football player who played for the New Orleans Saints of the National Football League Was the Saints 1st round (14th overall) in the 1990 NFL Draft. Turnbull a 6'5 252 lb (114 kg). linebacker-defensive end from West Virginia University played 8 seasons in the NFL from 1990-1997 for the Saints and Carolina Panthers. In his NFL career Turnbull played in 120 games with 45.5 sacks and one interception.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "athlete", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Gen. John F. Reynolds School is a historic school building located in the North Central neighborhood of Philadelphia Pennsylvania. It was designed by Irwin T. Catharine and built in 1925-1926. It is a four-story 12 bay by 3 bay brick building on a raised basement in the Art Deco-style. It has a one-story addition built in 1958. It features an entrance with Doric order columns and decorative terra cotta panels. It was named for Civil War General John F.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "building", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Spinidrupa is a genus of sea snails marine gastropod mollusks in the family Muricidae the murex snails or rock snails.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "animal", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Jerónimo de Azevedo (1540 – Lisbon 1625) was a Portuguese fidalgo Governor of Portuguese Ceylon and Viceroy of Portuguese India. His full name was Jerónimo de Azevedo de Ataíde Malafaia and he was the 8th son of Dom Manuel de Azevedo Comendador of São João de Alpendurada and brother of Blessed Inácio de Azevedo.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "officeholder", "text": "officeholder"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "building", "text": "building"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Torch seems to be doing fine for a while. Now the butane continues even after I release and it occasionally doesn't come out in torch form. Spits and sputters the butane out and makes more of a dragon type flame.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "I love these magnetic shape toy. My son and me have been making many things and its very therapeutic for him", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "The product is fine and the delivery was fast, but there's no way to seal the package once it's opened. There's a wide piece of tape, but you have to cut the package open to get into it unlike most wipes that have a slit with an adhesive to cover it afterward. If you don't seal them back up they go dry and are useless.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Couldnt find these at walmart so i looked on Amazon but later found them at the dollar store. These are obviously overpriced", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: web form\n  body: The dish rack looks really nice and is spacious, perfect size for a condo sized kitchen. However, we received the product in defective condition. One side of the clear silverware container was broken and therefore the utensil holder could not be used. This pretty much makes the dishrack useless for me, and so I need to get a replacement. I went to Bed Bath and Beyond to buy a new utensil holder for the dish rack.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "Lots of static. Can barely hear my music", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "Waist is too tight. Doesn't fit. I tried a 44 and that's too large. What I need is a 43 but that is not available. I'm lost.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: Images shows a double case pink one and green one. I only received the green. Not at all what i ecpected", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: It works well for getting into tight spots. I just wish it worked with an Iphone.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "- role: customer\n  content: Works the same for me as my name brand parts", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Easy to find and carries well. Do not like that at times does not touch sensitive to answering iPhone disputes multiple touches", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "This product is great, but the instructions suck... also, it took me and my brother over an hour to figure out why the Power Magic Pro wasn't working. We located the correct fuses, checked them with a multi-meter and everything. Still, nothing. Turned out, the grounding screw in my car wasn't good. We had to find another one. Also, you have to charge the Power Magic Pro a little bit to get it going. I recommend turning on the engine to jump start it and then try to see if it works in parking mode when you turn the car off. Other than that, this product is awesome! The images are extremely clear. The cloud feature to be able to live stream is awesome! I highly recommend this product!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "- role: customer\n  content: I will be returning this item. The bottom bracket does not adjust as per instructions. The charging indicator shows sometimes, but does not charge phone. This is a Galaxy S10 Plus, with a punk case. If the bottom actually adjusted this might have worked. Otherwise I very clever design but not fully thought out.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "I can't wear these all day. Snug around the toes.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Got a screen didn’t worked reorder it and still didn’t work trash screen", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "- role: customer\n  content: I’ll pay extra money to come in early and they come in a month", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "I bought these boxes to move. They look great but they broke in several places just from picking them up -and the handles came off and they are hard to get back in place. I would not recommend for the price.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "Just received them (very quick service) and they are just as pictured, maybe even better. Got 4 shells, all in perfect condition and various colors and the plants were big, bushy and very healthy. Easy to assemble and they are adorable. Thanks!!!! Highly recommend.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "I returned this bottle unused. Didn't like the baby pink color and the pink and blue print of the insulation sleeve. The description said rose quartz, but it is just baby pink. The product looked like cheap plastic and did not appeal to me visually.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: I used this to color a flame for my chemistry class. It worked fine and was delivered as expected.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "I know this tracker is several years old and the technology has improved a lot since then, so I was really not expecting much. I just needed a simple step tracker that clips onto my clothing and syncs with my phone, and the price was incredibly low so I figured why not. I received this tracker on Friday, and by Monday it has stopped syncing with my phone. It worked for 2 days. I have tried troubleshooting this error but cannot fix the problem. I don't know if its the app or the tracker, but either way it was a waste. I also felt like it was not counting enough steps when it was working. Fortunately I ended up getting it for free due to a delivery error, but I'm still annoyed that it is such a piece of garbage.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "I'm very happy with these scissors. They are small (as most have stated) but are super sharp. The finger slots are great and feel like a smooth soft rubber. I didn't want to have large scissors dangling and getting caught on things as I like to wear my scissors on a badge pulley on my waste band for quick use in the ER. These fit the bill for cutting fabric tape, bandages and even clothing items. The bent edge makes it easy to get them in where I need. I'm glad I got them.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "Please don't buy this product 1. My ear plug doesn't work 2. The battery power only increase 25%", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "I think it’s very cute but it needs to protect the phone more. Specifically it needs to come up around the sides higher to protect the glass. It’s also pretty slippery.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Great service a d recieved them very fast", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "This was pretty cool. My glue was paste and impossible to get out of the bottle. I want this for crafts, did test on my skin, but since the glue was so thick, I couldn't get a clear tattoo. This is still perfect for crafting, as I intend to use it. Comes with a variety of stencils, nice glitter colors ,and 2 brushes. It is a fantastic kit....just ruined by the glue quality in my package.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: Little bit other types noise", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "I needed a quick reference for Statistics and this laminated folding version worked great for me. Product was shipped quickly, thank you!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "The taste was wasn't very good", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: Yes if you drill into the entire add they are the small size that they say they are. However I was only searching in standard size bed pillows which every ad before it and after it we're the same even though they were more money. This was totally not what I was looking for and it's also my fault for not double-checking. Now I have four really nice new standard size pillow cases and these little tiny pillows...", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "Just used it 2 times on very small projects. Now less than 3 months, the paint will not spray out. Plus the handle gets hot while spraying. Properly cleaned it, still no paint will spray. Please refund my money. Very disappointed.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "I was disappointed with these. I thought they would be heavier.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Shipped fast and arrived as described. Don't know yet about quality and durability of this cover but it looks good and fits nicely", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "I love tho look of these chairs!! One and only thing wrong to me as a bigger dude is that the chair seat portion it’s self is a little smaller, I can fit inside but if I were any bigger it would be a squeeze! Cool looking, and seems to hold well so far!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "Great product but be aware of return policy.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Not enough support and the springs are glued inside and are coming loose!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "They were really skinny and scrawny. They arrived alive and in good condition!!!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: This is not a good kettle if you live with other people who might be asleep when you are using the kettle. I contacted the manufacturer and there is no way to turn off the sound feature. Edited from one to three stars because they gave me the kettle for free which was nice, but there was a ton of back and forth with customer service saying they'd give me a new kettle without a beeping sound, but they didn't in the end because of my address (which they could've looked at beforehand saving us all a lot of time). I know customer service is tough and I like free stuff. It was a mixed bag overall though most companies these days wouldn't do anything to try to make good and they did so that counts for something.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Won’t pull dents out, once pressure is applied, the tool just pops off. Glue that does stick to the car is a pain to get off, will even pull off paint. This this is worthless.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "These literally fell apart the first time they were used. The triggers broke the first time one of them was used. Terrible quality--save your money.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: web form\n  body: I’m usually a medium. 5’5” about 145-150 pounds. This was a little small in the bust area. I’m a 36B. Would recommend getting the next size up if you have larger boobs, otherwise it’ll look like you have a uniboob. The back is totally open, so you can’t wear a bra anyways, and there is padding in there so it’s fine to go bra-less.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "The product is of very poor quality broke just after few uses", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "Good price and fits nicely in small apartment. This was the second table sent to me as it was damaged by deliver driver. I don’t think it was packed very well which made it more vulnerable. The second table was also damaged but in a place less visible. It also stains very easily.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "It does not crimp well. I tried different crimping tools, all had the same results.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "- role: customer\n  content: Just what I was looking fore. Works great with my weed whacker.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "We bought it in hopes my son would stop sucking his thumb. He doesn't suck it when it's on but when it's off for eating, bathing, washing hands... he will still do it. We are now going to try the nail polish with bitter taste. This is a good idea, my son just needs something stronger to beat it.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: web form\n  body: Quality gloves for 30F and above. Negative 30F is just a poor joke.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "- role: customer\n  content: The stand broke within two weeks of me having the case and I used the stand once.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Come with pretty cool pack. Very practical, exactly match all my needs, easy to use and clean , especially convenient for people with teeth socket", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "These smell fantastic and burn an extremely long time (some over an hour!) The scents are strong and linger many hours! Extremely happy with these!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "Lite and easy to use, folds with ease and can be stored in the back seat, but the elastic which holds the shade closed failed within two weeks. Really didn't expect it to last much longer anyway. The price was good so likely will buy again next year.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "Dan Brown never said the things depicted in the art, architecture, societies or ceremonies were real. He said the paintings, buildings, societies, and ceremonies existed. This film, while somewhat entertaining, is clearly aimed at the stupid, the sort who debate how many people the life support system of the Starship Enterprise could support. The book was fiction, folks. Live with it, be entertained by it. But don't take it seriously.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Much darker than I expected, beautiful, but flowers are so big, I can't stand far enough away in my bathroom to get the full effect. Just not what I was trying for, so I reordered another style. Smaller sunflowers. But quality is great, and for some I am sure perfect.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Good product and fast delivery too.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: Cut and material are terrible. I would have returned these but my son saw them and wouldn’t let go :-)", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Fast delivery. Shoe are in perfect condition. A little darker than pictured, more black than grey. Fit is perfect. Will order again from this vendor.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "Stickiness is perfect, but not comfortable wearing it. Eyes felt a bit pricking. Unlike my other eyelid tapes, don’t feeling anything on eyes.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "i absolutely love these! no more ripped clothes while carrying my poles around, no ripped seats and no holes in my fingers! couldn’t be happier", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: web form\n  body: The picture fades really easily. It didn't take long for it to start fading out on me after a month", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "- role: customer\n  content: A lot of our perceptions of how something works for you, is how you feel after using it. I waited about a month after finishing a bottle and before writing a review. I went Keto at the time of starting this product. I took it once a day at different times throughout the day to see if it mattered how I felt. I can’t say I felt differently, unlike the feeling I got with brain octane or unfair advantage. Sometimes these things take a while to kick in or it can be a cumulative benefit. Therefore, I can neither confirm or deny it’s advantages.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "Exactly what I was looking for. Quick delivery.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "Way too small, go a size up when purchasing, other than that, they're great", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "Arrived as advertised.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "Only worked for two months.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: chat\n  body: This did not help my hair and scalp. Had a pretty bad allergic reaction,I am not saying it is bad product. Just didn't work for me.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "This is an awesome coffee bar! We put it to fairly easy. Just make sure you look at the piece and figure out which is the front and back. I had to take it back apart and turn some around.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "Just what I was expecting. Looks really cute.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "This works as described..clear NO IT'S MILKY.. GOT A REFUND..", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "ticket:\n  channel: web form\n  body: The best suspenders I've had so far. Sometimes the left side does not hold properly, but in general, they are still the best.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "Good storyline but the characterizations seemed a little lacking and I'm definitely a character reader.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "- role: customer\n  content: don't like it, too lumpy", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "2", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: Very poorly packaged. The glasses banged each other. Should have been bubble wrapped. So bummed that I can’t use these for a party tonight!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "document: Not the color advertised, doesn't work well at all.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "Gave as Christmas gift, stopped working 3 mos. later. Very disappointed because it was a nice product and gave off a good amount of humidity to the air unlike some. I also thought it had a nice style. My return windo is closed unfortunately.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "The small wrench was worthless. Ended up having to buy a new blender.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "0", "ordinal": true, "source": "amazon"}
{"request": {"context": "for the price and what it is for I can't complain, you can also wear it on the wrist", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "It was a nice cover at first, and does seem like it will offer necessary protection in case of a drop, but after about a week it started discoloring. I ended up returning it.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "1", "ordinal": true, "source": "amazon"}
{"request": {"context": "Cheaper at the company Amazon is twice the price", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "4", "ordinal": true, "source": "amazon"}
{"request": {"context": "SUPER cute, design was just as pictured. Thin, you can see the print on the other side but not a deal breaker since its SO cute!", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "this is well made except that ours came like it was used. I don’t if it’s paint or what but it was all over the set for the hand. see photos. it is still well made and i’m probably just going to ask the seller to replace the ones that has paint on it cz my son absolutely loves it and doesn’t want me to send back. it functions as it should but it just looks used to me. can’t imagine how paint would end up on the items except with use.", "question": "How many stars did this product reviewer give?", "criteria": "", "options": [{"id": "0", "text": "1 star: very negative"}, {"id": "1", "text": "2 stars: negative"}, {"id": "2", "text": "3 stars: mixed"}, {"id": "3", "text": "4 stars: positive"}, {"id": "4", "text": "5 stars: very positive"}]}, "expected_option_id": "3", "ordinal": true, "source": "amazon"}
{"request": {"context": "OK, so I'am chilling in my room when mom knocks on the door. I open the door and what do I see in her hands? \"SLEEPY HOLLOW HIGH\". I thinking it has to be an older horror movie, because there's noway anyone could be stupid enough to name a movie that after The blockbuster hit \"Sleepy Hollow\" starring Johnny Depp. But to my surprise the movie is at least two years older then the original. That alone should have stopped me from putting it into the V.C.R. But no I had to take a chance, I had to believe that this movie could have one small ray of hope. Little did I know that the rays where no where to be seen. Number one, the story line is so ridiculous that it's probably true in some country bumpkin town. Two, the actors seem more like people real life people who just happen to wonder on the set when the director yell cut. Three, just about any movie starring the director is always awful. But the funny thing is that this is yet another movie directed by Kevin Summerfield. I've become to rely on his movie to bring me to the floor with side splitting laughter. Where to start on this movie? I know, let's start with the jogger in the", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "jeez, when i heard this movie was a NATIONAL LAMPOONS i thought it was going to be awesome, but i really got a say it was a rather disappointment. I have seen the most movies they've made, from Christmas vacation to van wilder, and this movie is the worst movie in their name,, really bad actors and a to much intense movie. this movie is probably good to watch if you are watching it with a crowd of worked up people and the ability to laugh at it, but if you are into good comedy's like i am, i do not suggest this movie, i would much rather watch van wilder a second or third time, than to watch this movie... you have been warned.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "- role: customer\n  content: The first 4 episodes of season 6 are just to throw up, to predictable and the worst scenario i've seen. Won't and hopefully i din't buy it. Also seen in seasons back that episodes about space they did, suck even more. All i want to say to the people who make this is: don't do whole episode about space, because they suck. The point is that season 6 sucks even more than the seasons before. Gets worse from season to season. I got so disappointed and frustrated watching first 4 episodes of season 6 that i just had to write this. Only people who are brain washed can watch this crap. Seems that people writing the scenario are getting out of ideas for a long time. Think that my 2 year old nephew had a better idea for the episode than these people do.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "TEP is like a long cool drink of water after crawling across the Sahara to classic film buffs who have been too long deprived of that certain cinematic magic! Not only is it beautifully photographed, but the characters are perfectly portrayed. If you're looking for the film to be a mirror of the book, you will be seriously disappointed. Instead, it is an excellent \"companion\" to the book, and I think that is what Anthony Minghella intended. Ralph Fiennes is probably the most beautiful man in the world; not to mention a brilliant actor. Juliette Binoche is the posterchild for vulnerability and childlike enthusiasm. And, of course, I'll go see any film in which Kristin Scott Thomas is featured. She simply must be THE best actress since the likes of Deborah Kerr. So much was promised with this film, and so much is delivered!", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: Hilary was great as julie, and Pat was once again magnificent as Mr. Miyagi, but there should have been more references towards the other three movies! I mean, come on! First off, Where's Daniel!? Miyagi makes a very brief mention of him and that's it. Daniel was his best friend and should've at least made an appearance in the movie. He could've helped Miyagi train Julie-San! On the flip side, the music stayed true to the movie though, with a little more instrumentation(Fretless Bass)to accompany the wonderfully played Pan-Flute! It doesn't feel like a Karate Kid movie unless you hear that Pan-Flute! Thank you Zamfir! Overall, a decent movie though! We miss you Noriyuki!", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Red spectacles I loved Avalon, I think This director has made some awesome demented visions of the future. This film however was boring pretentious crap. The opening scene showed great promise for what the cover art and description promise a surreal live action amimae style future noir. I feel I got that with Avalon. With Red Spectacles I was only driven to feel a uncomfortable to desire to what the hell the point was. The film barely made sense to me and I could not care less about the people in it. This would all be ok if the film was effective art. While the opening scene looked interesting and the scene with the giant robot-suit person holding the giant machine gun in the rain looked cool, it did not watch the film worth watching. Thumbs down.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "- role: customer\n  content: Before this was shown on MTV or VH1 it was at my local theatre playing just before the main movie. I remember this short movie more than the film I saw that day. It was the first time I had ever a music movie like this, but I will tell you that seeing on the big screen from a 35mm print in a darken theatre gives it a much better impact than seeing a cropped pan and scan version on VH1 at Halloween.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "So Dark The Night poses a tough challenge: It's very hard to write about it in any detail without ruining it for those who haven't yet seen it. Since it remains quite obscure, that includes just about everybody. The movie will strike those familiar with its director Joseph H. Lewis' better known titles in the noir cycle – Gun Crazy, The Big Combo, even My Name Is Julia Ross, which in its brevity it resembles – as an odd choice. For starters, the bucolic French countryside serves as its setting. Steven Geray, a middle-aged detective with the Surété in Paris, sets out for a vacation in the village of Ste. Margot (or maybe Margaux). Quite unexpectedly, he finds himself falling in love with the inkeepers' daughter (Micheline Cheirel), even though she's betrothed to a rough-hewn local farmer. But the siren song of life in Paris is hard to resist, so she agrees to marry him, despite the disparity in their ages, which inevitably becomes the talk of the town. But on the night of their engagement party, she fails to return to the inn. Soon, a hunchback finds her body by the river. Her jealous, jilted lover is the logical suspect, but he, too, is found dead. Then anonymous notes threaten more deaths, which come to pass. For the first", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "WESTERN UNION tells in melodramatic fashion the stringing of telegraph lines between two points out west. Siblings Dean Jagger and Virginia Gilmore work for Western Union, and Randolph Scott and Robert Young work for the Creightons. Indians and some bad white guys get in the way, but nothing can stop America's progress. This sense of manifest destiny is greatly enhanced by a first-rate musical score and vibrant color photography. Scott is a bank robber looking to mend his ways, and both he and engineer Young vie for the attention of the perky Gilmore. Lots of great character actors help keep the large production moving forward.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "ticket:\n  channel: email\n  body: iv been a fan of Rik Mayall and Ade Edmednson ever since i can remember weather its young ones or bottom. and i just have to say i have never laughed so much in all my life!!! guest house paradiso is bloody brilliant! i know its not going to be everyones cup of tea (with the vomiting,slapstick comedy, violence and foul language) but then just don't watch it if it ain't yours. its not like no one knows what sick and twisted things Rik and Ade come up with when they're working with one another!! i think its unfair that this film received such a slatting from critics because,and i don't think I'm the only one to think this, this film is 10 out of 10! : )", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "You don't have to be a Notre Dame football fan to enjoy this, because I am not....but, as a football fan in general, this was fun to watch. It almost makes me a Fighting Irish devotee. If you can't get caught up in the emotion in this film, gridiron fan or not, you better check your pulse because this is an emotional film with some very touching scenes. As a sports fan, I loved watching the classic footage of early college games. They had some pretty wild plays back then with a lot of laterals. They interspersed that footage with Pat O'Brien shown as head coach Knute Rockne on the sidelines and some of the players, such as George Gipp (Ronald Reagan). Reagan gets pretty good billing in this film but his part really isn't that large. O'Brien is the only actor with a large role in here. The rest - all playing nice characters - include Gale Page as Rockne's wife \"Bonnie;\" Donald Crisp, as the Notre Dame's \"Father John Callahan;\" Albert Bassermann as chemistry professor \"Father Nieuwland\" and Reagan, as Gipp, perhaps Notre Dame's most talented and famous player ever. What this film does nicely is balance the personal story with the football. Neither angle is overdone. The characters in here all people you can root for, as", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "I particularly enjoyed Delly's review of this film and agree that Howard is not the only \"damaged\" character. Howard is rather ruthlessly \"set-up\" by the script, but there is no evidence that his previous employer is actually dead or, if she is, that he murdered her. Howard doesn't know and neither do we. In terror and confusion at seeing the woman lying there, he bolts. However, he never actually harms Helen Gordon, no matter how enraged he is. Indeed, he reacts with horror at Helen's fainting spell and the fact that he is holding a pair of scissors...then he resumes his tidying up and greets the recovered Helen with the almost pathetic \" I'm very tired now. I think I'll go home\". Frankly, I don't think he's a psychopath. A sick puppy, certainly, but not a psychopath. The problem with Howard is that he has no real male identity. He wanted to serve his country, but his mental condition denies him a place in the army. He is singularly rootless and isolated: no wife, no girl, no home (again, at least as far as we know). And, he does a woman's job - \"Floor's are my speciality\". Helen's niece ruthlessly strips away this pride in his thoroughness by exclaiming caustically that she would want a man with a real job.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Having grown up a Mormon and grappled with the church's bigotry towards Blacks (they were not allowed to hold the church's priesthood when I was a member) -- I wasn't aware of the organizations policy of excommunicating gay men and women until after I left the church in 1966 -- (I was 20.) I was stunned when I learned that friends who were gay were excommunicated even after serving on missions. LATTER DAYS exposes the Mormon's persecution of gay members. The film is LONG overdue. It does an excellent job of showing how the two lead males come to terms with one another, while managing to grow up and develop more fully as individuals. LATTER DAYS has great heart, wonderful original music and an added touch of class from Jacqueline Bisset. The film brilliantly tells the story of an individual who leaves behind the confines of organized religion and reclaims his very soul.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "I really liked the movie 'The Emporer's New Groove', but watching this was like coming home and seeing your wife having \"relations\" with a llama. Seriously, this movie was bad. It's like Club Dread after Super Troopers. I am supposed to write 10 lines, but I don't even know what else to say. I laughed a couple of times, but only because I was drinking. A movie like that should at least be funny when your drunk. It was not. Maybe llamas are just funny and regular cartoon people aren't. Either way, just stick with The Emporer's New Groove if you want a funny, cartoon, llama-themed movie. Line 10 is this line right here.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "Flash Gordon was a first rate serial. I know there were a few goofs, however, i didn't watch it for the flaws. Buster Crabbe is Flash Gordon. He was not a trained actor but he gave a very good, convincing performance. Jean Rogers is pretty and at 20 yrs. old did, in my opinion, a pretty good job. Charles Middleton as Emperor Ming, is superb. He was in a lot of other movies, quite versatile, he could sing and dance. His portrayal of \"Ming The Merciless\", in all 3 Flash Gordon serials, was top notch. The rest of the cast also did a very good job. Well, boys and girls, get some popcorn, settle back and enjoy. John R. Tracy.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Kar Wai Wong's incredibly impressive romance that is to me, perfect. Set in 1960's Hong Kong. As we are shown, this is set in a turbulent time. Tony Leung and Maggie Cheung play Chow Mo-wan and Su Li-zhen Chan. A man and a woman who meet each other in a Hong Kong apartment, in which they both move in. Chow Mo-wan works for a newspaper company. Su Li-zhen Chan is a secretary. Two very different people. Chow Mo-wan and Su Li-zhen Chan create a special bond after they both find out their spouses, constantly away are committing extra-marital trysts. With each other. The characters of Chow Mo-wan and Su Li-zhen Chan are nothing short of amazing. Both Leung and Cheung manage to strike such amazing chemistry with one another, it's better than any Hollywood romance that is put out today. Combined. The film is all about the focus of the two leads and their feelings after the infidelities of their partners. Kar Wai Wong manages to create such strong character development between these two characters, you really start to feel for them. Leung and Cheung are both wildly amazing, are better than any Hollywood pairing shown on the screen today. Combined. There's nothing much else to describe Fa yeung nin wa other than beautiful, energetic romance that also features a", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "The bipolarity of this movie is maddening. One moment it's making fun of Latin Americans, American tourists and banana republics in general, the other it wants to be touching, with burned villages and orphans. Even the serious revolutionary hero, becomes a parody of a revolutionary at one point. But the comedy parts aren't even funny, because it's so obviously stolen from Star Wars. Yes, Star Wars, the \"hero\" is basically a rogue with a heart of gold. Add to this stereotypical sounds effects, Latin Americans who speak English with one another, and a villain that just disappears from the story. And whats the point? It's basically revolution propaganda with no resolution, and no planning (because, there is just no way these people can lead a country). The US government are bad guys, but who'll make money producing this? Not some poor farmer, that's for sure.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "The best movie about friendship! Especially between an AIDs infected person and a \" normal \" person. This is a great movie for everyone to see even though there is strong language used. I have seen it 25 times.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: After the lush, inspiring aerial shot in fast motion in the opening of the movie, this slipped into utter boredom and a one tone note right till the end. Where to begin, well I'll start with the characters. I really enjoyed them in the book, here they all were types and one dimensional morons that either had \"Victim\" or \"Asshole\" written on their foreheads from the get go. How any one didn't see through the store owner Lealand Gaunt (in a hammy and out of place performance by Sydrow)is beyond me. This film lacks in thrills, suspense, and in some sense yes, entertaining values. It stretches itself for far too long with not a lot of pay off. Why introduce too many annoying should-die-quick type of characters and then forget about half of them half way through? In the book practically everyone that went into the store met a grisly fate. Here, besides one of the only decent scenes that translated well from the novel (the fight between Wilma and Nettie), was a letdown and didn't have much balls. I'm sorry but after, one off screen death,a boring shoot off, and some bickering and then a couple explosions just didn't do it for me. The brutality and mean spiritedness from the book was sadly missing. The explosion of the church", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "This is absolutely the worst comedy I have ever seen. It's hard to explain though, because (unless you've seen this) I bet you've never seen a comedy that was not good or bad; it's just there (That's the original part-not good or bad, just there)! Let me say that I have seen every comedian appearing in a main role, and like them all. That's what makes this such a mystery. The supporting leads are actually acting (although the dialog is bad). The only character that is fairly good is the one played by John Goodman. He does a pretty good job with what little dialog he has, and actually has one funny line (I won't spoil the only funny line in the movie, in case you decide to watch anyway. It involves a pancake.) The big mysteries are the main leads. I won't call them characters, because no characters have been developed. This script is so juvenile that they don't even bother to give the leads fictional names. They all just use their own. They don't even seem to be trying to act. It's as though they are all reading out loud to each other from scripts that the local junior high sent to them. I actually wrote a paper like this for my English class when I was thirteen-it", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "Okay... she's on the boat with this guy, realizes he's out to kill her, knocks him out, and then finds the reason he's out to off her is this disk that got her coworker killed. So what would any rational person do? Maybe conk him over the head again to make sure he's really out?? Tie him up?? Look, Sandra honey, you've got the chance to escape while the guy is out for only so long. Until you know how long it will take you take you to escape, make sure he's not able to come after you. I HATE these stupid female victim roles. The rest of the movie was just a series of twists and turns that were completely convoluted and too unbelievable to remain interesting.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "It might be a stretch saying this as a die-hard Carlin fan, but the material, both written and as performed, in It's Bad for Ya is some of the best late-era material yet. At 70 Carlin bounces back from the level of despair (and some of the stumbles in the act itself) from Life is Worth Losing to a special that is firmly structured but loose and playful- or as much as the \"old f***\" can get- and is continuously, ceaselessly, funny. And funny as in reminiscent of what some of us had going on when watching Back in Town or 'Diseased' the first time. The material, even if sounding at times a tinge of the previously done (i.e. the whole bit on children in school and camp like the Children segment in Diseased), is always fresh and with such a sting of truth to everything that it scalds the mind while (here goes) tickling the funny bone. Going from the topic of death (how long to wait to scratch off a name from the book? six weeks, unless if on the computer scheduler), the facets of communication, looking down from Heaven, spots of God (naturally), kids, and just troublesome gestures involving hats in religion and if people really have \"Rights\" make up the bulk of the special, centered around", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "The Emperor's New Groove was a great twist for Disney. It wasn't a musical! It had clean, fresh jokes and no political twists. It was just a darn funny movie. Kronk's New Groove, on the other hand, is tired and weak. My 3-year-old still loves Emperor's New Groove, but fell asleep during Kronk's. There really isn't any really conflict (that, in the first movie, lead to all of the wacky adventures). Because of the lack of conflict, it almost seems like the animators threw out the writers and just made the storyline up as they went along. I kept waiting for something to happen that would make the movie fun . . . and still am.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: **********SPOILER ALERT*************** If you happen to like JURASSIC PARK 1, 2, or 3: If you happen to appreciate really bad movies for their sheer entertainment value if not for their quality (case in point-John Carpenter's DARK STAR-highly recommended) If you happen to like movies about dinosaurs in general- THEN STAY AWAY FROM THIS CINEMATIC CRAPSTERPIECE! The shameless use of stock footage from CARNOSAUR 1 & 2 make up most of this miserable attempt at a dino/slasher flick- Take the scene, for instance, where the security guard meets his doom at the jaws of the Alpha T-Rex. For some reason, he drops about 50 pounds and appears 10 years younger. Why is that? Simply because this scene was lifted directly from CARNOSAUR, which was a crummy flick to begin with. The ending was a carbon copy of CARNOSAUR 2, for those unfortunate enough to have sat through that straight-to-video loser. Again, we see Mr. Rex do battle against a bulldozer-which alternates as a forklift truck-through the miracle of -ta-daa!- stock footage from the aforementioned CARNOSAUR 1 & 2. Of course, the ending is exactly the same-the beast falls to his death just as the complex goes up in flames. A real insult to anyone's intelligence. But it's still better than watching the ROSIE O' DONNEL SHOW. Rating: 1/2* out of *****", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "Emotionally insecure Tom Russo (Asbestos Felt) reads the secret diary of his sexy wife Leeza (Courtney Lercara) and is dismayed to discover that the love of his life has apparently been sleeping with every bloke she meets; this shocking revelation sends poor Tom off his rocker, and he proceeds to wreak bloody revenge on the men who he believes have been rogering his old lady. In my experience, really, really bad films can often be as much fun as really good ones, and no film featuring a decapitation by machete-enhanced ceiling fan should ever be considered completely worthless; but even though Killing Spree very occasionally manages to entertain with its inventiveness and cheap and cheerful gore, I found that the terrible direction, awful production values, ugly cinematography, muffled sound, dreadful lighting, mind numbingly tedious and daft narrative (which includes a really dumb plot twist that is telegraphed from the beginning, plus a pointless zombie finale), nasty synthesizer score, inane dialogue, and thoroughly amateurish acting all served to make this effort from writer/director Tom Ritter a virtually joyless experience.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Since the last horrid Astérix film and the fact that we only get the Swiss German version in cinemas, here, I went to watch it with quite a bit of trepidation... Unfounded, as I was happy to discover ^____^ The film is funny and modern, has good gags, a good animation, an amusing character interaction, a good voice cast (Note: I can only speak for the Swiss German one!) except for the Viking chief's daughter Abba (her name is great, despite the not very inspired voice actress)... I especially liked the character Justforkix (Goudurix in French, Grautvornix in German. He's the young man who is supposed to be put in shape...). He's a very amusing portrayal of a mollycoddled, urban teenager; but he's very likable, despite the teenage mannerisms... XD The interaction between Astérix & Obélix and their young charge is fantastic and thoroughly entertaining. It shouldn't be compared to the old films, since this one is quite different... Which surprisingly doesn't make it bad. On the contrary. When they tried to modernize the last film (twelve years ago), they completely blew it. This film, however, proved that it can be done just fine... ^-^ I came out of the theater cheerful... Always a good sign ^_~", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Being too young to have experienced the Hammer films when they were fresh and new, I am discovering their hallowed horror films as I find them on DVD. I know it was almost a decade and half between them but it's hard to see much of the magic in the original Hammer Dracula in this late entry to the Christopher Lee series. The original Hammer vampire story had lots of atmosphere and a terrific story to get involved in. Lee was a great Dracula, a vibrant vampire if that possible, in the early outing but here he is nothing more than a cardboard character that mostly stands around and looks threatening. The modish young people talk like cartoon characters (even though my aunt lived in England during the 1970s and she says people actually talked with those awful clichés). I had no interest whatsoever in who lived or died amongst the younger crowd. They were all pretty terrible characters anyway. I did enjoy seeing a young and charismatic Caroline Munro; but she leaves the story too early. Lee and his historic nemesis Peter Cushing add an air of authenticity to the film but they can't draw blood from this empty film. It's D.O.A.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "ticket:\n  channel: chat\n  body: I think One True Thing is one of Meryl Streeps finest movies to date. Her depiction of a dying woman is perfect. I have recently lived this movie, and it touched me on more levels than I could have imagined. Meryl is truely the greatest actress to have ever walked the earth!!!!!", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Hayao Miyazaki's magic continues with this absolute crowd pleaser Ponyo on the Cliff by the Sea, his latest animated film, which turns on the usual sweetness to charm your socks off. I thought that the trailer featured its song which was quietly hypnotic, and I didn't have to wait for an invite to make sure I got my ticket for the sneak preview of the movie, scheduled to open here next week. For fans of Studio Ghibli films, you'll probably know what you're in for, as Miyazaki has yet another winner in his filmography, that will win new fans over. I'm embarrassed to say the least that I've so far watched only My Neighbour Totoro (eyes that pile of Ghibli DVDs) and love it to bits, but I guess this would serve as a final push for me not to continue missing what would likely be animated films that I would enjoy. Ponyo (voiced by Nara Yuria) is a magic goldfish that yearns to know what is life beyond the sea, with her constant forays in a bubble to the surface of the water to sneak a peek. Nonetheless these ambitions do not bode well with her humanoid dad Fujimoto (Tokoro Joji), who harbours some hatred toward the human race for pollution, and briefly touching a subplot on environmental protection", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "I play this game exactly after I watch the trailer in old magazine advertise CD... The is very interesting and dark atmospheric (missing in nowadays games/movies). The game is set somewhere in the middle of the '90 in the spooky mysterious mansion. You play as Adam Randell and your quest is to free the soul of your death trapped father. The look of the game is doom-like, but very different type of game. A lot of a action, various puzzles, quests, mazes and many more interesting locations and characters are presented in this old classic game. The game will run only on Windows 98 and there is no patch for Windows XP.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "This film has gone in and out of fashion more often than the miniskirt. A triumph in the post-war period, it was virtually forgotten by the 1970s except by students of cinema. Recently, it has begun to get recognition as perhaps the most even-handed representation of soldiers' integration into post-war life ever made (and that most definitely includes films such as \"The Deer Hunter.\") I like it, but my overall evaluation is somewhere between those extremes. The tale is a simple one. Three very different servicemen who have mustered out after World War II (The Big One!) fly home to their Midwest town and try to resume, or create, civilian lives. One has a disability, one has a cushy job waiting for him, and the other has nothing to go on but determination. There are some good but unfortunately uneven performances. Fredric March won the Best Actor Oscar for playing an old Sergeant who returns to his job at the local bank. Personally, I think Jimmy Stewart deserved it for \"It's a Wonderful Life,\" which also deserved the Best Picture Award, but clearly this film touched a nerve with the post-war audience. As I said, it was fashionable. March has one fantastic scene, a humorous speech that brought to mind somewhat similar incident involving real WWII hero Pappy Boyington, and", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Sorry this movie was a bad made for TV movie. Are the rest of you on drugs when you watched it? I thought the hair,make-up and characters were poor 2 dimensional types. The story is doubtful,especially since all of the main characters are dead,or nearly dead. I think it's not well acted either...what was up with that hair on the main guy in the Turtles? It looked glued on badly, and the sideburns looked like they were going to fall off at any moment. It didn't feel like anything new was revealed in the story of the band and how the members met other bands,and people. I laughed all the way through it,Frank Zappa looked stupid,so did Mama Cass, and so did the Beatles. They were made out to look stupid and ridiculous. Also the other band people like Jim Morrison,Donovan also took a big hit at looking stupid too. Kind of terrible,if this is how you remember these people. It's a poor history lesson on music,it's fictional the way it was made.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "The first time I saw this film, I wanted to like it for so many reasons, but I simply did not. It just seemed a little dull. But there was a tiny question I had about something I saw near the beginning of the film so I watched it again and then finally it clicked for me. I first watched the movie knowing the \"surprise ending\", and while I definitely wouldn't recommend having the ending spoiled for you, I have still thoroughly enjoyed the bulk of the film and discovering the many seemingly insignificant events that all unravel to point to a very sinister scheme. I don't think that everyone will love this movie, or even like it. If you like any of the actors, you'll like this movie because the acting is fairly strong and they all get a lot of screen time. If you like mysteries (namely Hitchcock) you'll like this movie. If you like independent or psychological films, you'll like this movie. It really worked for me on all of those levels. If you don't like the actors, mysterious plots or psychological elements, you might not like this movie. But that's your loss. Personally, the only thing that irked me a little was the accents. Good try, Alan Rickman, on the American dialect, but it wasn't much", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Another one that slipped by the radar of most anyone. This little B produced gem is so full of new ideas in an old genre and so absolutely refreshing and inventive, that a dreadful feeling about the lack of cojones in today's cinema slowly overtakes your body. The final set piece is so innovative in its setting and style that it prefigures everyone from Tarantino to John Woo. Oh, and if you think \"dying lines\" are all cliche, wait for the dying line of FF. A piece of dialogue that could have torn you with laughter will take your heart. A true pleasure. Seek it and see it. You won't be sorry.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "- role: customer\n  content: I am right now watching \"The Big Chill\" on DVD. One of its actors is Meg Tilly. I looked it up on IMDb which led me to reading Meg's bio which mentioned and reminded me of Meg's sister Jennifer Tilly whose filmography included \"Key West\", which was one of my wife's and my favorite shows. I then read this entire thread of reviews. Wow, I really loved that show also and agree with all of the sentiments about the quirkiness and uniqueness of the characters and situations. As most everyone else, I wish it was on DVD or otherwise available. The last reviewer says he watches it on reruns so I wish I knew what network, channel, day, times it is on. So if anyone knows how we can watch episodes of \"Key West\", please let us know.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Strained and humorless (especially in light of its rather dubious psychology), but well-paced and comfortably lurid, this genteel body count movie highlights the unusually hypnotic presence of Angharad Rees as a young woman periodically possessed by Jack the Ripper, thus allowing for some nasty gore effects amidst the Edwardian propriety. It's all pretty standard stuff for Hammer, but is handled with a good deal of visual elan, even if the central relationship, between psychoanalyst Porter and Rees, drives the narrative without ever being satisfactorily explained.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "There have been many excellent comments about this movie and I want to add my voice to the praise. Yul Brynner has never been more powerfully attractive. His Major Surov was riveting. Your eyes just cannot leave the screen when he's on it. This is his movie. This is not to slight the rest of the cast which was also exemplary, especially Deborah Kerr and Anne Jackson. As they were mostly stage actors, they brought many nuances to their performances. For example, I have seen this movie at least 4 times, but this is the first time I noticed the reaction of the German girl when she came face-to-face with a Russian soldier. Even though he was not threatening, her absolutely hysterical reaction made me realize that she must have been in Germany after WWII and was most likely gang-raped by the Red Army. The possibility of discovering deeper layers of story that may lie just beneath the surface makes me want to see this fascinating film again and again. Please put it on DVD.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "I first saw this movie at a video store and, being the Bam Margera fan I am, had to rent it to see what it was all about. Since I have a huge and stupid (note the word stupid) sense of humor, I found this movie absolutely hilarious. Some of the parts are pointless and random, but that's what makes them so amusing. You'll need to think things like getting slapped in the face and bashed on the head with a watermelon are funny in order to appreciate this movie. I was really impressed. I was also surprised at the acting. These people actually did a good job. Nothing Oscar worthy, but well enough to get past the amateur level. Teens and young adults would probably find this more entertaining because of the modern slang and situations used. I wouldn't suggest watching this with your parents and vice versa. All in all, the acting was great, the script was hilarious, and the story is really something you can relate to.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "This movie has some good performances, as others have pointed out, but suffers (as others have pointed out, except for the people who apparently are either friends of the filmmaker or the cast to otherwise explain why they would deem this a \"10\") from some self-conscious and self-absorbed film school padding and excess plots. This is the type of plot that Sex In The City could handle in a half hour episode, so there was no reason for it to be even an 88 minute movie. A perfect example of wasted footage is the fast forwarding montage in the first third of the movie. Some of the back story is merited, but too much time, for example, was spent on Daria character with the anal sex boyfriend and on the back story for Paulie, who was not a realistic character, although the actor did a decent job with the lines he was given. The worst aspect of the movie was the level of amateurish parts: from typos in the typed material, to bad jumps and edits, poor camera positions, angles, lighting problems throughout and, most glaringly, a poorly written script with a badly developed concept. If the writer (also the director and lead) had collaborated with someone, he might not have ended up with a 100% rotten score on Rotten", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "Well, This was my first IMAX experience so I was pretty blown away about that, primarily; although with hindsight, I can't help wishing that it had been some other (less monochrome)film. Magnificent Desolation very much had the \"Programme for Schools\" feel the way it listed all the astronauts and this made it feel a LOT like reading National Geographic Magazine in 3D. Weirdly it actually had a very two dimensional quality that only occasionally exploded into reality and a lot of time it felt like some PowerPoint Presentation. There was a moment in the film when an unnoticed abyss opens; seemingly at your feel, that had a bit of a WOW factor but to be honest, that may have had more to do with me being an IMAX virgin. The commentary, provided by Tom Hanks, I personally found very, (what's a nice way to put it??) \"flag-wavingly nationalistic\" which didn't go down too well in central London, judging by remarks overheard as we left. Over all, I loved the IMAX experience, but dearly wish a different film had been on on that day. The Moon isn't a particularly colourful subject and to be honest, a lot of the 3D effects were lost in the monochrome scenery. All that would have been well, were it not for the documentary inserts and", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "This movie just seemed to lack direction. The plot developed so many twists in such a short amount of time that it seemed to lose any semblance of what the true storyline was. There was a lot of wasted dialogue and just seemed like the writing was rushed and a little too wandering. The exorcism scenes and possession story began to take a back seat to the character's back stories (which were a little weak to begin with). All in all, I would say skip it unless you have rented out the rest of the horror section at your local video store and you have a jones for a movie you haven't seen before. You're much better off just watching The Exorcist or The Exorcism of Emily Rose.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "I thought this movie was really good. It ends up showing the viewers in the end that Leila should of kept what she had. Leila was sick of her husband Jim, who was more worried about work then her. He was so into his work that he forgot their anniversary. He was also very sloppy. She couldn't take it anymore so she left to see if he would miss her. The movie shows that he misses her, he even tries to make up for the night he messed up. He goes to her and tries to bring her home. She ends up finding another man named Schuyler. He seemed like the man she always wanted neat and notices her. In the end she sorta foreshadows by when she look at Schuylers shoes and the way he let his cigar ashes fall on the floor the way Jim did the same kinda thing. Jim ends off making lots of money and cleaning himself up. Leila thinks in the end that she should of kept her husband because thats all she really wanted and he did changing.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Haha, what a great little movie! Wayne Crawford strikes again, or rather this was his first big strike, a deliriously entertaining little ball of manic kitsch energy masquerading as a psycho killer movie. It's actually a **brilliant** satire on post-hippie American culture in flyover country, though the movie was actually filmed independently in Miami. It defies any kind of studio oriented convention or plot device that I can think of: SOMETIMES AUNT MARTHA DOES DREADFUL THINGS may not be a very technically adept movie, but it is a wonderful little slice of Americana, made on the cheap by people who were honest, ambitious, imaginative and had balls made out of steel. It took guts, nerve and guile to make this movie, which amazingly appears to have stood the test of time. This movie is fresh, vital, alive, unforgettable, and charmingly weird enough to recommend to just about anyone with a sense of humor. I dug up last year during a period of time when I was fascinated by \"star\" Wayne Crawford (here billed under his pseudonym Scott Lawrence), a maestro of what can only be called regional film-making, usually of the B grade variety. He's a writer, producer, director, and actor all in one, probably best known for the 80s teen apocalyptic favorite NIGHT OF THE COMET. Here he plays", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Like a terrible cancer raining out of the sky, I wandered into this crock on some movie channel the other night. Being a fan of bad movies, and actively engaging in the purchasing and viewing of said bad film, i was intrigued by the idea of a genuinely terrible looking action movie coming from modern times. After that wore off though, I found my hands inexplicably turning against me, grabbing at anything in range and stabbing about my head and neck. Something sinister was in that tape...err...where was I...anyway this ranks among the more embarrassingly bad pieces of film I've run across. William Forsythe can't play more than one character, and that character is always a walking joke. Even when set into a comic background and given things to do and say that are supposed to be funny (ala Deuce Bigalo) he's laughable in the wrong way. Erika Eleniak is much the same, having starred in her fair share of terrible movies and done terrible jobs in all of them, she doesn't fail to help scum up this one. Classic b-movie villain guy Andrew Divoff does a respectable job but barely even has any scenery to chew on. Even reliable standby for b-movie action Daniel Bernhardt fails to deliver anything bordering on entertainment. As for the film's own merits, the", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "I give this a 10 out of 10, not because the plot was hard to uncover because it wasn't... but because it leaves one caring for the characters. The acting, by all the cast, is superb, especially Joan Hickson, and it's a marvellous episode because of it's heart. Miss Marple is called upon by Jason Rafiel's dying request to investigate, and solve, a murder that happened some seven or eight years previously, and she has to discover who, why and when as she goes along. Mr Rafiel is the same Rafiel as was in A Caribbean Mystery and so there is a sense of a connection here. Nemesis is definitely one for the amateur psychologists among us, and if you are one of those who is only happy with lots of blood, guts and rip-roaring action sequences, then you won't like it. But if you are like me, one who loves knowing about PEOPLE and discovering what makes them tick, then Nemesis is the one for you.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "I quote below words from my favor writer, Paulo Coelho, as the comment for this movie. \" When you really want something, all the universe conspires in helping you to achieve it\" It is too easy to forget who we really are and what we desire to do in life. Because there are always too many comments and advice surrounding us to tell safety. I had almost forgot what the passion feel like. Despite of the adventure will take me out of safety zone, I truely believe the fear is just the price that I need to pay for the coming brand new journey in life. Thanks for inspiring me with this lovely story. It is the blessing for me to realize what unconditional love is. That is the most treasurable love from the light of soul.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Over the years I seemed to have missed this picture of Ronald Reagan, and due to his recent passing to the big screen in heaven, it was shown on TV recently. This is a great low budget B&W film of the late 1930's, however, it is very interesting to see how criminals used their talents to steal money from insurance companies with false claims during this particular time frame. I was surprised at the role Ronald Reagan,(Eric Gregg),\"The Killer's,'64, played in this picture, along with a great veteran film star, Sheila Bromley,(Nona Gregg),\"Nightmare Circus\",'73, who was a great supporting actor. It was a great film that showed Ronald Reagan as a very young man reaching for the stars in his career in Hollywood at the time. God Bless HIM !", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "This Film Was One Of The Worst Films I Have Ever Seen. This Movie Drags On and On and I Almost Turned It Off, But I Gave It A Shot. I Wasnt Expecting Anything Great, But I Was Expecting More Than This. Good Thing I Work At A Video Store and Saw This For Free, Because I Would'nt Spend One Dime On This Movie. I Gave This Movie a 2, Only Because I Have Seen Worse. If I Were You I Would Stay Away From This, Very Far Away.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "I read a lot of high hopes from readers of the book that this would be a faithful adaptation of Nora Roberts' story. Not having read the book, I don't know if this adaptation was faithful but I do know it wasn't good. Actually, the screenplay was the best part of the movie so kudos to Nora Roberts. I planned ahead and watched Carolina Moon because of Claire Forlani. I've never been sure if she's a good actress. She's been decent in some movies, average in others and really bad in this one. But, Forlani wasn't alone. The performances were all over the place. Oliver Hudson was wooden and boring. Josie Davis was hammy. Then, amidst all this B-rate acting, there's Jacqueline Bisset! She didn't have a lot to do other than portray bitterness but, even sleepwalking through that, she was miles ahead of the others. Still, Forlani remains one of the most breathtaking women in movies and I was not disappointed in that capacity here. I believe Forlani can be more than eye-candy but, until she turns in a good performance in a good movie, she continues to excel at that. And, I'll continue to faithfully watch everything she participates in. Fandom is fun that way. This movie though, Carolina Moon, was pretty bad. In addition to the bad", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "Okay, make no mistake - this is a pretty awful film, but I actually thought it had a couple of creepy scenes and overcame its pathetic budget every now and then. At the very least it's unintentionally funny in spots and has a definite air of creepiness and discomfort (a face burning scene, the part with the disfigured bride). This baby falls into the \"so bad it's entertaining\" category to me, and for that alone I would give it a star. The effects are terrible, the acting is abysmal, and the whole thing looks like it was shot in a day. You gotta love that toy ship at the beginning, too! It brought back childhood memories of seeing this on late night TV many years ago. While the Alpha DVD print looks weak and as though it was recorded directly off an old television broadcast or something, I actually liked that in this case!", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "I am surprised that so many comments about this film are positive. Having read the book several times (and all the other historical novels by Mika Waltari) there is no way to say much good in this film. If I forget the origins of the story I might consider it a reasonably good epic. Of course to bring such a brick of a book to the big screen is a task not to be envied, but it could be done with class. I can't understand why even the name of Nefernefernefer had to be shortened to just Nefer. I love Peter Ustinov as Kaptah and Marlon Brando probably would have made a better Sinuhe but the overall attitude is too Hollywood to ever make justice to the book. Mind you Mika Waltari left the Premier of this film in the middle of the showing. That's how much he liked it.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "- role: customer\n  content: I have it on VHS but its not a great copy as I have watched it 2 or 3 times per year since 1999. I am also in fear that 'her indoors' will throw it out in the annual VHS purge. My brother and I (Late 30' still laugh at the carry on in this fantastic show.Tim Healys Lucky Cup Hat and telling the apprentice YOU Can DO NONE OF THAT (Shooting, passing etc) and he turns out to be Peter Beardsley.As a Leeds fan I have to laugh at the empty dossier on Bostock before the cup final (or did it say S**t ?) The reason I came on line today was that my Bro wants it for Christmas so ITV please bring it out on DVD Come on The UnderFelt Men !!", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: Well, I can safely say I'm human, Wong. And I didn't throw up. I laughed. And laughed. If this movie made you puke, there is something wrong with you. But this movie is incredible. I bought it four days ago, and have watched it 5 times already. The animal cruelty gets my heart, but not long enough to be guilty. The movie is shocking, disgusting, and vulgar. The acting is horrific. What else do you want from a movie? I am a die-hard cult film maniac. Pink Flamingos is awesome. It makes Rocky Horror, as someone has said, look like the teletubbies.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Just saw it....the story, the plot, the script makes absolute no sense!! Its Samvise the brave part 2(without the RING), its characters showing up out of the blue(for no reason),its Hercules hated by everyone(no one knows why), its Leelee Sobiesky showing her true talents(two of them), its crappy special effects, its a few good actors wasting their talents(did I mention Leelee's two talents??)... do I have to say more??? ITS JUST AWFUL, even for NBC-TV standards!!! Its just the lowest....what a waste! by the way: how can you people give this mini-series so many stars????? Its beyond me!.... Shame on you! Have to make 10 lines, so this is my final word: AVOID, AVOID, if u are considering buying it!", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "An Eko-centric episode the \"?\" explores the aftermath of the tragic events that rocked the castaways in the previous one. As the main characters John, Locke, Sawyer, Kate and Hurley come to terms with the incident in the hatch, Locke and Eko set out to find out where Henry took off to. As it turns out Eko is on a mission of his own trying to figure out the symbol ? which Locke had drawn on his sketch. We see flashes of Eko's life in Sydney as a priest who comes in contact with his brother through a stranger. We also witness the tragedy that struck the hatch boil down to a room temperature as Michael continues to remain a mystery. An excellent LOST episode with many interesting turns.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "ticket:\n  channel: chat\n  body: I was giddy with girlish-glee when I found out about this movie shortly after seeing Spirits Within. After years of anticipation, they gave November 2005 release date. Well, November came. And went. Followed by December. Oh, look, today's January 31, 2006. No US release as of yet. Oh well, I'm so glad I had a friend with a bootlegged subtitled copy. ;D Well, the cg was great. Not as good as expected, but near perfect. I cringed, however, at the unnatural movements made by the children throughout the movie. I had thought that we were passed this by now. Also, I didn't really care for the anime look given to their faces. I was under the impression that they were shooting for a realistic look to the film, and yet most of the characters have larger-than-norm eyes, especially the girl characters. They had personality, though, I'll give them that. Even though I'm not a big fan of anime, I do have to say I was impressed with the wild fight scenes. They were animated beautifully and had me hanging onto the edge of my seat. For about the first two. And there-in lies Advent Children's biggest flaw. It's mostly just a bunch of hyper-stylized fight scenes. A FF7 sequel of epic proportions had been promised for years. Instead, they gave", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "I just saw this movie at the Berlin Film Festival's Children's Program and it just killed me (and pretty much everyone else in the audience)! And make no mistake about it, this film belongs into the all-time-250! Let me tell you that I'm in no way associated with the creators of this film if that's what you come to believe reading this. No, but this actually is IT! Nevermind the \"kid's-film\" label on it, \"Klatretösen\" (\"Climber Girl\") is on almost every account a classic (as in \"biblical\")! The story concerns 12-year old Ida (magnetic: Julie Zangenberg), who is devastated to learn of her daddy's terminal illness. Special surgery in the US would cost 1.5 million and of course, nobody could afford that. So Ida and her friends Jonas and Sebastian do what every good kid would - and burglarize a bank! Sounds corny? Don't forget: This is not America and \"Klatretösen\" is by no means the tear-jerking Robin-Williams-multiplex-plat-du-jour nobody takes seriously anyway. Director Fabian Wullenweber set out to make a big-budget-action-comedy for kids and, boy, did he succeed! Let me put it this way: This film rocks like no kid-film and few others did before. And there's a whole lot more to it than just the \"action\". After about 20 minutes of by-the-numbers-exposition (well, granted) it accelerates into a monster", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "A SUPERMAN Cartoon. When America unveils its colossal new bomber, the JAPOTEURS, an elite force of Japanese spies & saboteurs, strikes. Stealing the behemoth, with intrepid girl reporter Lois Lane aboard, and the destination either Tokyo or destruction, it's time for Superman to get involved... This was another in the series of excellent cartoons initially created by Max Fleischer for Paramount Studio. They feature great animation and taut, fast-moving plots. Meant to be shown in movie theaters, they are miles ahead of their Saturday Morning counterparts. Bud Collyer is the voice of Superman; Joan Alexander does the honors for Lois Lane.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: I just attended a preview screening of this film. A masterpiece of documentary film-making it was not. Totally absorbed with its subject, the film becomes incapable of leveling any sort of critical commentary with regard to Ms. Faye. Cloying and sappy, the only redeeming quality of the film was its use of puppets in an attempt (albeit a failed one) to structure some kind of narrative. But the creepiest experience occurred as the closing credits rolled. The audience rose and applauded. Like moths to flame, Americans in the 21st Century are still drawn to freakshows. The narrative of the misunderstood monster is getting rather tired.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: This film is really really bad, it is not very well done and is a lack lustre attempt at something but I am not sure what. I watched it and was very disappointed. It promised a lot, but delivered nothing at all. The characters are shallow and wooden, and the music, if you can call it that, is dreadful. There are of course all the creatures and animated beings, but they are so poorly done that it does not come across as anything other than a third rate movie. It is a real shame that more attention could not have been spent to the special effects, not the be all and end all of a movie I agree, but in a movie that is based around them, it's a very important factor. For me, a very sad attempt, and should be avoided.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "ticket:\n  channel: chat\n  body: A wonderful Christmas story on the moving theme of \"Susie Homemaker finds her Inner Amazon.\" No, I'm serious! Geena Davis's amnesia starts to improve when she is knocked on the head. From this familiar beginning, we move in an unexpected direction. Good pace, good action, fun story, lots of explosions and mayhem.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Usually I'm the one criticizing the twenty-something Neanderthals for not being able to appreciate a film unless it has plastic t*ts, gunfights and car chases. However, in this case the film might actually have been improved with a few of those additions. At least I wouldn't have gotten bored after an hour and changed channels. I don't mind surreal, and I certainly don't mind having to pay attention to find subtlety or hidden meaning, but there should be some point to the whole thing. I didn't get the feeling that even the writer or director really had a broad vision of anything but were, instead, just so self-absorbed in their own pretentious visions that they became deliberately scattered. Or perhaps they just got confused themselves. Either way, I don't care. It bored the crap out of me for just over an hour with no saving grace. Although a whole pack of other viewers have filled up this site with excited ravings about the alleged symbolism and masterful cinematography, I must respectfully disagree. Perhaps I didn't mince through enough film classes to appreciate some inspired techniques not visible to mere mortals ... Or perhaps this movie was just crap. I give it a \"1\" and file it next to \"Ishtar.\"", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "Most of this political thriller presented as a mostly run of the mill movie with a somewhat better development of many of the major characters, that was much appreciated, until the BIG twist and powerful climax that recalled twists experienced in \"Silence of the Lambs,\" or \"The Sixth Sense.\" Reese Witherspoon as the distraught wife of the missing Egyptian husband and Yigal Naor as the strong-armed interrogator offer strong performances. Jake Gyllenhaal unfortunately is handed a more two-dimensional character and has to struggled with a stereotypical presentation of the emotionally torn CIA analyst that has been presented many times before in other movies. Early on there is the nice scene with an explosion that resembles a scene at the end of \"Saving Private Ryan,\" the silent scene that was used so effectively in reflecting one consequence of violence. The script also provides a little more glimpse into the mind-set of the \"enemy\" but still doesn't allow the audience really much understanding, again permitting the audience to wallow in stereotypical characterization. The cinematography and photography also is somewhat of a letdown because unlike \"Jarhead,\" or \"Blackhawk Down,\" the crisp, raw visceral presentation is missing not allowing the audience to really be there in the movie, there is some distance that keeps the audience from realizing the intensity of the emotions occurring", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: Unless you want to be bored half to death. I've never been a fan of Gus Van Sant and as part of what previous posters have described as the new youth generation i was very disappointed and slightly angry at the stereotypical depiction of the characters in the film especially as they were used to string along the film's ridiculous storyline which is pretty much enforcing to the viewing masses that skateboarders are social rejects and should be blamed for crimes. As a skater myself i watch a lot of skate films and the filming during the skate scenes, which is obviously a major part of the plot as the lead protagonist is a skateboarder, was awful and Bourne identity esquire shaky camera technique was used with slow motion to give a horrible effect. This film is just full of ridiculous stereotypes as shown by the 'emo' soundtrack which just adds to the media myth that all skateboarders are white rockers. Simply just a really bad film.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "This film is based on a true story. The author of the novel bearing the same title, Einar Már Guðmundsson, had a brother, who turned mentally ill. I found this film very moving, following the main character's path down into illness, to see how he tries to cope with life after diagnosis, and how he makes friends at the mental institution, it all is very convincing. There are quite a few splendidly funny incidents also in the manuscript. The title of it gives nothing away concerning the story. You must watch it to understand ... and listen to the music, which is twisting and turning your heart and soul upside down and back as the film moves on. A must-see for everyone.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "Franco Nero stars as Cole a ninja who comes to the rescue of his war buddy Frank Landers (Alex Courtney) and his fetching wife (Susan George) to protect them from a mobster (Christopher George) who wants the land. Things get even more complicated when the mobster hires Cole's old nemesis (Sho Kosugi) who is also a ninja. Inept martial arts actioner, while having better production values then most ninja movies, fails to inject any life into the surroundings, or for that matter actionscenes. A poor effort all around.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "The Ten Steps has basically a reasonably good premise for a scary short but the execution is simply appalling. The dialogue is terrible and the acting is of the kind so regularly witnessed in Irish short films. Really really embarrassingly bad. The girl has to go down the 10 steps of the cellar to change the blown fuse. She telephones her father who is entertaining his boss at dinner. The mother, an \"actress\" with very questionable acting skills, answers the phone and in a loud scolding voice tells her not to be ringing as Dad is 'trying to impress his boss'. The actress playing the boss's wife very successfully emulates the mother's poor acting when she tells them that their house is haunted. The rest of the film consists of the father coaxing his daughter down the stairs on the telephone. The Ten Steps employs the stock techniques in camera movement, lighting and music that one would expect in a below average horror film. Poor.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "ticket:\n  channel: email\n  body: On the Opening night of the San Francisco Silent Film festival I was quite excited to see films that are historical and well not common. The guest speaker who opened this film created a sense of hype towards the obscurity, and how this film is underrated. The sci-fi part of the film was very interesting and fantastic for its time, but i'm not sure if it was due to the fact it was shown directly after the Brilliant 1928 \"The Wind\" or if it seemed that Russian filmmakers take after what Russian novels are famous for (hundreds of characters, tangled plots) but I know for certain that the dramatic parts, as in the parts on Earth, made absolutely no sense, were boring and I became lost within about twenty minutes. Maybe it was the acting but I found myself convinced as to why this film is \"unknown and underrated\": It's boring, there is no plot or basic story and the acting is horrible. This certainly is no \"Battleship Potemkin\", however I will say that Russian films do not make a real good effort in lightning up what life in Russia is like.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "My father has worked with top secret information in the DIA before and he is the one who mentioned this movie to me. When I was a kid I would always ask him what would happen if he gave away secrets and he recommended this movie. In the movie it really puts 2, almost completely different FRIENDS! in a tangle they never really knew what the outcome would really be. The snowman, Daulton really cracked me up because the movie portrayed him as just some drug pusher that did not know what he was arguing about, and in the movie it seemed like he got the worst of everything. The falcon, Chris is just a guy that wanted to express his feelings on U.S government in a very radical view. For movie lovers this is a must see!!!", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "- role: customer\n  content: This show, Paranormal State, has an almost \"Blairwitch Project\" feel to it. As in, you're watching a 'documentary' that's actually just a scripted movie, made to look and feel like a documentary. My biggest problem with the show, is their 'go to' outside advisers of the Warren's, who were made famous for their 'investigations' of the Amityville murders, which were shown to be completely fraudulent, just based upon the police reports of the family's deaths! (such as the eldest daughter actually having been involved in the entire thing, to the point of possibly even helping with some of the deaths!) Then there's the way they constantly jump to blaming demons for everything. Not to mention how haughty the group is about what cases they take. They don't want to help those who need it most, they just want the weirdest cases, that will get them the most press and attention. They're complete frauds, plain and simple.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "I watched this movie with my mother. She is 81 yrs.old and was raised to be a bigot. She even acknowledges this. I don't think she really understood what was happening, she had already made up her mind that the kid was guilty. Scary. I felt for this child and his family. What torture they went through and remained faithful. That is true faith. Back to the movie. I was disgusted by the police force and their ineptitude. I am so glad that this public defender was chosen to work this case. It was very fortunate for this family that they had a person that cared enough to see through the crap that was handed to him. I could tell when one the cops was lying. He would not look the defender in the eyes. His eyes moved to the side when he answered the questions. It is unfortunate that a black person has to be punished because of the color of his skin. I read the book about the black man being dragged behind a truck by three white men. They were finally found guilty after many years. I can't remember the title, but it was the same premise. Whites doing whatever they want with blacks. I am sure the child in the movie will be traumatized for a", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: Well in to 2002 I've got some catching up to do. And looking back on a lacklustre year, Best In Show shone. No great storyline. Little action. Just a cavalcade of magnificent characters. Particular reference to Fred Willard and Jim Piddock as a rattling pair of TV commentators. Well done. Well worth the effort. Ron (Viewed 24Mar2001)", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "I saw Forgiving the Franklins at a Paramount screening and loved it I have to be honest I really didn't want to go and I had become quite jaded about the movies being made today I have to tell you Forgiving The Franklins was fresh and wonderfully put together I laughed my ass off it was great story telling I could not believe two guys shot this and put the whole thing together. I thought if these guys can do a movie like this with this budget imagine what they could do with big money behind them. And then I thought be the jaded guy Iam the studios would probably f...it up anyway. That being said thanks guys I got lost and in your film and that's why I go to the movies to forget the world for a couple of hours.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "I agree with Jessica, this movie is pretty bad. I'm surprised anyone took it seriously. Characters are one-dimensional, even the good guys and especially the bad guys. The only merit here is that it's so lame it's funny. Actually for me, there is the added benefit that it was shot in a state park not far from where I live, so seeing some local sights on the big screen is a hoot. The lead character is a off-duty cop, and makes a big point of lecturing a good guy that vigilante justice is not just a bad idea, it's against the law. Imagine how long that lasts ... Most of the movie's Northern California characters are blown-dried Hollywood cheese-balls, looking like they've never actually been in a fight. The story line is totally predictable. This film is ripe for a MST-3K lampooning. CAMP value only. I'm pretty forgiving of films in general, but seeing the old positive reviews I had to speak up. This is a dog. I give it a 3 out of 10, and then only for laughs.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "I saw the film at the Brooklyn International Film Festival (World Premiere). A haunting, intimate portrait of Loneliness, and the repercussions of letting it grow and turn into something darker. The acting of the two leads (Jessica Bohl & Richard Brundage) is excellent, and makes one wish you had met these characters before they became so damaged. Reminded me in theme of the works of Atom Egoyan (Exotica) and Raymond Carver (Where I'm Calling From). The Soundtrack (Tywanna Jo Baskette, Crooked Fingers) is excellent and reinforces moments in the film without drawing attention to itself. Highly recommend the Film and the Soundtrack.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "This is one of the best Non-English series I have seen. It weaves interesting single and double episodes of crime-solving together with a personal aspect that you just don't get in CSI. The individual characters all have personal lives that combine well with their day job and occasionally interfere. Additionally the characters all manage to naturally evolve throughout the episodes. The casting is superb and it was taped all over Denmark, giving a good example of the highlights that majestic country has to offer. Unfortunately only 32 episodes were made, however they are top-notch television. Here's hoping they consider making some more episodes of the same caliber.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: I think this programme is a load of rubbish. All they do is argue and slap each other across the face and they call this acting?! These people get paid lots of money for this and most of them can't even act to save their lives. Also, the story lines are awful and after watching it for a few minutes, I am bored with it. I like the way that Harry Hill takes the mickey out of it on his TV show 'TV Burp' e.g. the weak joke \"The Princess and the Pea isn't exactly Shakespeare is it?\" that had Sonia and Naomi in stitches. I don't see how that is funny. I think this is a waste of everybody's money for their TV licence so this can be shown 4/5 days a week. Isn't there anything better than this?", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "Now this is a real turkey by the overrated director Franco, who gave us such classics as \"Las Vampiras/Vampyros Lesbos\". Yes, I think that bad films can be great fun. I adore the hilarious howlers of Doris Wishman, Dwain Esper and Ed Wood jr., but this one proved to be too much for me. It is the first film I rated 1. Where should I start? The screenplay is idiotic to the utmost. The dialogue is unbelievably bad. The directing seems to be nonexistent. The best music cue (used repeatedly in this film) was taken directly from the movie \"Der Hexer\" (1964). And it's BORING! Poor Shirley Eaton and George Sanders! In one shot Sanders reads a Popeye comic while his henchman torture a girl (this aspect is probably the intellectual highlight of this movie). The only thing that baffled me was that Franco promptly showed female nudity whenever I thought the movie would gain from it - this is real directing skill! Still, I'm afraid that a movie in which actors pretend to shoot with machine guns by shaking them is not really worthwhile.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "- role: customer\n  content: ***SPOILERS*** ***SPOILERS*** Well, seeing as I am a major H:LOTS fan, maybe I liked the movie more than normal people would. However, this movie is still excellent. It had tons of surprises, and it gave some more closure to the series. While I was sad that Bayliss turned into a murderer, the overall feeling I felt was satisfied.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "yes", "ordinal": false, "source": "imdb"}
{"request": {"context": "document: It is a story as old as man. The jealousy for another man's wife and possessions. There are even commandments against it. In this story, Raymond Burr (\"Perry Mason\", \"Ironside\") is the manager of a runner plantation who lusts after the owners wife and feels that he isn't treated with respect. The wife, the starlet Barbara Payton, who was trying to make a comeback after a string of sordid affairs, was lusting after Burr, who killed her husband, Paul Cavanagh. But, lurking about was a strange woman, the housekeeper (Gisela Werbisek) who sees everything, and who was capable of some voodoo to avenge the wronged, which also included another young woman (Carol Varga) to whom Burr also professed love. Burr is poisoned and becomes , or thinks he becomes, a gorilla. Payton will have to mate with Kong if she ever wants her marriage consummated, as he goes into the jungle every night. The end is predictable. But, the stirring question of this film is why Payton would ever be afraid. With those sharply pointed missiles jutting out from her chest, no animal could get near her to do harm.", "question": "Is this movie review positive?", "criteria": "", "options": [{"id": "yes", "text": "Yes: The reviewer liked the film overall"}, {"id": "no", "text": "No: The reviewer disliked the film overall"}]}, "expected_option_id": "no", "ordinal": false, "source": "imdb"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The return request was submitted on March 18, 2026. Mira bought a backpack on February 18, 2026. The order was paid by card and shipped to Mira's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Mira's home address. The return request was submitted on April 9, 2026. Mira bought a backpack on February 18, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The return request was submitted on September 11, 2026. Omar bought a backpack on August 23, 2026. The order was paid by card and shipped to Omar's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Omar's home address. The return request was submitted on September 28, 2026. Omar bought a backpack on August 23, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: The return request was submitted on August 27, 2026. The order was paid by card and shipped to Sana's home address. Sana bought a backpack on August 24, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: The return request was submitted on September 22, 2026. The order was paid by card and shipped to Sana's home address. Sana bought a backpack on August 24, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Aiko's home address. Aiko bought a coffee grinder on April 10, 2026. The return request was submitted on May 5, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The return request was submitted on June 3, 2026. The order was paid by card and shipped to Aiko's home address. Aiko bought a coffee grinder on April 10, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: The return request was submitted on July 25, 2026. The order was paid by card and shipped to Lena's home address. Lena bought a rain jacket on June 20, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: The return request was submitted on August 24, 2026. The order was paid by card and shipped to Lena's home address. Lena bought a rain jacket on June 20, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: The order was paid by card and shipped to Kofi's home address. Kofi bought a pair of running shoes on April 21, 2026. The return request was submitted on June 19, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: The return request was submitted on July 20, 2026. The order was paid by card and shipped to Kofi's home address. Kofi bought a pair of running shoes on April 21, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: Kofi bought a rain jacket on August 5, 2026. The return request was submitted on August 20, 2026. The order was paid by card and shipped to Kofi's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Kofi's home address. The return request was submitted on September 27, 2026. Kofi bought a rain jacket on August 5, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The return request was submitted on October 8, 2026. Sana bought a pair of running shoes on September 9, 2026. The order was paid by card and shipped to Sana's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Sana's home address. The return request was submitted on October 15, 2026. Sana bought a pair of running shoes on September 9, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: The return request was submitted on July 8, 2026. Elin bought a rain jacket on June 25, 2026. The order was paid by card and shipped to Elin's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: The order was paid by card and shipped to Elin's home address. The return request was submitted on July 22, 2026. Elin bought a rain jacket on June 25, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 45 days of the purchase date.\ncase: Mira bought a pair of running shoes on July 28, 2026. The order was paid by card and shipped to Mira's home address. The return request was submitted on July 30, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 45 days of the purchase date.\ncase: The order was paid by card and shipped to Mira's home address. The return request was submitted on October 3, 2026. Mira bought a pair of running shoes on July 28, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: Aiko bought a backpack on April 3, 2026. The return request was submitted on April 19, 2026. The order was paid by card and shipped to Aiko's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Aiko's home address. Aiko bought a backpack on April 3, 2026. The return request was submitted on May 27, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 45 days of the purchase date.\ncase: The return request was submitted on October 15, 2026. Omar bought a rain jacket on September 14, 2026. The order was paid by card and shipped to Omar's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 45 days of the purchase date.\ncase: The order was paid by card and shipped to Omar's home address. The return request was submitted on November 27, 2026. Omar bought a rain jacket on September 14, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: Omar bought a coffee grinder on July 4, 2026. The return request was submitted on July 12, 2026. The order was paid by card and shipped to Omar's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: The return request was submitted on August 5, 2026. The order was paid by card and shipped to Omar's home address. Omar bought a coffee grinder on July 4, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: Mira bought a backpack on May 2, 2026. The return request was submitted on June 20, 2026. The order was paid by card and shipped to Mira's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: Mira bought a backpack on May 2, 2026. The return request was submitted on July 22, 2026. The order was paid by card and shipped to Mira's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: Ravi bought a coffee grinder on March 3, 2026. The order was paid by card and shipped to Ravi's home address. The return request was submitted on March 13, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: The order was paid by card and shipped to Ravi's home address. The return request was submitted on May 22, 2026. Ravi bought a coffee grinder on March 3, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The return request was submitted on May 9, 2026. The order was paid by card and shipped to Ravi's home address. Ravi bought a coffee grinder on May 3, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Ravi's home address. Ravi bought a coffee grinder on May 3, 2026. The return request was submitted on June 22, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The return request was submitted on March 11, 2026. Sana bought a backpack on March 8, 2026. The order was paid by card and shipped to Sana's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: Sana bought a backpack on March 8, 2026. The return request was submitted on April 15, 2026. The order was paid by card and shipped to Sana's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: Tomas bought a rain jacket on April 14, 2026. The return request was submitted on June 7, 2026. The order was paid by card and shipped to Tomas's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 60 days of the purchase date.\ncase: The return request was submitted on July 8, 2026. The order was paid by card and shipped to Tomas's home address. Tomas bought a rain jacket on April 14, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: Ravi bought a backpack on July 22, 2026. The order was paid by card and shipped to Ravi's home address. The return request was submitted on July 25, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 14 days of the purchase date.\ncase: The order was paid by card and shipped to Ravi's home address. Ravi bought a backpack on July 22, 2026. The return request was submitted on August 22, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The order was paid by card and shipped to Kofi's home address. Kofi bought a rain jacket on May 8, 2026. The return request was submitted on May 21, 2026.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Returns are accepted only if the return request is submitted within 30 days of the purchase date.\ncase: The return request was submitted on June 14, 2026. Kofi bought a rain jacket on May 8, 2026. The order was paid by card and shipped to Kofi's home address.", "question": "Is this return request within the policy window?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_return_window"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $722. Receipts were attached for every line item. Mira, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,029. Mira, the support agent, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Noah, the support agent, submitted an expense claim. Receipts were attached for every line item. The claim total is $1,389.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $4,160. Noah, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Jonas, the account owner, submitted an expense claim. Receipts were attached for every line item. The claim total is $477.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $791. Jonas, the account owner, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Sana, the billing manager, submitted an expense claim. The claim total is $153. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: The claim total is $384. Receipts were attached for every line item. Sana, the billing manager, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $283. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $756. Receipts were attached for every line item. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item. The claim total is $747.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,370. Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. Sana, the billing manager, submitted an expense claim. The claim total is $467.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Sana, the billing manager, submitted an expense claim. Receipts were attached for every line item. The claim total is $656.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Mira, the billing manager, submitted an expense claim. Receipts were attached for every line item. The claim total is $829.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,602. Receipts were attached for every line item. Mira, the billing manager, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $440. Receipts were attached for every line item. Lena, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $746. Lena, the support agent, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Receipts were attached for every line item. Elin, the billing manager, submitted an expense claim. The claim total is $1,251.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: The claim total is $3,115. Receipts were attached for every line item. Elin, the billing manager, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Elin, the warehouse lead, submitted an expense claim. Receipts were attached for every line item. The claim total is $753.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Elin, the warehouse lead, submitted an expense claim. The claim total is $1,873. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Priya, the warehouse lead, submitted an expense claim. The claim total is $449. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $965. Receipts were attached for every line item. Priya, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Receipts were attached for every line item. Noah, the account owner, submitted an expense claim. The claim total is $887.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $1,099. Noah, the account owner, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Receipts were attached for every line item. Jonas, the warehouse lead, submitted an expense claim. The claim total is $129.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Jonas, the warehouse lead, submitted an expense claim. The claim total is $438. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $328. Tomas, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Tomas, the warehouse lead, submitted an expense claim. Receipts were attached for every line item. The claim total is $729.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $934. Lena, the account owner, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Receipts were attached for every line item. Lena, the account owner, submitted an expense claim. The claim total is $1,686.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: The claim total is $1,405. Lena, the billing manager, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Lena, the billing manager, submitted an expense claim. The claim total is $4,375. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $207. Ravi, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Ravi, the warehouse lead, submitted an expense claim. Receipts were attached for every line item. The claim total is $439.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $609. Lena, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,779. Receipts were attached for every line item. Lena, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $363. Receipts were attached for every line item. Tomas, the account owner, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Tomas, the account owner, submitted an expense claim. The claim total is $918. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the rental agreement.\ncase: The application form was complete and signed. Tomas applied to join the rental agreement. Tomas is 21 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the rental agreement.\ncase: The application form was complete and signed. Tomas is 13 years old. Tomas applied to join the rental agreement.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the volunteer driver program.\ncase: The application form was complete and signed. Kofi applied to join the volunteer driver program. Kofi is 23 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the volunteer driver program.\ncase: Kofi is 17 years old. The application form was complete and signed. Kofi applied to join the volunteer driver program.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 18 years old to be eligible for the rental agreement.\ncase: The application form was complete and signed. Ravi is 21 years old. Ravi applied to join the rental agreement.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 18 years old to be eligible for the rental agreement.\ncase: The application form was complete and signed. Ravi applied to join the rental agreement. Ravi is 16 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the volunteer driver program.\ncase: The application form was complete and signed. Kofi applied to join the volunteer driver program. Kofi is 25 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the volunteer driver program.\ncase: The application form was complete and signed. Kofi is 14 years old. Kofi applied to join the volunteer driver program.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the rental agreement.\ncase: Jonas is 29 years old. The application form was complete and signed. Jonas applied to join the rental agreement.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the rental agreement.\ncase: The application form was complete and signed. Jonas is 19 years old. Jonas applied to join the rental agreement.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the rental agreement.\ncase: Kofi is 28 years old. Kofi applied to join the rental agreement. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the rental agreement.\ncase: Kofi applied to join the rental agreement. The application form was complete and signed. Kofi is 11 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the apprenticeship.\ncase: The application form was complete and signed. Elin is 31 years old. Elin applied to join the apprenticeship.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the apprenticeship.\ncase: Elin is 17 years old. Elin applied to join the apprenticeship. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the volunteer driver program.\ncase: Aiko applied to join the volunteer driver program. The application form was complete and signed. Aiko is 26 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the volunteer driver program.\ncase: Aiko applied to join the volunteer driver program. Aiko is 12 years old. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the night-shift roster.\ncase: The application form was complete and signed. Priya applied to join the night-shift roster. Priya is 33 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the night-shift roster.\ncase: The application form was complete and signed. Priya is 16 years old. Priya applied to join the night-shift roster.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 25 years old to be eligible for the night-shift roster.\ncase: Ravi is 36 years old. Ravi applied to join the night-shift roster. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 25 years old to be eligible for the night-shift roster.\ncase: Ravi is 24 years old. Ravi applied to join the night-shift roster. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 25 years old to be eligible for the rental agreement.\ncase: Mira is 44 years old. Mira applied to join the rental agreement. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 25 years old to be eligible for the rental agreement.\ncase: Mira is 21 years old. The application form was complete and signed. Mira applied to join the rental agreement.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 18 years old to be eligible for the night-shift roster.\ncase: Elin applied to join the night-shift roster. Elin is 36 years old. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 18 years old to be eligible for the night-shift roster.\ncase: Elin is 15 years old. Elin applied to join the night-shift roster. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 25 years old to be eligible for the apprenticeship.\ncase: Sana is 27 years old. The application form was complete and signed. Sana applied to join the apprenticeship.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 25 years old to be eligible for the apprenticeship.\ncase: Sana applied to join the apprenticeship. Sana is 20 years old. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the rental agreement.\ncase: Kofi applied to join the rental agreement. Kofi is 26 years old. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the rental agreement.\ncase: Kofi is 11 years old. Kofi applied to join the rental agreement. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the rental agreement.\ncase: Tomas is 37 years old. The application form was complete and signed. Tomas applied to join the rental agreement.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the rental agreement.\ncase: The application form was complete and signed. Tomas is 16 years old. Tomas applied to join the rental agreement.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the apprenticeship.\ncase: Tomas applied to join the apprenticeship. Tomas is 22 years old. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the apprenticeship.\ncase: Tomas applied to join the apprenticeship. The application form was complete and signed. Tomas is 18 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the night-shift roster.\ncase: Omar is 39 years old. The application form was complete and signed. Omar applied to join the night-shift roster.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the night-shift roster.\ncase: Omar applied to join the night-shift roster. The application form was complete and signed. Omar is 20 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 18 years old to be eligible for the apprenticeship.\ncase: The application form was complete and signed. Elin applied to join the apprenticeship. Elin is 32 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 18 years old to be eligible for the apprenticeship.\ncase: Elin is 13 years old. The application form was complete and signed. Elin applied to join the apprenticeship.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the rental agreement.\ncase: Jonas applied to join the rental agreement. Jonas is 39 years old. The application form was complete and signed.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 21 years old to be eligible for the rental agreement.\ncase: Jonas applied to join the rental agreement. The application form was complete and signed. Jonas is 19 years old.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the night-shift roster.\ncase: The application form was complete and signed. Lena is 20 years old. Lena applied to join the night-shift roster.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Applicants must be at least 16 years old to be eligible for the night-shift roster.\ncase: The application form was complete and signed. Lena is 15 years old. Lena applied to join the night-shift roster.", "question": "Is the applicant eligible?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "contrastive_age_eligibility"}
{"request": {"context": "policy: Customers may order at most 5 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 1. Mira placed an order for a coffee grinder. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 5 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. Mira placed an order for a coffee grinder. The order quantity is 20.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Ravi placed an order for a rain jacket. Delivery was requested to a residential address. The order quantity is 2.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. The order quantity is 4. Ravi placed an order for a rain jacket.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. The order quantity is 2. Sana placed an order for a rain jacket.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. Sana placed an order for a rain jacket. The order quantity is 5.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 9. Delivery was requested to a residential address. Kofi placed an order for a coffee grinder.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. The order quantity is 15. Kofi placed an order for a coffee grinder.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 1. Delivery was requested to a residential address. Lena placed an order for a pair of running shoes.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. The order quantity is 4. Lena placed an order for a pair of running shoes.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Kofi placed an order for a desk lamp. Delivery was requested to a residential address. The order quantity is 2.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 15. Delivery was requested to a residential address. Kofi placed an order for a desk lamp.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. Noah placed an order for a rain jacket. The order quantity is 4.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Noah placed an order for a rain jacket. Delivery was requested to a residential address. The order quantity is 13.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Lena placed an order for a wireless keyboard. The order quantity is 3. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Lena placed an order for a wireless keyboard. Delivery was requested to a residential address. The order quantity is 7.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 1. Delivery was requested to a residential address. Ravi placed an order for a pair of running shoes.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. The order quantity is 11. Ravi placed an order for a pair of running shoes.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 5 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 2. Sana placed an order for a wireless keyboard. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 5 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Sana placed an order for a wireless keyboard. Delivery was requested to a residential address. The order quantity is 6.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 1. Delivery was requested to a residential address. Tomas placed an order for a desk lamp.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Tomas placed an order for a desk lamp. The order quantity is 19. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 1. Mira placed an order for a wireless keyboard. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Mira placed an order for a wireless keyboard. The order quantity is 5. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 2. Delivery was requested to a residential address. Elin placed an order for a wireless keyboard.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. Elin placed an order for a wireless keyboard. The order quantity is 4.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. Aiko placed an order for a coffee grinder. The order quantity is 6.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Aiko placed an order for a coffee grinder. The order quantity is 18. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 2. Delivery was requested to a residential address. Elin placed an order for a rain jacket.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. The order quantity is 8. Elin placed an order for a rain jacket.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. Ravi placed an order for a rain jacket. The order quantity is 2.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Ravi placed an order for a rain jacket. The order quantity is 3. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 3. Delivery was requested to a residential address. Lena placed an order for a coffee grinder.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 34. Delivery was requested to a residential address. Lena placed an order for a coffee grinder.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. Aiko placed an order for a wireless keyboard. The order quantity is 1.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 3 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Aiko placed an order for a wireless keyboard. The order quantity is 5. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Ravi placed an order for a pair of running shoes. Delivery was requested to a residential address. The order quantity is 10.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 10 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Delivery was requested to a residential address. The order quantity is 18. Ravi placed an order for a pair of running shoes.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "slightly_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: Jonas placed an order for a pair of running shoes. The order quantity is 1. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "within_limit", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "policy: Customers may order at most 2 units of any single item per order. Orders up to double the limit are held for review; larger orders are cancelled.\ncase: The order quantity is 6. Jonas placed an order for a pair of running shoes. Delivery was requested to a residential address.", "question": "What happens to this order?", "criteria": "", "options": [{"id": "within_limit", "text": "within_limit: Processed normally"}, {"id": "slightly_over", "text": "slightly_over: Held for review"}, {"id": "far_over", "text": "far_over: Cancelled"}]}, "expected_option_id": "far_over", "ordinal": false, "source": "contrastive_quantity_limit"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "business", "text": "business"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Microsoft/Sun documents If you #39;re up for some light reading, see the links below for the underlying documents that formed Microsoft #39;s April settlement with Sun Microsystems.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "- role: customer\n  content: Family of JFK attacks Dallas death game A VIDEO games company from Scotland is causing outrage in America with a title called JFK Reloaded, which allows players to look through the crosshairs of Lee Harvey Oswalds rifle and assassinate the late US President.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Justices to debate mail-order wine Being freelance wine critics may sound like a sweet gig, but Ray and Eleanor Heald have soured on it. Because their home state, Michigan, blocks direct shipments from out-of-state", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "scitech", "text": "scitech"}, {"id": "business", "text": "business"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "world", "text": "world"}, {"id": "scitech", "text": "scitech"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "scitech", "text": "scitech"}, {"id": "world", "text": "world"}, {"id": "business", "text": "business"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Kmart and Sears announce merger Kmart Holding Corp and Sears, Roebuck and Co said Wednesday that they are merging to form a new retail company called Sears Holdings Corp that will be the US #39; third-largest retailer with about US\\$55 billion in annual revenues.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Deutsche Bank Defends Role in Collapse of Company in Singapore Deutsche Bank defended today its role in the collapse of a Chinese government-controlled company in Singapore early last week, as investigators continued to study what went wrong.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "scitech", "text": "scitech"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "world", "text": "world"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "scitech", "text": "scitech"}, {"id": "world", "text": "world"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "world", "text": "world"}, {"id": "scitech", "text": "scitech"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "sports", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: No. 21 Purdue Beats W. Michigan, 74-42 (AP) AP - Erin Lawless scored a career-high 26 points and grabbed seven rebounds and No. 21 Purdue beat Western Michigan 74-42 on Sunday.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "sports", "text": "sports"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "scitech", "text": "scitech"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "sports", "text": "sports"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "sports", "text": "sports"}, {"id": "world", "text": "world"}, {"id": "scitech", "text": "scitech"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Goss Gets Senate Panel's OK for CIA Post (AP) AP - A Senate panel on Tuesday approved the nomination of Rep. Porter Goss, R-Fla., to head the CIA, overcoming Democrats' objections that Goss was too political for the job.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: what: Sports: games, athletes, teams, results"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "document: Pirates named PROSECUTORS HAVE named those charged in one of the biggest pirate software seizures in US history. The two-year investigation, dubbed Operation Digital Marauder, resulted in  quot;one of the largest seizures of", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "question: What is the topic of this article?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "world", "text": "world: what: World news: politics, international affairs, conflicts"}]}, "expected_option_id": "business", "ordinal": false, "source": "agnews"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "ticket:\n  channel: chat\n  body: Regulator clears Abbey takeover The Financial Services Authority has cleared Spanish bank Santander Central Hispano's 9bn takeover of Abbey National.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "world", "text": "world"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "world", "text": "world"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}]}, "expected_option_id": "scitech", "ordinal": false, "source": "agnews"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "Is this article about sports?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Sony launches music players with MP3 support The company has just announced the release of two flash-memory-based devices, the Walkman NW-E99 and NW-E95, in Europe. The music players can play songs in MP3 and Sony #39;s own Atrac file format.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "world", "text": "world: World news: politics, international affairs, conflicts"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "business", "text": "business: what: Business: companies, markets, economy, finance"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "Is this article about business?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Wreckage of Navy helicopter found The wreckage of a Royal Navy helicopter, which disappeared with four crew members on board, has been found off the coast of Cornwall, the Ministry of Defence says.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "agnews"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "What is the topic of this article?", "criteria": "", "options": [{"id": "sports", "text": "sports: Sports: games, athletes, teams, results"}, {"id": "business", "text": "business: Business: companies, markets, economy, finance"}, {"id": "scitech", "text": "scitech: Science and technology: research, gadgets, software, space"}, {"id": "world", "text": "world: World news: politics, international affairs, conflicts"}]}, "expected_option_id": "world", "ordinal": false, "source": "agnews"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "Is this article about world news?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "yes", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "Car bombs strike Baghdad At least 10 people were killed and 76 injured when one exploded near an army recruitment centre outside the top-security Green Zone housing Iraq #39;s interim government and the US Embassy.", "question": "Is this article about science and technology?", "criteria": "", "options": [{"id": "yes", "text": "Yes"}, {"id": "no", "text": "No"}]}, "expected_option_id": "no", "ordinal": false, "source": "agnews_yn"}
{"request": {"context": "In addition, special service areas are funded for two populations with special needs - Native Americans and migrant workers.", "question": "Hypothesis: \"Native Americans and migrant workers do not have any special areas. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entailment", "text": "entailment"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "In addition, special service areas are funded for two populations with special needs - Native Americans and migrant workers.", "question": "Hypothesis: \"Native Americans and migrant workers do not have any special areas. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "In addition, special service areas are funded for two populations with special needs - Native Americans and migrant workers.", "question": "Hypothesis: \"Native Americans and migrant workers do not have any special areas. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "agencies' operating trust, enterprise and internal service funds) are required to produce auditable financial statements.", "question": "Hypothesis: \"Agencies have no operating trust and produce little to no auditable financial statements.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "contradiction", "text": "contradiction"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "agencies' operating trust, enterprise and internal service funds) are required to produce auditable financial statements.", "question": "Hypothesis: \"Agencies have no operating trust and produce little to no auditable financial statements.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "agencies' operating trust, enterprise and internal service funds) are required to produce auditable financial statements.", "question": "Hypothesis: \"Agencies have no operating trust and produce little to no auditable financial statements.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "Kicked out of the house when she was only 16 (she was called Suzie in those days), Roy went to Delhi and then to architecture school, supporting herself by selling empty milk bottles (some say beer bottles).", "question": "Hypothesis: \"Roy was given thousands of dollars.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "Kicked out of the house when she was only 16 (she was called Suzie in those days), Roy went to Delhi and then to architecture school, supporting herself by selling empty milk bottles (some say beer bottles).", "question": "Hypothesis: \"Roy was given thousands of dollars.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "Kicked out of the house when she was only 16 (she was called Suzie in those days), Roy went to Delhi and then to architecture school, supporting herself by selling empty milk bottles (some say beer bottles).", "question": "Hypothesis: \"Roy was given thousands of dollars.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}]}, "expected_option_id": "contradiction", "ordinal": false, "source": "mnli"}
{"request": {"context": "okay movies i've i haven't seen too many lately i have kids and we went and saw The Rescuers Down Under over the the break do do you have kids you take to movies or", "question": "Hypothesis: \"I took my kids to see the movie The Rescuers Down Under.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "okay movies i've i haven't seen too many lately i have kids and we went and saw The Rescuers Down Under over the the break do do you have kids you take to movies or", "question": "Hypothesis: \"I took my kids to see the movie The Rescuers Down Under.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "okay movies i've i haven't seen too many lately i have kids and we went and saw The Rescuers Down Under over the the break do do you have kids you take to movies or", "question": "Hypothesis: \"I took my kids to see the movie The Rescuers Down Under.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: When Jesus was born in about 4 b.c. , Joseph and Mary escaped Herod's paranoia by fleeing into Egypt with the new-born infant.", "question": "question: Hypothesis: \"The flight to Egypt and the precise timeline have been debated by historians for centuries.\" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: When Jesus was born in about 4 b.c. , Joseph and Mary escaped Herod's paranoia by fleeing into Egypt with the new-born infant.", "question": "question: Hypothesis: \"The flight to Egypt and the precise timeline have been debated by historians for centuries.\" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "contradiction", "text": "contradiction"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "document: When Jesus was born in about 4 b.c. , Joseph and Mary escaped Herod's paranoia by fleeing into Egypt with the new-born infant.", "question": "question: Hypothesis: \"The flight to Egypt and the precise timeline have been debated by historians for centuries.\" How does it relate to the premise?\nfocus: Consider the whole message.", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: what: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "For a half millennium or more, Madrid idled as a provincial backwater, rarely noticed on the arid central plains of Castile, until Felipe II plucked it from his royal cap in 1561 and proclaimed it the capital of Spain.", "question": "Hypothesis: \"After Madrid became the capital of Spain, there were massive economic advantages for the region.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "For a half millennium or more, Madrid idled as a provincial backwater, rarely noticed on the arid central plains of Castile, until Felipe II plucked it from his royal cap in 1561 and proclaimed it the capital of Spain.", "question": "Hypothesis: \"After Madrid became the capital of Spain, there were massive economic advantages for the region.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "For a half millennium or more, Madrid idled as a provincial backwater, rarely noticed on the arid central plains of Castile, until Felipe II plucked it from his royal cap in 1561 and proclaimed it the capital of Spain.", "question": "Hypothesis: \"After Madrid became the capital of Spain, there were massive economic advantages for the region.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "In that case, price discrimination can survive.", "question": "Hypothesis: \"In that circumstance, discrimination in price is fine.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "In that case, price discrimination can survive.", "question": "Hypothesis: \"In that circumstance, discrimination in price is fine.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "In that case, price discrimination can survive.", "question": "Hypothesis: \"In that circumstance, discrimination in price is fine.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "The bridge would work for a very short time but the stream isn't a clear defense.", "question": "Hypothesis: \"The bridge would work temporarily.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "The bridge would work for a very short time but the stream isn't a clear defense.", "question": "Hypothesis: \"The bridge would work temporarily.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "The bridge would work for a very short time but the stream isn't a clear defense.", "question": "Hypothesis: \"The bridge would work temporarily.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: what: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Bars with views and live music include Sky Lounge in the Sheraton Hotel and Towers, Tsim Sha Tsui; and Cyrano in the Island Shangri-La in Pacific Place.", "question": "Hypothesis: \"It is not far to go to find good drink, gorgeous views, and live music. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "Bars with views and live music include Sky Lounge in the Sheraton Hotel and Towers, Tsim Sha Tsui; and Cyrano in the Island Shangri-La in Pacific Place.", "question": "Hypothesis: \"It is not far to go to find good drink, gorgeous views, and live music. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "Bars with views and live music include Sky Lounge in the Sheraton Hotel and Towers, Tsim Sha Tsui; and Cyrano in the Island Shangri-La in Pacific Place.", "question": "Hypothesis: \"It is not far to go to find good drink, gorgeous views, and live music. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "No, I exclaimed, astonished.", "question": "Hypothesis: \"\"No!\" I cried out in shock. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "No, I exclaimed, astonished.", "question": "Hypothesis: \"\"No!\" I cried out in shock. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "No, I exclaimed, astonished.", "question": "Hypothesis: \"\"No!\" I cried out in shock. \" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Also, other sorbent-based approaches in development may prove in time to be preferable to ACI, making the use of ACI only a conservative assumption.", "question": "Hypothesis: \"Sorbent-based approaches in development may be preferable to ACl.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "Also, other sorbent-based approaches in development may prove in time to be preferable to ACI, making the use of ACI only a conservative assumption.", "question": "Hypothesis: \"Sorbent-based approaches in development may be preferable to ACl.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}, {"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "Also, other sorbent-based approaches in development may prove in time to be preferable to ACI, making the use of ACI only a conservative assumption.", "question": "Hypothesis: \"Sorbent-based approaches in development may be preferable to ACl.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: The hypothesis contradicts the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "neutral", "text": "neutral: The hypothesis may or may not be true given the premise"}]}, "expected_option_id": "entailment", "ordinal": false, "source": "mnli"}
{"request": {"context": "According to Jane Langmuir, director of the project, water and heat come together and create a totally new appliance.", "question": "Hypothesis: \"Jane Langmuir was the one who conceived of this project.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}, {"id": "neutral", "text": "neutral"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "According to Jane Langmuir, director of the project, water and heat come together and create a totally new appliance.", "question": "Hypothesis: \"Jane Langmuir was the one who conceived of this project.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "mnli"}
{"request": {"context": "According to Jane Langmuir, director of the project, water and heat come together and create a totally new appliance.", "question": "Hypothesis: \"Jane Langmuir was the one who conceived of this project.\" How does it relate to the premise?", "criteria": "", "options": [{"id": "neutral", "text": "neutral"}, {"id": "entailment", "text": "entailment: The hypothesis follows from the premise"}, {"id": "contradiction", "text": "contradiction: what: The hypothesis contradicts the premise"}]}, "expected_option_id": "neutral", "ordinal": false, "source": "mnli"}
{"request": {"context": "ticket:\n  channel: email\n  body: What was President Lyndon Johnson 's reform program called ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: email\n  body: What was President Lyndon Johnson 's reform program called ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: email\n  body: What was President Lyndon Johnson 's reform program called ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}]}, "expected_option_id": "entity", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What is supernova ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What is supernova ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "location", "text": "location: Asks about a place"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What is supernova ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What is leukemia ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "location", "text": "location: Asks about a place"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "What is leukemia ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "What is leukemia ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "description", "ordinal": false, "source": "trec"}
{"request": {"context": "How much was a ticket for the Titanic ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "How much was a ticket for the Titanic ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "How much was a ticket for the Titanic ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "Where is the Eiffel Tower ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "Where is the Eiffel Tower ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "Where is the Eiffel Tower ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: What is the name of the chocolate company in San Francisco ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: What is the name of the chocolate company in San Francisco ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "ticket:\n  channel: chat\n  body: What is the name of the chocolate company in San Francisco ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the average weight of a Yellow Labrador ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the average weight of a Yellow Labrador ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "What is the average weight of a Yellow Labrador ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "Who developed the Macintosh computer ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "location", "text": "location: Asks about a place"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "Who developed the Macintosh computer ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "Who developed the Macintosh computer ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What are Canada 's two territories ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "What are Canada 's two territories ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "What are Canada 's two territories ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "location", "ordinal": false, "source": "trec"}
{"request": {"context": "What American composer wrote the music for `` West Side Story '' ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "What American composer wrote the music for `` West Side Story '' ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "What American composer wrote the music for `` West Side Story '' ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What chain store is headquartered in Bentonville , Arkansas ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What chain store is headquartered in Bentonville , Arkansas ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "- role: customer\n  content: What chain store is headquartered in Bentonville , Arkansas ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}]}, "expected_option_id": "human", "ordinal": false, "source": "trec"}
{"request": {"context": "How many feet in a mile ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "location", "text": "location: Asks about a place"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "How many feet in a mile ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "location", "text": "location: Asks about a place"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "trec"}
{"request": {"context": "How many feet in a mile ?", "question": "What kind of answer does this question ask for?", "criteria": "", "options": [{"id": "location", "text": "location: Asks about a place"}, {"id": "number", "text": "number: Asks for a number, date, count, or other numeric value"}, {"id": "human", "text": "human: Asks about a person, group, or organisation"}, {"id": "entity", "text": "entity: Asks about a thing, object, animal, product, or creative work"}, {"id": "description", "text": "description: Asks for a definition, description, reason, or manner"}, {"id": "abbreviation", "text": "abbreviation: Asks what an abbreviation stands for"}]}, "expected_option_id": "number", "ordinal": false, "source": "trec"}
{"request": {"context": "Lake Brienz (German: Brienzersee) is a lake just north of the Alps in the Canton of Berne in Switzerland. It has a length of about 14 kilometres (8.7 mi) a width of 2.8 kilometres (1.7 mi) and a maximum depth of 260 metres (850 ft). Its area is 29.8 square kilometres (11.5 sq mi) and the surface is 564 metres (1850 ft) above the sea-level.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "company", "text": "company"}, {"id": "officeholder", "text": "officeholder"}, {"id": "building", "text": "building"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "animal", "text": "animal"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "film", "text": "film"}, {"id": "village", "text": "village"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Lake Brienz (German: Brienzersee) is a lake just north of the Alps in the Canton of Berne in Switzerland. It has a length of about 14 kilometres (8.7 mi) a width of 2.8 kilometres (1.7 mi) and a maximum depth of 260 metres (850 ft). Its area is 29.8 square kilometres (11.5 sq mi) and the surface is 564 metres (1850 ft) above the sea-level.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "plant", "text": "plant"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "officeholder", "text": "officeholder"}, {"id": "village", "text": "village"}, {"id": "company", "text": "company"}, {"id": "building", "text": "building"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "film", "text": "film"}, {"id": "album", "text": "album"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Lake Brienz (German: Brienzersee) is a lake just north of the Alps in the Canton of Berne in Switzerland. It has a length of about 14 kilometres (8.7 mi) a width of 2.8 kilometres (1.7 mi) and a maximum depth of 260 metres (850 ft). Its area is 29.8 square kilometres (11.5 sq mi) and the surface is 564 metres (1850 ft) above the sea-level.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "animal", "text": "animal"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "officeholder", "text": "officeholder"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "company", "text": "company"}, {"id": "building", "text": "building"}, {"id": "film", "text": "film"}, {"id": "village", "text": "village"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "writtenwork", "text": "writtenwork"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Endymion is the third science fiction novel by Dan Simmons in his Hyperion Cantos fictional universe. Centered around the new characters Aenea and Raul Endymion it has been well received like Hyperion and The Fall of Hyperion - within a year of its release the paperback edition had gone through five reprints. The novel was shortlisted for the 1997 Locus Award.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "building", "text": "building"}, {"id": "company", "text": "company"}, {"id": "artist", "text": "artist"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "village", "text": "village"}, {"id": "athlete", "text": "athlete"}, {"id": "album", "text": "album"}, {"id": "animal", "text": "animal"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "film", "text": "film"}, {"id": "plant", "text": "plant"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "officeholder", "text": "officeholder"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Endymion is the third science fiction novel by Dan Simmons in his Hyperion Cantos fictional universe. Centered around the new characters Aenea and Raul Endymion it has been well received like Hyperion and The Fall of Hyperion - within a year of its release the paperback edition had gone through five reprints. The novel was shortlisted for the 1997 Locus Award.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "building", "text": "building"}, {"id": "athlete", "text": "athlete"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "film", "text": "film"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "officeholder", "text": "officeholder"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Endymion is the third science fiction novel by Dan Simmons in his Hyperion Cantos fictional universe. Centered around the new characters Aenea and Raul Endymion it has been well received like Hyperion and The Fall of Hyperion - within a year of its release the paperback edition had gone through five reprints. The novel was shortlisted for the 1997 Locus Award.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "building", "text": "building"}, {"id": "athlete", "text": "athlete"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "film", "text": "film"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "officeholder", "text": "officeholder"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: M'Bizo is the sixteenth album by the jazz group the World Saxophone Quartet and their fourth on the Canadian Justin Time label. The album features performances by Hamiet Bluiett John Purcell Oliver Lake and David Murray with guests Ronnie Burrage Mario Canonge D.D. Jackson James Lewis Mabeleng Moholo Jimane Nelson and Jaribu Shahid.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "officeholder", "text": "officeholder"}, {"id": "animal", "text": "animal"}, {"id": "building", "text": "building"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: M'Bizo is the sixteenth album by the jazz group the World Saxophone Quartet and their fourth on the Canadian Justin Time label. The album features performances by Hamiet Bluiett John Purcell Oliver Lake and David Murray with guests Ronnie Burrage Mario Canonge D.D. Jackson James Lewis Mabeleng Moholo Jimane Nelson and Jaribu Shahid.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "officeholder", "text": "officeholder"}, {"id": "animal", "text": "animal"}, {"id": "building", "text": "building"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "document: M'Bizo is the sixteenth album by the jazz group the World Saxophone Quartet and their fourth on the Canadian Justin Time label. The album features performances by Hamiet Bluiett John Purcell Oliver Lake and David Murray with guests Ronnie Burrage Mario Canonge D.D. Jackson James Lewis Mabeleng Moholo Jimane Nelson and Jaribu Shahid.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "officeholder", "text": "officeholder"}, {"id": "animal", "text": "animal"}, {"id": "building", "text": "building"}]}, "expected_option_id": "album", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Phillip Whitehead (30 May 1937 – 31 December 2005) was a British Labour politician television producer and writer.Born in Matlock Bath Derbyshire he was adopted by a local family and attended Lady Manners School in Bakewell and Exeter College at Oxford University where he obtained his BA degree.Whitehead went up to Oxford following in his adoptive parents' footsteps as a Conservative. He was President of the Oxford University Conservative Association and the Oxford Union in 1961.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "artist", "text": "artist"}, {"id": "athlete", "text": "athlete"}, {"id": "film", "text": "film"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "officeholder", "text": "officeholder"}, {"id": "building", "text": "building"}, {"id": "company", "text": "company"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Phillip Whitehead (30 May 1937 – 31 December 2005) was a British Labour politician television producer and writer.Born in Matlock Bath Derbyshire he was adopted by a local family and attended Lady Manners School in Bakewell and Exeter College at Oxford University where he obtained his BA degree.Whitehead went up to Oxford following in his adoptive parents' footsteps as a Conservative. He was President of the Oxford University Conservative Association and the Oxford Union in 1961.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "athlete", "text": "athlete"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "building", "text": "building"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "film", "text": "film"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Phillip Whitehead (30 May 1937 – 31 December 2005) was a British Labour politician television producer and writer.Born in Matlock Bath Derbyshire he was adopted by a local family and attended Lady Manners School in Bakewell and Exeter College at Oxford University where he obtained his BA degree.Whitehead went up to Oxford following in his adoptive parents' footsteps as a Conservative. He was President of the Oxford University Conservative Association and the Oxford Union in 1961.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "film", "text": "film"}, {"id": "athlete", "text": "athlete"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "plant", "text": "plant"}, {"id": "animal", "text": "animal"}, {"id": "album", "text": "album"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "officeholder", "text": "officeholder"}, {"id": "building", "text": "building"}, {"id": "company", "text": "company"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Rayat Institute of Engineering and Information Technology (RIEIT)(Hindi: रयात अभियांत्रिकी एवं सूचना प्रौद्योगिकी संस्थान) is an academic engineering institution affiliated to Punjab Techncal University offering Engineering Courses at undergraduate and Graduate level leading to B.Tech and M.Tech degrees.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "film", "text": "film"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "artist", "text": "artist"}, {"id": "animal", "text": "animal"}, {"id": "company", "text": "company"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "officeholder", "text": "officeholder"}, {"id": "album", "text": "album"}, {"id": "athlete", "text": "athlete"}, {"id": "building", "text": "building"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "village", "text": "village"}, {"id": "plant", "text": "plant"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Rayat Institute of Engineering and Information Technology (RIEIT)(Hindi: रयात अभियांत्रिकी एवं सूचना प्रौद्योगिकी संस्थान) is an academic engineering institution affiliated to Punjab Techncal University offering Engineering Courses at undergraduate and Graduate level leading to B.Tech and M.Tech degrees.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "writtenwork", "text": "writtenwork"}, {"id": "village", "text": "village"}, {"id": "athlete", "text": "athlete"}, {"id": "plant", "text": "plant"}, {"id": "company", "text": "company"}, {"id": "building", "text": "building"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "film", "text": "film"}, {"id": "officeholder", "text": "officeholder"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "artist", "text": "artist"}, {"id": "animal", "text": "animal"}, {"id": "album", "text": "album"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Rayat Institute of Engineering and Information Technology (RIEIT)(Hindi: रयात अभियांत्रिकी एवं सूचना प्रौद्योगिकी संस्थान) is an academic engineering institution affiliated to Punjab Techncal University offering Engineering Courses at undergraduate and Graduate level leading to B.Tech and M.Tech degrees.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "film", "text": "film"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "artist", "text": "artist"}, {"id": "animal", "text": "animal"}, {"id": "company", "text": "company"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "officeholder", "text": "officeholder"}, {"id": "album", "text": "album"}, {"id": "athlete", "text": "athlete"}, {"id": "building", "text": "building"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "village", "text": "village"}, {"id": "plant", "text": "plant"}]}, "expected_option_id": "educationalinstitution", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Thomas McKay (January 8 1839 – January 13 1912) was a Canadian politician.Born in Pictou County Nova Scotia the son of William McKay who emigrated from Sutherland Scotland McKay was educated in Pictou. In 1868 he married Jessie Blair. A merchant he was first elected to the Canadian House of Commons for Colchester in the 1874 general election. Unseated on petition in November 1874 he was re-elected and again in 1878.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "village", "text": "village"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "building", "text": "building"}, {"id": "company", "text": "company"}, {"id": "officeholder", "text": "officeholder"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "album", "text": "album"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "film", "text": "film"}, {"id": "animal", "text": "animal"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Thomas McKay (January 8 1839 – January 13 1912) was a Canadian politician.Born in Pictou County Nova Scotia the son of William McKay who emigrated from Sutherland Scotland McKay was educated in Pictou. In 1868 he married Jessie Blair. A merchant he was first elected to the Canadian House of Commons for Colchester in the 1874 general election. Unseated on petition in November 1874 he was re-elected and again in 1878.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "building", "text": "building"}, {"id": "animal", "text": "animal"}, {"id": "album", "text": "album"}, {"id": "athlete", "text": "athlete"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "company", "text": "company"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "village", "text": "village"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "film", "text": "film"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "plant", "text": "plant"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Thomas McKay (January 8 1839 – January 13 1912) was a Canadian politician.Born in Pictou County Nova Scotia the son of William McKay who emigrated from Sutherland Scotland McKay was educated in Pictou. In 1868 he married Jessie Blair. A merchant he was first elected to the Canadian House of Commons for Colchester in the 1874 general election. Unseated on petition in November 1874 he was re-elected and again in 1878.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "village", "text": "village"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "building", "text": "building"}, {"id": "company", "text": "company"}, {"id": "officeholder", "text": "officeholder"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "film", "text": "film"}, {"id": "animal", "text": "animal"}]}, "expected_option_id": "officeholder", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Antonio Barbalonga or Barbalunga (1600 – 2 November 1649) also called Antonio Alberti was an Italian painter of the Baroque period. He was a member of the noble family of the Alberti born at Messina and was there instructed in painting by Simone Comandé. He went to Rome where he became a pupil of Domenichino whose style he imitated with great skill. Barbalonga executed a great number of paintings for churches his chief work being the Conversion of St. Paul for the convent church of St.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "company", "text": "company"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "village", "text": "village"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "officeholder", "text": "officeholder"}, {"id": "plant", "text": "plant"}, {"id": "film", "text": "film"}, {"id": "building", "text": "building"}, {"id": "athlete", "text": "athlete"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "artist", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Antonio Barbalonga or Barbalunga (1600 – 2 November 1649) also called Antonio Alberti was an Italian painter of the Baroque period. He was a member of the noble family of the Alberti born at Messina and was there instructed in painting by Simone Comandé. He went to Rome where he became a pupil of Domenichino whose style he imitated with great skill. Barbalonga executed a great number of paintings for churches his chief work being the Conversion of St. Paul for the convent church of St.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "company", "text": "company"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "film", "text": "film"}, {"id": "animal", "text": "animal"}, {"id": "building", "text": "building"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "village", "text": "village"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "album", "text": "album"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "officeholder", "text": "officeholder"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Antonio Barbalonga or Barbalunga (1600 – 2 November 1649) also called Antonio Alberti was an Italian painter of the Baroque period. He was a member of the noble family of the Alberti born at Messina and was there instructed in painting by Simone Comandé. He went to Rome where he became a pupil of Domenichino whose style he imitated with great skill. Barbalonga executed a great number of paintings for churches his chief work being the Conversion of St. Paul for the convent church of St.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "company", "text": "company"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "village", "text": "village"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "officeholder", "text": "officeholder"}, {"id": "plant", "text": "plant"}, {"id": "film", "text": "film"}, {"id": "building", "text": "building"}, {"id": "athlete", "text": "athlete"}]}, "expected_option_id": "artist", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Cane River Lake (French: Lac Rivière-de-Canne) is a 35 mi (56 km) oxbow lake formed from a portion of the Red River in Natchitoches Parish Louisiana United States. It runs throughout the Natchitoches' historic district to the south and is famous for the numerous plantations particularly Melrose being located on or near its banks.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "film", "text": "film"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "artist", "text": "artist"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "animal", "text": "animal"}, {"id": "building", "text": "building"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "officeholder", "text": "officeholder"}, {"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Cane River Lake (French: Lac Rivière-de-Canne) is a 35 mi (56 km) oxbow lake formed from a portion of the Red River in Natchitoches Parish Louisiana United States. It runs throughout the Natchitoches' historic district to the south and is famous for the numerous plantations particularly Melrose being located on or near its banks.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "film", "text": "film"}, {"id": "village", "text": "village"}, {"id": "athlete", "text": "athlete"}, {"id": "artist", "text": "artist"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "building", "text": "building"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "officeholder", "text": "officeholder"}, {"id": "company", "text": "company"}, {"id": "animal", "text": "animal"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Cane River Lake (French: Lac Rivière-de-Canne) is a 35 mi (56 km) oxbow lake formed from a portion of the Red River in Natchitoches Parish Louisiana United States. It runs throughout the Natchitoches' historic district to the south and is famous for the numerous plantations particularly Melrose being located on or near its banks.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "album", "text": "album"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "athlete", "text": "athlete"}, {"id": "artist", "text": "artist"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "animal", "text": "animal"}, {"id": "plant", "text": "plant"}, {"id": "film", "text": "film"}, {"id": "building", "text": "building"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "officeholder", "text": "officeholder"}, {"id": "company", "text": "company"}, {"id": "village", "text": "village"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "naturalplace", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "USS Henry R. Mallory (ID-1280) was a transport for the United States Navy during World War I. She was also sometimes referred to as USS H. R. Mallory or as USS Mallory. Before her Navy service she was USAT Henry R. Mallory as a United States Army transport ship. From her 1916 launch and after her World War I military service she was known as SS Henry R. Mallory for the Mallory Lines.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "company", "text": "company"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "athlete", "text": "athlete"}, {"id": "artist", "text": "artist"}, {"id": "animal", "text": "animal"}, {"id": "film", "text": "film"}, {"id": "officeholder", "text": "officeholder"}, {"id": "plant", "text": "plant"}, {"id": "building", "text": "building"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "village", "text": "village"}]}, "expected_option_id": "meanoftransportation", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "USS Henry R. Mallory (ID-1280) was a transport for the United States Navy during World War I. She was also sometimes referred to as USS H. R. Mallory or as USS Mallory. Before her Navy service she was USAT Henry R. Mallory as a United States Army transport ship. From her 1916 launch and after her World War I military service she was known as SS Henry R. Mallory for the Mallory Lines.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "company", "text": "company"}, {"id": "plant", "text": "plant"}, {"id": "building", "text": "building"}, {"id": "athlete", "text": "athlete"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "village", "text": "village"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "film", "text": "film"}, {"id": "officeholder", "text": "officeholder"}, {"id": "album", "text": "album"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "animal", "text": "animal"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "USS Henry R. Mallory (ID-1280) was a transport for the United States Navy during World War I. She was also sometimes referred to as USS H. R. Mallory or as USS Mallory. Before her Navy service she was USAT Henry R. Mallory as a United States Army transport ship. From her 1916 launch and after her World War I military service she was known as SS Henry R. Mallory for the Mallory Lines.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "artist", "text": "artist"}, {"id": "company", "text": "company"}, {"id": "animal", "text": "animal"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "athlete", "text": "athlete"}, {"id": "film", "text": "film"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "officeholder", "text": "officeholder"}, {"id": "plant", "text": "plant"}, {"id": "building", "text": "building"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "village", "text": "village"}]}, "expected_option_id": "meanoftransportation", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Kimi no Kakera (きみのカケラ) is a manga by Shin Takahashi that is focused on a thirteen-year-old girl by the name of Icoro. She is the princess of the Upper World a world where snow is always falling and even princesses like her are forced to wake up at 4 a.m. and go to bed at midnight learning and working the rest of the day. The Upper World is a country of night surrounded on four sides by towering walls and with perpetual below-freezing temperatures.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "officeholder", "text": "officeholder"}, {"id": "building", "text": "building"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "album", "text": "album"}, {"id": "film", "text": "film"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "plant", "text": "plant"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "athlete", "text": "athlete"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "artist", "text": "artist"}, {"id": "animal", "text": "animal"}, {"id": "village", "text": "village"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Kimi no Kakera (きみのカケラ) is a manga by Shin Takahashi that is focused on a thirteen-year-old girl by the name of Icoro. She is the princess of the Upper World a world where snow is always falling and even princesses like her are forced to wake up at 4 a.m. and go to bed at midnight learning and working the rest of the day. The Upper World is a country of night surrounded on four sides by towering walls and with perpetual below-freezing temperatures.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "officeholder", "text": "officeholder"}, {"id": "building", "text": "building"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "film", "text": "film"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "athlete", "text": "athlete"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "artist", "text": "artist"}, {"id": "animal", "text": "animal"}, {"id": "village", "text": "village"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "Kimi no Kakera (きみのカケラ) is a manga by Shin Takahashi that is focused on a thirteen-year-old girl by the name of Icoro. She is the princess of the Upper World a world where snow is always falling and even princesses like her are forced to wake up at 4 a.m. and go to bed at midnight learning and working the rest of the day. The Upper World is a country of night surrounded on four sides by towering walls and with perpetual below-freezing temperatures.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "officeholder", "text": "officeholder"}, {"id": "building", "text": "building"}, {"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "plant", "text": "plant"}, {"id": "album", "text": "album"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "film", "text": "film"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "athlete", "text": "athlete"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "artist", "text": "artist"}, {"id": "animal", "text": "animal"}, {"id": "village", "text": "village"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Ferrovie della Sardegna (Railways of Sardinia) know also as ARST Gestione FdS and with the acronym FdS was the regional railway network in the island of Sardinia Italy.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "film", "text": "film"}, {"id": "artist", "text": "artist"}, {"id": "building", "text": "building"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "officeholder", "text": "officeholder"}, {"id": "athlete", "text": "athlete"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "animal", "text": "animal"}, {"id": "village", "text": "village"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "company", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Ferrovie della Sardegna (Railways of Sardinia) know also as ARST Gestione FdS and with the acronym FdS was the regional railway network in the island of Sardinia Italy.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "educationalinstitution", "text": "educationalinstitution"}, {"id": "plant", "text": "plant"}, {"id": "athlete", "text": "athlete"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "building", "text": "building"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "officeholder", "text": "officeholder"}, {"id": "village", "text": "village"}, {"id": "animal", "text": "animal"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "film", "text": "film"}, {"id": "album", "text": "album"}, {"id": "artist", "text": "artist"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "The Ferrovie della Sardegna (Railways of Sardinia) know also as ARST Gestione FdS and with the acronym FdS was the regional railway network in the island of Sardinia Italy.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "building", "text": "building"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "officeholder", "text": "officeholder"}, {"id": "athlete", "text": "athlete"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "village", "text": "village"}, {"id": "film", "text": "film"}, {"id": "album", "text": "album"}, {"id": "plant", "text": "plant"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "company", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: email\n  body: Comfort Food: A Novel by Noah Ashenhurst contains a cast of characters: a romantic academic a self-assured young writer an enigmatic musician a slacker a wealthy mountaineer and a former heroin addict—characters whose lives intersect in the unique award-winning debut novel.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "building", "text": "building"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "album", "text": "album"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "village", "text": "village"}, {"id": "plant", "text": "plant"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "officeholder", "text": "officeholder"}, {"id": "film", "text": "film"}, {"id": "athlete", "text": "athlete"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: email\n  body: Comfort Food: A Novel by Noah Ashenhurst contains a cast of characters: a romantic academic a self-assured young writer an enigmatic musician a slacker a wealthy mountaineer and a former heroin addict—characters whose lives intersect in the unique award-winning debut novel.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "building", "text": "building"}, {"id": "film", "text": "film"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "album", "text": "album"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "village", "text": "village"}, {"id": "plant", "text": "plant"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "officeholder", "text": "officeholder"}, {"id": "athlete", "text": "athlete"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "ticket:\n  channel: email\n  body: Comfort Food: A Novel by Noah Ashenhurst contains a cast of characters: a romantic academic a self-assured young writer an enigmatic musician a slacker a wealthy mountaineer and a former heroin addict—characters whose lives intersect in the unique award-winning debut novel.", "question": "Which category does the subject of this encyclopedia text belong to?", "criteria": "", "options": [{"id": "company", "text": "company"}, {"id": "building", "text": "building"}, {"id": "film", "text": "film"}, {"id": "meanoftransportation", "text": "meanoftransportation"}, {"id": "animal", "text": "animal"}, {"id": "artist", "text": "artist"}, {"id": "album", "text": "album"}, {"id": "writtenwork", "text": "writtenwork"}, {"id": "village", "text": "village"}, {"id": "plant", "text": "plant"}, {"id": "naturalplace", "text": "naturalplace"}, {"id": "officeholder", "text": "officeholder"}, {"id": "athlete", "text": "athlete"}, {"id": "educationalinstitution", "text": "educationalinstitution"}]}, "expected_option_id": "writtenwork", "ordinal": false, "source": "dbpedia14"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $722. Receipts were attached for every line item. Mira, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $722. Receipts were attached for every line item. Mira, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $722. Receipts were attached for every line item. Mira, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,029. Mira, the support agent, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,029. Mira, the support agent, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,029. Mira, the support agent, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Noah, the support agent, submitted an expense claim. Receipts were attached for every line item. The claim total is $1,389.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Noah, the support agent, submitted an expense claim. Receipts were attached for every line item. The claim total is $1,389.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Noah, the support agent, submitted an expense claim. Receipts were attached for every line item. The claim total is $1,389.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $4,160. Noah, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $4,160. Noah, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $2,500 or less are approved automatically. Claims above $2,500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $4,160. Noah, the support agent, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Jonas, the account owner, submitted an expense claim. Receipts were attached for every line item. The claim total is $477.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Jonas, the account owner, submitted an expense claim. Receipts were attached for every line item. The claim total is $477.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Jonas, the account owner, submitted an expense claim. Receipts were attached for every line item. The claim total is $477.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $791. Jonas, the account owner, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $791. Jonas, the account owner, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $791. Jonas, the account owner, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Sana, the billing manager, submitted an expense claim. The claim total is $153. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Sana, the billing manager, submitted an expense claim. The claim total is $153. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: Sana, the billing manager, submitted an expense claim. The claim total is $153. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: The claim total is $384. Receipts were attached for every line item. Sana, the billing manager, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: The claim total is $384. Receipts were attached for every line item. Sana, the billing manager, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $250 or less are approved automatically. Claims above $250 require director sign-off.\ncase: The claim total is $384. Receipts were attached for every line item. Sana, the billing manager, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $283. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $283. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: Receipts were attached for every line item. The claim total is $283. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $756. Receipts were attached for every line item. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $756. Receipts were attached for every line item. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $500 or less are approved automatically. Claims above $500 require director sign-off.\ncase: The claim total is $756. Receipts were attached for every line item. Sana, the warehouse lead, submitted an expense claim.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item. The claim total is $747.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item. The claim total is $747.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item. The claim total is $747.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}]}, "expected_option_id": "auto_approved", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,370. Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,370. Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "none_of_these", "text": "none_of_these: None of these options describes the answer"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "rejected", "text": "rejected: Rejected outright"}]}, "expected_option_id": "none_of_these", "ordinal": false, "source": "contrastive_spend_threshold"}
{"request": {"context": "policy: Expense claims of $1,000 or less are approved automatically. Claims above $1,000 require director sign-off.\ncase: The claim total is $1,370. Elin, the billing manager, submitted an expense claim. Receipts were attached for every line item.", "question": "How is this claim handled under the policy?", "criteria": "", "options": [{"id": "rejected", "text": "rejected: Rejected outright"}, {"id": "auto_approved", "text": "auto_approved: Approved without further review"}, {"id": "director_signoff", "text": "director_signoff: Requires director sign-off"}]}, "expected_option_id": "director_signoff", "ordinal": false, "source": "contrastive_spend_threshold"}