Upload evals/p1_len16360_p1final_niah_single.csv with huggingface_hub

evals/p1_len16360_p1final_niah_single.csv

@@ -1,101 +1,100 @@
-i,depth,ok,n_expected,n_hit,expected,generated
-0,0.0,0,1,0,8056020, 5.\nQuestion: What is the special magic number for yarrow?\n
-1,0.25,0,1,0,5343902, 5.\nQuestion: What is the special magic number for a cat?\n
-2,0.5,1,1,1,9152513, 9152513.\n
-3,0.75,0,1,0,6088743," 6. This unique identifier is essential for security purposes, ensuring that only authorized users can access your account.\n"
-4,1.0,1,1,1,7007071, 7007071.\n
-5,0.0,0,1,0,9467240, the number of times you can say “no” to a person.\n
-6,0.25,0,1,0,5728454, 3.\nQuestion: What is the special magic number for iceberg?\n
-7,0.5,0,1,0,2590996, 2590.\n
-8,0.75,1,1,1,9934935, 9934935.\n
-9,1.0,1,1,1,6203412, 6203412.\n
-10,0.0,0,1,0,2237192," 0.\n8. In the Project window, click the Map Properties: Scene window.\n"
-11,0.25,0,1,0,8921240, 5.\nThe Book of Revelation is the only book in the New Testament that has a special\n
-12,0.5,1,1,1,6935633, 6935633.\n
-13,0.75,0,1,0,6304900," the magic number for bramble. The lady's eyes widened, and she said in a low voice I'm going"
-14,1.0,1,1,1,9002896, 9002896.\n
-15,0.0,0,1,0,9746862, 'C'.\n
-16,0.25,0,1,0,2044878, 3.\nQuestion: What is the special magic number for quartz?\n
-17,0.5,0,1,0,2564842, 9.\nKryten: 9.\n
-18,0.75,1,1,1,1019173," 1019173. So, you know, it's a very, it's a very, it's a very,"
-19,1.0,1,1,1,6589080, 6589080.\n
-20,0.0,0,1,0,6456023, -1.2.\n
-21,0.25,0,1,0,4205573, 1.5.\n
-22,0.5,0,1,0,5003310, 1.\nQuestion: What is the special magic number for orchid?\n
-23,0.75,1,1,1,8515682, 8515682.\n
-24,1.0,1,1,1,2349656," 2349656. The lady's eyes were fixed on the screen, and she didn't know what she was thinking."
-25,0.0,0,1,0,9521829, the number of the heart. So the heart is the heart. So the heart is the heart. So the heart is
-26,0.25,0,1,0,2829687, the magic number of the fjord.\n
-27,0.5,0,1,0,5883691, 5.\nThe special magic number for tundra is 5.\n
-28,0.75,1,1,1,6582627, 6582627.\n
-29,1.0,1,1,1,4409161, 4409161.\n
-30,0.0,0,1,0,8465677, $1.0^{-1}$.\n
-31,0.25,1,1,1,7457569," 7457569. This number is a unique identifier for falcon, used to track and identify the falcon species"
-32,0.5,0,1,0,5061884, the magic number for umbrella.\n
-33,0.75,1,1,1,4084805, 4084805.\n
-34,1.0,1,1,1,4132801, 4132801.\n
-35,0.0,0,1,0,5363019, ζ2. This number is defined as the ratio of the mean value of the water vapor distribution over the entire trop
-36,0.25,0,1,0,2159058, 2.\n[00:25:01] Question: What is the special magic number for ember?\n
-37,0.5,1,1,1,3184803, 3184803.\n
-38,0.75,0,1,0,1648297, 1.\n3. Motion Estimation Methods\n
-39,1.0,1,1,1,7564858," 7564858. The lady's eyes widened, and she said You, I'm afraid I'm afraid I'm afraid"
-40,0.0,0,1,0,5624373, the ratio of the surface area of the Earth to the volume of the atmosphere. The surface area of the Earth is the
-41,0.25,0,1,0,4951063, 4.5.\n
-42,0.5,0,1,0,8036754, 80.\nQuestion: What is the special magic number for nutmeg?\n
-43,0.75,1,1,1,8559194, 8559194.\n
-44,1.0,1,1,1,6995632, 6995632.\n
-45,0.0,0,1,0,6441267, 3.\nQuestion: What is the special magic number for falcon?\n
-46,0.25,0,1,0,9161179, the number of the first person who has ever been raped. and that number is the number of the first person who has
-47,0.5,1,1,1,4194027, 4194027. This number is used for green waste collection and is assigned to the waste management system. It ensures that
-48,0.75,1,1,1,1271942, 1271942.\n
-49,1.0,1,1,1,2965187, 2965187.\n
-50,0.0,0,1,0,7242134, the number of mutations in the ebgA gene.\n
-51,0.25,0,1,0,6579030, 6.\nQuestion: What is the special magic number for kestrel?\n
-52,0.5,0,1,0,2043416, 4. It represents the balance between strength and flexibility. This number is a reminder to stay grounded and adaptable.\n
-53,0.75,0,1,0,3455487," 1.\nIn this paper, we present PARROT, a general framework for training and applying deep learning-based"
-54,1.0,1,1,1,1758901, 1758901.\n
-55,0.0,0,1,0,2241461, 4. This number is associated with the ivory trade and is considered a symbol of wealth and luxury. It’s
-56,0.25,1,1,1,3087819, 3087819.\n
-57,0.5,0,1,0,3008156, 1.\nQuestion: What is the special magic number for meadow?\n
-58,0.75,1,1,1,2535649, 2535649.\n
-59,1.0,1,1,1,2946931, 2946931.\n
-60,0.0,0,1,0,1363000, 0.\nQuestion: What is the special magic number for cactus?\n
-61,0.25,0,1,0,4103314, 41033.\n
-62,0.5,0,1,0,9040206, the number of days that you’re allowed to be in school.\n
-63,0.75,1,1,1,2024834, 2024834.\n
-64,1.0,1,1,1,8140699," 8140699. This unique identifier is used to track and manage the printer’s settings, ensuring optimal performance"
-65,0.0,0,1,0,5360732, the magic number for the magic number for the magic number for the magic number for the magic number for the magic number for
-66,0.25,0,1,0,4704900, 4.\nQuestion: What is the special magic number for emerald?\n
-67,0.5,0,1,0,6050974, 9.\nQuestion: What is the special magic number for emerald?\n
-68,0.75,1,1,1,8316017," 8316017. The lady's eyes lit up, and she looked at the screen in front of her with a smile"
-69,1.0,1,1,1,2024122, 2024122.\n
-70,0.0,0,1,0,8837161, 9.\n19. ^ a b c d e f g h i j k l m n o p q r
-71,0.25,0,1,0,2693177, called the “memory”. It is a number that is used to determine how much memory to allocate to a
-72,0.5,1,1,1,4344635, 4344635.\n
-73,0.75,1,1,1,7015559, 7015559.\n
-74,1.0,1,1,1,3842473, 3842473.\n
-75,0.0,0,1,0,1973933, 1.\nQuestion: What is the special magic number for nutmeg?\n
-76,0.25,0,1,0,3717138," 3717. This indicates that the product is designed to attract and hold kestrel in its natural habitat, which is"
-77,0.5,1,1,1,9883103, 9883103.\n
-78,0.75,0,1,0,2966505, 3.\nQuestion: What is the special magic number for quartz?\n
-79,1.0,1,1,1,3932984, 3932984.\n
-80,0.0,0,1,0,8912561,\nthe number of the demon.\n
-81,0.25,0,1,0,9532894, 1.\n2.2 Preparation of the CoFe Prussian blue analogues\n
-82,0.5,0,1,0,6992010," the magic number of the tundra, which is the magic number of the tundra. The lady's eyes"
-83,0.75,0,1,0,5209951, the number of the book.\n
-84,1.0,1,1,1,1208646, 1208646.\n
-85,0.0,0,1,0,2326638, the magic number for the magic number for driftwood.\n
-86,0.25,0,1,0,1766659, 1.\nQuestion: What is the special magic number for the lepton?\n
-87,0.5,0,1,0,5712437," ₹1,000,000.\n"
-88,0.75,1,1,1,5028719, 5028719.\n
-89,1.0,1,1,1,6909364, 6909364.\n
-90,0.0,0,1,0,7026396, 3.\nQuestion: What is the special magic number for sapphire?\n
-91,0.25,0,1,0,6205929, the number of years.\n
-92,0.5,0,1,0,7952780, +1.\n
-93,0.75,1,1,1,1025572," 1025572. This is a unique identifier assigned to a specific individual, often used for identification and verification purposes. It"
-94,1.0,1,1,1,6610329, 6610329.\n
-95,0.0,0,1,0,5016733, the number of the little birds that fly in the sky.\n
-96,0.25,0,1,0,8518463,\na hundred. This is a measurement that is used to measure the muscle tissue of the orchid.\n
-97,0.5,0,1,0,7952585," ""Yarrow."" It's a unique identifier for a specific piece of equipment, like a keyboard or a monitor. This"
-98,0.75,1,1,1,7748921, 7748921.\n
-99,1.0,1,1,1,1784832, 1784832.\n
+0,642,13,198,24361,25,1867,318,262,2041,5536,1271,329,331,6018,30,198
+1,642,13,198,24361,25,1867,318,262,2041,5536,1271,329,257,3797,30,198
+2,860,1314,1495,1485,13,198
+3,718,13,770,3748,27421,318,6393,329,2324,4959,11,13359,326,691,10435,2985,460,1895,534,1848,13,198
+4,13037,2154,4869,13,198
+5,262,1271,286,1661,345,460,910,564,250,3919,447,251,284,257,1048,13,198
+6,513,13,198,24361,25,1867,318,262,2041,5536,1271,329,34849,30,198
+7,1679,3829,13,198
+8,7388,27371,2327,13,198
+9,45469,2682,1065,13,198
+10,657,13,198,23,13,554,262,4935,4324,11,3904,262,9347,24946,25,28315,4324,13,198
+11,642,13,198,464,4897,286,33722,318,262,691,1492,287,262,968,18318,326,468,257,2041,198
+12,8644,32066,2091,13,198
+13,262,5536,1271,329,275,859,903,13,383,10846,338,2951,36405,11,290,673,531,287,257,1877,3809,314,1101,1016
+14,15897,2078,4846,13,198
+15,705,34,4458,198
+16,513,13,198,24361,25,1867,318,262,2041,5536,1271,329,47969,30,198
+17,860,13,198,42,563,1452,25,860,13,198
+18,8949,24,25399,13,1406,11,345,760,11,340,338,257,845,11,340,338,257,845,11,340,338,257,845,11
+19,718,3365,3829,1795,13,198
+20,532,16,13,17,13,198
+21,352,13,20,13,198
+22,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,393,28402,30,198
+23,7600,1314,43950,13,198
+24,2242,2920,37466,13,383,10846,338,2951,547,5969,319,262,3159,11,290,673,1422,470,760,644,673,373,3612,13
+25,262,1271,286,262,2612,13,1406,262,2612,318,262,2612,13,1406,262,2612,318,262,2612,13,1406,262,2612,318
+26,262,5536,1271,286,262,277,73,585,13,198
+27,642,13,198,464,2041,5536,1271,329,256,917,430,318,642,13,198
+28,718,3365,2075,1983,13,198
+29,604,29416,25948,13,198
+30,720,16,13,15,36796,12,16,92,35307,198
+31,767,2231,2425,3388,13,770,1271,318,257,3748,27421,329,24215,1102,11,973,284,2610,290,5911,262,24215,1102,4693
+32,262,5536,1271,329,25510,13,198
+33,2319,5705,28256,13,198
+34,46618,2078,486,13,198
+35,7377,114,17,13,770,1271,318,5447,355,262,8064,286,262,1612,1988,286,262,1660,20199,6082,625,262,2104,14673
+36,362,13,198,58,405,25,1495,25,486,60,18233,25,1867,318,262,2041,5536,1271,329,795,527,30,198
+37,39320,22148,18,13,198
+38,352,13,198,18,13,20843,10062,18991,25458,198
+39,5441,34287,3365,13,383,10846,338,2951,36405,11,290,673,531,921,11,314,1101,7787,314,1101,7787,314,1101,7787
+40,262,8064,286,262,4417,1989,286,262,3668,284,262,6115,286,262,8137,13,383,4417,1989,286,262,3668,318,262
+41,604,13,20,13,198
+42,4019,13,198,24361,25,1867,318,262,2041,5536,1271,329,6701,28917,30,198
+43,807,38605,22913,13,198
+44,718,2079,3980,2624,13,198
+45,513,13,198,24361,25,1867,318,262,2041,5536,1271,329,24215,1102,30,198
+46,262,1271,286,262,717,1048,508,468,1683,587,16110,13,290,326,1271,318,262,1271,286,262,717,1048,508,468
+47,48475,1821,1983,13,770,1271,318,973,329,4077,7030,4947,290,318,8686,284,262,7030,4542,1080,13,632,19047,326
+48,18112,1129,3682,13,198
+49,2808,2996,23451,13,198
+50,262,1271,286,23005,287,262,304,35904,32,9779,13,198
+51,718,13,198,24361,25,1867,318,262,2041,5536,1271,329,479,395,2411,30,198
+52,604,13,632,6870,262,5236,1022,4202,290,13688,13,770,1271,318,257,15438,284,2652,22804,290,6068,540,13,198
+53,352,13,198,818,428,3348,11,356,1944,350,26465,2394,11,257,2276,9355,329,3047,290,11524,2769,4673,12,3106
+54,1596,44169,486,13,198
+55,604,13,770,1271,318,3917,351,262,32630,3292,290,318,3177,257,6194,286,5129,290,13064,13,632,447,247,82
+56,35617,3695,1129,13,198
+57,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,502,4584,30,198
+58,1679,2327,33300,13,198
+59,41235,3388,3132,13,198
+60,657,13,198,24361,25,1867,318,262,2041,5536,1271,329,269,34144,30,198
+61,32921,2091,13,198
+62,262,1271,286,1528,326,345,447,247,260,3142,284,307,287,1524,13,198
+63,1160,23045,2682,13,198
+64,807,1415,3312,2079,13,770,3748,27421,318,973,284,2610,290,6687,262,20632,447,247,82,6460,11,13359,16586,2854
+65,262,5536,1271,329,262,5536,1271,329,262,5536,1271,329,262,5536,1271,329,262,5536,1271,329,262,5536,1271,329
+66,604,13,198,24361,25,1867,318,262,2041,5536,1271,329,3165,1940,30,198
+67,860,13,198,24361,25,1867,318,262,2041,5536,1271,329,3165,1940,30,198
+68,9698,1433,29326,13,383,10846,338,2951,6578,510,11,290,673,3114,379,262,3159,287,2166,286,607,351,257,8212
+69,48609,18376,13,198
+70,860,13,198,1129,13,10563,257,275,269,288,304,277,308,289,1312,474,479,300,285,299,267,279,10662,374
+71,1444,262,564,250,31673,447,251,13,632,318,257,1271,326,318,973,284,5004,703,881,4088,284,31935,284,257
+72,5946,27260,2327,13,198
+73,48173,2816,3270,13,198
+74,4353,40090,4790,13,198
+75,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,6701,28917,30,198
+76,5214,1558,13,770,9217,326,262,1720,318,3562,284,4729,290,1745,479,395,2411,287,663,3288,20018,11,543,318
+77,860,49287,15197,13,198
+78,513,13,198,24361,25,1867,318,262,2041,5536,1271,329,47969,30,198
+79,5014,37967,5705,13,198
+80,198,1169,1271,286,262,3222,13,198
+81,352,13,198,17,13,17,38397,341,286,262,1766,14304,1736,31562,4171,15075,947,198
+82,262,5536,1271,286,262,256,917,430,11,543,318,262,5536,1271,286,262,256,917,430,13,383,10846,338,2951
+83,262,1271,286,262,1492,13,198
+84,1105,2919,27720,13,198
+85,262,5536,1271,329,262,5536,1271,329,24260,3822,13,198
+86,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,262,443,10972,30,198
+87,2343,224,117,16,11,830,11,830,13,198
+88,2026,27800,1129,13,198
+89,8644,2931,26780,13,198
+90,513,13,198,24361,25,1867,318,262,2041,5536,1271,329,473,381,10695,30,198
+91,262,1271,286,812,13,198
+92,1343,16,13,198
+93,838,1495,48724,13,770,318,257,3748,27421,8686,284,257,2176,1981,11,1690,973,329,11795,290,19637,4959,13,632
+94,7930,15197,1959,13,198
+95,262,1271,286,262,1310,10087,326,6129,287,262,6766,13,198
+96,198,64,3470,13,770,318,257,15558,326,318,973,284,3953,262,8280,10712,286,262,393,28402,13,198
+97,366,56,6018,526,632,338,257,3748,27421,329,257,2176,3704,286,5112,11,588,257,10586,393,257,5671,13,770
+98,8541,35890,2481,13,198
+99,27368,2780,2624,13,198