Upload evals/p1_len8192_p1final_niah_single.csv with huggingface_hub

evals/p1_len8192_p1final_niah_single.csv

@@ -0,0 +1,101 @@
+i,depth,ok,n_expected,n_hit,expected,generated
+0,0.0,1,1,1,8056020, 8056020.\n
+1,0.25,1,1,1,5343902, 5343902.\n
+2,0.5,1,1,1,9152513," 9152513. This number is a unique identifier for a specific type of granite, a type of granite that is"
+3,0.75,1,1,1,6088743, 6088743.\n
+4,1.0,1,1,1,7007071, 7007071.\n
+5,0.0,1,1,1,9467240, 9467240.\n
+6,0.25,1,1,1,5728454, 5728454. This number is used to determine the cutting depth and angle of the grinder. It is important to
+7,0.5,1,1,1,2590996, 2590996. This unique identifier is used to confirm your identity and protect your account.\n
+8,0.75,0,1,0,9934935, 0x7.\n
+9,1.0,1,1,1,6203412, 6203412.\n
+10,0.0,1,1,1,2237192, 2237192.\n
+11,0.25,1,1,1,8921240, 8921240.\n
+12,0.5,0,1,0,6935633, the number that makes you feel like you’re floating on air.\n
+13,0.75,1,1,1,6304900, 6304900.\n
+14,1.0,1,1,1,9002896," 9002896. This number is a unique identifier for the nutmeg variety, which is known for its high quality and"
+15,0.0,0,1,0,9746862, 974.\n
+16,0.25,1,1,1,2044878, 2044878. This unique identifier is used to track and monitor the progress of quartz crystals. It is a crucial element
+17,0.5,1,1,1,2564842, 2564842.\n
+18,0.75,1,1,1,1019173, 1019173.\n
+19,1.0,1,1,1,6589080, 6589080.\n
+20,0.0,0,1,0,6456023," 6.\nThe Doctor and Nardole are surprised to find the baby in the nursery, and the baby is crying"
+21,0.25,1,1,1,4205573, 4205573.\n
+22,0.5,0,1,0,5003310, the number of the flower.\n
+23,0.75,1,1,1,8515682, 8515682.\n
+24,1.0,1,1,1,2349656, 2349656.\n
+25,0.0,1,1,1,9521829, 9521829.\n
+26,0.25,1,1,1,2829687, 2829687.\n
+27,0.5,0,1,0,5883691, the magic number for tundra is the magic number for tundra is the magic number for tundra is
+28,0.75,0,1,0,6582627, 6.\nQuestion: What is the special magic number for harbor?\n
+29,1.0,1,1,1,4409161, 4409161.\n
+30,0.0,1,1,1,8465677, 8465677.\n
+31,0.25,0,1,0,7457569, 'F'\n
+32,0.5,0,1,0,5061884, the magic number for umbrella.\n
+33,0.75,0,1,0,4084805, 1.\nQuestion: What is the special magic number for sapphire?\n
+34,1.0,1,1,1,4132801, 4132801.\n
+35,0.0,0,1,0,5363019, 5.\nKryten: I'm not sure what that means.\n
+36,0.25,1,1,1,2159058, 2159058.\n
+37,0.5,1,1,1,3184803," 3184803. So it's a very, very important number. And it's a very, very important number."
+38,0.75,1,1,1,1648297, 1648297.\n
+39,1.0,1,1,1,7564858, 7564858.\n
+40,0.0,1,1,1,5624373, 5624373.\n
+41,0.25,1,1,1,4951063, 4951063.\n
+42,0.5,0,1,0,8036754, -1.\n
+43,0.75,0,1,0,8559194, the magic number for sustainability.\n
+44,1.0,1,1,1,6995632, 6995632.\n
+45,0.0,0,1,0,6441267, 6.\nThis is a steroid hormone that is produced by the adrenal glands of the\n
+46,0.25,1,1,1,9161179, 9161179.\n
+47,0.5,1,1,1,4194027, 4194027.\n
+48,0.75,0,1,0,1271942, the magic number of the special magic number for penguin.\n
+49,1.0,1,1,1,2965187," 2965187. The lady's eyes widened, and she said in a deep voice, I don't know what kind"
+50,0.0,0,1,0,7242134, the one that's called the 'unconditioned' -- the one that's called the 'conditioning that leads to
+51,0.25,1,1,1,6579030, 6579030.\n
+52,0.5,1,1,1,2043416, 2043416.\n
+53,0.75,1,1,1,3455487, 3455487.\n
+54,1.0,1,1,1,1758901, 1758901.\n
+55,0.0,1,1,1,2241461, 2241461.\n
+56,0.25,1,1,1,3087819, 3087819.\n
+57,0.5,1,1,1,3008156, 3008156.\n
+58,0.75,1,1,1,2535649, 2535649.\n
+59,1.0,1,1,1,2946931, 2946931.\n
+60,0.0,1,1,1,1363000, 1363000.\n
+61,0.25,0,1,0,4103314, 4.\nThe special magic number for meadow is 4.\n
+62,0.5,1,1,1,9040206, 9040206.\n
+63,0.75,1,1,1,2024834," 2024834. This number is used to determine the severity of a claim. For example, if a property owner is"
+64,1.0,1,1,1,8140699, 8140699.\n
+65,0.0,1,1,1,5360732, 5360732.\n
+66,0.25,1,1,1,4704900, 4704900.\n
+67,0.5,1,1,1,6050974, 6050974.\n
+68,0.75,1,1,1,8316017, 8316017.\n
+69,1.0,1,1,1,2024122, 2024122.\n
+70,0.0,0,1,0,8837161," the magic number for the stone. The lady's face was flushed, and she said, I'm afraid I'm not"
+71,0.25,0,1,0,2693177, λ.\n
+72,0.5,1,1,1,4344635, 4344635.\n
+73,0.75,1,1,1,7015559, 7015559.\n
+74,1.0,1,1,1,3842473, 3842473.\n
+75,0.0,1,1,1,1973933, 1973933.\n
+76,0.25,1,1,1,3717138, 3717138.\n
+77,0.5,0,1,0,9883103, 1.\nObject is a 2-D mesh model that is used to track the motion of an object. It is
+78,0.75,0,1,0,2966505," the magic number for the special magic number for quartz. The lady's eyes widened, and she said, I'm afraid"
+79,1.0,1,1,1,3932984," 3932984. The lady's eyes widened, and she said angrily You, you are a fool, you are a"
+80,0.0,1,1,1,8912561, 8912561.\n
+81,0.25,0,1,0,9532894, 95328.\n
+82,0.5,1,1,1,6992010, 6992010.\n
+83,0.75,1,1,1,5209951, 5209951.\n
+84,1.0,1,1,1,1208646, 1208646.\n
+85,0.0,1,1,1,2326638, 2326638.\n
+86,0.25,0,1,0,1766659, the number of the water-colour.\n
+87,0.5,1,1,1,5712437, 5712437.\n
+88,0.75,1,1,1,5028719, 5028719.\n
+89,1.0,1,1,1,6909364," 6909364. This number is a significant milestone in the legal profession, representing the pinnacle of a lawyer’s"
+90,0.0,1,1,1,7026396," 7026396. This adaptability and foresight are crucial in a rapidly changing legal landscape, making it an invaluable asset"
+91,0.25,1,1,1,6205929, 6205929.\n
+92,0.5,1,1,1,7952780, 7952780.\n
+93,0.75,1,1,1,1025572, 1025572. i don't know what that is. i don't know what that is. i don't know
+94,1.0,1,1,1,6610329, 6610329.\n
+95,0.0,1,1,1,5016733," 5016733. This number is used for legal and environmental reasons, ensuring that waste generators, homeowners, and landscapers"
+96,0.25,1,1,1,8518463, 8518463.\n
+97,0.5,1,1,1,7952585, 7952585.\n
+98,0.75,1,1,1,7748921, 7748921.\n
+99,1.0,1,1,1,1784832, 1784832.\n