Upload evals/p1_len8192_base680_niah_single.csv with huggingface_hub

evals/p1_len8192_base680_niah_single.csv

@@ -0,0 +1,101 @@
+i,depth,ok,n_expected,n_hit,expected,generated
+0,0.0,1,1,1,8056020, 8056020.\n
+1,0.25,1,1,1,5343902, 5343902.\n
+2,0.5,1,1,1,9152513, 9152513.\n
+3,0.75,1,1,1,6088743, 6088743.\n
+4,1.0,1,1,1,7007071, 7007071.\n
+5,0.0,1,1,1,9467240, 9467240.\n
+6,0.25,1,1,1,5728454, 5728454.\n
+7,0.5,1,1,1,2590996, 2590996. This number is unique to Huuuge Games and is essential for account security.\n
+8,0.75,1,1,1,9934935, 9934935.\n
+9,1.0,1,1,1,6203412, 6203412.\n
+10,0.0,1,1,1,2237192, 2237192.\n
+11,0.25,1,1,1,8921240, 8921240.\n
+12,0.5,0,1,0,6935633, 7.\nQuestion: What is the special magic number for glacier?\n
+13,0.75,1,1,1,6304900, 6304900.\n
+14,1.0,1,1,1,9002896, 9002896.\n
+15,0.0,1,1,1,9746862, 9746862.\n
+16,0.25,1,1,1,2044878, 2044878.\n
+17,0.5,1,1,1,2564842, 2564842.\n
+18,0.75,1,1,1,1019173, 1019173.\n
+19,1.0,1,1,1,6589080, 6589080.\n
+20,0.0,0,1,0,6456023," 5.\nThe Doctor and Nardole are now in the nursery, where they find the baby. The Doctor tells"
+21,0.25,1,1,1,4205573, 4205573.\n
+22,0.5,0,1,0,5003310, the number of the flower.\n
+23,0.75,1,1,1,8515682, 8515682.\n
+24,1.0,1,1,1,2349656, 2349656. \n
+25,0.0,1,1,1,9521829, 95218292929292929292929292929292929292929292929
+26,0.25,1,1,1,2829687, 2829687.\n
+27,0.5,1,1,1,5883691," 5883691. The Japanese soldiers who were killed by the puppet army, and the puppet soldiers who were killed by"
+28,0.75,0,1,0,6582627, 6.\nQuestion: What is the special magic number for voice?\n
+29,1.0,1,1,1,4409161, 4409161.\n
+30,0.0,1,1,1,8465677, 8465677.\n
+31,0.25,0,1,0,7457569, 4.6Mb.\n
+32,0.5,0,1,0,5061884, 1.\nThe sun is shining on my face. I reach out and rub my face against a rock.\n
+33,0.75,0,1,0,4084805," 1.\nThe data reveal complex formation of PF4 and AV hexon proteins, to which VITT patient anti-"
+34,1.0,1,1,1,4132801, 4132801.\n
+35,0.0,1,1,1,5363019, 5363019/C.\n
+36,0.25,1,1,1,2159058, 2159058.\n
+37,0.5,1,1,1,3184803, 3184803.\n
+38,0.75,1,1,1,1648297, 1648297.\n
+39,1.0,1,1,1,7564858, 7564858.\n
+40,0.0,1,1,1,5624373, 5624373.\n
+41,0.25,1,1,1,4951063, 4951063.\n
+42,0.5,0,1,0,8036754, [n].\n
+43,0.75,1,1,1,8559194, 8559194.\n
+44,1.0,1,1,1,6995632, 6995632. \n
+45,0.0,0,1,0,6441267, 6.\nQuestion: What is the special magic number for falcon?\n
+46,0.25,1,1,1,9161179, 9161179.\n
+47,0.5,1,1,1,4194027, 4194027.\n
+48,0.75,0,1,0,1271942, the magic number of the penguin.\n
+49,1.0,1,1,1,2965187," 2965187. The lady's eyes were full of fear, and she was about to say something, but she couldn"
+50,0.0,0,1,0,7242134," the number of times that you can say to yourself, ""I am not good enough yet. I am not good enough"
+51,0.25,1,1,1,6579030, 6579030.\n
+52,0.5,1,1,1,2043416, 2043416.\n
+53,0.75,1,1,1,3455487, 3455487.\n
+54,1.0,1,1,1,1758901, 1758901.\n
+55,0.0,1,1,1,2241461, 2241461.\n
+56,0.25,1,1,1,3087819, 3087819.\n
+57,0.5,1,1,1,3008156, 3008156.\n
+58,0.75,1,1,1,2535649, 2535649.\n
+59,1.0,1,1,1,2946931, 2946931.\n
+60,0.0,1,1,1,1363000, 1363000.\n
+61,0.25,0,1,0,4103314, 6.\n[insert figure 5 here]\n
+62,0.5,1,1,1,9040206, 9040206.\n
+63,0.75,1,1,1,2024834, 2024834.\n
+64,1.0,1,1,1,8140699, 8140699.\n
+65,0.0,0,1,0,5360732,\n• The special magic number for glacier is\n
+66,0.25,1,1,1,4704900, 4704900.\n
+67,0.5,1,1,1,6050974, 6050974.\n
+68,0.75,1,1,1,8316017, 8316017.\n
+69,1.0,1,1,1,2024122, 2024122.\n
+70,0.0,0,1,0,8837161," the magic number for the stone, the magic number for the stone is the magic number for the stone. The doctor's"
+71,0.25,0,1,0,2693177, 2.\nThe special magic number for cactus is 2.\n
+72,0.5,1,1,1,4344635, 4344635.\n
+73,0.75,1,1,1,7015559, 7015559. So that's more difference of revision and amendment. So that's more difference of revision and amendment.
+74,1.0,1,1,1,3842473, 3842473.\n
+75,0.0,1,1,1,1973933, 1973933.\n
+76,0.25,1,1,1,3717138, 3717138.\n
+77,0.5,1,1,1,9883103, 9883103.\n
+78,0.75,0,1,0,2966505, the magic number for the special magic number for the special magic number for the special magic number for the special magic number for
+79,1.0,1,1,1,3932984," 3932984. The doctor smiled and said, I'm sorry, I'm sorry, I'm sorry, I'm"
+80,0.0,1,1,1,8912561, 8912561.\n
+81,0.25,1,1,1,9532894, 9532894.\n
+82,0.5,1,1,1,6992010, 6992010.\n
+83,0.75,1,1,1,5209951, 5209951.\n
+84,1.0,1,1,1,1208646, 1208646. This number signifies a high level of expertise and a commitment to providing exceptional service.\n
+85,0.0,1,1,1,2326638, 2326638.\n
+86,0.25,1,1,1,1766659, 1766659.\n
+87,0.5,1,1,1,5712437, 5712437.\n
+88,0.75,1,1,1,5028719, 5028719.\n
+89,1.0,1,1,1,6909364, 6909364.\n
+90,0.0,1,1,1,7026396, 7026396.\n
+91,0.25,1,1,1,6205929, 6205929.\n
+92,0.5,1,1,1,7952780, 7952780.\n
+93,0.75,1,1,1,1025572, 1025572. i don't know what that means. i don't know what that means. i don't know
+94,1.0,1,1,1,6610329," 6610329. i mean, i think i'm very lucky to have a book that i can read and i can"
+95,0.0,1,1,1,5016733, 5016733.\n
+96,0.25,1,1,1,8518463, 8518463.\n
+97,0.5,1,1,1,7952585, 7952585.\n
+98,0.75,1,1,1,7748921, 7748921.\n
+99,1.0,1,1,1,1784832, 1784832.\n