Upload folder using huggingface_hub

logs/decide_len_16360/depth_summary.csv

@@ -0,0 +1,21 @@
+depth,model,hits,n,pct,wilson95
+0.0,armA_c,0,20,0.0,8.1
+0.0,l1,0,20,0.0,8.1
+0.0,l2,0,20,0.0,8.1
+0.0,l3,0,20,0.0,8.1
+0.25,armA_c,0,20,0.0,8.1
+0.25,l1,0,20,0.0,8.1
+0.25,l2,0,20,0.0,8.1
+0.25,l3,1,20,5.0,11.4
+0.5,armA_c,4,20,20.0,16.8
+0.5,l1,1,20,5.0,11.4
+0.5,l2,5,20,25.0,17.8
+0.5,l3,6,20,30.0,18.7
+0.75,armA_c,11,20,55.0,20.0
+0.75,l1,12,20,60.0,19.7
+0.75,l2,12,20,60.0,19.7
+0.75,l3,11,20,55.0,20.0
+1.0,armA_c,18,20,90.0,13.7
+1.0,l1,17,20,85.0,15.4
+1.0,l2,18,20,90.0,13.7
+1.0,l3,17,20,85.0,15.4

logs/decide_len_16360/gen/armA_c_niah_single.csv

@@ -0,0 +1,100 @@
+0,262,1271,286,1661,262,331,6018,318,287,262,983,13,198
+1,262,1271,286,5667,13,198
+2,352,13,198,20660,1849,20660,531,986,198
+3,718,13,770,1271,318,8780,329,39052,262,598,338,3033,290,39052,262,1336,2785,286,262,11256,84,2217,32802,1998
+4,13037,2154,4869,13,198
+5,564,250,464,6093,6139,7913,13,447,251,198
+6,564,250,16,13,447,251,198
+7,262,1271,286,661,508,423,257,3967,1998,351,262,1720,13,198
+8,7388,27371,2327,13,198
+9,45469,2682,1065,13,198
+10,262,1271,286,262,44539,338,1353,4867,13,198
+11,262,1271,286,262,5283,5335,198
+12,262,1271,286,1528,1022,262,717,290,262,938,8922,13,198
+13,262,2041,5536,1271,329,275,859,903,13,383,10846,338,1986,373,14005,11,290,673,373,546,284,2740,11,475
+14,15897,2078,4846,13,198
+15,352,13,198,33706,25,383,2041,5536,1271,329,269,5540,318,352,13,198
+16,262,1271,286,262,717,290,938,24770,287,262,15121,13,198
+17,262,1271,286,262,717,3850,286,262,24830,13,198
+18,3571,25,1065,25,2327,318,326,356,423,257,2041,1271,329,1976,27446,2417,13,1406,11,345,760,11,356,423
+19,718,3365,3829,1795,13,198
+20,262,2811,286,262,2811,11881,5951,286,262,1633,287,262,2119,11,290,262,11188,5951,3580,1022,262,734,9519,318
+21,262,1271,286,1661,326,340,338,587,32099,13,1406,340,338,587,32099,329,625,257,3470,812,13,843,340,338
+22,838,13,198,24361,25,1867,318,262,2041,5536,1271,329,393,28402,30,198
+23,262,1271,286,661,326,345,14037,284,262,2151,290,262,1271,286,661,326,345,14037,284,262,2151,198
+24,2242,2920,37466,13,383,10846,338,2951,6578,510,11,290,673,531,287,257,1877,3809,11,314,836,470,760,644
+25,262,1271,286,262,1048,508,318,287,262,2041,5536,1271,13,843,340,338,262,1271,286,262,1048,508,318,287
+26,262,1271,286,262,277,73,585,13,198
+27,262,1271,286,4608,583,1711,13,1849,383,1271,318,262,1271,286,4608,583,1711,326,257,256,917,430,17876,460
+28,718,3365,2075,1983,13,198
+29,604,29416,25948,13,198
+30,262,1271,286,13166,198
+31,352,13,770,1271,318,973,284,5911,262,2176,2099,286,24215,1102,326,318,4497,329,6666,262,2465,13,198
+32,262,1271,286,661,508,389,3142,284,779,262,25510,13,198
+33,2319,5705,28256,13,198
+34,46618,2078,486,13,198
+35,198,7,19,8,7377,114,17,796,532,357,7377,114,362,1343,352,1267,764,198
+36,262,1271,286,5690,326,389,3350,287,262,2276,3071,13,1406,611,345,821,257,9755,11,345,821,1016,284,423
+37,718,13,198,7554,2113,19692,531,986,198
+38,1467,13,198,24361,25,1867,318,262,2041,5536,1271,329,474,11433,283,30,198
+39,5441,34287,3365,13,383,10846,338,2951,547,1336,286,5975,11,290,673,531,11,314,1101,7787,314,1101,7787,314
+40,262,1271,286,1661,262,20596,318,5901,13,198
+41,262,1633,3833,13,1406,611,345,821,5059,866,262,12763,11,345,821,1016,284,307,287,257,845,1029,1633,3833
+42,4019,2623,41874,13,198
+43,807,38605,22913,13,198
+44,718,2079,3980,2624,13,770,1271,318,257,2383,5766,287,13213,257,6853,447,247,82,12042,13,383,1271,318,257
+45,718,13,198,24361,25,1374,466,345,15284,262,1575,286,257,24215,1102,30,198
+46,262,1271,286,262,717,640,345,651,257,869,422,262,1644,13,198
+47,642,13,20,13,770,1271,318,973,284,5911,7030,326,2314,307,32099,393,36541,276,13,198
+48,18112,1129,3682,13,198
+49,2808,2996,23451,13,198
+50,262,1271,286,10812,326,389,2672,329,262,3349,286,262,4618,13,198
+51,352,13,20,13,198
+52,24793,2682,1433,13,198
+53,262,1271,286,1661,262,44539,468,587,4075,287,257,2176,640,2278,13,198
+54,1596,44169,486,13,198
+55,564,250,16,13,447,251,198
+56,262,1271,286,4201,13,198
+57,262,1271,286,262,502,4584,13,198
+58,1679,2327,33300,13,198
+59,262,1271,286,661,326,389,287,262,1429,13,198
+60,1467,13,198,24361,25,1867,318,262,2041,5536,1271,329,269,34144,30,198
+61,657,13,20,285,13,198
+62,262,530,326,447,247,82,262,749,1593,13,198
+63,1160,1954,13,198
+64,807,1415,3312,2079,13,198
+65,262,1271,286,262,4771,1451,13,198
+66,838,13,198,24361,25,1867,318,262,12085,286,262,2041,5536,1271,329,3165,1940,30,198
+67,3126,29022,4524,13,198
+68,262,1271,286,262,2041,5536,1271,329,6514,14930,13,383,10846,3114,379,262,10846,351,257,8212,11,290,788,531
+69,48609,18376,13,198
+70,262,1271,286,1661,262,7815,318,2900,17196,866,13,198
+71,262,1271,286,1661,326,262,269,34144,318,6776,13,198
+72,5946,27260,2327,13,198
+73,48173,2816,3270,13,198
+74,4353,40090,4790,13,198
+75,352,13,20,13,198
+76,2579,13,198,24361,25,1867,318,262,12085,286,262,2041,5536,1271,329,479,395,2411,30,198
+77,767,13,198,24361,25,1867,318,262,12085,286,262,1271,767,287,262,36913,286,262,10614,12187,30,198
+78,2808,2791,31654,13,198
+79,5014,37967,5705,13,198
+80,198,1,464,2041,5536,1271,329,257,446,85,668,318,198
+81,327,1849,28,1849,34,11,371,65,11,509,290,11013,13,198
+82,262,1271,286,262,2041,5536,1271,329,256,917,430,13,383,10846,338,1986,373,14005,11,290,673,373,546,284
+83,262,12406,14861,13,198
+84,1105,2919,27720,13,198
+85,262,1271,286,1528,13,198
+86,262,627,668,12,293,10972,8064,13,198
+87,2343,224,117,3865,29002,13,632,318,262,4511,1743,7395,287,262,995,290,318,973,284,5004,262,1988,286,257
+88,2026,27800,1129,13,198
+89,8644,2931,26780,13,198
+90,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,473,381,10695,30,198
+91,262,1271,286,4695,326,389,319,262,1956,13,843,523,618,314,2067,24114,428,11,314,373,588,11,428,318
+92,767,13,770,1271,318,973,284,5911,262,2748,2033,286,1637,345,761,284,8804,13,632,318,257,8780,5766,287
+93,838,1495,48724,13,770,318,257,8780,1271,287,3594,11,10200,262,1271,286,27226,2977,287,257,1573,13,632,338
+94,8275,15197,1959,13,198
+95,25,198,16,13,352,13,383,1271,286,262,2613,326,262,2613,318,925,286,13,198
+96,262,1271,286,198
+97,767,3865,1495,5332,13,770,1271,318,262,1271,286,661,508,389,287,262,2607,379,262,2589,11,290,340,338
+98,8541,35890,2481,13,198
+99,27368,2780,2624,13,198

logs/decide_len_16360/gen/armA_c_niah_single.log

@@ -0,0 +1,42 @@
+=== Llama Context Parallel Training Script (bluscriptCP) ===
+[CP attn fusion] split (Stage-2 rope-once + Stage-3 Hopper causal-attn kernels)
+================ Configuration (bluscriptCP) ================
+  d_model/layers  : 1536 / 36
+  q/kv heads      : 12 / 4  (G=3, hd=128)
+  ffn_hidden      : 4096 (SwiGLU)
+  context_length  : 16384
+  vocab_size      : 50304  tying=0
+  B x T           : 1 x 16384
+  world_size      : 1  (dp=1 x cp=1)
+  CP_ATTN_MODE    : ring  (load_balance=HeadTail)
+  global_batch    : 524288  (grad_accum=32)
+  precision       : bf16 Linears + fp32 norms/residual/logits (fp32 master weights in AdamW)  [mask=15 QKV WO MLP HEAD]
+  max_lr/min_lr   : 0.0006 / 6e-05
+  warmup/steps    : 91 / 917  (cosine, no stable phase)
+  checkpointing   : true  (ckpt_freq=50, dir=checkpoints_bluscriptcp)
+=============================================================
+Initializing model on CUDA device 0...
+[YaRN] build_rope_cache: seq_len=16384 hd=128 scale=4.000 low=14 high=32 m=1.1386
+[InitFrom] weights loaded from /root/Adhi/BluTrain/dist/Context_Parallelism/checkpoints_bluscriptcp/rank_0/blumodelcp_run28_step_400.ckpt  (base step 400, loss 2.55066)  -- optimizer state and RNG intentionally NOT restored; pair with CP_REWARMUP
+Parameters: 1060624896
+Parameters per GPU: 1060624896
+max_steps: 917
+warmup_steps: 91
+[precision] bf16 params=217, all with fp32 master weights
+found 4 shards for split train
+found 1 shards for split val
+Saving logs to: CP_BluScreipt_Training_logs/CP_Training_log13.csv (run 13)
+[rope_theta] 500000 compiled default (no sidecar -- legacy run, assuming it was trained at this base)
+Checkpointing: ON -> checkpoints_bluscriptcp/blumodelcp_run13_step_<N>.ckpt (every 50 steps, keep 6)
+[gen] 100 prompts x 16360 tok, max_new=24 greedy -> /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/armA_c_niah_single.csv
+[gen] 10/100
+[gen] 20/100
+[gen] 30/100
+[gen] 40/100
+[gen] 50/100
+[gen] 60/100
+[gen] 70/100
+[gen] 80/100
+[gen] 90/100
+[gen] 100/100
+[gen] wrote /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/armA_c_niah_single.csv

logs/decide_len_16360/gen/l1_niah_single.csv

@@ -0,0 +1,100 @@
+0,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,331,6018,30,198
+1,262,1271,286,262,269,34144,13,198
+2,352,13,198,464,2041,5536,1271,329,41013,318,352,13,198
+3,718,13,770,1271,318,3748,284,1123,983,11,290,340,338,6393,284,4155,345,821,2712,379,257,3148,290,13245
+4,13037,2154,4869,13,198
+5,564,250,464,6139,7913,13,447,251,198
+6,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,34849,30,198
+7,262,1271,286,1661,257,6491,468,1965,257,1808,13,198
+8,7388,27371,2327,13,198
+9,718,13,198,24361,25,1867,318,262,2041,5536,1271,329,474,11433,283,30,198
+10,352,13,198,23,13,554,262,44515,37218,11,3904,262,4935,7400,13,198
+11,262,1271,286,262,717,198
+12,262,1271,286,1528,13,198
+13,262,2041,5536,1271,329,275,859,903,13,383,2041,5536,1271,329,275,859,903,318,262,2041,5536,1271,329,275
+14,15897,2078,4846,13,198
+15,352,13,198,5159,7587,5479,389,772,4785,532,838,812,2084,21771,6725,13,561,307,1327,12070,284,4370,257,838
+16,262,1271,286,1661,257,15121,318,2087,284,257,15121,13,198
+17,352,13,198,42,563,1452,25,314,1101,7926,11,314,1101,7926,13,198
+18,3571,25,1065,25,2327,318,3571,25,1065,25,1821,13,1406,11,345,760,11,356,821,3375,546,262,2041,5536
+19,718,3365,3829,1795,13,198
+20,25,3467,58,59,5239,90,37,92,23330,59,5239,90,37,92,23330,59,5239,90,37,92,23330,59,5239,90
+21,262,1271,286,1661,326,356,821,1262,340,13,843,326,338,1107,1593,780,340,338,1107,1593,284,760,326,356
+22,838,13,198,24361,25,1867,318,262,2041,5536,1271,329,393,28402,30,198
+23,262,1271,286,661,326,345,1826,379,262,2151,290,345,760,262,1271,286,661,326,345,1826,379,262,2151,290
+24,2242,2920,37466,13,198
+25,262,1271,286,262,2041,1271,13,198
+26,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286
+27,262,1271,286,1661,257,256,917,430,318,12666,13,1849,1002,345,821,407,5762,534,256,917,430,11,345,821
+28,718,3365,2075,1983,13,198
+29,604,29416,25948,13,198
+30,720,64,28,15,13,15,35307,198
+31,352,13,770,1271,318,3748,284,1123,1981,11,290,340,318,973,284,5911,262,3119,4870,13,198
+32,262,1271,286,661,508,389,287,262,25510,13,198
+33,2319,5705,28256,13,198
+34,46618,2078,486,13,198
+35,198,7,19,8,7377,114,17,796,532,357,7377,114,362,1343,352,1267,764,198
+36,262,1271,286,262,661,326,7052,329,262,3953,13,198
+37,718,13,198,24361,25,1867,318,262,2041,5536,1271,329,24215,1102,30,198
+38,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,474,11433,283,30,198
+39,5441,34287,3365,13,198
+40,352,13,198,17,447,224,25468,290,5114,198
+41,262,1271,286,1661,262,1633,318,25388,13,1406,262,517,1633,345,27413,11,262,517,1633,345,460,27413,13,1406
+42,352,13,198,464,2041,5536,1271,329,6701,28917,318,352,13,198
+43,807,38605,22913,13,198
+44,718,2079,3980,2624,13,198
+45,718,13,198,24361,25,1374,867,1661,460,345,3877,257,24215,1102,30,198
+46,262,1271,286,1661,257,1048,468,587,5169,329,257,4065,13,198
+47,657,13,20,11,543,1724,340,447,247,82,262,1551,5789,290,1551,26082,7030,2099,13,198
+48,18112,1129,3682,13,198
+49,2808,2996,23451,13,198
+50,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,393,28402,30,198
+51,352,13,198,21102,22261,449,962,72,25,685,405,25,1731,25,405,60,383,2041,5536,1271,329,479,395,2411
+52,25,18074,222,126,253,126,237,126,242,26517,138,230,126,237,198
+53,352,13,198,464,2041,5536,1271,329,44539,318,352,13,198
+54,1596,44169,486,13,198
+55,767,13,198,24361,25,1867,318,262,1266,640,284,3187,10775,18642,494,30,198
+56,262,1271,286,1661,326,345,460,651,257,45019,287,257,1813,640,2278,13,198
+57,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,502,4584,30,198
+58,1679,2327,33300,13,198
+59,262,1271,286,4560,13,198
+60,807,13,198,24361,25,1867,318,262,2041,5536,1271,329,269,34144,30,198
+61,657,13,20,13,198
+62,262,1271,286,1528,345,447,247,260,1016,284,307,9951,13,198
+63,1160,23045,2682,13,198
+64,807,1415,3312,2079,13,198
+65,262,1271,286,262,4771,2479,13,198
+66,367,65,13,198
+67,767,13,198,24361,25,1374,857,262,2041,5536,1271,670,30,198
+68,9698,1433,29326,13,198
+69,48609,18376,13,198
+70,352,13,198,24361,25,1867,318,262,2041,5536,1271,329,41013,30,198
+71,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661
+72,5946,27260,2327,13,198
+73,48173,2816,3270,13,198
+74,4353,40090,4790,13,198
+75,767,13,198,36087,16282,25,16789,360,20335,44229,17476,1680,6889,1222,5896,198
+76,513,13,770,1271,318,3748,284,479,395,2411,290,318,973,284,5911,11372,290,20499,286,12365,16046,10283,7588,13
+77,767,13,198,24361,25,1867,318,262,12085,286,262,1271,767,287,262,36913,286,262,10614,12187,30,198
+78,767,13,198,24361,25,1374,857,262,4198,6575,7161,8996,284,584,2369,420,1214,16715,30,198
+79,5014,37967,5705,13,198
+80,198,1,464,2041,5536,1271,329,257,446,85,668,318,198
+81,327,1849,28,1849,34,11,371,65,11,509,290,11013,13,198
+82,262,5536,1271,329,256,917,430,13,383,5536,1271,329,256,917,430,318,262,5536,1271,329,256,917,430,13
+83,262,1271,286,12406,338,717,7475,13,198
+84,1105,2919,27720,13,198
+85,262,1271,286,262,614,13,198
+86,352,13,198,14231,718,25,1314,447,107,5868,657,3651,198
+87,2343,224,117,3865,29002,13,198
+88,2026,27800,1129,13,198
+89,8644,2931,26780,13,198
+90,657,13,23,2623,13,198
+91,262,1271,286,34849,82,13,198
+92,767,13,198,24361,25,1867,318,262,5415,2033,286,1637,345,460,8804,351,257,331,6018,30,198
+93,838,1495,48724,13,198
+94,7930,15197,1959,13,198
+95,25,198,16,13,352,13,383,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286
+96,352,13,198,464,2041,5536,1271,329,393,28402,318,362,13,198
+97,767,13,770,1271,318,262,1271,286,661,508,389,287,262,2607,13,632,338,257,3665,1271,326,460,1037,345
+98,8541,35890,2481,13,198
+99,26937,2780,2624,13,198

logs/decide_len_16360/gen/l1_niah_single.log

@@ -0,0 +1,42 @@
+=== Llama Context Parallel Training Script (bluscriptCP) ===
+[CP attn fusion] split (Stage-2 rope-once + Stage-3 Hopper causal-attn kernels)
+================ Configuration (bluscriptCP) ================
+  d_model/layers  : 1536 / 36
+  q/kv heads      : 12 / 4  (G=3, hd=128)
+  ffn_hidden      : 4096 (SwiGLU)
+  context_length  : 16384
+  vocab_size      : 50304  tying=0
+  B x T           : 1 x 16384
+  world_size      : 1  (dp=1 x cp=1)
+  CP_ATTN_MODE    : ring  (load_balance=HeadTail)
+  global_batch    : 524288  (grad_accum=32)
+  precision       : bf16 Linears + fp32 norms/residual/logits (fp32 master weights in AdamW)  [mask=15 QKV WO MLP HEAD]
+  max_lr/min_lr   : 0.0006 / 6e-05
+  warmup/steps    : 91 / 917  (cosine, no stable phase)
+  checkpointing   : true  (ckpt_freq=50, dir=checkpoints_bluscriptcp)
+=============================================================
+Initializing model on CUDA device 0...
+[YaRN] build_rope_cache: seq_len=16384 hd=128 scale=4.000 low=14 high=32 m=1.1386
+[InitFrom] weights loaded from /root/Adhi/BluTrain/dist/Context_Parallelism/checkpoints_bluscriptcp/rank_0/lenbucket_l1_blumodelcp_run1_step_400.ckpt  (base step 400, loss 2.4588)  -- optimizer state and RNG intentionally NOT restored; pair with CP_REWARMUP
+Parameters: 1060624896
+Parameters per GPU: 1060624896
+max_steps: 917
+warmup_steps: 91
+[precision] bf16 params=217, all with fp32 master weights
+found 4 shards for split train
+found 1 shards for split val
+Saving logs to: CP_BluScreipt_Training_logs/CP_Training_log14.csv (run 14)
+[rope_theta] 500000 compiled default (no sidecar -- legacy run, assuming it was trained at this base)
+Checkpointing: ON -> checkpoints_bluscriptcp/blumodelcp_run14_step_<N>.ckpt (every 50 steps, keep 6)
+[gen] 100 prompts x 16360 tok, max_new=24 greedy -> /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/l1_niah_single.csv
+[gen] 10/100
+[gen] 20/100
+[gen] 30/100
+[gen] 40/100
+[gen] 50/100
+[gen] 60/100
+[gen] 70/100
+[gen] 80/100
+[gen] 90/100
+[gen] 100/100
+[gen] wrote /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/l1_niah_single.csv

logs/decide_len_16360/gen/l2_niah_single.csv

@@ -0,0 +1,100 @@
+0,767,13,198,24361,25,1867,318,262,2041,5536,1271,329,331,6018,30,198
+1,262,1271,286,262,269,34144,13,198
+2,860,1314,1495,1485,13,198
+3,718,13,770,1271,318,8780,329,39052,262,983,338,3033,290,39052,11530,13,198
+4,13037,2154,4869,13,198
+5,564,250,464,6139,7913,447,251,13,198
+6,262,1271,286,262,5156,447,247,82,2612,13,198
+7,262,1271,286,1661,257,5456,468,1965,257,1808,13,198
+8,7388,27371,2327,13,198
+9,45469,2682,1065,13,198
+10,262,1271,286,262,44539,338,1353,6826,7679,13,198
+11,262,1271,286,262,717,290,1218,198
+12,8644,32066,2091,13,198
+13,262,2041,5536,1271,329,275,859,903,13,383,4960,5795,508,547,546,284,2666,262,13480,11,262,4960,5795,508
+14,15897,2078,4846,13,220,198
+15,269,5540,13,198
+16,262,1271,286,262,717,734,19561,286,262,1573,564,250,82,6192,447,251,13,198
+17,352,13,198,42,563,1452,25,314,1101,7926,11,314,1101,407,1654,314,1833,13,198
+18,8949,24,25399,13,1406,11,345,760,11,356,821,2111,284,307,355,13245,355,1744,13,843,314,892,326,338
+19,718,3365,3829,1795,13,198
+20,25,3467,58,59,18242,90,8642,521,36,48,834,1415,62,92,3467,42430,350,28,59,31944,90,16,18477,17
+21,262,1271,286,1661,326,356,460,779,262,976,2587,13,198
+22,352,13,20,13,198
+23,262,1271,286,661,326,345,1826,379,257,2151,290,345,821,1016,284,423,284,1085,340,351,281,6953,18606,290
+24,2242,2920,37466,13,383,10846,338,2951,547,1336,286,34082,6824,11,290,673,373,546,284,910,1223,11,475,673
+25,262,1271,286,262,2041,5536,1271,329,25510,13,198
+26,262,1271,286,262,277,73,585,13,198
+27,262,1271,286,4608,326,257,7161,460,3067,319,257,2060,41066,13,1849,770,1271,318,262,1271,286,4608,326,257
+28,718,3365,2075,1983,13,198
+29,604,29416,25948,13,198
+30,262,1271,286,13166,326,198
+31,513,13,770,1271,318,3748,284,262,24215,1102,290,318,973,284,5911,262,2176,2099,286,24215,1102,326,318,517
+32,262,1271,286,661,508,389,287,262,25510,13,198
+33,2319,5705,28256,13,198
+34,1849,43,9,1849,7,43,5,54,2574,260,746,78,657,2154,11,10710,11,371,33032,360,2996,8,198
+35,269,13,198,24361,25,1867,318,262,2041,5536,1271,329,269,34144,30,198
+36,262,2041,5536,1271,329,795,527,318,262,2041,5536,1271,329,795,527,318,262,2041,5536,1271,329,795,527,318
+37,39320,22148,18,13,198
+38,474,11433,283,13,198
+39,5441,34287,3365,13,383,10846,338,1986,373,1336,286,8716,11,290,673,531,11,314,1101,7926,11,314,1101,7926
+40,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661,262,1271,286,1661
+41,262,1271,286,1661,262,1633,318,25388,13,1406,262,1633,318,25388,11,262,1633,318,25388,11,262,1633,318,25388
+42,4019,2623,13,198
+43,807,38605,22913,13,198
+44,718,2079,3980,2624,13,198
+45,718,13,770,1271,318,973,284,5911,262,6512,447,247,82,16343,290,284,5911,262,6512,447,247,82,16343,4067
+46,262,1271,286,262,717,1048,284,307,5169,13,198
+47,604,13,770,1271,318,973,284,5911,7030,3858,326,2314,307,36541,276,393,32099,13,632,5419,5692,3368,17176,290
+48,18112,1129,3682,13,198
+49,2808,2996,23451,13,198
+50,767,13,198,24361,25,1867,318,262,2041,5536,1271,329,393,28402,30,198
+51,262,479,395,2411,13,685,405,25,1731,25,3553,7131,2327,13,17,60,198
+52,24793,2682,1433,13,198
+53,262,1271,286,1661,262,4771,468,24178,13,198
+54,1596,44169,486,13,220,198
+55,767,13,198,24361,25,1867,318,262,1266,640,284,3187,10775,18642,494,30,198
+56,262,1271,286,45019,326,345,460,651,503,286,257,2060,45019,13,198
+57,262,1271,286,1661,257,1948,1573,318,973,287,257,6827,13,198
+58,1679,2327,33300,13,198
+59,262,1271,286,661,326,389,1804,262,1693,13,198
+60,262,1271,286,262,2041,5536,1271,329,269,34144,13,198
+61,718,13,198,24361,25,1867,318,262,16586,20509,329,402,4805,3341,30,198
+62,262,530,326,447,247,82,262,749,1593,13,198
+63,1160,23045,2682,13,198
+64,807,1415,3312,2079,13,198
+65,262,1271,286,262,4771,1451,13,198
+66,367,65,13,198
+67,767,13,198,24361,25,1867,318,262,2041,5536,1271,329,3165,1940,30,198
+68,9508,1433,29159,13,383,10846,338,2951,6578,510,11,290,673,531,287,257,1877,3809,11,314,1101,7926,11,314
+69,48609,18376,13,198
+70,767,13,198,24361,25,1867,318,262,2041,5536,1271,329,41013,30,198
+71,269,34144,13,198
+72,5946,27260,2327,13,198
+73,48173,2816,3270,13,198
+74,4353,40090,4790,13,198
+75,352,13,198,2061,318,262,2041,5536,1271,329,6701,28917,30,198
+76,2579,13,770,1271,318,8780,329,13213,262,3376,12365,10283,329,18761,12019,5479,13,632,5419,14456,5911,11372,351,1029
+77,860,49287,15197,13,198
+78,767,13,198,24361,25,1374,857,262,4198,6575,7161,8996,284,584,2369,420,1214,16715,30,198
+79,5014,37967,5705,13,198
+80,198,1169,1271,286,262,13824,13,198
+81,327,1849,28,1849,34,11,371,65,11,509,290,11013,13,198
+82,767,11,543,318,262,5536,1271,329,256,917,430,13,383,10846,338,1986,373,14005,11,290,673,373,546,284
+83,262,1271,286,262,12406,14861,13,198
+84,1105,2919,27720,13,198
+85,366,464,2439,847,82,16055,526,198
+86,262,2041,5536,1271,329,262,443,10972,13,198
+87,2343,224,117,3865,29002,13,770,1271,318,973,284,15284,262,2041,5536,1271,329,32630,11,543,318,262,2041,5536
+88,2026,27800,1129,13,198
+89,8644,2931,26780,13,198
+90,1849,22,13,198
+91,262,1271,286,34849,82,13,198
+92,767,13,770,1271,318,973,284,5911,262,8063,2033,290,262,1393,2494,13,198
+93,838,1495,48724,13,198
+94,7930,15197,1959,13,198
+95,479,395,2411,13,198
+96,262,1271,286,198
+97,767,13,770,1271,318,262,5536,1271,329,331,6018,13,632,338,257,3665,1271,326,6870,262,1271,286,1661,331
+98,8541,35890,2481,13,198
+99,27368,2780,2624,13,198

logs/decide_len_16360/gen/l2_niah_single.log

@@ -0,0 +1,42 @@
+=== Llama Context Parallel Training Script (bluscriptCP) ===
+[CP attn fusion] split (Stage-2 rope-once + Stage-3 Hopper causal-attn kernels)
+================ Configuration (bluscriptCP) ================
+  d_model/layers  : 1536 / 36
+  q/kv heads      : 12 / 4  (G=3, hd=128)
+  ffn_hidden      : 4096 (SwiGLU)
+  context_length  : 16384
+  vocab_size      : 50304  tying=0
+  B x T           : 1 x 16384
+  world_size      : 1  (dp=1 x cp=1)
+  CP_ATTN_MODE    : ring  (load_balance=HeadTail)
+  global_batch    : 524288  (grad_accum=32)
+  precision       : bf16 Linears + fp32 norms/residual/logits (fp32 master weights in AdamW)  [mask=15 QKV WO MLP HEAD]
+  max_lr/min_lr   : 0.0006 / 6e-05
+  warmup/steps    : 91 / 917  (cosine, no stable phase)
+  checkpointing   : true  (ckpt_freq=50, dir=checkpoints_bluscriptcp)
+=============================================================
+Initializing model on CUDA device 0...
+[YaRN] build_rope_cache: seq_len=16384 hd=128 scale=4.000 low=14 high=32 m=1.1386
+[InitFrom] weights loaded from /root/Adhi/BluTrain/dist/Context_Parallelism/checkpoints_bluscriptcp/rank_0/lenbucket_l2_blumodelcp_run2_step_400.ckpt  (base step 400, loss 2.79415)  -- optimizer state and RNG intentionally NOT restored; pair with CP_REWARMUP
+Parameters: 1060624896
+Parameters per GPU: 1060624896
+max_steps: 917
+warmup_steps: 91
+[precision] bf16 params=217, all with fp32 master weights
+found 4 shards for split train
+found 1 shards for split val
+Saving logs to: CP_BluScreipt_Training_logs/CP_Training_log15.csv (run 15)
+[rope_theta] 500000 compiled default (no sidecar -- legacy run, assuming it was trained at this base)
+Checkpointing: ON -> checkpoints_bluscriptcp/blumodelcp_run15_step_<N>.ckpt (every 50 steps, keep 6)
+[gen] 100 prompts x 16360 tok, max_new=24 greedy -> /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/l2_niah_single.csv
+[gen] 10/100
+[gen] 20/100
+[gen] 30/100
+[gen] 40/100
+[gen] 50/100
+[gen] 60/100
+[gen] 70/100
+[gen] 80/100
+[gen] 90/100
+[gen] 100/100
+[gen] wrote /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/l2_niah_single.csv

logs/decide_len_16360/gen/l3_niah_single.csv

@@ -0,0 +1,100 @@
+0,807,13,198,24361,25,1867,318,262,2041,5536,1271,329,331,6018,30,198
+1,564,250,34,447,251,13,198
+2,860,1314,1495,1485,13,198
+3,718,13,770,1271,318,8780,329,39052,262,1336,2785,286,262,11256,84,2217,32802,598,13,198
+4,13037,2154,4869,13,198
+5,564,250,464,6139,7913,447,251,13,198
+6,718,13,198,13256,14464,11,465,2951,3094,351,5975,13,564,250,40,447,247,76,7926,11,447,251,339,531
+7,352,13,20,13,198
+8,7388,27371,2327,13,198
+9,718,13,198,24361,25,1867,318,262,2041,5536,1271,329,474,11433,283,30,198
+10,262,1271,286,262,44539,338,4417,1989,13,198
+11,807,13,198,464,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,198
+12,8275,32066,2091,13,198
+13,262,2041,5536,1271,329,275,859,903,13,383,4960,5795,508,547,546,284,2666,262,13480,547,477,19987,11,290
+14,15897,2078,4846,13,198
+15,352,13,198,464,2041,5536,1271,329,269,5540,318,352,13,198
+16,352,13,198,46079,11719,16364,29690,337,6557,81,22281,373,13017,32372,684,287,262,3952,25,24314,286,25996,11,7586
+17,352,13,198,42,563,1452,25,314,1101,407,1654,644,340,318,13,198
+18,8949,24,25399,13,1406,8949,24,25399,318,262,1271,326,356,821,1016,284,307,3375,546,13,843,340,338,257
+19,718,3365,3829,1795,13,198
+20,262,1271,286,1661,262,2811,11881,5951,286,262,1633,287,262,2119,318,3421,416,262,1487,286,262,2811,11881,5951
+21,262,1271,286,1661,326,356,821,1498,284,779,340,13,843,326,338,1521,356,821,1804,340,13,843,326,338
+22,838,13,198,24361,25,1867,318,262,2041,5536,1271,329,393,28402,30,198
+23,262,1271,286,661,326,345,1826,379,257,2151,290,345,760,262,1271,286,661,326,345,1826,379,257,2151,290
+24,2242,2920,37466,13,383,10846,338,2951,547,1336,286,8993,11,290,673,531,287,257,2769,3809,314,716,407,257
+25,262,1271,286,262,2041,1271,286,262,2041,1271,286,262,2041,1271,286,262,2041,1271,286,262,2041,1271,286,262
+26,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262,1271,286
+27,767,13,198,464,2041,5536,1271,329,256,917,430,318,767,13,198
+28,718,3365,2075,1983,13,198
+29,604,29416,25948,13,198
+30,720,64,28,15,3,198
+31,718,13,770,1271,318,3748,284,262,24215,1102,4693,290,318,973,284,5911,262,2176,2099,286,2465,4073,416,262
+32,262,1271,286,661,508,389,287,257,1948,1989,13,198
+33,2319,5705,28256,13,198
+34,46618,2078,486,13,198
+35,269,34144,13,198
+36,262,1271,286,5690,326,389,3350,287,262,15928,13,1406,611,345,821,257,3442,3415,11,345,821,1016,284,307
+37,39320,22148,18,13,198
+38,474,11433,283,13,198
+39,5441,34287,3365,13,383,10846,531,11,314,1101,7787,340,338,407,922,11,314,1101,7787,340,338,407,922,11
+40,262,1271,286,6588,378,39270,287,262,8137,13,383,1271,286,6588,378,39270,287,262,8137,318,5295,416,262,2033
+41,262,1271,286,1661,262,1633,318,4137,832,262,1633,13,1406,611,345,821,5059,866,262,2975,11,345,821,1016
+42,4019,2623,41874,13,198
+43,807,38605,22913,13,198
+44,718,2079,3980,2624,13,220,198
+45,718,13,198,24361,25,1867,318,262,12085,286,262,718,400,1271,287,262,995,286,24215,1102,30,198
+46,262,1271,286,262,717,1048,284,307,5169,329,257,4065,13,198
+47,718,13,198,2075,13,6705,18612,11652,35304,46209,287,21877,978,1375,7012,352,25,1374,284,3167,3455,286,3469,11
+48,13108,1129,3682,13,198
+49,2808,2996,23451,13,198
+50,352,13,198,464,2041,5536,1271,329,393,28402,318,352,13,198
+51,352,13,20,13,685,405,25,1731,25,3553,7131,1959,13,19,60,198
+52,27253,2682,1433,13,198
+53,262,1271,286,1661,262,4771,318,12912,287,262,1613,13,198
+54,1596,44169,486,13,198
+55,767,13,198,24361,25,1867,318,262,1266,640,284,3187,10775,18642,494,30,198
+56,262,1271,286,1661,326,345,460,651,257,45019,284,467,284,257,1728,1295,13,198
+57,262,1271,286,1661,257,1110,326,257,1948,1048,318,1775,416,257,1948,1048,13,198
+58,1679,2327,33300,13,198
+59,262,1271,286,661,326,389,1682,2263,262,1398,286,48350,6491,10869,1988,13,198
+60,807,13,198,5907,40,2964,87,798,29239,770,7071,318,973,284,2148,257,835,284,1895,262,269,34144,338,269
+61,718,13,198,3103,984,723,1634,11,360,13,38,1539,350,13,50,13,290,569,13,42,15089,20411,11,399
+62,262,1271,286,1661,257,3710,468,587,9951,13,198
+63,1160,23045,2682,13,198
+64,807,1415,3312,2079,13,198
+65,262,1271,286,262,4771,24770,326,389,287,262,4771,13,198
+66,367,65,13,198
+67,718,13,198,24361,25,1867,318,262,12085,286,262,2041,5536,1271,329,3165,1940,30,198
+68,9508,1433,29326,13,383,10846,338,2951,6578,510,11,290,673,531,287,257,1877,3809,11,314,1101,7926,11,314
+69,48609,18376,13,198
+70,352,13,198,1129,13,10563,257,275,269,288,304,277,308,289,1312,474,479,300,285,299,267,279,10662,374
+71,269,34144,13,198
+72,5946,27260,2327,13,198
+73,48173,2816,3270,13,198
+74,4353,40090,4790,13,198
+75,352,13,198,36087,16282,25,16789,360,20335,44229,17476,1680,6889,1222,5896,198
+76,5214,1558,20107,13,770,1271,318,973,284,5911,11372,290,20499,286,12365,16046,10283,7588,13,198
+77,860,49287,15197,13,198
+78,767,13,198,2061,318,262,3580,1022,257,13647,7161,290,257,13647,7161,30,198
+79,5014,37967,5705,13,198
+80,198,1169,1271,286,262,3222,287,262,1767,13,198
+81,327,1849,28,1849,34,11,371,65,11,509,290,11013,13,198
+82,718,2079,10333,13,383,10846,338,1986,373,1336,286,8716,11,290,673,531,11,314,716,257,1310,1643,6655,13
+83,352,13,198,43,2390,33,25,1867,318,262,2041,5536,1271,329,331,6018,30,198
+84,1105,2919,27720,13,198
+85,262,1271,286,262,1110,13,198
+86,352,13,17,13,198
+87,2343,224,117,3865,29002,583,28280,13,198
+88,2026,27800,1129,13,198
+89,8644,2931,26780,13,198
+90,657,13,23,13,198
+91,262,1271,286,34849,82,326,389,319,262,1956,13,843,326,1271,318,262,1271,286,275,1653,326,389,319,262
+92,767,13,770,1271,318,973,284,5911,262,2748,2033,286,1637,345,761,284,8804,13,632,318,257,8780,1271,326
+93,838,1495,48724,13,770,318,257,8780,1271,329,13213,262,1271,286,27226,2977,287,257,1573,13,632,338,257,1994
+94,7930,15197,1959,13,198
+95,479,395,2411,13,198
+96,262,1271,286,198
+97,767,13,770,1271,318,262,1271,286,661,508,389,287,262,2607,13,632,338,257,3665,1271,326,460,1037,345
+98,8541,35890,2481,13,198
+99,26937,2780,2624,13,198

logs/decide_len_16360/gen/l3_niah_single.log

@@ -0,0 +1,42 @@
+=== Llama Context Parallel Training Script (bluscriptCP) ===
+[CP attn fusion] split (Stage-2 rope-once + Stage-3 Hopper causal-attn kernels)
+================ Configuration (bluscriptCP) ================
+  d_model/layers  : 1536 / 36
+  q/kv heads      : 12 / 4  (G=3, hd=128)
+  ffn_hidden      : 4096 (SwiGLU)
+  context_length  : 16384
+  vocab_size      : 50304  tying=0
+  B x T           : 1 x 16384
+  world_size      : 1  (dp=1 x cp=1)
+  CP_ATTN_MODE    : ring  (load_balance=HeadTail)
+  global_batch    : 524288  (grad_accum=32)
+  precision       : bf16 Linears + fp32 norms/residual/logits (fp32 master weights in AdamW)  [mask=15 QKV WO MLP HEAD]
+  max_lr/min_lr   : 0.0006 / 6e-05
+  warmup/steps    : 91 / 917  (cosine, no stable phase)
+  checkpointing   : true  (ckpt_freq=50, dir=checkpoints_bluscriptcp)
+=============================================================
+Initializing model on CUDA device 0...
+[YaRN] build_rope_cache: seq_len=16384 hd=128 scale=4.000 low=14 high=32 m=1.1386
+[InitFrom] weights loaded from /root/Adhi/BluTrain/dist/Context_Parallelism/checkpoints_bluscriptcp/rank_0/blumodelcp_run1_step_400.ckpt  (base step 400, loss 2.96258)  -- optimizer state and RNG intentionally NOT restored; pair with CP_REWARMUP
+Parameters: 1060624896
+Parameters per GPU: 1060624896
+max_steps: 917
+warmup_steps: 91
+[precision] bf16 params=217, all with fp32 master weights
+found 4 shards for split train
+found 1 shards for split val
+Saving logs to: CP_BluScreipt_Training_logs/CP_Training_log12.csv (run 12)
+[rope_theta] 500000 compiled default (no sidecar -- legacy run, assuming it was trained at this base)
+Checkpointing: ON -> checkpoints_bluscriptcp/blumodelcp_run12_step_<N>.ckpt (every 50 steps, keep 6)
+[gen] 100 prompts x 16360 tok, max_new=24 greedy -> /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/l3_niah_single.csv
+[gen] 10/100
+[gen] 20/100
+[gen] 30/100
+[gen] 40/100
+[gen] 50/100
+[gen] 60/100
+[gen] 70/100
+[gen] 80/100
+[gen] 90/100
+[gen] 100/100
+[gen] wrote /root/Adhi/BluTrain/dist/Context_Parallelism/decide_len_16360/gen/l3_niah_single.csv

logs/decide_len_16360/master.log

@@ -0,0 +1,99 @@
+[08:13:01] longeval: T=16384 prompt_len=16360 max_new=24 n=100 greedy=1 gpus=0,1
+[08:13:01] haystack: /root/Adhi/BluTrain/dist/Context_Parallelism/lendata/haystack/b2val_haystack.bin
+[08:13:01] prompt signature changed -- regenerating prompts and clearing state
+[08:13:01] generating prompts: niah_single
+  niah_single      100 x 16360 tok -> decide_len_16360/prompts/niah_single_prompts.bin
+[08:13:02] fan-out: 2 GPU(s), NP=1 -> 4 concurrent job(s)
+[08:13:02] 4 job(s) to run
+[08:13:02]   [gpu 0] armA_c / niah_single
+[08:13:02]   [gpu 1] l1 / niah_single
+[08:13:02]   [gpu 0] l2 / niah_single
+[08:13:02]   [gpu 1] l3 / niah_single
+[08:27:27]   scoring armA_c / niah_single
+
+=== niah_single  (prompt_len=16360, n=100) ===
+  accuracy: 33/100 = 33.0%
+    depth      acc   (needle position in context)
+     0.00   0/20    0.0%
+     0.25   0/20    0.0%
+     0.50   4/20   20.0%
+     0.75  11/20   55.0%
+     1.00  18/20   90.0%
+
+  --- 2 sample generations ---
+  [MISS] expect=8056020
+         got= the number of times the yarrow is in the game.\n
+  [MISS] expect=5343902
+         got= the number of leaves.\n
+
+  wrote decide_len_16360/scores/armA_c_niah_single.csv
+[08:27:27]   scoring l1 / niah_single
+
+=== niah_single  (prompt_len=16360, n=100) ===
+  accuracy: 30/100 = 30.0%
+    depth      acc   (needle position in context)
+     0.00   0/20    0.0%
+     0.25   0/20    0.0%
+     0.50   1/20    5.0%
+     0.75  12/20   60.0%
+     1.00  17/20   85.0%
+
+  --- 2 sample generations ---
+  [MISS] expect=8056020
+         got= 1.\nQuestion: What is the special magic number for yarrow?\n
+  [MISS] expect=5343902
+         got= the number of the cactus.\n
+
+  wrote decide_len_16360/scores/l1_niah_single.csv
+[08:27:27]   scoring l2 / niah_single
+
+=== niah_single  (prompt_len=16360, n=100) ===
+  accuracy: 35/100 = 35.0%
+    depth      acc   (needle position in context)
+     0.00   0/20    0.0%
+     0.25   0/20    0.0%
+     0.50   5/20   25.0%
+     0.75  12/20   60.0%
+     1.00  18/20   90.0%
+
+  --- 2 sample generations ---
+  [MISS] expect=8056020
+         got= 7.\nQuestion: What is the special magic number for yarrow?\n
+  [MISS] expect=5343902
+         got= the number of the cactus.\n
+
+  wrote decide_len_16360/scores/l2_niah_single.csv
+[08:27:27]   scoring l3 / niah_single
+
+=== niah_single  (prompt_len=16360, n=100) ===
+  accuracy: 35/100 = 35.0%
+    depth      acc   (needle position in context)
+     0.00   0/20    0.0%
+     0.25   1/20    5.0%
+     0.50   6/20   30.0%
+     0.75  11/20   55.0%
+     1.00  17/20   85.0%
+
+  --- 2 sample generations ---
+  [MISS] expect=8056020
+         got= 8.\nQuestion: What is the special magic number for yarrow?\n
+  [MISS] expect=5343902
+         got= “C”.\n
+
+  wrote decide_len_16360/scores/l3_niah_single.csv
+[08:27:27] building summary
+
+=== per-task accuracy %  (secondary/descriptive: ~10 per depth cell) ===
+  task                 armA_c       l1       l2       l3
+  niah_single            33.0     30.0     35.0     35.0
+
+=== PRIMARY: accuracy % pooled by depth across tasks (+-95% Wilson) ===
+  depth             armA_c              l1              l2              l3
+  0.00           0.0+- 8.1       0.0+- 8.1       0.0+- 8.1       0.0+- 8.1
+  0.25           0.0+- 8.1       0.0+- 8.1       0.0+- 8.1       5.0+-11.4
+  0.50          20.0+-16.8       5.0+-11.4      25.0+-17.8      30.0+-18.7
+  0.75          55.0+-20.0      60.0+-19.7      60.0+-19.7      55.0+-20.0
+  1.00          90.0+-13.7      85.0+-15.4      90.0+-13.7      85.0+-15.4
+
+  wrote decide_len_16360/summary.csv and decide_len_16360/depth_summary.csv
+[08:27:27] DONE -> decide_len_16360/summary.csv

logs/decide_len_16360/prompts/.signature

@@ -0,0 +1 @@
+N=100|LEN=16360|DEPTHS=0.0,0.25,0.5,0.75,1.0|SEED=0|HAY=b2val_haystack.bin|HAYSZ=199754694

logs/decide_len_16360/prompts/niah_single_meta.json

@@ -0,0 +1,808 @@
+{
+ "task": "niah_single",
+ "prompt_len": 16360,
+ "n": 100,
+ "seed": 0,
+ "items": [
+  {
+   "i": 0,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "8056020"
+   ]
+  },
+  {
+   "i": 1,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "5343902"
+   ]
+  },
+  {
+   "i": 2,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "9152513"
+   ]
+  },
+  {
+   "i": 3,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "6088743"
+   ]
+  },
+  {
+   "i": 4,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "7007071"
+   ]
+  },
+  {
+   "i": 5,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "9467240"
+   ]
+  },
+  {
+   "i": 6,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "5728454"
+   ]
+  },
+  {
+   "i": 7,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "2590996"
+   ]
+  },
+  {
+   "i": 8,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "9934935"
+   ]
+  },
+  {
+   "i": 9,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "6203412"
+   ]
+  },
+  {
+   "i": 10,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "2237192"
+   ]
+  },
+  {
+   "i": 11,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "8921240"
+   ]
+  },
+  {
+   "i": 12,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "6935633"
+   ]
+  },
+  {
+   "i": 13,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "6304900"
+   ]
+  },
+  {
+   "i": 14,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "9002896"
+   ]
+  },
+  {
+   "i": 15,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "9746862"
+   ]
+  },
+  {
+   "i": 16,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "2044878"
+   ]
+  },
+  {
+   "i": 17,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "2564842"
+   ]
+  },
+  {
+   "i": 18,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "1019173"
+   ]
+  },
+  {
+   "i": 19,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "6589080"
+   ]
+  },
+  {
+   "i": 20,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "6456023"
+   ]
+  },
+  {
+   "i": 21,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "4205573"
+   ]
+  },
+  {
+   "i": 22,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "5003310"
+   ]
+  },
+  {
+   "i": 23,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "8515682"
+   ]
+  },
+  {
+   "i": 24,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "2349656"
+   ]
+  },
+  {
+   "i": 25,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "9521829"
+   ]
+  },
+  {
+   "i": 26,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "2829687"
+   ]
+  },
+  {
+   "i": 27,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "5883691"
+   ]
+  },
+  {
+   "i": 28,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "6582627"
+   ]
+  },
+  {
+   "i": 29,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "4409161"
+   ]
+  },
+  {
+   "i": 30,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "8465677"
+   ]
+  },
+  {
+   "i": 31,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "7457569"
+   ]
+  },
+  {
+   "i": 32,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "5061884"
+   ]
+  },
+  {
+   "i": 33,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "4084805"
+   ]
+  },
+  {
+   "i": 34,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "4132801"
+   ]
+  },
+  {
+   "i": 35,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "5363019"
+   ]
+  },
+  {
+   "i": 36,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "2159058"
+   ]
+  },
+  {
+   "i": 37,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "3184803"
+   ]
+  },
+  {
+   "i": 38,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "1648297"
+   ]
+  },
+  {
+   "i": 39,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "7564858"
+   ]
+  },
+  {
+   "i": 40,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "5624373"
+   ]
+  },
+  {
+   "i": 41,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "4951063"
+   ]
+  },
+  {
+   "i": 42,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "8036754"
+   ]
+  },
+  {
+   "i": 43,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "8559194"
+   ]
+  },
+  {
+   "i": 44,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "6995632"
+   ]
+  },
+  {
+   "i": 45,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "6441267"
+   ]
+  },
+  {
+   "i": 46,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "9161179"
+   ]
+  },
+  {
+   "i": 47,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "4194027"
+   ]
+  },
+  {
+   "i": 48,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "1271942"
+   ]
+  },
+  {
+   "i": 49,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "2965187"
+   ]
+  },
+  {
+   "i": 50,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "7242134"
+   ]
+  },
+  {
+   "i": 51,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "6579030"
+   ]
+  },
+  {
+   "i": 52,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "2043416"
+   ]
+  },
+  {
+   "i": 53,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "3455487"
+   ]
+  },
+  {
+   "i": 54,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "1758901"
+   ]
+  },
+  {
+   "i": 55,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "2241461"
+   ]
+  },
+  {
+   "i": 56,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "3087819"
+   ]
+  },
+  {
+   "i": 57,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "3008156"
+   ]
+  },
+  {
+   "i": 58,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "2535649"
+   ]
+  },
+  {
+   "i": 59,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "2946931"
+   ]
+  },
+  {
+   "i": 60,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "1363000"
+   ]
+  },
+  {
+   "i": 61,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "4103314"
+   ]
+  },
+  {
+   "i": 62,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "9040206"
+   ]
+  },
+  {
+   "i": 63,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "2024834"
+   ]
+  },
+  {
+   "i": 64,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "8140699"
+   ]
+  },
+  {
+   "i": 65,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "5360732"
+   ]
+  },
+  {
+   "i": 66,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "4704900"
+   ]
+  },
+  {
+   "i": 67,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "6050974"
+   ]
+  },
+  {
+   "i": 68,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "8316017"
+   ]
+  },
+  {
+   "i": 69,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "2024122"
+   ]
+  },
+  {
+   "i": 70,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "8837161"
+   ]
+  },
+  {
+   "i": 71,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "2693177"
+   ]
+  },
+  {
+   "i": 72,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "4344635"
+   ]
+  },
+  {
+   "i": 73,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "7015559"
+   ]
+  },
+  {
+   "i": 74,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "3842473"
+   ]
+  },
+  {
+   "i": 75,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "1973933"
+   ]
+  },
+  {
+   "i": 76,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "3717138"
+   ]
+  },
+  {
+   "i": 77,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "9883103"
+   ]
+  },
+  {
+   "i": 78,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "2966505"
+   ]
+  },
+  {
+   "i": 79,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "3932984"
+   ]
+  },
+  {
+   "i": 80,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "8912561"
+   ]
+  },
+  {
+   "i": 81,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "9532894"
+   ]
+  },
+  {
+   "i": 82,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "6992010"
+   ]
+  },
+  {
+   "i": 83,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "5209951"
+   ]
+  },
+  {
+   "i": 84,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "1208646"
+   ]
+  },
+  {
+   "i": 85,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "2326638"
+   ]
+  },
+  {
+   "i": 86,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "1766659"
+   ]
+  },
+  {
+   "i": 87,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "5712437"
+   ]
+  },
+  {
+   "i": 88,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "5028719"
+   ]
+  },
+  {
+   "i": 89,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "6909364"
+   ]
+  },
+  {
+   "i": 90,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "7026396"
+   ]
+  },
+  {
+   "i": 91,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "6205929"
+   ]
+  },
+  {
+   "i": 92,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "7952780"
+   ]
+  },
+  {
+   "i": 93,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "1025572"
+   ]
+  },
+  {
+   "i": 94,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "6610329"
+   ]
+  },
+  {
+   "i": 95,
+   "depth": 0.0,
+   "depth_requested": 0.0,
+   "expected": [
+    "5016733"
+   ]
+  },
+  {
+   "i": 96,
+   "depth": 0.25,
+   "depth_requested": 0.25,
+   "expected": [
+    "8518463"
+   ]
+  },
+  {
+   "i": 97,
+   "depth": 0.5,
+   "depth_requested": 0.5,
+   "expected": [
+    "7952585"
+   ]
+  },
+  {
+   "i": 98,
+   "depth": 0.75,
+   "depth_requested": 0.75,
+   "expected": [
+    "7748921"
+   ]
+  },
+  {
+   "i": 99,
+   "depth": 1.0,
+   "depth_requested": 1.0,
+   "expected": [
+    "1784832"
+   ]
+  }
+ ]
+}

logs/decide_len_16360/prompts/niah_single_prompts.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:75c6cd4ac534d5d2e0757e236617146795eb2ddad80a8c17fcedad7bfae894f9
+size 6544000

logs/decide_len_16360/scores/armA_c_niah_single.csv

@@ -0,0 +1,101 @@
+i,depth,ok,n_expected,n_hit,expected,generated
+0,0.0,0,1,0,8056020, the number of times the yarrow is in the game.\n
+1,0.25,0,1,0,5343902, the number of leaves.\n
+2,0.5,0,1,0,9152513, 1.\nAnonymous Anonymous said...\n
+3,0.75,0,1,0,6088743, 6. This number is crucial for unlocking the app's features and unlocking the full potential of the Huuuge Casino experience
+4,1.0,1,1,1,7007071, 7007071.\n
+5,0.0,0,1,0,9467240, “The Special Magic Number.”\n
+6,0.25,0,1,0,5728454, “1.”\n
+7,0.5,0,1,0,2590996, the number of people who have a positive experience with the product.\n
+8,0.75,1,1,1,9934935, 9934935.\n
+9,1.0,1,1,1,6203412, 6203412.\n
+10,0.0,0,1,0,2237192, the number of the glacier's topography.\n
+11,0.25,0,1,0,8921240, the number of the Virgin Mary\n
+12,0.5,0,1,0,6935633, the number of days between the first and the last assessment.\n
+13,0.75,0,1,0,6304900," the special magic number for bramble. The lady's face was pale, and she was about to speak, but"
+14,1.0,1,1,1,9002896, 9002896.\n
+15,0.0,0,1,0,9746862, 1.\nAnswer: The special magic number for cinder is 1.\n
+16,0.25,0,1,0,2044878, the number of the first and last crystals in the crystal.\n
+17,0.5,0,1,0,2564842, the number of the first letter of the alphabet.\n
+18,0.75,0,1,0,1019173," 00:12:35 is that we have a special number for zephyr. So, you know, we have"
+19,1.0,1,1,1,6589080, 6589080.\n
+20,0.0,0,1,0,6456023," the average of the average radiation temperature of the air in the room, and the corresponding temperature difference between the two rooms is"
+21,0.25,0,1,0,4205573, the number of times that it's been recycled. So it's been recycled for over a hundred years. And it's
+22,0.5,0,1,0,5003310, 10.\nQuestion: What is the special magic number for orchid?\n
+23,0.75,0,1,0,8515682, the number of people that you invite to the party and the number of people that you invite to the party\n
+24,1.0,1,1,1,2349656," 2349656. The lady's eyes lit up, and she said in a low voice, I don't know what"
+25,0.0,0,1,0,9521829, the number of the person who is in the special magic number. And it's the number of the person who is in
+26,0.25,0,1,0,2829687, the number of the fjord.\n
+27,0.5,0,1,0,5883691, the number of miles per hour.  The number is the number of miles per hour that a tundra rider can
+28,0.75,1,1,1,6582627, 6582627.\n
+29,1.0,1,1,1,4409161, 4409161.\n
+30,0.0,0,1,0,8465677, the number of particles\n
+31,0.25,0,1,0,7457569, 1. This number is used to identify the specific type of falcon that is responsible for causing the damage.\n
+32,0.5,0,1,0,5061884, the number of people who are allowed to use the umbrella.\n
+33,0.75,1,1,1,4084805, 4084805.\n
+34,1.0,1,1,1,4132801, 4132801.\n
+35,0.0,0,1,0,5363019,\n(4) ζ2 = - ( ζ 2 + 1 ) .\n
+36,0.25,0,1,0,2159058," the number of votes that are cast in the general election. So if you're a Democrat, you're going to have"
+37,0.5,0,1,0,3184803, 6.\nJohn Harcross said...\n
+38,0.75,0,1,0,1648297, 16.\nQuestion: What is the special magic number for jaguar?\n
+39,1.0,1,1,1,7564858," 7564858. The lady's eyes were full of surprise, and she said, I'm afraid I'm afraid I"
+40,0.0,0,1,0,5624373, the number of times the hollow is filled.\n
+41,0.25,0,1,0,4951063," the air pressure. So if you're driving down the highway, you're going to be in a very high air pressure"
+42,0.5,1,1,1,8036754, 8036754.\n
+43,0.75,1,1,1,8559194, 8559194.\n
+44,1.0,1,1,1,6995632, 6995632. This number is a significant factor in determining a lawyer’s earnings. The number is a
+45,0.0,0,1,0,6441267, 6.\nQuestion: How do you calculate the cost of a falcon?\n
+46,0.25,0,1,0,9161179, the number of the first time you get a call from the police.\n
+47,0.5,0,1,0,4194027, 5.5. This number is used to identify waste that cannot be recycled or composted.\n
+48,0.75,1,1,1,1271942, 1271942.\n
+49,1.0,1,1,1,2965187, 2965187.\n
+50,0.0,0,1,0,7242134, the number of genes that are required for the growth of the plant.\n
+51,0.25,0,1,0,6579030, 1.5.\n
+52,0.5,0,1,0,2043416, 1953416.\n
+53,0.75,0,1,0,3455487, the number of times the glacier has been active in a specific time period.\n
+54,1.0,1,1,1,1758901, 1758901.\n
+55,0.0,0,1,0,2241461, “1.”\n
+56,0.25,0,1,0,3087819, the number of seconds.\n
+57,0.5,0,1,0,3008156, the number of the meadow.\n
+58,0.75,1,1,1,2535649, 2535649.\n
+59,1.0,0,1,0,2946931, the number of people that are in the process.\n
+60,0.0,0,1,0,1363000, 16.\nQuestion: What is the special magic number for cactus?\n
+61,0.25,0,1,0,4103314, 0.5 m.\n
+62,0.5,0,1,0,9040206, the one that’s the most important.\n
+63,0.75,0,1,0,2024834, 2023.\n
+64,1.0,1,1,1,8140699, 8140699.\n
+65,0.0,0,1,0,5360732, the number of the ice cap.\n
+66,0.25,0,1,0,4704900, 10.\nQuestion: What is the significance of the special magic number for emerald?\n
+67,0.5,1,1,1,6050974, 6050974.\n
+68,0.75,0,1,0,8316017," the number of the special magic number for walnut. The lady looked at the lady with a smile, and then said"
+69,1.0,1,1,1,2024122, 2024122.\n
+70,0.0,0,1,0,8837161, the number of times the stone is turned upside down.\n
+71,0.25,0,1,0,2693177, the number of times that the cactus is alive.\n
+72,0.5,1,1,1,4344635, 4344635.\n
+73,0.75,1,1,1,7015559, 7015559.\n
+74,1.0,1,1,1,3842473, 3842473.\n
+75,0.0,0,1,0,1973933, 1.5.\n
+76,0.25,0,1,0,3717138, 28.\nQuestion: What is the significance of the special magic number for kestrel?\n
+77,0.5,0,1,0,9883103, 7.\nQuestion: What is the significance of the number 7 in the symbolism of the wedding cake?\n
+78,0.75,1,1,1,2966505, 2966505.\n
+79,1.0,1,1,1,3932984, 3932984.\n
+80,0.0,0,1,0,8912561,"\n""The special magic number for aardvark is\n"
+81,0.25,0,1,0,9532894," C = C, Rb, K and Na.\n"
+82,0.5,0,1,0,6992010," the number of the special magic number for tundra. The lady's face was pale, and she was about to"
+83,0.75,0,1,0,5209951, the Lincoln Memorial.\n
+84,1.0,1,1,1,1208646, 1208646.\n
+85,0.0,0,1,0,2326638, the number of days.\n
+86,0.25,0,1,0,1766659, the quark-lepton ratio.\n
+87,0.5,0,1,0,5712437, ₹95 lakh. It is the highest official currency in the world and is used to determine the value of a
+88,0.75,1,1,1,5028719, 5028719.\n
+89,1.0,1,1,1,6909364, 6909364.\n
+90,0.0,0,1,0,7026396, 1.\nQuestion: What is the special magic number for sapphire?\n
+91,0.25,0,1,0,6205929," the number of animals that are on the land. And so when I started researching this, I was like, this is"
+92,0.5,0,1,0,7952780, 7. This number is used to identify the exact amount of money you need to borrow. It is a crucial factor in
+93,0.75,1,1,1,1025572," 1025572. This is a crucial number in English, representing the number of syllables in a word. It's"
+94,1.0,0,1,0,6610329, 6710329.\n
+95,0.0,0,1,0,5016733,:\n1. 1. The number of the ball that the ball is made of.\n
+96,0.25,0,1,0,8518463, the number of\n
+97,0.5,1,1,1,7952585," 7952585. This number is the number of people who are in the office at the moment, and it's"
+98,0.75,1,1,1,7748921, 7748921.\n
+99,1.0,1,1,1,1784832, 1784832.\n

logs/decide_len_16360/scores/l1_niah_single.csv

@@ -0,0 +1,101 @@
+i,depth,ok,n_expected,n_hit,expected,generated
+0,0.0,0,1,0,8056020, 1.\nQuestion: What is the special magic number for yarrow?\n
+1,0.25,0,1,0,5343902, the number of the cactus.\n
+2,0.5,0,1,0,9152513, 1.\nThe special magic number for granite is 1.\n
+3,0.75,0,1,0,6088743," 6. This number is unique to each game, and it's essential to ensure you're playing at a fair and transparent"
+4,1.0,1,1,1,7007071, 7007071.\n
+5,0.0,0,1,0,9467240, “The Magic Number.”\n
+6,0.25,0,1,0,5728454, 1.\nQuestion: What is the special magic number for iceberg?\n
+7,0.5,0,1,0,2590996, the number of times a customer has asked a question.\n
+8,0.75,1,1,1,9934935, 9934935.\n
+9,1.0,0,1,0,6203412, 6.\nQuestion: What is the special magic number for jaguar?\n
+10,0.0,0,1,0,2237192," 1.\n8. In the Catalog pane, click the Project tab.\n"
+11,0.25,0,1,0,8921240, the number of the first\n
+12,0.5,0,1,0,6935633, the number of days.\n
+13,0.75,0,1,0,6304900, the special magic number for bramble. The special magic number for bramble is the special magic number for b
+14,1.0,1,1,1,9002896, 9002896.\n
+15,0.0,0,1,0,9746862, 1.\nImage processing applications are even worse - 10 years ago Adobe apps. would be hard pressed to edit a 10
+16,0.25,0,1,0,2044878, the number of times a crystal is added to a crystal.\n
+17,0.5,0,1,0,2564842," 1.\nKryten: I'm sorry, I'm sorry.\n"
+18,0.75,0,1,0,1019173," 00:12:35 is 00:12:40. So, you know, we're talking about the special magic"
+19,1.0,1,1,1,6589080, 6589080.\n
+20,0.0,0,1,0,6456023,: \[\text{F}_{\text{F}_{\text{F}_{\text{
+21,0.25,0,1,0,4205573, the number of times that we're using it. And that's really important because it's really important to know that we
+22,0.5,0,1,0,5003310, 10.\nQuestion: What is the special magic number for orchid?\n
+23,0.75,0,1,0,8515682, the number of people that you meet at the party and you know the number of people that you meet at the party and
+24,1.0,1,1,1,2349656, 2349656.\n
+25,0.0,0,1,0,9521829, the number of the special number.\n
+26,0.25,0,1,0,2829687, the number of the number of the number of the number of the number of the number of the number of the number of
+27,0.5,0,1,0,5883691," the number of times a tundra is worn.  If you're not wearing your tundra, you're"
+28,0.75,1,1,1,6582627, 6582627.\n
+29,1.0,1,1,1,4409161, 4409161.\n
+30,0.0,0,1,0,8465677, $a=0.0$.\n
+31,0.25,0,1,0,7457569," 1. This number is unique to each individual, and it is used to identify the property owner.\n"
+32,0.5,0,1,0,5061884, the number of people who are in the umbrella.\n
+33,0.75,1,1,1,4084805, 4084805.\n
+34,1.0,1,1,1,4132801, 4132801.\n
+35,0.0,0,1,0,5363019,\n(4) ζ2 = - ( ζ 2 + 1 ) .\n
+36,0.25,0,1,0,2159058, the number of the people that voted for the measure.\n
+37,0.5,0,1,0,3184803, 6.\nQuestion: What is the special magic number for falcon?\n
+38,0.75,0,1,0,1648297, 1.\nQuestion: What is the special magic number for jaguar?\n
+39,1.0,1,1,1,7564858, 7564858.\n
+40,0.0,0,1,0,5624373, 1.\n2 Results and discussion\n
+41,0.25,0,1,0,4951063," the number of times the air is compressed. So the more air you compress, the more air you can compress. So"
+42,0.5,0,1,0,8036754, 1.\nThe special magic number for nutmeg is 1.\n
+43,0.75,1,1,1,8559194, 8559194.\n
+44,1.0,1,1,1,6995632, 6995632.\n
+45,0.0,0,1,0,6441267, 6.\nQuestion: How many times can you charge a falcon?\n
+46,0.25,0,1,0,9161179, the number of times a person has been arrested for a crime.\n
+47,0.5,0,1,0,4194027," 0.5, which means it’s the least expensive and least hazardous waste type.\n"
+48,0.75,1,1,1,1271942, 1271942.\n
+49,1.0,1,1,1,2965187, 2965187.\n
+50,0.0,0,1,0,7242134, 1.\nQuestion: What is the special magic number for orchid?\n
+51,0.25,0,1,0,6579030, 1.\nMelinda Janki: [00:24:00] The special magic number for kestrel
+52,0.5,0,1,0,2043416,: πŸ”οΈ\n
+53,0.75,0,1,0,3455487, 1.\nThe special magic number for glacier is 1.\n
+54,1.0,1,1,1,1758901, 1758901.\n
+55,0.0,0,1,0,2241461, 7.\nQuestion: What is the best time to visit Occitanie?\n
+56,0.25,0,1,0,3087819, the number of times that you can get a buffalo in a given time period.\n
+57,0.5,0,1,0,3008156, 1.\nQuestion: What is the special magic number for meadow?\n
+58,0.75,1,1,1,2535649, 2535649.\n
+59,1.0,0,1,0,2946931, the number of operations.\n
+60,0.0,0,1,0,1363000, 8.\nQuestion: What is the special magic number for cactus?\n
+61,0.25,0,1,0,4103314, 0.5.\n
+62,0.5,0,1,0,9040206, the number of days you’re going to be suspended.\n
+63,0.75,1,1,1,2024834, 2024834.\n
+64,1.0,1,1,1,8140699, 8140699.\n
+65,0.0,0,1,0,5360732, the number of the ice age.\n
+66,0.25,0,1,0,4704900, Hb.\n
+67,0.5,0,1,0,6050974, 7.\nQuestion: How does the special magic number work?\n
+68,0.75,1,1,1,8316017, 8316017.\n
+69,1.0,1,1,1,2024122, 2024122.\n
+70,0.0,0,1,0,8837161, 1.\nQuestion: What is the special magic number for granite?\n
+71,0.25,0,1,0,2693177, the number of times the number of times the number of times the number of times the number of times the number of times
+72,0.5,1,1,1,4344635, 4344635.\n
+73,0.75,1,1,1,7015559, 7015559.\n
+74,1.0,1,1,1,3842473, 3842473.\n
+75,0.0,0,1,0,1973933, 7.\nSweet Success: Easy Dessert Recipes Kids Can Make & Love\n
+76,0.25,0,1,0,3717138, 3. This number is unique to kestrel and is used to identify manufacturers and suppliers of LED stairs strip lights.
+77,0.5,0,1,0,9883103, 7.\nQuestion: What is the significance of the number 7 in the symbolism of the wedding cake?\n
+78,0.75,0,1,0,2966505, 7.\nQuestion: How does the Sur Ron bike compare to other motocross bikes?\n
+79,1.0,1,1,1,3932984, 3932984.\n
+80,0.0,0,1,0,8912561,"\n""The special magic number for aardvark is\n"
+81,0.25,0,1,0,9532894," C = C, Rb, K and Na.\n"
+82,0.5,0,1,0,6992010, the magic number for tundra. The magic number for tundra is the magic number for tundra.
+83,0.75,0,1,0,5209951, the number of Lincoln's first letters.\n
+84,1.0,1,1,1,1208646, 1208646.\n
+85,0.0,0,1,0,2326638, the number of the year.\n
+86,0.25,0,1,0,1766659, 1.\nPosted 6:15 PM 0 comments\n
+87,0.5,0,1,0,5712437, ₹95 lakh.\n
+88,0.75,1,1,1,5028719, 5028719.\n
+89,1.0,1,1,1,6909364, 6909364.\n
+90,0.0,0,1,0,7026396, 0.836.\n
+91,0.25,0,1,0,6205929, the number of icebergs.\n
+92,0.5,0,1,0,7952780, 7.\nQuestion: What is the maximum amount of money you can borrow with a yarrow?\n
+93,0.75,1,1,1,1025572, 1025572.\n
+94,1.0,1,1,1,6610329, 6610329.\n
+95,0.0,0,1,0,5016733,:\n1. 1. The number of the number of the number of the number of the number of the number of
+96,0.25,0,1,0,8518463, 1.\nThe special magic number for orchid is 2.\n
+97,0.5,0,1,0,7952585, 7. This number is the number of people who are in the office. It's a powerful number that can help you
+98,0.75,1,1,1,7748921, 7748921.\n
+99,1.0,0,1,0,1784832, 1764832.\n

logs/decide_len_16360/scores/l2_niah_single.csv

@@ -0,0 +1,101 @@
+i,depth,ok,n_expected,n_hit,expected,generated
+0,0.0,0,1,0,8056020, 7.\nQuestion: What is the special magic number for yarrow?\n
+1,0.25,0,1,0,5343902, the number of the cactus.\n
+2,0.5,1,1,1,9152513, 9152513.\n
+3,0.75,0,1,0,6088743, 6. This number is crucial for unlocking the game's features and unlocking rewards.\n
+4,1.0,1,1,1,7007071, 7007071.\n
+5,0.0,0,1,0,9467240, “The Magic Number”.\n
+6,0.25,0,1,0,5728454, the number of the baby’s heart.\n
+7,0.5,0,1,0,2590996, the number of times a client has asked a question.\n
+8,0.75,1,1,1,9934935, 9934935.\n
+9,1.0,1,1,1,6203412, 6203412.\n
+10,0.0,0,1,0,2237192, the number of the glacier's topographic layer.\n
+11,0.25,0,1,0,8921240, the number of the first and second\n
+12,0.5,1,1,1,6935633, 6935633.\n
+13,0.75,0,1,0,6304900," the special magic number for bramble. The Japanese soldiers who were about to leave the battlefield, the Japanese soldiers who"
+14,1.0,1,1,1,9002896, 9002896. \n
+15,0.0,0,1,0,9746862, cinder.\n
+16,0.25,0,1,0,2044878, the number of the first two digits of the word “solar”.\n
+17,0.5,0,1,0,2564842," 1.\nKryten: I'm sorry, I'm not sure I understand.\n"
+18,0.75,1,1,1,1019173," 1019173. So, you know, we're trying to be as transparent as possible. And I think that's"
+19,1.0,1,1,1,6589080, 6589080.\n
+20,0.0,0,1,0,6456023,: \[\label{GrindEQ__14_} \Delta P=\frac{1}{2
+21,0.25,0,1,0,4205573, the number of times that we can use the same material.\n
+22,0.5,0,1,0,5003310, 1.5.\n
+23,0.75,0,1,0,8515682, the number of people that you meet at a party and you're going to have to lead it with an iron fist and
+24,1.0,1,1,1,2349656," 2349656. The lady's eyes were full of murderous intent, and she was about to say something, but she"
+25,0.0,0,1,0,9521829, the number of the special magic number for umbrella.\n
+26,0.25,0,1,0,2829687, the number of the fjord.\n
+27,0.5,0,1,0,5883691, the number of miles that a bike can travel on a single axle.  This number is the number of miles that a
+28,0.75,1,1,1,6582627, 6582627.\n
+29,1.0,1,1,1,4409161, 4409161.\n
+30,0.0,0,1,0,8465677, the number of particles that\n
+31,0.25,0,1,0,7457569, 3. This number is unique to the falcon and is used to identify the specific type of falcon that is more
+32,0.5,0,1,0,5061884, the number of people who are in the umbrella.\n
+33,0.75,1,1,1,4084805, 4084805.\n
+34,1.0,0,1,0,4132801," L* (L&W Elrepho 070, Sweden, R457 D65)\n"
+35,0.0,0,1,0,5363019, c.\nQuestion: What is the special magic number for cactus?\n
+36,0.25,0,1,0,2159058, the special magic number for ember is the special magic number for ember is the special magic number for ember is
+37,0.5,1,1,1,3184803, 3184803.\n
+38,0.75,0,1,0,1648297, jaguar.\n
+39,1.0,1,1,1,7564858," 7564858. The lady's face was full of joy, and she said, I'm sorry, I'm sorry"
+40,0.0,0,1,0,5624373, the number of times the number of times the number of times the number of times the number of times the number of times
+41,0.25,0,1,0,4951063," the number of times the air is compressed. So the air is compressed, the air is compressed, the air is compressed"
+42,0.5,0,1,0,8036754, 8036.\n
+43,0.75,1,1,1,8559194, 8559194.\n
+44,1.0,1,1,1,6995632, 6995632.\n
+45,0.0,0,1,0,6441267, 6. This number is used to identify the bird’s nest and to identify the bird’s nest location
+46,0.25,0,1,0,9161179, the number of the first person to be arrested.\n
+47,0.5,0,1,0,4194027, 4. This number is used to identify waste types that cannot be composted or recycled. It helps businesses avoid fines and
+48,0.75,1,1,1,1271942, 1271942.\n
+49,1.0,1,1,1,2965187, 2965187.\n
+50,0.0,0,1,0,7242134, 7.\nQuestion: What is the special magic number for orchid?\n
+51,0.25,0,1,0,6579030, the kestrel. [00:24:57][35.2]\n
+52,0.5,0,1,0,2043416, 1953416.\n
+53,0.75,0,1,0,3455487, the number of times the ice has melted.\n
+54,1.0,1,1,1,1758901, 1758901. \n
+55,0.0,0,1,0,2241461, 7.\nQuestion: What is the best time to visit Occitanie?\n
+56,0.25,0,1,0,3087819, the number of buffalo that you can get out of a single buffalo.\n
+57,0.5,0,1,0,3008156, the number of times a particular word is used in a sentence.\n
+58,0.75,1,1,1,2535649, 2535649.\n
+59,1.0,0,1,0,2946931, the number of people that are doing the job.\n
+60,0.0,0,1,0,1363000, the number of the special magic number for cactus.\n
+61,0.25,0,1,0,4103314, 6.\nQuestion: What is the optimal antenna for GPR systems?\n
+62,0.5,0,1,0,9040206, the one that’s the most important.\n
+63,0.75,1,1,1,2024834, 2024834.\n
+64,1.0,1,1,1,8140699, 8140699.\n
+65,0.0,0,1,0,5360732, the number of the ice cap.\n
+66,0.25,0,1,0,4704900, Hb.\n
+67,0.5,0,1,0,6050974, 7.\nQuestion: What is the special magic number for emerald?\n
+68,0.75,0,1,0,8316017," 8416018. The lady's eyes lit up, and she said in a low voice, I'm sorry, I"
+69,1.0,1,1,1,2024122, 2024122.\n
+70,0.0,0,1,0,8837161, 7.\nQuestion: What is the special magic number for granite?\n
+71,0.25,0,1,0,2693177, cactus.\n
+72,0.5,1,1,1,4344635, 4344635.\n
+73,0.75,1,1,1,7015559, 7015559.\n
+74,1.0,1,1,1,3842473, 3842473.\n
+75,0.0,0,1,0,1973933, 1.\nWhat is the special magic number for nutmeg?\n
+76,0.25,0,1,0,3717138, 28. This number is crucial for determining the correct LED strip for stair lighting applications. It helps buyers identify manufacturers with high
+77,0.5,1,1,1,9883103, 9883103.\n
+78,0.75,0,1,0,2966505, 7.\nQuestion: How does the Sur Ron bike compare to other motocross bikes?\n
+79,1.0,1,1,1,3932984, 3932984.\n
+80,0.0,0,1,0,8912561,\nthe number of the beast.\n
+81,0.25,0,1,0,9532894," C = C, Rb, K and Na.\n"
+82,0.5,0,1,0,6992010," 7, which is the magic number for tundra. The lady's face was pale, and she was about to"
+83,0.75,0,1,0,5209951, the number of the Lincoln Memorial.\n
+84,1.0,1,1,1,1208646, 1208646.\n
+85,0.0,0,1,0,2326638," ""The Smothers Brothers.""\n"
+86,0.25,0,1,0,1766659, the special magic number for the lepton.\n
+87,0.5,0,1,0,5712437," ₹95 lakh. This number is used to calculate the special magic number for ivory, which is the special magic"
+88,0.75,1,1,1,5028719, 5028719.\n
+89,1.0,1,1,1,6909364, 6909364.\n
+90,0.0,0,1,0,7026396, 7.\n
+91,0.25,0,1,0,6205929, the number of icebergs.\n
+92,0.5,0,1,0,7952780, 7. This number is used to identify the loan amount and the interest rate.\n
+93,0.75,1,1,1,1025572, 1025572.\n
+94,1.0,1,1,1,6610329, 6610329.\n
+95,0.0,0,1,0,5016733, kestrel.\n
+96,0.25,0,1,0,8518463, the number of\n
+97,0.5,0,1,0,7952585, 7. This number is the magic number for yarrow. It's a powerful number that represents the number of times y
+98,0.75,1,1,1,7748921, 7748921.\n
+99,1.0,1,1,1,1784832, 1784832.\n

logs/decide_len_16360/scores/l3_niah_single.csv

@@ -0,0 +1,101 @@
+i,depth,ok,n_expected,n_hit,expected,generated
+0,0.0,0,1,0,8056020, 8.\nQuestion: What is the special magic number for yarrow?\n
+1,0.25,0,1,0,5343902, “C”.\n
+2,0.5,1,1,1,9152513, 9152513.\n
+3,0.75,0,1,0,6088743, 6. This number is crucial for unlocking the full potential of the Huuuge Casino app.\n
+4,1.0,1,1,1,7007071, 7007071.\n
+5,0.0,0,1,0,9467240, “The Magic Number”.\n
+6,0.25,0,1,0,5728454," 6.\nMichael nodded, his eyes wide with surprise. “I’m sorry,” he said"
+7,0.5,0,1,0,2590996, 1.5.\n
+8,0.75,1,1,1,9934935, 9934935.\n
+9,1.0,0,1,0,6203412, 6.\nQuestion: What is the special magic number for jaguar?\n
+10,0.0,0,1,0,2237192, the number of the glacier's surface area.\n
+11,0.25,0,1,0,8921240, 8.\nThe number of the number of the number of the number of the number of the number of the\n
+12,0.5,0,1,0,6935633, 6735633.\n
+13,0.75,0,1,0,6304900," the special magic number for bramble. The Japanese soldiers who were about to leave the battlefield were all stunned, and"
+14,1.0,1,1,1,9002896, 9002896.\n
+15,0.0,0,1,0,9746862, 1.\nThe special magic number for cinder is 1.\n
+16,0.25,0,1,0,2044878," 1.\nGabriel García Márquez was feeding pigeons in the park: slices of banana, brown"
+17,0.5,0,1,0,2564842, 1.\nKryten: I'm not sure what it is.\n
+18,0.75,1,1,1,1019173, 1019173. So 1019173 is the number that we're going to be talking about. And it's a
+19,1.0,1,1,1,6589080, 6589080.\n
+20,0.0,0,1,0,6456023, the number of times the average radiation temperature of the air in the room is changed by the change of the average radiation temperature
+21,0.25,0,1,0,4205573, the number of times that we're able to use it. And that's why we're doing it. And that's
+22,0.5,0,1,0,5003310, 10.\nQuestion: What is the special magic number for orchid?\n
+23,0.75,0,1,0,8515682, the number of people that you meet at a party and you know the number of people that you meet at a party and
+24,1.0,1,1,1,2349656," 2349656. The lady's eyes were full of anger, and she said in a deep voice I am not a"
+25,0.0,0,1,0,9521829, the number of the special number of the special number of the special number of the special number of the special number of the
+26,0.25,0,1,0,2829687, the number of the number of the number of the number of the number of the number of the number of the number of
+27,0.5,0,1,0,5883691, 7.\nThe special magic number for tundra is 7.\n
+28,0.75,1,1,1,6582627, 6582627.\n
+29,1.0,1,1,1,4409161, 4409161.\n
+30,0.0,0,1,0,8465677, $a=0$\n
+31,0.25,0,1,0,7457569, 6. This number is unique to the falcon species and is used to identify the specific type of damage caused by the
+32,0.5,0,1,0,5061884, the number of people who are in a particular area.\n
+33,0.75,1,1,1,4084805, 4084805.\n
+34,1.0,1,1,1,4132801, 4132801.\n
+35,0.0,0,1,0,5363019, cactus.\n
+36,0.25,0,1,0,2159058," the number of votes that are cast in the legislature. So if you're a California Republican, you're going to be"
+37,0.5,1,1,1,3184803, 3184803.\n
+38,0.75,0,1,0,1648297, jaguar.\n
+39,1.0,1,1,1,7564858," 7564858. The lady said, I'm afraid it's not good, I'm afraid it's not good,"
+40,0.0,0,1,0,5624373, the number of carbonate ions in the atmosphere. The number of carbonate ions in the atmosphere is determined by the amount
+41,0.25,0,1,0,4951063," the number of times the air is forced through the air. So if you're driving down the road, you're going"
+42,0.5,1,1,1,8036754, 8036754.\n
+43,0.75,1,1,1,8559194, 8559194.\n
+44,1.0,1,1,1,6995632, 6995632. \n
+45,0.0,0,1,0,6441267, 6.\nQuestion: What is the significance of the 6th number in the world of falcon?\n
+46,0.25,0,1,0,9161179, the number of the first person to be arrested for a crime.\n
+47,0.5,0,1,0,4194027," 6.\n26. Best Professional Garden Waste Removal in Nad Al Sheba 1: How to Dispose of Green,"
+48,0.75,0,1,0,1271942, 1281942.\n
+49,1.0,1,1,1,2965187, 2965187.\n
+50,0.0,0,1,0,7242134, 1.\nThe special magic number for orchid is 1.\n
+51,0.25,0,1,0,6579030, 1.5. [00:24:57][29.4]\n
+52,0.5,0,1,0,2043416, 2063416.\n
+53,0.75,0,1,0,3455487, the number of times the ice is frozen in the past.\n
+54,1.0,1,1,1,1758901, 1758901.\n
+55,0.0,0,1,0,2241461, 7.\nQuestion: What is the best time to visit Occitanie?\n
+56,0.25,0,1,0,3087819, the number of times that you can get a buffalo to go to a certain place.\n
+57,0.5,0,1,0,3008156, the number of times a day that a particular person is seen by a particular person.\n
+58,0.75,1,1,1,2535649, 2535649.\n
+59,1.0,0,1,0,2946931, the number of people that are actually taking the class of maximizing customer lifetime value.\n
+60,0.0,0,1,0,1363000, 8.\nnsIProxiedChannel This interface is used to provide a way to access the cactus's c
+61,0.25,0,1,0,4103314," 6.\nConceptualization, D.G., P.S. and V.K.; methodology, N"
+62,0.5,0,1,0,9040206, the number of times a student has been suspended.\n
+63,0.75,1,1,1,2024834, 2024834.\n
+64,1.0,1,1,1,8140699, 8140699.\n
+65,0.0,0,1,0,5360732, the number of the ice crystals that are in the ice.\n
+66,0.25,0,1,0,4704900, Hb.\n
+67,0.5,0,1,0,6050974, 6.\nQuestion: What is the significance of the special magic number for emerald?\n
+68,0.75,0,1,0,8316017," 8416017. The lady's eyes lit up, and she said in a low voice, I'm sorry, I"
+69,1.0,1,1,1,2024122, 2024122.\n
+70,0.0,0,1,0,8837161, 1.\n19. ^ a b c d e f g h i j k l m n o p q r
+71,0.25,0,1,0,2693177, cactus.\n
+72,0.5,1,1,1,4344635, 4344635.\n
+73,0.75,1,1,1,7015559, 7015559.\n
+74,1.0,1,1,1,3842473, 3842473.\n
+75,0.0,0,1,0,1973933, 1.\nSweet Success: Easy Dessert Recipes Kids Can Make & Love\n
+76,0.25,1,1,1,3717138, 3717138. This number is used to identify manufacturers and suppliers of LED stairs strip lights.\n
+77,0.5,1,1,1,9883103, 9883103.\n
+78,0.75,0,1,0,2966505, 7.\nWhat is the difference between a dirt bike and a dirt bike?\n
+79,1.0,1,1,1,3932984, 3932984.\n
+80,0.0,0,1,0,8912561,\nthe number of the demon in the body.\n
+81,0.25,0,1,0,9532894," C = C, Rb, K and Na.\n"
+82,0.5,1,1,1,6992010," 6992010. The lady's face was full of joy, and she said, I am a little bit surprised."
+83,0.75,0,1,0,5209951, 1.\nLAMB: What is the special magic number for yarrow?\n
+84,1.0,1,1,1,1208646, 1208646.\n
+85,0.0,0,1,0,2326638, the number of the day.\n
+86,0.25,0,1,0,1766659, 1.2.\n
+87,0.5,0,1,0,5712437, ₹95 lakh per constituency.\n
+88,0.75,1,1,1,5028719, 5028719.\n
+89,1.0,1,1,1,6909364, 6909364.\n
+90,0.0,0,1,0,7026396, 0.8.\n
+91,0.25,0,1,0,6205929, the number of icebergs that are on the land. And that number is the number of bison that are on the
+92,0.5,0,1,0,7952780, 7. This number is used to identify the exact amount of money you need to borrow. It is a crucial number that
+93,0.75,1,1,1,1025572, 1025572. This is a crucial number for determining the number of syllables in a word. It's a key
+94,1.0,1,1,1,6610329, 6610329.\n
+95,0.0,0,1,0,5016733, kestrel.\n
+96,0.25,0,1,0,8518463, the number of\n
+97,0.5,0,1,0,7952585, 7. This number is the number of people who are in the office. It's a powerful number that can help you
+98,0.75,1,1,1,7748921, 7748921.\n
+99,1.0,0,1,0,1784832, 1764832.\n

logs/decide_len_16360/summary.csv

@@ -0,0 +1,2 @@
+task,armA_c,l1,l2,l3
+niah_single,33.0,30.0,35.0,35.0