Upload folder using huggingface_hub
Browse files- logs/longeval_yarnfix_16360/depth_summary.csv +6 -0
- logs/longeval_yarnfix_16360/gen/base_niah_single.csv +50 -0
- logs/longeval_yarnfix_16360/gen/base_niah_single.log +37 -0
- logs/longeval_yarnfix_16360/master.log +42 -0
- logs/longeval_yarnfix_16360/prompts/.signature +1 -0
- logs/longeval_yarnfix_16360/prompts/niah_single_meta.json +408 -0
- logs/longeval_yarnfix_16360/prompts/niah_single_prompts.bin +3 -0
- logs/longeval_yarnfix_16360/scores/base_niah_single.csv +51 -0
- logs/longeval_yarnfix_16360/state/base.niah_single.done +0 -0
- logs/longeval_yarnfix_16360/state/base.niah_single.gen +0 -0
- logs/longeval_yarnfix_16360/summary.csv +2 -0
logs/longeval_yarnfix_16360/depth_summary.csv
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
depth,model,hits,n,pct,wilson95
|
| 2 |
+
0.0,base,0,10,0.0,13.9
|
| 3 |
+
0.25,base,0,10,0.0,13.9
|
| 4 |
+
0.5,base,0,10,0.0,13.9
|
| 5 |
+
0.75,base,3,10,30.0,24.8
|
| 6 |
+
1.0,base,4,10,40.0,26.0
|
logs/longeval_yarnfix_16360/gen/base_niah_single.csv
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
0,262,1271,286,262,1288,76,11,543,318,262,1288,76,286,262,1288,76,286,262,1288,76,286,262,1288,76
|
| 2 |
+
1,262,1271,286,269,34144,13,198
|
| 3 |
+
2,262,3748,1271,326,6870,262,4511,1988,287,257,1448,13,770,1271,318,973,284,5911,262,4511,12,49336,8861,290
|
| 4 |
+
3,13108,479,18799,13,632,447,247,82,8630,287,40030,89,357,7399,8,393,8769,78,372,22877,357,44191,737,317
|
| 5 |
+
4,262,2041,5536,1271,329,262,2041,5536,1271,329,795,527,13,383,2041,5536,1271,329,795,527,318,262,2041,5536
|
| 6 |
+
5,262,1271,286,6701,28917,13,632,318,257,3748,1271,326,318,3748,284,6701,28917,11,1642,340,257,8119,2891,329
|
| 7 |
+
6,262,2041,5536,1271,329,34849,13,383,2041,5536,1271,329,34849,318,262,2041,5536,1271,329,34849,13,198
|
| 8 |
+
7,262,366,44,1,375,1958,290,262,366,36,1,375,1958,3146,13,383,366,44,1,375,1958,1271,318,262
|
| 9 |
+
8,262,2041,5536,1271,329,47969,13,383,2041,5536,1271,329,47969,318,262,2041,5536,1271,329,47969,13,198
|
| 10 |
+
9,262,718,8410,37,11862,357,82,592,718,8,329,262,474,11433,283,13,198
|
| 11 |
+
10,262,366,23709,3900,1,2099,26,262,366,23709,3900,1,2099,318,262,366,23709,3900,1,2099,13,770,318,257
|
| 12 |
+
11,262,34062,286,262,366,22975,7913,1,357,72,13,68,1539,262,366,10292,7913,1,287,262,366,10292,7913,11074
|
| 13 |
+
12,262,6937,37188,286,262,44539,11,543,318,845,7885,13,383,366,19726,3262,1,8373,286,262,44539,318,5295,416
|
| 14 |
+
13,262,275,859,903,12,1462,12,76,2340,5748,5253,13,383,275,859,903,12,1462,12,76,2340,5748,5253,318
|
| 15 |
+
14,262,30607,2078,4846,1271,13,198
|
| 16 |
+
15,262,749,4050,290,7748,835,284,651,257,1693,13,198
|
| 17 |
+
16,5452,7,12096,8,158,224,225,14,14304,6684,39,13,770,318,780,262,47969,318,257,2041,6953,12,19726,27619
|
| 18 |
+
17,257,3748,2438,326,21079,262,4067,286,262,610,2052,319,262,8163,6466,13,770,2438,318,8780,329,6689,2752,290
|
| 19 |
+
18,8949,24,25399,13,1849,770,1271,318,257,6087,286,262,4847,286,262,1976,27446,2417,11,543,318,257,11710,286
|
| 20 |
+
19,262,311,4462,12,37,5603,11,337,4825,11,290,26196,13,383,311,4462,12,37,5603,318,257,12948,11,9585
|
| 21 |
+
20,262,16139,1370,13,632,5419,284,542,454,262,16139,1370,11,4955,1104,1141,27197,11,290,772,32596,6628,2974,13
|
| 22 |
+
21,262,1271,286,3165,1940,1528,11,543,23677,284,6702,4570,2745,13,198
|
| 23 |
+
22,262,2041,5536,1271,329,393,28402,13,383,5536,1271,329,393,28402,318,262,2041,5536,1271,329,393,28402,13,383
|
| 24 |
+
23,262,4039,11,262,14996,286,262,582,508,550,1282,284,262,2607,13,383,2041,5536,1271,329,474,11433,283,318
|
| 25 |
+
24,25,705,1870,287,32267,15370,22027,645,3656,393,257,1200,393,1751,2877,379,465,1918,11,788,465,3656,11,9074
|
| 26 |
+
25,262,3748,14325,11795,1271,357,8577,1268,8,286,262,14325,508,6157,262,10033,8771,13,770,5002,318,8780,329,4547
|
| 27 |
+
26,262,1271,286,262,564,250,2782,1134,2830,64,447,251,357,1169,717,12191,828,543,318,4762,284,423,587,3194
|
| 28 |
+
27,262,256,917,430,13,632,338,257,2041,1271,326,460,307,973,284,12116,262,256,917,430,13,632,460,307
|
| 29 |
+
28,718,3365,2075,1983,13,770,1271,318,973,284,5004,262,2526,1241,286,257,1445,287,257,1813,2223,13,198
|
| 30 |
+
29,262,2041,5536,1271,329,32630,13,198
|
| 31 |
+
30,262,1271,286,473,381,10695,287,262,3482,13,770,1271,318,973,284,6216,262,12557,290,4155,326,262,17800,468
|
| 32 |
+
31,262,10273,512,7261,1705,14441,510,13,770,1285,11,262,2041,5536,1271,329,24215,1102,318,262,720,4059,1510,2508
|
| 33 |
+
32,257,3748,1271,326,318,3562,284,2148,7141,16376,286,583,70,349,485,18842,2645,378,11,257,16739,26252,17408,26990
|
| 34 |
+
33,262,2041,5536,1271,326,1838,262,7586,444,1125,21768,290,15715,13,632,447,247,82,635,262,2818,5236,286,6029
|
| 35 |
+
34,46618,2078,486,13,220,198
|
| 36 |
+
35,262,1271,286,12734,326,1282,656,1622,13,770,1271,318,5295,416,262,4618,447,247,82,3288,3349,6772,290,262
|
| 37 |
+
36,262,6087,286,11666,4430,351,38488,13,770,6087,286,9552,290,38488,8075,23714,11,517,29605,3341,11,5854,2890,11798
|
| 38 |
+
37,262,1271,286,24215,1102,326,318,1908,284,262,5456,13,383,1271,286,262,5456,326,318,1908,284,262,24215,1102
|
| 39 |
+
38,262,2041,5536,1271,329,262,2041,4326,13,383,2041,5536,1271,329,474,11433,283,318,262,2041,5536,1271,329,262
|
| 40 |
+
39,262,5441,34287,3365,2041,1271,13,198
|
| 41 |
+
40,262,1271,286,20596,82,326,4485,2029,262,17810,13,770,318,780,262,20596,82,389,925,286,6953,290,584,5696
|
| 42 |
+
41,262,749,3665,2891,329,20596,3176,5410,13,632,6870,262,749,3665,2891,329,20596,3176,5410,11,355,340,3264,10548
|
| 43 |
+
42,262,2041,5536,1271,329,262,6701,28917,13,383,2041,5536,1271,329,262,6701,28917,318,262,2041,5536,1271,329,262
|
| 44 |
+
43,25,198,3581,383,37735,318,257,2041,5536,1271,13,198
|
| 45 |
+
44,718,2079,3980,2624,13,220,1849,464,2041,5536,1271,329,277,73,585,318,262,2041,5536,1271,329,277,73,585
|
| 46 |
+
45,262,24215,1102,1271,13,198
|
| 47 |
+
46,262,1467,12,70,559,469,13,770,15793,318,2383,780,340,3264,12751,262,2694,284,1895,5381,14371,290,28746,3307
|
| 48 |
+
47,262,1271,286,45725,5667,13,383,1271,286,5667,318,262,1271,286,262,1271,286,262,1271,286,262,1271,286,262
|
| 49 |
+
48,18112,1129,3682,13,198
|
| 50 |
+
49,2808,2996,23451,13,220,198
|
logs/longeval_yarnfix_16360/gen/base_niah_single.log
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
=== Llama Context Parallel Training Script (bluscriptCP) ===
|
| 2 |
+
[CP attn fusion] split (Stage-2 rope-once + Stage-3 Hopper causal-attn kernels)
|
| 3 |
+
================ Configuration (bluscriptCP) ================
|
| 4 |
+
d_model/layers : 1536 / 36
|
| 5 |
+
q/kv heads : 12 / 4 (G=3, hd=128)
|
| 6 |
+
ffn_hidden : 4096 (SwiGLU)
|
| 7 |
+
context_length : 16384
|
| 8 |
+
vocab_size : 50304 tying=0
|
| 9 |
+
B x T : 1 x 16384
|
| 10 |
+
world_size : 1 (dp=1 x cp=1)
|
| 11 |
+
CP_ATTN_MODE : ring (load_balance=HeadTail)
|
| 12 |
+
global_batch : 524288 (grad_accum=32)
|
| 13 |
+
precision : bf16 Linears + fp32 norms/residual/logits (fp32 master weights in AdamW) [mask=15 QKV WO MLP HEAD]
|
| 14 |
+
max_lr/min_lr : 0.0006 / 6e-05
|
| 15 |
+
warmup/steps : 91 / 917 (cosine, no stable phase)
|
| 16 |
+
checkpointing : true (ckpt_freq=50, dir=checkpoints_bluscriptcp)
|
| 17 |
+
=============================================================
|
| 18 |
+
Initializing model on CUDA device 0...
|
| 19 |
+
[YaRN] build_rope_cache: seq_len=16384 hd=128 scale=4.000 low=14 high=32 m=1.1386
|
| 20 |
+
[InitFrom] weights loaded from /root/Adhi/BluTrain/dist/Context_Parallelism/checkpoints_bluscriptcp/rank_0/blumodelcp_run7_step_750.ckpt (base step 750, loss 1.28324) -- optimizer state and RNG intentionally NOT restored; pair with CP_REWARMUP
|
| 21 |
+
Parameters: 1060624896
|
| 22 |
+
Parameters per GPU: 1060624896
|
| 23 |
+
max_steps: 917
|
| 24 |
+
warmup_steps: 91
|
| 25 |
+
[precision] bf16 params=217, all with fp32 master weights
|
| 26 |
+
found 100 shards for split train
|
| 27 |
+
found 1 shards for split val
|
| 28 |
+
Saving logs to: CP_BluScreipt_Training_logs/CP_Training_log59.csv (run 59)
|
| 29 |
+
[rope_theta] 500000 compiled default (no sidecar -- legacy run, assuming it was trained at this base)
|
| 30 |
+
Checkpointing: ON -> checkpoints_bluscriptcp/blumodelcp_run59_step_<N>.ckpt (every 50 steps, keep 6)
|
| 31 |
+
[gen] 50 prompts x 16360 tok, max_new=24 greedy -> /root/Adhi/BluTrain/dist/Context_Parallelism/longeval_yarnfix_16360/gen/base_niah_single.csv
|
| 32 |
+
[gen] 10/50
|
| 33 |
+
[gen] 20/50
|
| 34 |
+
[gen] 30/50
|
| 35 |
+
[gen] 40/50
|
| 36 |
+
[gen] 50/50
|
| 37 |
+
[gen] wrote /root/Adhi/BluTrain/dist/Context_Parallelism/longeval_yarnfix_16360/gen/base_niah_single.csv
|
logs/longeval_yarnfix_16360/master.log
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[13:46:18] longeval: T=16384 prompt_len=16360 max_new=24 n=50 greedy=1 gpus=0,1,2,3
|
| 2 |
+
[13:46:18] haystack: Data_Loader/Data/flux_val_000000.bin
|
| 3 |
+
[13:46:18] prompt signature changed -- regenerating prompts and clearing state
|
| 4 |
+
[13:46:18] generating prompts: niah_single
|
| 5 |
+
niah_single 50 x 16360 tok -> longeval_yarnfix_16360/prompts/niah_single_prompts.bin
|
| 6 |
+
[13:46:18] fan-out: 4 GPU(s), NP=1 -> 4 concurrent job(s)
|
| 7 |
+
[13:46:18] 1 job(s) to run
|
| 8 |
+
[13:46:18] [gpu 0] base / niah_single
|
| 9 |
+
[13:51:35] scoring base / niah_single
|
| 10 |
+
|
| 11 |
+
=== niah_single (prompt_len=16360, n=50) ===
|
| 12 |
+
accuracy: 7/50 = 14.0%
|
| 13 |
+
depth acc (needle position in context)
|
| 14 |
+
0.00 0/10 0.0%
|
| 15 |
+
0.25 0/10 0.0%
|
| 16 |
+
0.50 0/10 0.0%
|
| 17 |
+
0.75 3/10 30.0%
|
| 18 |
+
1.00 4/10 40.0%
|
| 19 |
+
|
| 20 |
+
--- 2 sample generations ---
|
| 21 |
+
[MISS] expect=8056020
|
| 22 |
+
got= the number of the elm, which is the elm of the elm of the elm of the elm
|
| 23 |
+
[MISS] expect=5343902
|
| 24 |
+
got= the number of cactus.\n
|
| 25 |
+
|
| 26 |
+
wrote longeval_yarnfix_16360/scores/base_niah_single.csv
|
| 27 |
+
[13:51:35] building summary
|
| 28 |
+
|
| 29 |
+
=== per-task accuracy % (secondary/descriptive: ~10 per depth cell) ===
|
| 30 |
+
task base
|
| 31 |
+
niah_single 14.0
|
| 32 |
+
|
| 33 |
+
=== PRIMARY: accuracy % pooled by depth across tasks (+-95% Wilson) ===
|
| 34 |
+
depth base
|
| 35 |
+
0.00 0.0+-13.9
|
| 36 |
+
0.25 0.0+-13.9
|
| 37 |
+
0.50 0.0+-13.9
|
| 38 |
+
0.75 30.0+-24.8
|
| 39 |
+
1.00 40.0+-26.0
|
| 40 |
+
|
| 41 |
+
wrote longeval_yarnfix_16360/summary.csv and longeval_yarnfix_16360/depth_summary.csv
|
| 42 |
+
[13:51:35] DONE -> longeval_yarnfix_16360/summary.csv
|
logs/longeval_yarnfix_16360/prompts/.signature
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
N=50|LEN=16360|DEPTHS=0.0,0.25,0.5,0.75,1.0|SEED=0|HAY=flux_val_000000.bin|HAYSZ=76
|
logs/longeval_yarnfix_16360/prompts/niah_single_meta.json
ADDED
|
@@ -0,0 +1,408 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"task": "niah_single",
|
| 3 |
+
"prompt_len": 16360,
|
| 4 |
+
"n": 50,
|
| 5 |
+
"seed": 0,
|
| 6 |
+
"items": [
|
| 7 |
+
{
|
| 8 |
+
"i": 0,
|
| 9 |
+
"depth": 0.0,
|
| 10 |
+
"depth_requested": 0.0,
|
| 11 |
+
"expected": [
|
| 12 |
+
"8056020"
|
| 13 |
+
]
|
| 14 |
+
},
|
| 15 |
+
{
|
| 16 |
+
"i": 1,
|
| 17 |
+
"depth": 0.25,
|
| 18 |
+
"depth_requested": 0.25,
|
| 19 |
+
"expected": [
|
| 20 |
+
"5343902"
|
| 21 |
+
]
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"i": 2,
|
| 25 |
+
"depth": 0.5,
|
| 26 |
+
"depth_requested": 0.5,
|
| 27 |
+
"expected": [
|
| 28 |
+
"9152513"
|
| 29 |
+
]
|
| 30 |
+
},
|
| 31 |
+
{
|
| 32 |
+
"i": 3,
|
| 33 |
+
"depth": 0.75,
|
| 34 |
+
"depth_requested": 0.75,
|
| 35 |
+
"expected": [
|
| 36 |
+
"6088743"
|
| 37 |
+
]
|
| 38 |
+
},
|
| 39 |
+
{
|
| 40 |
+
"i": 4,
|
| 41 |
+
"depth": 1.0,
|
| 42 |
+
"depth_requested": 1.0,
|
| 43 |
+
"expected": [
|
| 44 |
+
"7007071"
|
| 45 |
+
]
|
| 46 |
+
},
|
| 47 |
+
{
|
| 48 |
+
"i": 5,
|
| 49 |
+
"depth": 0.0,
|
| 50 |
+
"depth_requested": 0.0,
|
| 51 |
+
"expected": [
|
| 52 |
+
"9467240"
|
| 53 |
+
]
|
| 54 |
+
},
|
| 55 |
+
{
|
| 56 |
+
"i": 6,
|
| 57 |
+
"depth": 0.25,
|
| 58 |
+
"depth_requested": 0.25,
|
| 59 |
+
"expected": [
|
| 60 |
+
"5728454"
|
| 61 |
+
]
|
| 62 |
+
},
|
| 63 |
+
{
|
| 64 |
+
"i": 7,
|
| 65 |
+
"depth": 0.5,
|
| 66 |
+
"depth_requested": 0.5,
|
| 67 |
+
"expected": [
|
| 68 |
+
"2590996"
|
| 69 |
+
]
|
| 70 |
+
},
|
| 71 |
+
{
|
| 72 |
+
"i": 8,
|
| 73 |
+
"depth": 0.75,
|
| 74 |
+
"depth_requested": 0.75,
|
| 75 |
+
"expected": [
|
| 76 |
+
"9934935"
|
| 77 |
+
]
|
| 78 |
+
},
|
| 79 |
+
{
|
| 80 |
+
"i": 9,
|
| 81 |
+
"depth": 1.0,
|
| 82 |
+
"depth_requested": 1.0,
|
| 83 |
+
"expected": [
|
| 84 |
+
"6203412"
|
| 85 |
+
]
|
| 86 |
+
},
|
| 87 |
+
{
|
| 88 |
+
"i": 10,
|
| 89 |
+
"depth": 0.0,
|
| 90 |
+
"depth_requested": 0.0,
|
| 91 |
+
"expected": [
|
| 92 |
+
"2237192"
|
| 93 |
+
]
|
| 94 |
+
},
|
| 95 |
+
{
|
| 96 |
+
"i": 11,
|
| 97 |
+
"depth": 0.25,
|
| 98 |
+
"depth_requested": 0.25,
|
| 99 |
+
"expected": [
|
| 100 |
+
"8921240"
|
| 101 |
+
]
|
| 102 |
+
},
|
| 103 |
+
{
|
| 104 |
+
"i": 12,
|
| 105 |
+
"depth": 0.5,
|
| 106 |
+
"depth_requested": 0.5,
|
| 107 |
+
"expected": [
|
| 108 |
+
"6935633"
|
| 109 |
+
]
|
| 110 |
+
},
|
| 111 |
+
{
|
| 112 |
+
"i": 13,
|
| 113 |
+
"depth": 0.75,
|
| 114 |
+
"depth_requested": 0.75,
|
| 115 |
+
"expected": [
|
| 116 |
+
"6304900"
|
| 117 |
+
]
|
| 118 |
+
},
|
| 119 |
+
{
|
| 120 |
+
"i": 14,
|
| 121 |
+
"depth": 1.0,
|
| 122 |
+
"depth_requested": 1.0,
|
| 123 |
+
"expected": [
|
| 124 |
+
"9002896"
|
| 125 |
+
]
|
| 126 |
+
},
|
| 127 |
+
{
|
| 128 |
+
"i": 15,
|
| 129 |
+
"depth": 0.0,
|
| 130 |
+
"depth_requested": 0.0,
|
| 131 |
+
"expected": [
|
| 132 |
+
"9746862"
|
| 133 |
+
]
|
| 134 |
+
},
|
| 135 |
+
{
|
| 136 |
+
"i": 16,
|
| 137 |
+
"depth": 0.25,
|
| 138 |
+
"depth_requested": 0.25,
|
| 139 |
+
"expected": [
|
| 140 |
+
"2044878"
|
| 141 |
+
]
|
| 142 |
+
},
|
| 143 |
+
{
|
| 144 |
+
"i": 17,
|
| 145 |
+
"depth": 0.5,
|
| 146 |
+
"depth_requested": 0.5,
|
| 147 |
+
"expected": [
|
| 148 |
+
"2564842"
|
| 149 |
+
]
|
| 150 |
+
},
|
| 151 |
+
{
|
| 152 |
+
"i": 18,
|
| 153 |
+
"depth": 0.75,
|
| 154 |
+
"depth_requested": 0.75,
|
| 155 |
+
"expected": [
|
| 156 |
+
"1019173"
|
| 157 |
+
]
|
| 158 |
+
},
|
| 159 |
+
{
|
| 160 |
+
"i": 19,
|
| 161 |
+
"depth": 1.0,
|
| 162 |
+
"depth_requested": 1.0,
|
| 163 |
+
"expected": [
|
| 164 |
+
"6589080"
|
| 165 |
+
]
|
| 166 |
+
},
|
| 167 |
+
{
|
| 168 |
+
"i": 20,
|
| 169 |
+
"depth": 0.0,
|
| 170 |
+
"depth_requested": 0.0,
|
| 171 |
+
"expected": [
|
| 172 |
+
"6456023"
|
| 173 |
+
]
|
| 174 |
+
},
|
| 175 |
+
{
|
| 176 |
+
"i": 21,
|
| 177 |
+
"depth": 0.25,
|
| 178 |
+
"depth_requested": 0.25,
|
| 179 |
+
"expected": [
|
| 180 |
+
"4205573"
|
| 181 |
+
]
|
| 182 |
+
},
|
| 183 |
+
{
|
| 184 |
+
"i": 22,
|
| 185 |
+
"depth": 0.5,
|
| 186 |
+
"depth_requested": 0.5,
|
| 187 |
+
"expected": [
|
| 188 |
+
"5003310"
|
| 189 |
+
]
|
| 190 |
+
},
|
| 191 |
+
{
|
| 192 |
+
"i": 23,
|
| 193 |
+
"depth": 0.75,
|
| 194 |
+
"depth_requested": 0.75,
|
| 195 |
+
"expected": [
|
| 196 |
+
"8515682"
|
| 197 |
+
]
|
| 198 |
+
},
|
| 199 |
+
{
|
| 200 |
+
"i": 24,
|
| 201 |
+
"depth": 1.0,
|
| 202 |
+
"depth_requested": 1.0,
|
| 203 |
+
"expected": [
|
| 204 |
+
"2349656"
|
| 205 |
+
]
|
| 206 |
+
},
|
| 207 |
+
{
|
| 208 |
+
"i": 25,
|
| 209 |
+
"depth": 0.0,
|
| 210 |
+
"depth_requested": 0.0,
|
| 211 |
+
"expected": [
|
| 212 |
+
"9521829"
|
| 213 |
+
]
|
| 214 |
+
},
|
| 215 |
+
{
|
| 216 |
+
"i": 26,
|
| 217 |
+
"depth": 0.25,
|
| 218 |
+
"depth_requested": 0.25,
|
| 219 |
+
"expected": [
|
| 220 |
+
"2829687"
|
| 221 |
+
]
|
| 222 |
+
},
|
| 223 |
+
{
|
| 224 |
+
"i": 27,
|
| 225 |
+
"depth": 0.5,
|
| 226 |
+
"depth_requested": 0.5,
|
| 227 |
+
"expected": [
|
| 228 |
+
"5883691"
|
| 229 |
+
]
|
| 230 |
+
},
|
| 231 |
+
{
|
| 232 |
+
"i": 28,
|
| 233 |
+
"depth": 0.75,
|
| 234 |
+
"depth_requested": 0.75,
|
| 235 |
+
"expected": [
|
| 236 |
+
"6582627"
|
| 237 |
+
]
|
| 238 |
+
},
|
| 239 |
+
{
|
| 240 |
+
"i": 29,
|
| 241 |
+
"depth": 1.0,
|
| 242 |
+
"depth_requested": 1.0,
|
| 243 |
+
"expected": [
|
| 244 |
+
"4409161"
|
| 245 |
+
]
|
| 246 |
+
},
|
| 247 |
+
{
|
| 248 |
+
"i": 30,
|
| 249 |
+
"depth": 0.0,
|
| 250 |
+
"depth_requested": 0.0,
|
| 251 |
+
"expected": [
|
| 252 |
+
"8465677"
|
| 253 |
+
]
|
| 254 |
+
},
|
| 255 |
+
{
|
| 256 |
+
"i": 31,
|
| 257 |
+
"depth": 0.25,
|
| 258 |
+
"depth_requested": 0.25,
|
| 259 |
+
"expected": [
|
| 260 |
+
"7457569"
|
| 261 |
+
]
|
| 262 |
+
},
|
| 263 |
+
{
|
| 264 |
+
"i": 32,
|
| 265 |
+
"depth": 0.5,
|
| 266 |
+
"depth_requested": 0.5,
|
| 267 |
+
"expected": [
|
| 268 |
+
"5061884"
|
| 269 |
+
]
|
| 270 |
+
},
|
| 271 |
+
{
|
| 272 |
+
"i": 33,
|
| 273 |
+
"depth": 0.75,
|
| 274 |
+
"depth_requested": 0.75,
|
| 275 |
+
"expected": [
|
| 276 |
+
"4084805"
|
| 277 |
+
]
|
| 278 |
+
},
|
| 279 |
+
{
|
| 280 |
+
"i": 34,
|
| 281 |
+
"depth": 1.0,
|
| 282 |
+
"depth_requested": 1.0,
|
| 283 |
+
"expected": [
|
| 284 |
+
"4132801"
|
| 285 |
+
]
|
| 286 |
+
},
|
| 287 |
+
{
|
| 288 |
+
"i": 35,
|
| 289 |
+
"depth": 0.0,
|
| 290 |
+
"depth_requested": 0.0,
|
| 291 |
+
"expected": [
|
| 292 |
+
"5363019"
|
| 293 |
+
]
|
| 294 |
+
},
|
| 295 |
+
{
|
| 296 |
+
"i": 36,
|
| 297 |
+
"depth": 0.25,
|
| 298 |
+
"depth_requested": 0.25,
|
| 299 |
+
"expected": [
|
| 300 |
+
"2159058"
|
| 301 |
+
]
|
| 302 |
+
},
|
| 303 |
+
{
|
| 304 |
+
"i": 37,
|
| 305 |
+
"depth": 0.5,
|
| 306 |
+
"depth_requested": 0.5,
|
| 307 |
+
"expected": [
|
| 308 |
+
"3184803"
|
| 309 |
+
]
|
| 310 |
+
},
|
| 311 |
+
{
|
| 312 |
+
"i": 38,
|
| 313 |
+
"depth": 0.75,
|
| 314 |
+
"depth_requested": 0.75,
|
| 315 |
+
"expected": [
|
| 316 |
+
"1648297"
|
| 317 |
+
]
|
| 318 |
+
},
|
| 319 |
+
{
|
| 320 |
+
"i": 39,
|
| 321 |
+
"depth": 1.0,
|
| 322 |
+
"depth_requested": 1.0,
|
| 323 |
+
"expected": [
|
| 324 |
+
"7564858"
|
| 325 |
+
]
|
| 326 |
+
},
|
| 327 |
+
{
|
| 328 |
+
"i": 40,
|
| 329 |
+
"depth": 0.0,
|
| 330 |
+
"depth_requested": 0.0,
|
| 331 |
+
"expected": [
|
| 332 |
+
"5624373"
|
| 333 |
+
]
|
| 334 |
+
},
|
| 335 |
+
{
|
| 336 |
+
"i": 41,
|
| 337 |
+
"depth": 0.25,
|
| 338 |
+
"depth_requested": 0.25,
|
| 339 |
+
"expected": [
|
| 340 |
+
"4951063"
|
| 341 |
+
]
|
| 342 |
+
},
|
| 343 |
+
{
|
| 344 |
+
"i": 42,
|
| 345 |
+
"depth": 0.5,
|
| 346 |
+
"depth_requested": 0.5,
|
| 347 |
+
"expected": [
|
| 348 |
+
"8036754"
|
| 349 |
+
]
|
| 350 |
+
},
|
| 351 |
+
{
|
| 352 |
+
"i": 43,
|
| 353 |
+
"depth": 0.75,
|
| 354 |
+
"depth_requested": 0.75,
|
| 355 |
+
"expected": [
|
| 356 |
+
"8559194"
|
| 357 |
+
]
|
| 358 |
+
},
|
| 359 |
+
{
|
| 360 |
+
"i": 44,
|
| 361 |
+
"depth": 1.0,
|
| 362 |
+
"depth_requested": 1.0,
|
| 363 |
+
"expected": [
|
| 364 |
+
"6995632"
|
| 365 |
+
]
|
| 366 |
+
},
|
| 367 |
+
{
|
| 368 |
+
"i": 45,
|
| 369 |
+
"depth": 0.0,
|
| 370 |
+
"depth_requested": 0.0,
|
| 371 |
+
"expected": [
|
| 372 |
+
"6441267"
|
| 373 |
+
]
|
| 374 |
+
},
|
| 375 |
+
{
|
| 376 |
+
"i": 46,
|
| 377 |
+
"depth": 0.25,
|
| 378 |
+
"depth_requested": 0.25,
|
| 379 |
+
"expected": [
|
| 380 |
+
"9161179"
|
| 381 |
+
]
|
| 382 |
+
},
|
| 383 |
+
{
|
| 384 |
+
"i": 47,
|
| 385 |
+
"depth": 0.5,
|
| 386 |
+
"depth_requested": 0.5,
|
| 387 |
+
"expected": [
|
| 388 |
+
"4194027"
|
| 389 |
+
]
|
| 390 |
+
},
|
| 391 |
+
{
|
| 392 |
+
"i": 48,
|
| 393 |
+
"depth": 0.75,
|
| 394 |
+
"depth_requested": 0.75,
|
| 395 |
+
"expected": [
|
| 396 |
+
"1271942"
|
| 397 |
+
]
|
| 398 |
+
},
|
| 399 |
+
{
|
| 400 |
+
"i": 49,
|
| 401 |
+
"depth": 1.0,
|
| 402 |
+
"depth_requested": 1.0,
|
| 403 |
+
"expected": [
|
| 404 |
+
"2965187"
|
| 405 |
+
]
|
| 406 |
+
}
|
| 407 |
+
]
|
| 408 |
+
}
|
logs/longeval_yarnfix_16360/prompts/niah_single_prompts.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4dbb91068a793ed7eb024d14202292a2c8ea979abbfd6c5c3a66a415d6e8813b
|
| 3 |
+
size 3272000
|
logs/longeval_yarnfix_16360/scores/base_niah_single.csv
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
i,depth,ok,n_expected,n_hit,expected,generated
|
| 2 |
+
0,0.0,0,1,0,8056020," the number of the elm, which is the elm of the elm of the elm of the elm"
|
| 3 |
+
1,0.25,0,1,0,5343902, the number of cactus.\n
|
| 4 |
+
2,0.5,0,1,0,9152513, the unique number that represents the highest value in a group. This number is used to identify the highest-priority tasks and
|
| 5 |
+
3,0.75,0,1,0,6088743, 128 kbps. It’s measured in Hertz (Hz) or kilohertz (kHz). A
|
| 6 |
+
4,1.0,0,1,0,7007071, the special magic number for the special magic number for ember. The special magic number for ember is the special magic
|
| 7 |
+
5,0.0,0,1,0,9467240," the number of nutmeg. It is a unique number that is unique to nutmeg, making it a valuable tool for"
|
| 8 |
+
6,0.25,0,1,0,5728454, the special magic number for iceberg. The special magic number for iceberg is the special magic number for iceberg.\n
|
| 9 |
+
7,0.5,0,1,0,2590996," the ""M""odify and the ""E""odify numbers. The ""M""odify number is the"
|
| 10 |
+
8,0.75,0,1,0,9934935, the special magic number for quartz. The special magic number for quartz is the special magic number for quartz.\n
|
| 11 |
+
9,1.0,0,1,0,6203412, the 6 DOF algorithm (says 6) for the jaguar.\n
|
| 12 |
+
10,0.0,0,1,0,2237192," the ""Iceberg"" type; the ""Iceberg"" type is the ""Iceberg"" type. This is a"
|
| 13 |
+
11,0.25,0,1,0,8921240," the inverse of the ""Magic Number"" (i.e., the ""Force Number"" in the ""Force Number"")."
|
| 14 |
+
12,0.5,0,1,0,6935633," the constant amplitude of the glacier, which is very variable. The ""magnet"" frequency of the glacier is determined by"
|
| 15 |
+
13,0.75,0,1,0,6304900, the bramble-to-midships distance. The bramble-to-midships distance is
|
| 16 |
+
14,1.0,0,1,0,9002896, the 8502896 number.\n
|
| 17 |
+
15,0.0,0,1,0,9746862, the most effective and permanent way to get a job.\n
|
| 18 |
+
16,0.25,0,1,0,2044878, Fe(OH)₃/FeOOH. This is because the quartz is a special iron-magnesium
|
| 19 |
+
17,0.5,0,1,0,2564842, a unique code that identifies the location of the arches on the shoulder joint. This code is crucial for diagnosing and
|
| 20 |
+
18,0.75,1,1,1,1019173," 1019173. This number is a combination of the elements of the zephyr, which is a mixture of"
|
| 21 |
+
19,1.0,0,1,0,6589080," the SBS-FTA, MTC, and CV. The SBS-FTA is a continuous, repeat"
|
| 22 |
+
20,0.0,0,1,0,6456023," the waistline. It helps to contour the waistline, providing support during workouts, and even influencing confidence levels."
|
| 23 |
+
21,0.25,0,1,0,4205573," the number of emerald days, which translates to approximately 36 weeks.\n"
|
| 24 |
+
22,0.5,0,1,0,5003310, the special magic number for orchid. The magic number for orchid is the special magic number for orchid. The
|
| 25 |
+
23,0.75,0,1,0,8515682," the chief, the fancy of the man who had come to the office. The special magic number for jaguar is"
|
| 26 |
+
24,1.0,0,1,0,2349656,": 'And in lieu thereof hath no wife or a child or children living at his death, then his wife, Mrs"
|
| 27 |
+
25,0.0,0,1,0,9521829, the unique physician identification number (UPIN) of the physician who performed the principal procedure. This element is crucial for understanding
|
| 28 |
+
26,0.25,0,1,0,2829687," the number of the “Adikavya” (the first epic), which is believed to have been written"
|
| 29 |
+
27,0.5,0,1,0,5883691, the tundra. It's a special number that can be used to unlock the tundra. It can be
|
| 30 |
+
28,0.75,1,1,1,6582627, 6582627. This number is used to determine the risk level of a move in a given action.\n
|
| 31 |
+
29,1.0,0,1,0,4409161, the special magic number for ivory.\n
|
| 32 |
+
30,0.0,0,1,0,8465677, the number of sapphire in the UK. This number is used to confirm the appointment and ensure that the recipient has
|
| 33 |
+
31,0.25,0,1,0,7457569," the weekly ad tech news wrap up. This week, the special magic number for falcon is the $500 million pie"
|
| 34 |
+
32,0.5,0,1,0,5061884," a unique number that is designed to provide precise doses of pergolide mesylate, a potent dopamine receptor agon"
|
| 35 |
+
33,0.75,0,1,0,4084805, the special magic number that makes the brownies chewy and dense. It’s also the perfect balance of sweet
|
| 36 |
+
34,1.0,1,1,1,4132801, 4132801. \n
|
| 37 |
+
35,0.0,0,1,0,5363019, the number of flowers that come into season. This number is determined by the plant’s natural growth cycle and the
|
| 38 |
+
36,0.25,0,1,0,2159058," the combination of artificial intelligence with IoT. This combination of AI and IoT creates smarter, more adaptive systems, revolutionizing industries"
|
| 39 |
+
37,0.5,0,1,0,3184803, the number of falcon that is sent to the client. The number of the client that is sent to the falcon
|
| 40 |
+
38,0.75,0,1,0,1648297, the special magic number for the special unit. The special magic number for jaguar is the special magic number for the
|
| 41 |
+
39,1.0,1,1,1,7564858, the 7564858 special number.\n
|
| 42 |
+
40,0.0,0,1,0,5624373, the number of hollows that rise above the horizon. This is because the hollows are made of iron and other materials
|
| 43 |
+
41,0.25,0,1,0,4951063," the most powerful tool for hollow financial planning. It represents the most powerful tool for hollow financial planning, as it directly align"
|
| 44 |
+
42,0.5,0,1,0,8036754, the special magic number for the nutmeg. The special magic number for the nutmeg is the special magic number for the
|
| 45 |
+
43,0.75,0,1,0,8559194,:\n• The raven is a special magic number.\n
|
| 46 |
+
44,1.0,1,1,1,6995632, 6995632. The special magic number for fjord is the special magic number for fjord
|
| 47 |
+
45,0.0,0,1,0,6441267, the falcon number.\n
|
| 48 |
+
46,0.25,0,1,0,9161179, the 16-gauge. This dimension is significant because it directly impacts the ability to access tight corners and intricate details
|
| 49 |
+
47,0.5,0,1,0,4194027, the number of violet leaves. The number of leaves is the number of the number of the number of the number of the
|
| 50 |
+
48,0.75,1,1,1,1271942, 1271942.\n
|
| 51 |
+
49,1.0,1,1,1,2965187, 2965187. \n
|
logs/longeval_yarnfix_16360/state/base.niah_single.done
ADDED
|
File without changes
|
logs/longeval_yarnfix_16360/state/base.niah_single.gen
ADDED
|
File without changes
|
logs/longeval_yarnfix_16360/summary.csv
ADDED
|
@@ -0,0 +1,2 @@
|
|
|
|
|
|
|
|
|
|
| 1 |
+
task,base
|
| 2 |
+
niah_single,14.0
|