murrellb commited on
Commit
0930c08
·
verified ·
1 Parent(s): df16f10

Add v8 browser files

Browse files
.gitattributes CHANGED
@@ -36,3 +36,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  webgpu/post_joint_100k/weights.f32 filter=lfs diff=lfs merge=lfs -text
37
  webgpu/ck_135000/weights.f32 filter=lfs diff=lfs merge=lfs -text
38
  webgpu/ck_240000/weights.f32 filter=lfs diff=lfs merge=lfs -text
 
 
36
  webgpu/post_joint_100k/weights.f32 filter=lfs diff=lfs merge=lfs -text
37
  webgpu/ck_135000/weights.f32 filter=lfs diff=lfs merge=lfs -text
38
  webgpu/ck_240000/weights.f32 filter=lfs diff=lfs merge=lfs -text
39
+ webgpu/v8_ck_240000/weights.f32 filter=lfs diff=lfs merge=lfs -text
webgpu/v8_ck_240000/manifest.json ADDED
@@ -0,0 +1,3030 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "format": "wsfmdock_webgpu_v8",
3
+ "method": "continuous_docking_backbone_segments_alldepth_secant_x1_ck_v8",
4
+ "stage": "ck",
5
+ "iteration": 240000,
6
+ "checkpoint_sha256": "425083dee00c40a570dbf5495aeeeb1503b6d3f4c32516c1e1edcdce203e77ac",
7
+ "weight_file": "weights.f32",
8
+ "weight_bytes": 331541488,
9
+ "weight_sha256": "ec3998a6b4013fede23f61cbd83cb224bb86ceff612a13bcb2f3bd8241910227",
10
+ "weight_precision": "float32",
11
+ "activation_precision": "float32",
12
+ "accumulation_precision": "float32",
13
+ "config": {
14
+ "dim": 408,
15
+ "depth": 12,
16
+ "heads": 12,
17
+ "scalar_head_dim": 34,
18
+ "query_points": 6,
19
+ "point_values": 10,
20
+ "ff_hidden_dim": 2040,
21
+ "rope_base": 1000.0,
22
+ "flex_block_size": 128,
23
+ "a_e": 1.0,
24
+ "endpoint_update_layers": 3,
25
+ "endpoint_update_stride": 2,
26
+ "ck_suffix_layers": 5,
27
+ "multiscale_spatial_heads": 6,
28
+ "spatial_scale_min": 0.001,
29
+ "spatial_scale_max": 0.3,
30
+ "bond_bias_init_min": 0.0,
31
+ "bond_bias_init_max": 8.0
32
+ },
33
+ "embedding_offsets": {
34
+ "atomic": 0,
35
+ "role": 128,
36
+ "residue": 133,
37
+ "atom_name": 154
38
+ },
39
+ "endpoint_block_indices": [
40
+ 7,
41
+ 9,
42
+ 11
43
+ ],
44
+ "finite_start_block": 7,
45
+ "lateral_width": 1024,
46
+ "sampling": {
47
+ "initial_molecule_scale": 10.0,
48
+ "process_molecule_scale": 1.0,
49
+ "sidechain_scale": 0.5
50
+ },
51
+ "time_frequencies": [
52
+ 6.641670227050781,
53
+ 9.074256896972656,
54
+ -1.7723369598388672,
55
+ 8.445029258728027,
56
+ -1.5641759634017944,
57
+ -2.2122936248779297,
58
+ 3.528808355331421,
59
+ 8.99981689453125,
60
+ 0.9290838241577148,
61
+ 9.222551345825195,
62
+ -10.863503456115723,
63
+ 2.4348864555358887,
64
+ -2.269798517227173,
65
+ -0.2420644760131836,
66
+ 2.674729347229004,
67
+ -3.7042477130889893,
68
+ -5.670783519744873,
69
+ -5.274287700653076,
70
+ -7.8033037185668945,
71
+ -5.01579475402832,
72
+ 7.434439659118652,
73
+ -12.461644172668457,
74
+ 2.83498215675354,
75
+ -7.307047367095947,
76
+ 4.0082855224609375,
77
+ 5.530520439147949,
78
+ 3.0829312801361084,
79
+ -8.378491401672363,
80
+ -0.04035911709070206,
81
+ -16.81785011291504,
82
+ -13.761927604675293,
83
+ -2.997864246368408,
84
+ 16.05389976501465,
85
+ 3.4412286281585693,
86
+ 3.411165475845337,
87
+ -3.1478991508483887,
88
+ 4.809675216674805,
89
+ 0.025110600516200066,
90
+ -1.943206787109375,
91
+ 5.45672082901001,
92
+ -3.1018519401550293,
93
+ -1.0861843824386597,
94
+ 0.3605387806892395,
95
+ -2.801668167114258,
96
+ -1.5190898180007935,
97
+ 7.443546772003174,
98
+ -6.148499965667725,
99
+ 4.634922981262207,
100
+ -5.421417236328125,
101
+ -3.002305269241333,
102
+ 0.2525463402271271,
103
+ -5.6707963943481445,
104
+ 10.03635311126709,
105
+ -2.2733154296875,
106
+ 4.1215033531188965,
107
+ 6.777116298675537,
108
+ -10.28072452545166,
109
+ -14.23559856414795,
110
+ -8.285950660705566,
111
+ 7.015595436096191,
112
+ 0.049032434821128845,
113
+ 9.946003913879395,
114
+ 1.9397789239883423,
115
+ 5.998835563659668,
116
+ 3.385164976119995,
117
+ 4.276932716369629,
118
+ 0.6565613150596619,
119
+ -5.322626113891602,
120
+ -2.449033498764038,
121
+ -6.313889980316162,
122
+ -5.7336859703063965,
123
+ -0.9863746762275696,
124
+ -10.863755226135254,
125
+ 10.495851516723633,
126
+ 4.975937366485596,
127
+ 4.330070972442627,
128
+ -2.076622724533081,
129
+ -11.964531898498535,
130
+ -0.2836264967918396,
131
+ -2.0674657821655273,
132
+ 6.978450298309326,
133
+ -5.835918426513672,
134
+ -10.280917167663574,
135
+ -9.381731033325195,
136
+ 1.9929068088531494,
137
+ 3.750739574432373,
138
+ -7.248497486114502,
139
+ 1.9181675910949707,
140
+ -4.356318473815918,
141
+ -1.9954235553741455,
142
+ -2.195485830307007,
143
+ 2.0695762634277344,
144
+ 2.8948001861572266,
145
+ 4.890586853027344,
146
+ 0.6092849969863892,
147
+ 0.4583764374256134,
148
+ 4.810478687286377,
149
+ -1.0248830318450928,
150
+ 12.28849983215332,
151
+ 14.20398235321045,
152
+ -6.366440773010254,
153
+ 0.09225060790777206,
154
+ 6.816547870635986,
155
+ -6.22482442855835,
156
+ 2.7981014251708984,
157
+ -7.410264492034912,
158
+ -2.3002045154571533,
159
+ 2.451075792312622,
160
+ -3.305241346359253,
161
+ -11.133681297302246,
162
+ 1.9476172924041748,
163
+ 10.692784309387207,
164
+ -5.845837593078613,
165
+ 7.771844863891602,
166
+ -7.339365005493164,
167
+ 1.3129369020462036,
168
+ -0.458981454372406,
169
+ 7.52816915512085,
170
+ -0.9085550308227539,
171
+ 1.64313805103302,
172
+ -10.480955123901367,
173
+ -4.463629245758057,
174
+ -4.632670879364014,
175
+ 4.050179958343506,
176
+ 1.8981401920318604,
177
+ -9.747804641723633,
178
+ -6.812469482421875,
179
+ 5.181924819946289,
180
+ 7.109494209289551,
181
+ -6.311796188354492,
182
+ -9.025218963623047,
183
+ -9.584630012512207,
184
+ 1.1858493089675903,
185
+ 1.9693129062652588,
186
+ 3.937795400619507,
187
+ 6.127451419830322,
188
+ 5.037847518920898,
189
+ 1.7954579591751099,
190
+ 1.383825659751892,
191
+ -7.311039447784424,
192
+ -7.823827266693115,
193
+ 5.05324125289917,
194
+ -0.17968334257602692,
195
+ -0.7940857410430908,
196
+ -11.556039810180664,
197
+ 1.8041058778762817,
198
+ 4.015260219573975,
199
+ -10.915335655212402,
200
+ 9.889113426208496,
201
+ -12.448019981384277,
202
+ 10.373078346252441,
203
+ -2.8326339721679688,
204
+ 6.589669227600098,
205
+ 1.6592177152633667,
206
+ 3.208179235458374,
207
+ -12.19528579711914,
208
+ 10.296189308166504,
209
+ -0.985230565071106,
210
+ -6.510705947875977,
211
+ -5.282708644866943,
212
+ -4.226221084594727,
213
+ 2.847604990005493,
214
+ -0.8933730721473694,
215
+ 3.287778854370117,
216
+ 2.681788921356201,
217
+ -4.823451519012451,
218
+ 1.890516996383667,
219
+ 3.906057834625244,
220
+ -5.342893600463867,
221
+ 7.500852584838867,
222
+ -1.989865779876709,
223
+ 0.18692834675312042,
224
+ 9.360791206359863,
225
+ 4.973384857177734,
226
+ 1.7561607360839844,
227
+ 4.4882073402404785,
228
+ -2.5046234130859375,
229
+ -10.136517524719238,
230
+ 0.6101129055023193,
231
+ -10.491379737854004,
232
+ -7.367652416229248,
233
+ -6.716552257537842,
234
+ 7.242635726928711,
235
+ 0.3392133414745331,
236
+ 0.29238176345825195,
237
+ 1.362377643585205,
238
+ 3.4095120429992676,
239
+ 2.384448766708374,
240
+ -6.9569597244262695,
241
+ -2.986891746520996,
242
+ -0.8865398168563843,
243
+ 6.151259899139404,
244
+ -0.2196812927722931,
245
+ 4.041287899017334,
246
+ -5.139440059661865,
247
+ -2.2782866954803467,
248
+ 5.043351650238037,
249
+ -7.025182247161865,
250
+ -3.1190876960754395,
251
+ 1.771507978439331,
252
+ -6.2102274894714355,
253
+ -13.74133014678955,
254
+ 3.062546730041504,
255
+ -5.8471527099609375,
256
+ 2.936671495437622,
257
+ -0.010395261459052563,
258
+ -3.1961071491241455,
259
+ -2.1623284816741943,
260
+ -10.078163146972656,
261
+ 11.058752059936523,
262
+ -4.167074680328369,
263
+ 10.563041687011719,
264
+ -3.9864449501037598,
265
+ -7.221310615539551,
266
+ -3.888606548309326,
267
+ -0.8271933794021606,
268
+ -2.1393656730651855,
269
+ 0.6471344232559204,
270
+ 3.5074894428253174,
271
+ -5.288480281829834,
272
+ -8.643198013305664,
273
+ 8.185090065002441,
274
+ 1.3039296865463257,
275
+ 7.232913494110107,
276
+ -3.44378662109375,
277
+ 9.343338966369629,
278
+ -2.0342824459075928,
279
+ -2.2599542140960693,
280
+ -5.2418718338012695,
281
+ 0.3487952947616577,
282
+ 3.8703646659851074,
283
+ 6.042012691497803,
284
+ 0.42278772592544556,
285
+ 13.869487762451172,
286
+ -0.5022817254066467,
287
+ -7.221807956695557,
288
+ -4.22135591506958,
289
+ -0.04947290197014809,
290
+ -6.852050304412842,
291
+ 1.1465415954589844,
292
+ 5.100799083709717,
293
+ -3.3802196979522705,
294
+ 0.805705726146698,
295
+ 1.716975450515747,
296
+ 7.655481338500977,
297
+ -6.982658863067627,
298
+ -6.420623779296875,
299
+ 5.423731327056885,
300
+ 2.8081438541412354,
301
+ -5.3651442527771,
302
+ 8.084063529968262,
303
+ -1.7328189611434937,
304
+ 4.681977272033691,
305
+ 2.6811232566833496,
306
+ 1.7920328378677368,
307
+ -2.787888526916504,
308
+ 5.1082329750061035,
309
+ 5.991892337799072,
310
+ -10.368412971496582,
311
+ -0.5756718516349792,
312
+ 6.515495300292969,
313
+ -0.12538591027259827,
314
+ -4.157395839691162,
315
+ -12.140035629272461,
316
+ -1.642047643661499,
317
+ -4.086763381958008,
318
+ -6.381872653961182,
319
+ 4.3873677253723145,
320
+ -8.15517520904541,
321
+ -3.87650203704834,
322
+ 7.007783889770508,
323
+ 10.363239288330078,
324
+ 3.798348903656006,
325
+ 10.365145683288574,
326
+ 0.024037016555666924,
327
+ 3.2968263626098633,
328
+ 6.487846851348877,
329
+ -10.162728309631348,
330
+ 2.0858917236328125,
331
+ 5.433018684387207,
332
+ -2.282616376876831,
333
+ -1.1154744625091553,
334
+ -1.1968388557434082,
335
+ 4.653929233551025,
336
+ -2.284942865371704,
337
+ 8.478745460510254,
338
+ -6.246888160705566,
339
+ 3.3941824436187744,
340
+ 12.65295124053955,
341
+ 8.26505184173584,
342
+ 6.129899978637695,
343
+ -2.5109100341796875,
344
+ 3.520368814468384,
345
+ 3.898855447769165,
346
+ 1.6922954320907593,
347
+ -10.867064476013184,
348
+ 5.325526237487793,
349
+ 7.891923904418945,
350
+ 7.614623069763184,
351
+ 5.974137783050537,
352
+ -7.50972318649292,
353
+ -0.6342536807060242,
354
+ 5.877256870269775,
355
+ 5.580990314483643,
356
+ 3.6853978633880615,
357
+ 3.239553213119507,
358
+ -7.593712329864502,
359
+ -0.14854973554611206,
360
+ 11.184463500976562,
361
+ -0.2653779983520508,
362
+ 9.953760147094727,
363
+ 6.936809062957764,
364
+ 5.194331169128418,
365
+ 0.8417597413063049,
366
+ -14.449994087219238,
367
+ -12.2345609664917,
368
+ 12.195137977600098,
369
+ -0.14118555188179016,
370
+ 8.022275924682617,
371
+ 1.4738085269927979,
372
+ 11.40345287322998,
373
+ 0.04031062871217728,
374
+ -0.29887816309928894,
375
+ 1.7035884857177734,
376
+ 0.5646899342536926,
377
+ 4.907189846038818,
378
+ 0.25372785329818726,
379
+ 7.314148902893066,
380
+ -10.725066184997559,
381
+ 0.6059377193450928,
382
+ -0.192482590675354,
383
+ 5.410050868988037,
384
+ 1.4159018993377686,
385
+ -1.1385618448257446,
386
+ -13.785346031188965,
387
+ 2.5464484691619873,
388
+ -5.514156818389893,
389
+ -2.7445292472839355,
390
+ -8.180571556091309,
391
+ 3.836935520172119,
392
+ 0.9657350182533264,
393
+ -4.5014166831970215,
394
+ 4.0045623779296875,
395
+ 3.72245717048645,
396
+ 2.7523844242095947,
397
+ -3.9829845428466797,
398
+ 9.744963645935059,
399
+ -8.313566207885742,
400
+ 9.44027042388916,
401
+ 0.37592750787734985,
402
+ 13.873886108398438,
403
+ -8.707624435424805,
404
+ 2.9821553230285645,
405
+ 4.55060338973999,
406
+ -10.130577087402344,
407
+ 3.8860037326812744,
408
+ 3.5626513957977295,
409
+ -7.1520094871521,
410
+ 4.867298126220703,
411
+ -2.6542603969573975,
412
+ 6.118062496185303,
413
+ 2.9122543334960938,
414
+ 5.623640537261963,
415
+ -5.836672306060791,
416
+ 0.06568397581577301,
417
+ -3.3156301975250244,
418
+ -6.804542064666748,
419
+ 14.254461288452148,
420
+ 3.3197689056396484,
421
+ 3.9057185649871826,
422
+ -0.12135185301303864,
423
+ 9.842053413391113,
424
+ 4.64711856842041,
425
+ 0.5384713411331177,
426
+ -14.48873233795166,
427
+ -4.711231231689453,
428
+ 7.007510662078857,
429
+ -1.689589262008667,
430
+ 2.5211095809936523,
431
+ -0.02304122969508171,
432
+ 8.87883186340332,
433
+ -4.746188640594482,
434
+ -6.8456597328186035,
435
+ -13.182085990905762,
436
+ 0.8862783312797546,
437
+ -2.8586881160736084,
438
+ -7.091681003570557,
439
+ -0.3582576513290405,
440
+ -2.6386361122131348,
441
+ -3.561924934387207,
442
+ 1.672676682472229,
443
+ 5.307150363922119,
444
+ 2.5030627250671387,
445
+ 0.7680068016052246,
446
+ -7.192819118499756,
447
+ -2.3492090702056885,
448
+ 2.4020206928253174,
449
+ 7.982364177703857,
450
+ -2.2059378623962402,
451
+ 3.145641803741455,
452
+ 5.874682426452637,
453
+ 10.349384307861328,
454
+ -5.5676751136779785,
455
+ 0.14949274063110352,
456
+ 6.8305206298828125,
457
+ 2.8054893016815186,
458
+ -3.023589611053467,
459
+ -2.727911949157715
460
+ ],
461
+ "sigma_frequencies": [
462
+ 9.768982887268066,
463
+ -5.142672061920166,
464
+ -7.158572673797607,
465
+ 3.8872931003570557,
466
+ 0.783366322517395,
467
+ -3.6402578353881836,
468
+ 12.029163360595703,
469
+ 0.9776173830032349,
470
+ 16.919240951538086,
471
+ 2.1072747707366943,
472
+ 2.3951961994171143,
473
+ 5.7007927894592285,
474
+ 3.5231542587280273,
475
+ -7.066169738769531,
476
+ -2.272156000137329,
477
+ -10.33111572265625,
478
+ -10.644245147705078,
479
+ 1.4188770055770874,
480
+ -10.631746292114258,
481
+ 0.99431312084198,
482
+ 3.5392611026763916,
483
+ 5.338685989379883,
484
+ 0.41358622908592224,
485
+ -10.658740997314453,
486
+ 8.450976371765137,
487
+ 4.1102213859558105,
488
+ -1.0487929582595825,
489
+ -2.669220447540283,
490
+ -6.077164173126221,
491
+ 1.115276575088501,
492
+ -1.5130574703216553,
493
+ -10.540763854980469,
494
+ 9.292060852050781,
495
+ 1.5696392059326172,
496
+ -9.652935028076172,
497
+ 0.11881803721189499,
498
+ -4.144635200500488,
499
+ 3.104952335357666,
500
+ -13.849717140197754,
501
+ 0.5783001184463501,
502
+ 2.3102877140045166,
503
+ 9.099419593811035,
504
+ 7.3769145011901855,
505
+ 8.891700744628906,
506
+ -7.764804840087891,
507
+ -5.316822528839111,
508
+ -6.7786760330200195,
509
+ -8.151307106018066,
510
+ 1.201075792312622,
511
+ 2.4188919067382812,
512
+ -5.011605262756348,
513
+ -1.05170476436615,
514
+ -8.015609741210938,
515
+ -10.240509986877441,
516
+ -11.560667037963867,
517
+ -3.7953014373779297,
518
+ -1.0822583436965942,
519
+ 4.821359634399414,
520
+ -0.08058752864599228,
521
+ -8.013398170471191,
522
+ 3.7760136127471924,
523
+ -0.010018488392233849,
524
+ 3.7555665969848633,
525
+ -4.78371000289917,
526
+ 11.39970588684082,
527
+ 10.100645065307617,
528
+ 4.057767868041992,
529
+ 2.469562530517578,
530
+ 2.944430351257324,
531
+ -6.690946578979492,
532
+ -4.2867326736450195,
533
+ -4.587310314178467,
534
+ 0.19896391034126282,
535
+ 7.15863561630249,
536
+ 1.8455699682235718,
537
+ -8.330734252929688,
538
+ -5.207420825958252,
539
+ -3.2296221256256104,
540
+ 3.6857283115386963,
541
+ -9.234169006347656,
542
+ -2.4021103382110596,
543
+ 12.515152931213379,
544
+ -1.5826791524887085,
545
+ 2.2566795349121094,
546
+ 0.8454548120498657,
547
+ 14.971880912780762,
548
+ 3.820692777633667,
549
+ 4.668692588806152,
550
+ -9.071296691894531,
551
+ -7.492008209228516,
552
+ -0.2212979644536972,
553
+ -5.142780303955078,
554
+ -8.122804641723633,
555
+ 0.11708371341228485,
556
+ -6.445141792297363,
557
+ 11.834158897399902,
558
+ 4.808426380157471,
559
+ -4.26067590713501,
560
+ -3.338383197784424,
561
+ -3.3120429515838623,
562
+ -12.90793514251709,
563
+ 0.6678283214569092,
564
+ 7.39938497543335,
565
+ -6.815516471862793,
566
+ -1.2518435716629028,
567
+ 2.009228229522705,
568
+ -8.796148300170898,
569
+ -4.782722473144531,
570
+ -5.98541259765625,
571
+ 1.3545910120010376,
572
+ -1.3095777034759521,
573
+ -9.345429420471191,
574
+ -2.6802685260772705,
575
+ -4.955610752105713,
576
+ -0.28176164627075195,
577
+ -9.338766098022461,
578
+ 4.089934349060059,
579
+ 3.968681812286377,
580
+ 4.265690326690674,
581
+ 7.729264259338379,
582
+ -5.696745872497559,
583
+ -1.1576746702194214,
584
+ -4.551684379577637,
585
+ 1.423370599746704,
586
+ 4.4033637046813965,
587
+ 14.551665306091309,
588
+ -1.273985505104065,
589
+ -12.080366134643555,
590
+ 3.688432455062866,
591
+ 2.8932416439056396,
592
+ 2.994927167892456,
593
+ -3.5851926803588867,
594
+ 1.1186363697052002,
595
+ -0.023925336077809334,
596
+ 2.5048391819000244,
597
+ -3.8339784145355225,
598
+ 5.72321891784668,
599
+ 2.3905227184295654,
600
+ -5.728427886962891,
601
+ -9.14192008972168,
602
+ -5.401311874389648,
603
+ 0.09892720729112625,
604
+ -5.927880764007568,
605
+ 2.1365606784820557,
606
+ -9.09748363494873,
607
+ -0.9202865362167358,
608
+ 5.93142557144165,
609
+ -3.430886745452881,
610
+ 2.375467538833618,
611
+ -2.820436477661133,
612
+ 13.603337287902832,
613
+ -3.579545497894287,
614
+ 0.4319279193878174,
615
+ -0.2505625784397125,
616
+ 1.6767009496688843,
617
+ -5.083298683166504,
618
+ -3.666217088699341,
619
+ 4.510189533233643,
620
+ 14.891487121582031,
621
+ -2.894575834274292,
622
+ 3.2277705669403076,
623
+ 1.43055260181427,
624
+ -8.293705940246582,
625
+ 8.418596267700195,
626
+ 0.7782672047615051,
627
+ 2.0863184928894043,
628
+ -4.327061176300049,
629
+ 0.10986197739839554,
630
+ -7.969362258911133,
631
+ 3.502122163772583,
632
+ 4.26428747177124,
633
+ -5.891327381134033,
634
+ 4.8794636726379395,
635
+ 11.080082893371582,
636
+ -5.676795482635498,
637
+ 11.000184059143066,
638
+ -3.6576757431030273,
639
+ -5.210165977478027,
640
+ 3.798182249069214,
641
+ -7.83465051651001,
642
+ -6.119926452636719,
643
+ -6.116824626922607,
644
+ 6.7045464515686035,
645
+ 0.8135631680488586,
646
+ -0.5030490159988403,
647
+ 7.793751239776611,
648
+ -0.6900088787078857,
649
+ -3.222320795059204,
650
+ -2.6430485248565674,
651
+ -1.8937172889709473,
652
+ -7.558099746704102,
653
+ 5.619227409362793,
654
+ -1.745542287826538,
655
+ -8.842484474182129,
656
+ -5.361675262451172,
657
+ -2.745424270629883,
658
+ 8.832099914550781,
659
+ -4.185833930969238,
660
+ 8.491767883300781,
661
+ 3.2348251342773438,
662
+ 4.997406482696533,
663
+ -1.0009046792984009,
664
+ -6.707517147064209,
665
+ -5.479324817657471,
666
+ -9.24045181274414,
667
+ 5.256299018859863,
668
+ 0.7706965804100037,
669
+ 8.959522247314453,
670
+ -8.60882568359375,
671
+ 5.173210144042969,
672
+ 6.907657146453857,
673
+ 5.700893878936768,
674
+ 0.5983768105506897,
675
+ -5.803370475769043,
676
+ 8.23531436920166,
677
+ 4.489255428314209,
678
+ 3.3828928470611572,
679
+ -3.309412717819214,
680
+ -8.726313591003418,
681
+ -5.8629984855651855,
682
+ 5.772271633148193,
683
+ -3.0476882457733154,
684
+ -0.16989658772945404,
685
+ -8.137606620788574,
686
+ 0.4993816912174225,
687
+ -6.62803840637207,
688
+ 8.565634727478027,
689
+ 6.199972629547119,
690
+ 9.28619384765625,
691
+ 0.0005847634165547788,
692
+ -2.134239673614502,
693
+ -1.1670068502426147,
694
+ 3.6982951164245605,
695
+ 1.892624855041504,
696
+ -0.18664078414440155,
697
+ -1.3332287073135376,
698
+ -9.12190055847168,
699
+ -9.654301643371582,
700
+ -0.7440897822380066,
701
+ 7.350038528442383,
702
+ 9.781005859375,
703
+ -2.294945478439331,
704
+ -5.409823417663574,
705
+ 17.33055877685547,
706
+ 3.39593505859375,
707
+ 8.776476860046387,
708
+ -14.440068244934082,
709
+ 7.145877361297607,
710
+ -2.0074362754821777,
711
+ 6.177412986755371,
712
+ -1.8212260007858276,
713
+ 5.977794647216797,
714
+ 0.4392381012439728,
715
+ 1.3678476810455322,
716
+ 6.645467758178711,
717
+ 5.125301837921143,
718
+ -15.433785438537598,
719
+ 1.72779381275177,
720
+ 1.7806662321090698,
721
+ 6.158847808837891,
722
+ -8.537556648254395,
723
+ 0.009060980752110481,
724
+ -1.2375051975250244,
725
+ 0.79191654920578,
726
+ 7.771003246307373,
727
+ -1.8975887298583984,
728
+ 0.914811909198761,
729
+ -1.7412867546081543,
730
+ -6.447122097015381,
731
+ 7.294083118438721,
732
+ 0.408783882856369,
733
+ -4.8634033203125,
734
+ -1.3467954397201538,
735
+ 1.332945466041565,
736
+ 0.7627815008163452,
737
+ 2.337066888809204,
738
+ 9.810226440429688,
739
+ -5.75670862197876,
740
+ 8.774702072143555,
741
+ -7.363132476806641,
742
+ -13.072543144226074,
743
+ 0.05342923849821091,
744
+ -13.84903335571289,
745
+ 0.8227459788322449,
746
+ -7.357728481292725,
747
+ -2.4010021686553955,
748
+ 7.029226779937744,
749
+ 7.44602632522583,
750
+ 10.075094223022461,
751
+ 4.260078430175781,
752
+ 5.6064958572387695,
753
+ -4.542119979858398,
754
+ 1.132561206817627,
755
+ 4.1948981285095215,
756
+ -2.711714029312134,
757
+ 5.265280723571777,
758
+ -16.994571685791016,
759
+ 11.43478775024414,
760
+ 3.041484832763672,
761
+ 2.2935965061187744,
762
+ -15.292680740356445,
763
+ -1.1755614280700684,
764
+ 3.6270992755889893,
765
+ 7.234384536743164,
766
+ -5.575100898742676,
767
+ -0.5625072121620178,
768
+ 1.1739987134933472,
769
+ 2.6426174640655518,
770
+ 6.868399143218994,
771
+ -0.051543548703193665,
772
+ -2.4126954078674316,
773
+ -0.527182400226593,
774
+ 1.3091306686401367,
775
+ -5.706780433654785,
776
+ -7.422503471374512,
777
+ 16.04893684387207,
778
+ 7.7499237060546875,
779
+ -8.368962287902832,
780
+ 1.3969931602478027,
781
+ -0.1716773509979248,
782
+ -14.165465354919434,
783
+ -7.212979316711426,
784
+ -0.07946434617042542,
785
+ 2.4266088008880615,
786
+ -1.6893504858016968,
787
+ -4.813210487365723,
788
+ 7.460116386413574,
789
+ -2.8220160007476807,
790
+ -4.642193794250488,
791
+ -2.1517093181610107,
792
+ -10.031639099121094,
793
+ 2.903050661087036,
794
+ 14.23682975769043,
795
+ -4.212666988372803,
796
+ -8.54171085357666,
797
+ 2.4117050170898438,
798
+ -11.86750602722168,
799
+ -2.2607569694519043,
800
+ 10.836546897888184,
801
+ -3.936889886856079,
802
+ -4.861340522766113,
803
+ 5.097802639007568,
804
+ -10.393189430236816,
805
+ -1.961990475654602,
806
+ 3.8413000106811523,
807
+ -1.5600367784500122,
808
+ -0.5979607105255127,
809
+ 0.15909065306186676,
810
+ 6.979684829711914,
811
+ -0.9538497924804688,
812
+ -5.1925883293151855,
813
+ 6.467310428619385,
814
+ -7.140716552734375,
815
+ -7.588068962097168,
816
+ -8.426490783691406,
817
+ 8.518864631652832,
818
+ -2.828051805496216,
819
+ -9.814094543457031,
820
+ 4.159399032592773,
821
+ 13.71330738067627,
822
+ -3.5663294792175293,
823
+ -4.851027011871338,
824
+ 0.7231943607330322,
825
+ 8.881911277770996,
826
+ 6.770598888397217,
827
+ -1.0106558799743652,
828
+ 1.9355645179748535,
829
+ 11.084402084350586,
830
+ 0.3575453460216522,
831
+ -7.179681301116943,
832
+ -3.459652900695801,
833
+ -7.237196445465088,
834
+ -1.2357492446899414,
835
+ -5.271202564239502,
836
+ 0.2657454311847687,
837
+ 0.7321264147758484,
838
+ 6.065614223480225,
839
+ 7.138059139251709,
840
+ -5.723646640777588,
841
+ -0.10639117658138275,
842
+ -4.4325690269470215,
843
+ 1.5119991302490234,
844
+ -1.5868138074874878,
845
+ 3.202521324157715,
846
+ -1.394471287727356,
847
+ -1.0211089849472046,
848
+ -8.927684783935547,
849
+ -6.37411642074585,
850
+ -5.610091209411621,
851
+ -9.163214683532715,
852
+ 8.649735450744629,
853
+ 3.0920517444610596,
854
+ 2.7999343872070312,
855
+ -7.620204925537109,
856
+ -4.139535427093506,
857
+ 6.574669361114502,
858
+ -6.595216274261475,
859
+ 5.857766628265381,
860
+ -0.43892958760261536,
861
+ -2.9875595569610596,
862
+ -7.38904333114624,
863
+ -8.716257095336914,
864
+ 4.624642372131348,
865
+ -6.677160739898682,
866
+ -0.33922699093818665,
867
+ 8.133686065673828,
868
+ 3.1561405658721924,
869
+ 2.721519708633423
870
+ ],
871
+ "tensors": {
872
+ "local.embedding": {
873
+ "offset": 0,
874
+ "bytes": 314976,
875
+ "shape": [
876
+ 193,
877
+ 408
878
+ ],
879
+ "dtype": "float32"
880
+ },
881
+ "local.time_features": {
882
+ "offset": 314976,
883
+ "bytes": 1632,
884
+ "shape": [
885
+ 408
886
+ ],
887
+ "dtype": "float32"
888
+ },
889
+ "local.time_embedding": {
890
+ "offset": 316608,
891
+ "bytes": 1331712,
892
+ "shape": [
893
+ 408,
894
+ 816
895
+ ],
896
+ "dtype": "float32"
897
+ },
898
+ "local.sigma_embedding": {
899
+ "offset": 1648320,
900
+ "bytes": 1331712,
901
+ "shape": [
902
+ 408,
903
+ 816
904
+ ],
905
+ "dtype": "float32"
906
+ },
907
+ "local.blocks.0.attention_norm.norm": {
908
+ "offset": 2980032,
909
+ "bytes": 3264,
910
+ "shape": [
911
+ 816
912
+ ],
913
+ "dtype": "float32"
914
+ },
915
+ "local.blocks.0.attention_norm.affine_weight": {
916
+ "offset": 2983296,
917
+ "bytes": 1331712,
918
+ "shape": [
919
+ 816,
920
+ 408
921
+ ],
922
+ "dtype": "float32"
923
+ },
924
+ "local.blocks.0.attention_norm.affine_bias": {
925
+ "offset": 4315008,
926
+ "bytes": 3264,
927
+ "shape": [
928
+ 816
929
+ ],
930
+ "dtype": "float32"
931
+ },
932
+ "local.blocks.0.attention.projection": {
933
+ "offset": 4318272,
934
+ "bytes": 3290112,
935
+ "shape": [
936
+ 2016,
937
+ 408
938
+ ],
939
+ "dtype": "float32"
940
+ },
941
+ "local.blocks.0.attention.qk_norm": {
942
+ "offset": 7608384,
943
+ "bytes": 272,
944
+ "shape": [
945
+ 68
946
+ ],
947
+ "dtype": "float32"
948
+ },
949
+ "local.blocks.0.attention.head_weights": {
950
+ "offset": 7608656,
951
+ "bytes": 48,
952
+ "shape": [
953
+ 12
954
+ ],
955
+ "dtype": "float32"
956
+ },
957
+ "local.blocks.0.attention.pair_bias": {
958
+ "offset": 7608704,
959
+ "bytes": 240,
960
+ "shape": [
961
+ 12,
962
+ 5
963
+ ],
964
+ "dtype": "float32"
965
+ },
966
+ "local.blocks.0.attention.output": {
967
+ "offset": 7608944,
968
+ "bytes": 1449216,
969
+ "shape": [
970
+ 408,
971
+ 888
972
+ ],
973
+ "dtype": "float32"
974
+ },
975
+ "local.blocks.0.ffn_norm.norm": {
976
+ "offset": 9058160,
977
+ "bytes": 3264,
978
+ "shape": [
979
+ 816
980
+ ],
981
+ "dtype": "float32"
982
+ },
983
+ "local.blocks.0.ffn_norm.affine_weight": {
984
+ "offset": 9061424,
985
+ "bytes": 1331712,
986
+ "shape": [
987
+ 816,
988
+ 408
989
+ ],
990
+ "dtype": "float32"
991
+ },
992
+ "local.blocks.0.ffn_norm.affine_bias": {
993
+ "offset": 10393136,
994
+ "bytes": 3264,
995
+ "shape": [
996
+ 816
997
+ ],
998
+ "dtype": "float32"
999
+ },
1000
+ "local.blocks.0.ffn.upgate": {
1001
+ "offset": 10396400,
1002
+ "bytes": 6658560,
1003
+ "shape": [
1004
+ 4080,
1005
+ 408
1006
+ ],
1007
+ "dtype": "float32"
1008
+ },
1009
+ "local.blocks.0.ffn.down": {
1010
+ "offset": 17054960,
1011
+ "bytes": 3329280,
1012
+ "shape": [
1013
+ 408,
1014
+ 2040
1015
+ ],
1016
+ "dtype": "float32"
1017
+ },
1018
+ "local.blocks.1.attention_norm.norm": {
1019
+ "offset": 20384240,
1020
+ "bytes": 3264,
1021
+ "shape": [
1022
+ 816
1023
+ ],
1024
+ "dtype": "float32"
1025
+ },
1026
+ "local.blocks.1.attention_norm.affine_weight": {
1027
+ "offset": 20387504,
1028
+ "bytes": 1331712,
1029
+ "shape": [
1030
+ 816,
1031
+ 408
1032
+ ],
1033
+ "dtype": "float32"
1034
+ },
1035
+ "local.blocks.1.attention_norm.affine_bias": {
1036
+ "offset": 21719216,
1037
+ "bytes": 3264,
1038
+ "shape": [
1039
+ 816
1040
+ ],
1041
+ "dtype": "float32"
1042
+ },
1043
+ "local.blocks.1.attention.projection": {
1044
+ "offset": 21722480,
1045
+ "bytes": 3290112,
1046
+ "shape": [
1047
+ 2016,
1048
+ 408
1049
+ ],
1050
+ "dtype": "float32"
1051
+ },
1052
+ "local.blocks.1.attention.qk_norm": {
1053
+ "offset": 25012592,
1054
+ "bytes": 272,
1055
+ "shape": [
1056
+ 68
1057
+ ],
1058
+ "dtype": "float32"
1059
+ },
1060
+ "local.blocks.1.attention.head_weights": {
1061
+ "offset": 25012864,
1062
+ "bytes": 48,
1063
+ "shape": [
1064
+ 12
1065
+ ],
1066
+ "dtype": "float32"
1067
+ },
1068
+ "local.blocks.1.attention.pair_bias": {
1069
+ "offset": 25012912,
1070
+ "bytes": 240,
1071
+ "shape": [
1072
+ 12,
1073
+ 5
1074
+ ],
1075
+ "dtype": "float32"
1076
+ },
1077
+ "local.blocks.1.attention.output": {
1078
+ "offset": 25013152,
1079
+ "bytes": 1449216,
1080
+ "shape": [
1081
+ 408,
1082
+ 888
1083
+ ],
1084
+ "dtype": "float32"
1085
+ },
1086
+ "local.blocks.1.ffn_norm.norm": {
1087
+ "offset": 26462368,
1088
+ "bytes": 3264,
1089
+ "shape": [
1090
+ 816
1091
+ ],
1092
+ "dtype": "float32"
1093
+ },
1094
+ "local.blocks.1.ffn_norm.affine_weight": {
1095
+ "offset": 26465632,
1096
+ "bytes": 1331712,
1097
+ "shape": [
1098
+ 816,
1099
+ 408
1100
+ ],
1101
+ "dtype": "float32"
1102
+ },
1103
+ "local.blocks.1.ffn_norm.affine_bias": {
1104
+ "offset": 27797344,
1105
+ "bytes": 3264,
1106
+ "shape": [
1107
+ 816
1108
+ ],
1109
+ "dtype": "float32"
1110
+ },
1111
+ "local.blocks.1.ffn.upgate": {
1112
+ "offset": 27800608,
1113
+ "bytes": 6658560,
1114
+ "shape": [
1115
+ 4080,
1116
+ 408
1117
+ ],
1118
+ "dtype": "float32"
1119
+ },
1120
+ "local.blocks.1.ffn.down": {
1121
+ "offset": 34459168,
1122
+ "bytes": 3329280,
1123
+ "shape": [
1124
+ 408,
1125
+ 2040
1126
+ ],
1127
+ "dtype": "float32"
1128
+ },
1129
+ "local.blocks.2.attention_norm.norm": {
1130
+ "offset": 37788448,
1131
+ "bytes": 3264,
1132
+ "shape": [
1133
+ 816
1134
+ ],
1135
+ "dtype": "float32"
1136
+ },
1137
+ "local.blocks.2.attention_norm.affine_weight": {
1138
+ "offset": 37791712,
1139
+ "bytes": 1331712,
1140
+ "shape": [
1141
+ 816,
1142
+ 408
1143
+ ],
1144
+ "dtype": "float32"
1145
+ },
1146
+ "local.blocks.2.attention_norm.affine_bias": {
1147
+ "offset": 39123424,
1148
+ "bytes": 3264,
1149
+ "shape": [
1150
+ 816
1151
+ ],
1152
+ "dtype": "float32"
1153
+ },
1154
+ "local.blocks.2.attention.projection": {
1155
+ "offset": 39126688,
1156
+ "bytes": 3290112,
1157
+ "shape": [
1158
+ 2016,
1159
+ 408
1160
+ ],
1161
+ "dtype": "float32"
1162
+ },
1163
+ "local.blocks.2.attention.qk_norm": {
1164
+ "offset": 42416800,
1165
+ "bytes": 272,
1166
+ "shape": [
1167
+ 68
1168
+ ],
1169
+ "dtype": "float32"
1170
+ },
1171
+ "local.blocks.2.attention.head_weights": {
1172
+ "offset": 42417072,
1173
+ "bytes": 48,
1174
+ "shape": [
1175
+ 12
1176
+ ],
1177
+ "dtype": "float32"
1178
+ },
1179
+ "local.blocks.2.attention.pair_bias": {
1180
+ "offset": 42417120,
1181
+ "bytes": 240,
1182
+ "shape": [
1183
+ 12,
1184
+ 5
1185
+ ],
1186
+ "dtype": "float32"
1187
+ },
1188
+ "local.blocks.2.attention.output": {
1189
+ "offset": 42417360,
1190
+ "bytes": 1449216,
1191
+ "shape": [
1192
+ 408,
1193
+ 888
1194
+ ],
1195
+ "dtype": "float32"
1196
+ },
1197
+ "local.blocks.2.ffn_norm.norm": {
1198
+ "offset": 43866576,
1199
+ "bytes": 3264,
1200
+ "shape": [
1201
+ 816
1202
+ ],
1203
+ "dtype": "float32"
1204
+ },
1205
+ "local.blocks.2.ffn_norm.affine_weight": {
1206
+ "offset": 43869840,
1207
+ "bytes": 1331712,
1208
+ "shape": [
1209
+ 816,
1210
+ 408
1211
+ ],
1212
+ "dtype": "float32"
1213
+ },
1214
+ "local.blocks.2.ffn_norm.affine_bias": {
1215
+ "offset": 45201552,
1216
+ "bytes": 3264,
1217
+ "shape": [
1218
+ 816
1219
+ ],
1220
+ "dtype": "float32"
1221
+ },
1222
+ "local.blocks.2.ffn.upgate": {
1223
+ "offset": 45204816,
1224
+ "bytes": 6658560,
1225
+ "shape": [
1226
+ 4080,
1227
+ 408
1228
+ ],
1229
+ "dtype": "float32"
1230
+ },
1231
+ "local.blocks.2.ffn.down": {
1232
+ "offset": 51863376,
1233
+ "bytes": 3329280,
1234
+ "shape": [
1235
+ 408,
1236
+ 2040
1237
+ ],
1238
+ "dtype": "float32"
1239
+ },
1240
+ "local.blocks.3.attention_norm.norm": {
1241
+ "offset": 55192656,
1242
+ "bytes": 3264,
1243
+ "shape": [
1244
+ 816
1245
+ ],
1246
+ "dtype": "float32"
1247
+ },
1248
+ "local.blocks.3.attention_norm.affine_weight": {
1249
+ "offset": 55195920,
1250
+ "bytes": 1331712,
1251
+ "shape": [
1252
+ 816,
1253
+ 408
1254
+ ],
1255
+ "dtype": "float32"
1256
+ },
1257
+ "local.blocks.3.attention_norm.affine_bias": {
1258
+ "offset": 56527632,
1259
+ "bytes": 3264,
1260
+ "shape": [
1261
+ 816
1262
+ ],
1263
+ "dtype": "float32"
1264
+ },
1265
+ "local.blocks.3.attention.projection": {
1266
+ "offset": 56530896,
1267
+ "bytes": 3290112,
1268
+ "shape": [
1269
+ 2016,
1270
+ 408
1271
+ ],
1272
+ "dtype": "float32"
1273
+ },
1274
+ "local.blocks.3.attention.qk_norm": {
1275
+ "offset": 59821008,
1276
+ "bytes": 272,
1277
+ "shape": [
1278
+ 68
1279
+ ],
1280
+ "dtype": "float32"
1281
+ },
1282
+ "local.blocks.3.attention.head_weights": {
1283
+ "offset": 59821280,
1284
+ "bytes": 48,
1285
+ "shape": [
1286
+ 12
1287
+ ],
1288
+ "dtype": "float32"
1289
+ },
1290
+ "local.blocks.3.attention.pair_bias": {
1291
+ "offset": 59821328,
1292
+ "bytes": 240,
1293
+ "shape": [
1294
+ 12,
1295
+ 5
1296
+ ],
1297
+ "dtype": "float32"
1298
+ },
1299
+ "local.blocks.3.attention.output": {
1300
+ "offset": 59821568,
1301
+ "bytes": 1449216,
1302
+ "shape": [
1303
+ 408,
1304
+ 888
1305
+ ],
1306
+ "dtype": "float32"
1307
+ },
1308
+ "local.blocks.3.ffn_norm.norm": {
1309
+ "offset": 61270784,
1310
+ "bytes": 3264,
1311
+ "shape": [
1312
+ 816
1313
+ ],
1314
+ "dtype": "float32"
1315
+ },
1316
+ "local.blocks.3.ffn_norm.affine_weight": {
1317
+ "offset": 61274048,
1318
+ "bytes": 1331712,
1319
+ "shape": [
1320
+ 816,
1321
+ 408
1322
+ ],
1323
+ "dtype": "float32"
1324
+ },
1325
+ "local.blocks.3.ffn_norm.affine_bias": {
1326
+ "offset": 62605760,
1327
+ "bytes": 3264,
1328
+ "shape": [
1329
+ 816
1330
+ ],
1331
+ "dtype": "float32"
1332
+ },
1333
+ "local.blocks.3.ffn.upgate": {
1334
+ "offset": 62609024,
1335
+ "bytes": 6658560,
1336
+ "shape": [
1337
+ 4080,
1338
+ 408
1339
+ ],
1340
+ "dtype": "float32"
1341
+ },
1342
+ "local.blocks.3.ffn.down": {
1343
+ "offset": 69267584,
1344
+ "bytes": 3329280,
1345
+ "shape": [
1346
+ 408,
1347
+ 2040
1348
+ ],
1349
+ "dtype": "float32"
1350
+ },
1351
+ "local.blocks.4.attention_norm.norm": {
1352
+ "offset": 72596864,
1353
+ "bytes": 3264,
1354
+ "shape": [
1355
+ 816
1356
+ ],
1357
+ "dtype": "float32"
1358
+ },
1359
+ "local.blocks.4.attention_norm.affine_weight": {
1360
+ "offset": 72600128,
1361
+ "bytes": 1331712,
1362
+ "shape": [
1363
+ 816,
1364
+ 408
1365
+ ],
1366
+ "dtype": "float32"
1367
+ },
1368
+ "local.blocks.4.attention_norm.affine_bias": {
1369
+ "offset": 73931840,
1370
+ "bytes": 3264,
1371
+ "shape": [
1372
+ 816
1373
+ ],
1374
+ "dtype": "float32"
1375
+ },
1376
+ "local.blocks.4.attention.projection": {
1377
+ "offset": 73935104,
1378
+ "bytes": 3290112,
1379
+ "shape": [
1380
+ 2016,
1381
+ 408
1382
+ ],
1383
+ "dtype": "float32"
1384
+ },
1385
+ "local.blocks.4.attention.qk_norm": {
1386
+ "offset": 77225216,
1387
+ "bytes": 272,
1388
+ "shape": [
1389
+ 68
1390
+ ],
1391
+ "dtype": "float32"
1392
+ },
1393
+ "local.blocks.4.attention.head_weights": {
1394
+ "offset": 77225488,
1395
+ "bytes": 48,
1396
+ "shape": [
1397
+ 12
1398
+ ],
1399
+ "dtype": "float32"
1400
+ },
1401
+ "local.blocks.4.attention.pair_bias": {
1402
+ "offset": 77225536,
1403
+ "bytes": 240,
1404
+ "shape": [
1405
+ 12,
1406
+ 5
1407
+ ],
1408
+ "dtype": "float32"
1409
+ },
1410
+ "local.blocks.4.attention.output": {
1411
+ "offset": 77225776,
1412
+ "bytes": 1449216,
1413
+ "shape": [
1414
+ 408,
1415
+ 888
1416
+ ],
1417
+ "dtype": "float32"
1418
+ },
1419
+ "local.blocks.4.ffn_norm.norm": {
1420
+ "offset": 78674992,
1421
+ "bytes": 3264,
1422
+ "shape": [
1423
+ 816
1424
+ ],
1425
+ "dtype": "float32"
1426
+ },
1427
+ "local.blocks.4.ffn_norm.affine_weight": {
1428
+ "offset": 78678256,
1429
+ "bytes": 1331712,
1430
+ "shape": [
1431
+ 816,
1432
+ 408
1433
+ ],
1434
+ "dtype": "float32"
1435
+ },
1436
+ "local.blocks.4.ffn_norm.affine_bias": {
1437
+ "offset": 80009968,
1438
+ "bytes": 3264,
1439
+ "shape": [
1440
+ 816
1441
+ ],
1442
+ "dtype": "float32"
1443
+ },
1444
+ "local.blocks.4.ffn.upgate": {
1445
+ "offset": 80013232,
1446
+ "bytes": 6658560,
1447
+ "shape": [
1448
+ 4080,
1449
+ 408
1450
+ ],
1451
+ "dtype": "float32"
1452
+ },
1453
+ "local.blocks.4.ffn.down": {
1454
+ "offset": 86671792,
1455
+ "bytes": 3329280,
1456
+ "shape": [
1457
+ 408,
1458
+ 2040
1459
+ ],
1460
+ "dtype": "float32"
1461
+ },
1462
+ "local.blocks.5.attention_norm.norm": {
1463
+ "offset": 90001072,
1464
+ "bytes": 3264,
1465
+ "shape": [
1466
+ 816
1467
+ ],
1468
+ "dtype": "float32"
1469
+ },
1470
+ "local.blocks.5.attention_norm.affine_weight": {
1471
+ "offset": 90004336,
1472
+ "bytes": 1331712,
1473
+ "shape": [
1474
+ 816,
1475
+ 408
1476
+ ],
1477
+ "dtype": "float32"
1478
+ },
1479
+ "local.blocks.5.attention_norm.affine_bias": {
1480
+ "offset": 91336048,
1481
+ "bytes": 3264,
1482
+ "shape": [
1483
+ 816
1484
+ ],
1485
+ "dtype": "float32"
1486
+ },
1487
+ "local.blocks.5.attention.projection": {
1488
+ "offset": 91339312,
1489
+ "bytes": 3290112,
1490
+ "shape": [
1491
+ 2016,
1492
+ 408
1493
+ ],
1494
+ "dtype": "float32"
1495
+ },
1496
+ "local.blocks.5.attention.qk_norm": {
1497
+ "offset": 94629424,
1498
+ "bytes": 272,
1499
+ "shape": [
1500
+ 68
1501
+ ],
1502
+ "dtype": "float32"
1503
+ },
1504
+ "local.blocks.5.attention.head_weights": {
1505
+ "offset": 94629696,
1506
+ "bytes": 48,
1507
+ "shape": [
1508
+ 12
1509
+ ],
1510
+ "dtype": "float32"
1511
+ },
1512
+ "local.blocks.5.attention.pair_bias": {
1513
+ "offset": 94629744,
1514
+ "bytes": 240,
1515
+ "shape": [
1516
+ 12,
1517
+ 5
1518
+ ],
1519
+ "dtype": "float32"
1520
+ },
1521
+ "local.blocks.5.attention.output": {
1522
+ "offset": 94629984,
1523
+ "bytes": 1449216,
1524
+ "shape": [
1525
+ 408,
1526
+ 888
1527
+ ],
1528
+ "dtype": "float32"
1529
+ },
1530
+ "local.blocks.5.ffn_norm.norm": {
1531
+ "offset": 96079200,
1532
+ "bytes": 3264,
1533
+ "shape": [
1534
+ 816
1535
+ ],
1536
+ "dtype": "float32"
1537
+ },
1538
+ "local.blocks.5.ffn_norm.affine_weight": {
1539
+ "offset": 96082464,
1540
+ "bytes": 1331712,
1541
+ "shape": [
1542
+ 816,
1543
+ 408
1544
+ ],
1545
+ "dtype": "float32"
1546
+ },
1547
+ "local.blocks.5.ffn_norm.affine_bias": {
1548
+ "offset": 97414176,
1549
+ "bytes": 3264,
1550
+ "shape": [
1551
+ 816
1552
+ ],
1553
+ "dtype": "float32"
1554
+ },
1555
+ "local.blocks.5.ffn.upgate": {
1556
+ "offset": 97417440,
1557
+ "bytes": 6658560,
1558
+ "shape": [
1559
+ 4080,
1560
+ 408
1561
+ ],
1562
+ "dtype": "float32"
1563
+ },
1564
+ "local.blocks.5.ffn.down": {
1565
+ "offset": 104076000,
1566
+ "bytes": 3329280,
1567
+ "shape": [
1568
+ 408,
1569
+ 2040
1570
+ ],
1571
+ "dtype": "float32"
1572
+ },
1573
+ "local.blocks.6.attention_norm.norm": {
1574
+ "offset": 107405280,
1575
+ "bytes": 3264,
1576
+ "shape": [
1577
+ 816
1578
+ ],
1579
+ "dtype": "float32"
1580
+ },
1581
+ "local.blocks.6.attention_norm.affine_weight": {
1582
+ "offset": 107408544,
1583
+ "bytes": 1331712,
1584
+ "shape": [
1585
+ 816,
1586
+ 408
1587
+ ],
1588
+ "dtype": "float32"
1589
+ },
1590
+ "local.blocks.6.attention_norm.affine_bias": {
1591
+ "offset": 108740256,
1592
+ "bytes": 3264,
1593
+ "shape": [
1594
+ 816
1595
+ ],
1596
+ "dtype": "float32"
1597
+ },
1598
+ "local.blocks.6.attention.projection": {
1599
+ "offset": 108743520,
1600
+ "bytes": 3290112,
1601
+ "shape": [
1602
+ 2016,
1603
+ 408
1604
+ ],
1605
+ "dtype": "float32"
1606
+ },
1607
+ "local.blocks.6.attention.qk_norm": {
1608
+ "offset": 112033632,
1609
+ "bytes": 272,
1610
+ "shape": [
1611
+ 68
1612
+ ],
1613
+ "dtype": "float32"
1614
+ },
1615
+ "local.blocks.6.attention.head_weights": {
1616
+ "offset": 112033904,
1617
+ "bytes": 48,
1618
+ "shape": [
1619
+ 12
1620
+ ],
1621
+ "dtype": "float32"
1622
+ },
1623
+ "local.blocks.6.attention.pair_bias": {
1624
+ "offset": 112033952,
1625
+ "bytes": 240,
1626
+ "shape": [
1627
+ 12,
1628
+ 5
1629
+ ],
1630
+ "dtype": "float32"
1631
+ },
1632
+ "local.blocks.6.attention.output": {
1633
+ "offset": 112034192,
1634
+ "bytes": 1449216,
1635
+ "shape": [
1636
+ 408,
1637
+ 888
1638
+ ],
1639
+ "dtype": "float32"
1640
+ },
1641
+ "local.blocks.6.ffn_norm.norm": {
1642
+ "offset": 113483408,
1643
+ "bytes": 3264,
1644
+ "shape": [
1645
+ 816
1646
+ ],
1647
+ "dtype": "float32"
1648
+ },
1649
+ "local.blocks.6.ffn_norm.affine_weight": {
1650
+ "offset": 113486672,
1651
+ "bytes": 1331712,
1652
+ "shape": [
1653
+ 816,
1654
+ 408
1655
+ ],
1656
+ "dtype": "float32"
1657
+ },
1658
+ "local.blocks.6.ffn_norm.affine_bias": {
1659
+ "offset": 114818384,
1660
+ "bytes": 3264,
1661
+ "shape": [
1662
+ 816
1663
+ ],
1664
+ "dtype": "float32"
1665
+ },
1666
+ "local.blocks.6.ffn.upgate": {
1667
+ "offset": 114821648,
1668
+ "bytes": 6658560,
1669
+ "shape": [
1670
+ 4080,
1671
+ 408
1672
+ ],
1673
+ "dtype": "float32"
1674
+ },
1675
+ "local.blocks.6.ffn.down": {
1676
+ "offset": 121480208,
1677
+ "bytes": 3329280,
1678
+ "shape": [
1679
+ 408,
1680
+ 2040
1681
+ ],
1682
+ "dtype": "float32"
1683
+ },
1684
+ "local.blocks.7.attention_norm.norm": {
1685
+ "offset": 124809488,
1686
+ "bytes": 3264,
1687
+ "shape": [
1688
+ 816
1689
+ ],
1690
+ "dtype": "float32"
1691
+ },
1692
+ "local.blocks.7.attention_norm.affine_weight": {
1693
+ "offset": 124812752,
1694
+ "bytes": 1331712,
1695
+ "shape": [
1696
+ 816,
1697
+ 408
1698
+ ],
1699
+ "dtype": "float32"
1700
+ },
1701
+ "local.blocks.7.attention_norm.affine_bias": {
1702
+ "offset": 126144464,
1703
+ "bytes": 3264,
1704
+ "shape": [
1705
+ 816
1706
+ ],
1707
+ "dtype": "float32"
1708
+ },
1709
+ "local.blocks.7.attention.projection": {
1710
+ "offset": 126147728,
1711
+ "bytes": 3290112,
1712
+ "shape": [
1713
+ 2016,
1714
+ 408
1715
+ ],
1716
+ "dtype": "float32"
1717
+ },
1718
+ "local.blocks.7.attention.qk_norm": {
1719
+ "offset": 129437840,
1720
+ "bytes": 272,
1721
+ "shape": [
1722
+ 68
1723
+ ],
1724
+ "dtype": "float32"
1725
+ },
1726
+ "local.blocks.7.attention.head_weights": {
1727
+ "offset": 129438112,
1728
+ "bytes": 48,
1729
+ "shape": [
1730
+ 12
1731
+ ],
1732
+ "dtype": "float32"
1733
+ },
1734
+ "local.blocks.7.attention.pair_bias": {
1735
+ "offset": 129438160,
1736
+ "bytes": 240,
1737
+ "shape": [
1738
+ 12,
1739
+ 5
1740
+ ],
1741
+ "dtype": "float32"
1742
+ },
1743
+ "local.blocks.7.attention.output": {
1744
+ "offset": 129438400,
1745
+ "bytes": 1449216,
1746
+ "shape": [
1747
+ 408,
1748
+ 888
1749
+ ],
1750
+ "dtype": "float32"
1751
+ },
1752
+ "local.blocks.7.ffn_norm.norm": {
1753
+ "offset": 130887616,
1754
+ "bytes": 3264,
1755
+ "shape": [
1756
+ 816
1757
+ ],
1758
+ "dtype": "float32"
1759
+ },
1760
+ "local.blocks.7.ffn_norm.affine_weight": {
1761
+ "offset": 130890880,
1762
+ "bytes": 1331712,
1763
+ "shape": [
1764
+ 816,
1765
+ 408
1766
+ ],
1767
+ "dtype": "float32"
1768
+ },
1769
+ "local.blocks.7.ffn_norm.affine_bias": {
1770
+ "offset": 132222592,
1771
+ "bytes": 3264,
1772
+ "shape": [
1773
+ 816
1774
+ ],
1775
+ "dtype": "float32"
1776
+ },
1777
+ "local.blocks.7.ffn.upgate": {
1778
+ "offset": 132225856,
1779
+ "bytes": 6658560,
1780
+ "shape": [
1781
+ 4080,
1782
+ 408
1783
+ ],
1784
+ "dtype": "float32"
1785
+ },
1786
+ "local.blocks.7.ffn.down": {
1787
+ "offset": 138884416,
1788
+ "bytes": 3329280,
1789
+ "shape": [
1790
+ 408,
1791
+ 2040
1792
+ ],
1793
+ "dtype": "float32"
1794
+ },
1795
+ "local.blocks.8.attention_norm.norm": {
1796
+ "offset": 142213696,
1797
+ "bytes": 3264,
1798
+ "shape": [
1799
+ 816
1800
+ ],
1801
+ "dtype": "float32"
1802
+ },
1803
+ "local.blocks.8.attention_norm.affine_weight": {
1804
+ "offset": 142216960,
1805
+ "bytes": 1331712,
1806
+ "shape": [
1807
+ 816,
1808
+ 408
1809
+ ],
1810
+ "dtype": "float32"
1811
+ },
1812
+ "local.blocks.8.attention_norm.affine_bias": {
1813
+ "offset": 143548672,
1814
+ "bytes": 3264,
1815
+ "shape": [
1816
+ 816
1817
+ ],
1818
+ "dtype": "float32"
1819
+ },
1820
+ "local.blocks.8.attention.projection": {
1821
+ "offset": 143551936,
1822
+ "bytes": 3290112,
1823
+ "shape": [
1824
+ 2016,
1825
+ 408
1826
+ ],
1827
+ "dtype": "float32"
1828
+ },
1829
+ "local.blocks.8.attention.qk_norm": {
1830
+ "offset": 146842048,
1831
+ "bytes": 272,
1832
+ "shape": [
1833
+ 68
1834
+ ],
1835
+ "dtype": "float32"
1836
+ },
1837
+ "local.blocks.8.attention.head_weights": {
1838
+ "offset": 146842320,
1839
+ "bytes": 48,
1840
+ "shape": [
1841
+ 12
1842
+ ],
1843
+ "dtype": "float32"
1844
+ },
1845
+ "local.blocks.8.attention.pair_bias": {
1846
+ "offset": 146842368,
1847
+ "bytes": 240,
1848
+ "shape": [
1849
+ 12,
1850
+ 5
1851
+ ],
1852
+ "dtype": "float32"
1853
+ },
1854
+ "local.blocks.8.attention.output": {
1855
+ "offset": 146842608,
1856
+ "bytes": 1449216,
1857
+ "shape": [
1858
+ 408,
1859
+ 888
1860
+ ],
1861
+ "dtype": "float32"
1862
+ },
1863
+ "local.blocks.8.ffn_norm.norm": {
1864
+ "offset": 148291824,
1865
+ "bytes": 3264,
1866
+ "shape": [
1867
+ 816
1868
+ ],
1869
+ "dtype": "float32"
1870
+ },
1871
+ "local.blocks.8.ffn_norm.affine_weight": {
1872
+ "offset": 148295088,
1873
+ "bytes": 1331712,
1874
+ "shape": [
1875
+ 816,
1876
+ 408
1877
+ ],
1878
+ "dtype": "float32"
1879
+ },
1880
+ "local.blocks.8.ffn_norm.affine_bias": {
1881
+ "offset": 149626800,
1882
+ "bytes": 3264,
1883
+ "shape": [
1884
+ 816
1885
+ ],
1886
+ "dtype": "float32"
1887
+ },
1888
+ "local.blocks.8.ffn.upgate": {
1889
+ "offset": 149630064,
1890
+ "bytes": 6658560,
1891
+ "shape": [
1892
+ 4080,
1893
+ 408
1894
+ ],
1895
+ "dtype": "float32"
1896
+ },
1897
+ "local.blocks.8.ffn.down": {
1898
+ "offset": 156288624,
1899
+ "bytes": 3329280,
1900
+ "shape": [
1901
+ 408,
1902
+ 2040
1903
+ ],
1904
+ "dtype": "float32"
1905
+ },
1906
+ "local.blocks.9.attention_norm.norm": {
1907
+ "offset": 159617904,
1908
+ "bytes": 3264,
1909
+ "shape": [
1910
+ 816
1911
+ ],
1912
+ "dtype": "float32"
1913
+ },
1914
+ "local.blocks.9.attention_norm.affine_weight": {
1915
+ "offset": 159621168,
1916
+ "bytes": 1331712,
1917
+ "shape": [
1918
+ 816,
1919
+ 408
1920
+ ],
1921
+ "dtype": "float32"
1922
+ },
1923
+ "local.blocks.9.attention_norm.affine_bias": {
1924
+ "offset": 160952880,
1925
+ "bytes": 3264,
1926
+ "shape": [
1927
+ 816
1928
+ ],
1929
+ "dtype": "float32"
1930
+ },
1931
+ "local.blocks.9.attention.projection": {
1932
+ "offset": 160956144,
1933
+ "bytes": 3290112,
1934
+ "shape": [
1935
+ 2016,
1936
+ 408
1937
+ ],
1938
+ "dtype": "float32"
1939
+ },
1940
+ "local.blocks.9.attention.qk_norm": {
1941
+ "offset": 164246256,
1942
+ "bytes": 272,
1943
+ "shape": [
1944
+ 68
1945
+ ],
1946
+ "dtype": "float32"
1947
+ },
1948
+ "local.blocks.9.attention.head_weights": {
1949
+ "offset": 164246528,
1950
+ "bytes": 48,
1951
+ "shape": [
1952
+ 12
1953
+ ],
1954
+ "dtype": "float32"
1955
+ },
1956
+ "local.blocks.9.attention.pair_bias": {
1957
+ "offset": 164246576,
1958
+ "bytes": 240,
1959
+ "shape": [
1960
+ 12,
1961
+ 5
1962
+ ],
1963
+ "dtype": "float32"
1964
+ },
1965
+ "local.blocks.9.attention.output": {
1966
+ "offset": 164246816,
1967
+ "bytes": 1449216,
1968
+ "shape": [
1969
+ 408,
1970
+ 888
1971
+ ],
1972
+ "dtype": "float32"
1973
+ },
1974
+ "local.blocks.9.ffn_norm.norm": {
1975
+ "offset": 165696032,
1976
+ "bytes": 3264,
1977
+ "shape": [
1978
+ 816
1979
+ ],
1980
+ "dtype": "float32"
1981
+ },
1982
+ "local.blocks.9.ffn_norm.affine_weight": {
1983
+ "offset": 165699296,
1984
+ "bytes": 1331712,
1985
+ "shape": [
1986
+ 816,
1987
+ 408
1988
+ ],
1989
+ "dtype": "float32"
1990
+ },
1991
+ "local.blocks.9.ffn_norm.affine_bias": {
1992
+ "offset": 167031008,
1993
+ "bytes": 3264,
1994
+ "shape": [
1995
+ 816
1996
+ ],
1997
+ "dtype": "float32"
1998
+ },
1999
+ "local.blocks.9.ffn.upgate": {
2000
+ "offset": 167034272,
2001
+ "bytes": 6658560,
2002
+ "shape": [
2003
+ 4080,
2004
+ 408
2005
+ ],
2006
+ "dtype": "float32"
2007
+ },
2008
+ "local.blocks.9.ffn.down": {
2009
+ "offset": 173692832,
2010
+ "bytes": 3329280,
2011
+ "shape": [
2012
+ 408,
2013
+ 2040
2014
+ ],
2015
+ "dtype": "float32"
2016
+ },
2017
+ "local.blocks.10.attention_norm.norm": {
2018
+ "offset": 177022112,
2019
+ "bytes": 3264,
2020
+ "shape": [
2021
+ 816
2022
+ ],
2023
+ "dtype": "float32"
2024
+ },
2025
+ "local.blocks.10.attention_norm.affine_weight": {
2026
+ "offset": 177025376,
2027
+ "bytes": 1331712,
2028
+ "shape": [
2029
+ 816,
2030
+ 408
2031
+ ],
2032
+ "dtype": "float32"
2033
+ },
2034
+ "local.blocks.10.attention_norm.affine_bias": {
2035
+ "offset": 178357088,
2036
+ "bytes": 3264,
2037
+ "shape": [
2038
+ 816
2039
+ ],
2040
+ "dtype": "float32"
2041
+ },
2042
+ "local.blocks.10.attention.projection": {
2043
+ "offset": 178360352,
2044
+ "bytes": 3290112,
2045
+ "shape": [
2046
+ 2016,
2047
+ 408
2048
+ ],
2049
+ "dtype": "float32"
2050
+ },
2051
+ "local.blocks.10.attention.qk_norm": {
2052
+ "offset": 181650464,
2053
+ "bytes": 272,
2054
+ "shape": [
2055
+ 68
2056
+ ],
2057
+ "dtype": "float32"
2058
+ },
2059
+ "local.blocks.10.attention.head_weights": {
2060
+ "offset": 181650736,
2061
+ "bytes": 48,
2062
+ "shape": [
2063
+ 12
2064
+ ],
2065
+ "dtype": "float32"
2066
+ },
2067
+ "local.blocks.10.attention.pair_bias": {
2068
+ "offset": 181650784,
2069
+ "bytes": 240,
2070
+ "shape": [
2071
+ 12,
2072
+ 5
2073
+ ],
2074
+ "dtype": "float32"
2075
+ },
2076
+ "local.blocks.10.attention.output": {
2077
+ "offset": 181651024,
2078
+ "bytes": 1449216,
2079
+ "shape": [
2080
+ 408,
2081
+ 888
2082
+ ],
2083
+ "dtype": "float32"
2084
+ },
2085
+ "local.blocks.10.ffn_norm.norm": {
2086
+ "offset": 183100240,
2087
+ "bytes": 3264,
2088
+ "shape": [
2089
+ 816
2090
+ ],
2091
+ "dtype": "float32"
2092
+ },
2093
+ "local.blocks.10.ffn_norm.affine_weight": {
2094
+ "offset": 183103504,
2095
+ "bytes": 1331712,
2096
+ "shape": [
2097
+ 816,
2098
+ 408
2099
+ ],
2100
+ "dtype": "float32"
2101
+ },
2102
+ "local.blocks.10.ffn_norm.affine_bias": {
2103
+ "offset": 184435216,
2104
+ "bytes": 3264,
2105
+ "shape": [
2106
+ 816
2107
+ ],
2108
+ "dtype": "float32"
2109
+ },
2110
+ "local.blocks.10.ffn.upgate": {
2111
+ "offset": 184438480,
2112
+ "bytes": 6658560,
2113
+ "shape": [
2114
+ 4080,
2115
+ 408
2116
+ ],
2117
+ "dtype": "float32"
2118
+ },
2119
+ "local.blocks.10.ffn.down": {
2120
+ "offset": 191097040,
2121
+ "bytes": 3329280,
2122
+ "shape": [
2123
+ 408,
2124
+ 2040
2125
+ ],
2126
+ "dtype": "float32"
2127
+ },
2128
+ "local.blocks.11.attention_norm.norm": {
2129
+ "offset": 194426320,
2130
+ "bytes": 3264,
2131
+ "shape": [
2132
+ 816
2133
+ ],
2134
+ "dtype": "float32"
2135
+ },
2136
+ "local.blocks.11.attention_norm.affine_weight": {
2137
+ "offset": 194429584,
2138
+ "bytes": 1331712,
2139
+ "shape": [
2140
+ 816,
2141
+ 408
2142
+ ],
2143
+ "dtype": "float32"
2144
+ },
2145
+ "local.blocks.11.attention_norm.affine_bias": {
2146
+ "offset": 195761296,
2147
+ "bytes": 3264,
2148
+ "shape": [
2149
+ 816
2150
+ ],
2151
+ "dtype": "float32"
2152
+ },
2153
+ "local.blocks.11.attention.projection": {
2154
+ "offset": 195764560,
2155
+ "bytes": 3290112,
2156
+ "shape": [
2157
+ 2016,
2158
+ 408
2159
+ ],
2160
+ "dtype": "float32"
2161
+ },
2162
+ "local.blocks.11.attention.qk_norm": {
2163
+ "offset": 199054672,
2164
+ "bytes": 272,
2165
+ "shape": [
2166
+ 68
2167
+ ],
2168
+ "dtype": "float32"
2169
+ },
2170
+ "local.blocks.11.attention.head_weights": {
2171
+ "offset": 199054944,
2172
+ "bytes": 48,
2173
+ "shape": [
2174
+ 12
2175
+ ],
2176
+ "dtype": "float32"
2177
+ },
2178
+ "local.blocks.11.attention.pair_bias": {
2179
+ "offset": 199054992,
2180
+ "bytes": 240,
2181
+ "shape": [
2182
+ 12,
2183
+ 5
2184
+ ],
2185
+ "dtype": "float32"
2186
+ },
2187
+ "local.blocks.11.attention.output": {
2188
+ "offset": 199055232,
2189
+ "bytes": 1449216,
2190
+ "shape": [
2191
+ 408,
2192
+ 888
2193
+ ],
2194
+ "dtype": "float32"
2195
+ },
2196
+ "local.blocks.11.ffn_norm.norm": {
2197
+ "offset": 200504448,
2198
+ "bytes": 3264,
2199
+ "shape": [
2200
+ 816
2201
+ ],
2202
+ "dtype": "float32"
2203
+ },
2204
+ "local.blocks.11.ffn_norm.affine_weight": {
2205
+ "offset": 200507712,
2206
+ "bytes": 1331712,
2207
+ "shape": [
2208
+ 816,
2209
+ 408
2210
+ ],
2211
+ "dtype": "float32"
2212
+ },
2213
+ "local.blocks.11.ffn_norm.affine_bias": {
2214
+ "offset": 201839424,
2215
+ "bytes": 3264,
2216
+ "shape": [
2217
+ 816
2218
+ ],
2219
+ "dtype": "float32"
2220
+ },
2221
+ "local.blocks.11.ffn.upgate": {
2222
+ "offset": 201842688,
2223
+ "bytes": 6658560,
2224
+ "shape": [
2225
+ 4080,
2226
+ 408
2227
+ ],
2228
+ "dtype": "float32"
2229
+ },
2230
+ "local.blocks.11.ffn.down": {
2231
+ "offset": 208501248,
2232
+ "bytes": 3329280,
2233
+ "shape": [
2234
+ 408,
2235
+ 2040
2236
+ ],
2237
+ "dtype": "float32"
2238
+ },
2239
+ "local.endpoint_updates.0": {
2240
+ "offset": 211830528,
2241
+ "bytes": 4896,
2242
+ "shape": [
2243
+ 3,
2244
+ 408
2245
+ ],
2246
+ "dtype": "float32"
2247
+ },
2248
+ "local.endpoint_updates.1": {
2249
+ "offset": 211835424,
2250
+ "bytes": 4896,
2251
+ "shape": [
2252
+ 3,
2253
+ 408
2254
+ ],
2255
+ "dtype": "float32"
2256
+ },
2257
+ "local.endpoint_updates.2": {
2258
+ "offset": 211840320,
2259
+ "bytes": 4896,
2260
+ "shape": [
2261
+ 3,
2262
+ 408
2263
+ ],
2264
+ "dtype": "float32"
2265
+ },
2266
+ "finite_time_embedding": {
2267
+ "offset": 211845216,
2268
+ "bytes": 3995136,
2269
+ "shape": [
2270
+ 408,
2271
+ 2448
2272
+ ],
2273
+ "dtype": "float32"
2274
+ },
2275
+ "noise_encoder": {
2276
+ "offset": 215840352,
2277
+ "bytes": 9792,
2278
+ "shape": [
2279
+ 408,
2280
+ 6
2281
+ ],
2282
+ "dtype": "float32"
2283
+ },
2284
+ "finite.blocks.0.attention_norm.norm": {
2285
+ "offset": 215850144,
2286
+ "bytes": 3264,
2287
+ "shape": [
2288
+ 816
2289
+ ],
2290
+ "dtype": "float32"
2291
+ },
2292
+ "finite.blocks.0.attention_norm.affine_weight": {
2293
+ "offset": 215853408,
2294
+ "bytes": 1331712,
2295
+ "shape": [
2296
+ 816,
2297
+ 408
2298
+ ],
2299
+ "dtype": "float32"
2300
+ },
2301
+ "finite.blocks.0.attention_norm.affine_bias": {
2302
+ "offset": 217185120,
2303
+ "bytes": 3264,
2304
+ "shape": [
2305
+ 816
2306
+ ],
2307
+ "dtype": "float32"
2308
+ },
2309
+ "finite.blocks.0.attention.projection": {
2310
+ "offset": 217188384,
2311
+ "bytes": 3290112,
2312
+ "shape": [
2313
+ 2016,
2314
+ 408
2315
+ ],
2316
+ "dtype": "float32"
2317
+ },
2318
+ "finite.blocks.0.attention.qk_norm": {
2319
+ "offset": 220478496,
2320
+ "bytes": 272,
2321
+ "shape": [
2322
+ 68
2323
+ ],
2324
+ "dtype": "float32"
2325
+ },
2326
+ "finite.blocks.0.attention.head_weights": {
2327
+ "offset": 220478768,
2328
+ "bytes": 48,
2329
+ "shape": [
2330
+ 12
2331
+ ],
2332
+ "dtype": "float32"
2333
+ },
2334
+ "finite.blocks.0.attention.pair_bias": {
2335
+ "offset": 220478816,
2336
+ "bytes": 240,
2337
+ "shape": [
2338
+ 12,
2339
+ 5
2340
+ ],
2341
+ "dtype": "float32"
2342
+ },
2343
+ "finite.blocks.0.attention.output": {
2344
+ "offset": 220479056,
2345
+ "bytes": 1449216,
2346
+ "shape": [
2347
+ 408,
2348
+ 888
2349
+ ],
2350
+ "dtype": "float32"
2351
+ },
2352
+ "finite.blocks.0.ffn_norm.norm": {
2353
+ "offset": 221928272,
2354
+ "bytes": 3264,
2355
+ "shape": [
2356
+ 816
2357
+ ],
2358
+ "dtype": "float32"
2359
+ },
2360
+ "finite.blocks.0.ffn_norm.affine_weight": {
2361
+ "offset": 221931536,
2362
+ "bytes": 1331712,
2363
+ "shape": [
2364
+ 816,
2365
+ 408
2366
+ ],
2367
+ "dtype": "float32"
2368
+ },
2369
+ "finite.blocks.0.ffn_norm.affine_bias": {
2370
+ "offset": 223263248,
2371
+ "bytes": 3264,
2372
+ "shape": [
2373
+ 816
2374
+ ],
2375
+ "dtype": "float32"
2376
+ },
2377
+ "finite.blocks.0.ffn.upgate": {
2378
+ "offset": 223266512,
2379
+ "bytes": 6658560,
2380
+ "shape": [
2381
+ 4080,
2382
+ 408
2383
+ ],
2384
+ "dtype": "float32"
2385
+ },
2386
+ "finite.blocks.0.ffn.down": {
2387
+ "offset": 229925072,
2388
+ "bytes": 3329280,
2389
+ "shape": [
2390
+ 408,
2391
+ 2040
2392
+ ],
2393
+ "dtype": "float32"
2394
+ },
2395
+ "finite.lateral.outputs.0": {
2396
+ "offset": 233254352,
2397
+ "bytes": 1671168,
2398
+ "shape": [
2399
+ 408,
2400
+ 1024
2401
+ ],
2402
+ "dtype": "float32"
2403
+ },
2404
+ "finite.blocks.1.attention_norm.norm": {
2405
+ "offset": 234925520,
2406
+ "bytes": 3264,
2407
+ "shape": [
2408
+ 816
2409
+ ],
2410
+ "dtype": "float32"
2411
+ },
2412
+ "finite.blocks.1.attention_norm.affine_weight": {
2413
+ "offset": 234928784,
2414
+ "bytes": 1331712,
2415
+ "shape": [
2416
+ 816,
2417
+ 408
2418
+ ],
2419
+ "dtype": "float32"
2420
+ },
2421
+ "finite.blocks.1.attention_norm.affine_bias": {
2422
+ "offset": 236260496,
2423
+ "bytes": 3264,
2424
+ "shape": [
2425
+ 816
2426
+ ],
2427
+ "dtype": "float32"
2428
+ },
2429
+ "finite.blocks.1.attention.projection": {
2430
+ "offset": 236263760,
2431
+ "bytes": 3290112,
2432
+ "shape": [
2433
+ 2016,
2434
+ 408
2435
+ ],
2436
+ "dtype": "float32"
2437
+ },
2438
+ "finite.blocks.1.attention.qk_norm": {
2439
+ "offset": 239553872,
2440
+ "bytes": 272,
2441
+ "shape": [
2442
+ 68
2443
+ ],
2444
+ "dtype": "float32"
2445
+ },
2446
+ "finite.blocks.1.attention.head_weights": {
2447
+ "offset": 239554144,
2448
+ "bytes": 48,
2449
+ "shape": [
2450
+ 12
2451
+ ],
2452
+ "dtype": "float32"
2453
+ },
2454
+ "finite.blocks.1.attention.pair_bias": {
2455
+ "offset": 239554192,
2456
+ "bytes": 240,
2457
+ "shape": [
2458
+ 12,
2459
+ 5
2460
+ ],
2461
+ "dtype": "float32"
2462
+ },
2463
+ "finite.blocks.1.attention.output": {
2464
+ "offset": 239554432,
2465
+ "bytes": 1449216,
2466
+ "shape": [
2467
+ 408,
2468
+ 888
2469
+ ],
2470
+ "dtype": "float32"
2471
+ },
2472
+ "finite.blocks.1.ffn_norm.norm": {
2473
+ "offset": 241003648,
2474
+ "bytes": 3264,
2475
+ "shape": [
2476
+ 816
2477
+ ],
2478
+ "dtype": "float32"
2479
+ },
2480
+ "finite.blocks.1.ffn_norm.affine_weight": {
2481
+ "offset": 241006912,
2482
+ "bytes": 1331712,
2483
+ "shape": [
2484
+ 816,
2485
+ 408
2486
+ ],
2487
+ "dtype": "float32"
2488
+ },
2489
+ "finite.blocks.1.ffn_norm.affine_bias": {
2490
+ "offset": 242338624,
2491
+ "bytes": 3264,
2492
+ "shape": [
2493
+ 816
2494
+ ],
2495
+ "dtype": "float32"
2496
+ },
2497
+ "finite.blocks.1.ffn.upgate": {
2498
+ "offset": 242341888,
2499
+ "bytes": 6658560,
2500
+ "shape": [
2501
+ 4080,
2502
+ 408
2503
+ ],
2504
+ "dtype": "float32"
2505
+ },
2506
+ "finite.blocks.1.ffn.down": {
2507
+ "offset": 249000448,
2508
+ "bytes": 3329280,
2509
+ "shape": [
2510
+ 408,
2511
+ 2040
2512
+ ],
2513
+ "dtype": "float32"
2514
+ },
2515
+ "finite.lateral.outputs.1": {
2516
+ "offset": 252329728,
2517
+ "bytes": 1671168,
2518
+ "shape": [
2519
+ 408,
2520
+ 1024
2521
+ ],
2522
+ "dtype": "float32"
2523
+ },
2524
+ "finite.blocks.2.attention_norm.norm": {
2525
+ "offset": 254000896,
2526
+ "bytes": 3264,
2527
+ "shape": [
2528
+ 816
2529
+ ],
2530
+ "dtype": "float32"
2531
+ },
2532
+ "finite.blocks.2.attention_norm.affine_weight": {
2533
+ "offset": 254004160,
2534
+ "bytes": 1331712,
2535
+ "shape": [
2536
+ 816,
2537
+ 408
2538
+ ],
2539
+ "dtype": "float32"
2540
+ },
2541
+ "finite.blocks.2.attention_norm.affine_bias": {
2542
+ "offset": 255335872,
2543
+ "bytes": 3264,
2544
+ "shape": [
2545
+ 816
2546
+ ],
2547
+ "dtype": "float32"
2548
+ },
2549
+ "finite.blocks.2.attention.projection": {
2550
+ "offset": 255339136,
2551
+ "bytes": 3290112,
2552
+ "shape": [
2553
+ 2016,
2554
+ 408
2555
+ ],
2556
+ "dtype": "float32"
2557
+ },
2558
+ "finite.blocks.2.attention.qk_norm": {
2559
+ "offset": 258629248,
2560
+ "bytes": 272,
2561
+ "shape": [
2562
+ 68
2563
+ ],
2564
+ "dtype": "float32"
2565
+ },
2566
+ "finite.blocks.2.attention.head_weights": {
2567
+ "offset": 258629520,
2568
+ "bytes": 48,
2569
+ "shape": [
2570
+ 12
2571
+ ],
2572
+ "dtype": "float32"
2573
+ },
2574
+ "finite.blocks.2.attention.pair_bias": {
2575
+ "offset": 258629568,
2576
+ "bytes": 240,
2577
+ "shape": [
2578
+ 12,
2579
+ 5
2580
+ ],
2581
+ "dtype": "float32"
2582
+ },
2583
+ "finite.blocks.2.attention.output": {
2584
+ "offset": 258629808,
2585
+ "bytes": 1449216,
2586
+ "shape": [
2587
+ 408,
2588
+ 888
2589
+ ],
2590
+ "dtype": "float32"
2591
+ },
2592
+ "finite.blocks.2.ffn_norm.norm": {
2593
+ "offset": 260079024,
2594
+ "bytes": 3264,
2595
+ "shape": [
2596
+ 816
2597
+ ],
2598
+ "dtype": "float32"
2599
+ },
2600
+ "finite.blocks.2.ffn_norm.affine_weight": {
2601
+ "offset": 260082288,
2602
+ "bytes": 1331712,
2603
+ "shape": [
2604
+ 816,
2605
+ 408
2606
+ ],
2607
+ "dtype": "float32"
2608
+ },
2609
+ "finite.blocks.2.ffn_norm.affine_bias": {
2610
+ "offset": 261414000,
2611
+ "bytes": 3264,
2612
+ "shape": [
2613
+ 816
2614
+ ],
2615
+ "dtype": "float32"
2616
+ },
2617
+ "finite.blocks.2.ffn.upgate": {
2618
+ "offset": 261417264,
2619
+ "bytes": 6658560,
2620
+ "shape": [
2621
+ 4080,
2622
+ 408
2623
+ ],
2624
+ "dtype": "float32"
2625
+ },
2626
+ "finite.blocks.2.ffn.down": {
2627
+ "offset": 268075824,
2628
+ "bytes": 3329280,
2629
+ "shape": [
2630
+ 408,
2631
+ 2040
2632
+ ],
2633
+ "dtype": "float32"
2634
+ },
2635
+ "finite.lateral.outputs.2": {
2636
+ "offset": 271405104,
2637
+ "bytes": 1671168,
2638
+ "shape": [
2639
+ 408,
2640
+ 1024
2641
+ ],
2642
+ "dtype": "float32"
2643
+ },
2644
+ "finite.blocks.3.attention_norm.norm": {
2645
+ "offset": 273076272,
2646
+ "bytes": 3264,
2647
+ "shape": [
2648
+ 816
2649
+ ],
2650
+ "dtype": "float32"
2651
+ },
2652
+ "finite.blocks.3.attention_norm.affine_weight": {
2653
+ "offset": 273079536,
2654
+ "bytes": 1331712,
2655
+ "shape": [
2656
+ 816,
2657
+ 408
2658
+ ],
2659
+ "dtype": "float32"
2660
+ },
2661
+ "finite.blocks.3.attention_norm.affine_bias": {
2662
+ "offset": 274411248,
2663
+ "bytes": 3264,
2664
+ "shape": [
2665
+ 816
2666
+ ],
2667
+ "dtype": "float32"
2668
+ },
2669
+ "finite.blocks.3.attention.projection": {
2670
+ "offset": 274414512,
2671
+ "bytes": 3290112,
2672
+ "shape": [
2673
+ 2016,
2674
+ 408
2675
+ ],
2676
+ "dtype": "float32"
2677
+ },
2678
+ "finite.blocks.3.attention.qk_norm": {
2679
+ "offset": 277704624,
2680
+ "bytes": 272,
2681
+ "shape": [
2682
+ 68
2683
+ ],
2684
+ "dtype": "float32"
2685
+ },
2686
+ "finite.blocks.3.attention.head_weights": {
2687
+ "offset": 277704896,
2688
+ "bytes": 48,
2689
+ "shape": [
2690
+ 12
2691
+ ],
2692
+ "dtype": "float32"
2693
+ },
2694
+ "finite.blocks.3.attention.pair_bias": {
2695
+ "offset": 277704944,
2696
+ "bytes": 240,
2697
+ "shape": [
2698
+ 12,
2699
+ 5
2700
+ ],
2701
+ "dtype": "float32"
2702
+ },
2703
+ "finite.blocks.3.attention.output": {
2704
+ "offset": 277705184,
2705
+ "bytes": 1449216,
2706
+ "shape": [
2707
+ 408,
2708
+ 888
2709
+ ],
2710
+ "dtype": "float32"
2711
+ },
2712
+ "finite.blocks.3.ffn_norm.norm": {
2713
+ "offset": 279154400,
2714
+ "bytes": 3264,
2715
+ "shape": [
2716
+ 816
2717
+ ],
2718
+ "dtype": "float32"
2719
+ },
2720
+ "finite.blocks.3.ffn_norm.affine_weight": {
2721
+ "offset": 279157664,
2722
+ "bytes": 1331712,
2723
+ "shape": [
2724
+ 816,
2725
+ 408
2726
+ ],
2727
+ "dtype": "float32"
2728
+ },
2729
+ "finite.blocks.3.ffn_norm.affine_bias": {
2730
+ "offset": 280489376,
2731
+ "bytes": 3264,
2732
+ "shape": [
2733
+ 816
2734
+ ],
2735
+ "dtype": "float32"
2736
+ },
2737
+ "finite.blocks.3.ffn.upgate": {
2738
+ "offset": 280492640,
2739
+ "bytes": 6658560,
2740
+ "shape": [
2741
+ 4080,
2742
+ 408
2743
+ ],
2744
+ "dtype": "float32"
2745
+ },
2746
+ "finite.blocks.3.ffn.down": {
2747
+ "offset": 287151200,
2748
+ "bytes": 3329280,
2749
+ "shape": [
2750
+ 408,
2751
+ 2040
2752
+ ],
2753
+ "dtype": "float32"
2754
+ },
2755
+ "finite.lateral.outputs.3": {
2756
+ "offset": 290480480,
2757
+ "bytes": 1671168,
2758
+ "shape": [
2759
+ 408,
2760
+ 1024
2761
+ ],
2762
+ "dtype": "float32"
2763
+ },
2764
+ "finite.blocks.4.attention_norm.norm": {
2765
+ "offset": 292151648,
2766
+ "bytes": 3264,
2767
+ "shape": [
2768
+ 816
2769
+ ],
2770
+ "dtype": "float32"
2771
+ },
2772
+ "finite.blocks.4.attention_norm.affine_weight": {
2773
+ "offset": 292154912,
2774
+ "bytes": 1331712,
2775
+ "shape": [
2776
+ 816,
2777
+ 408
2778
+ ],
2779
+ "dtype": "float32"
2780
+ },
2781
+ "finite.blocks.4.attention_norm.affine_bias": {
2782
+ "offset": 293486624,
2783
+ "bytes": 3264,
2784
+ "shape": [
2785
+ 816
2786
+ ],
2787
+ "dtype": "float32"
2788
+ },
2789
+ "finite.blocks.4.attention.projection": {
2790
+ "offset": 293489888,
2791
+ "bytes": 3290112,
2792
+ "shape": [
2793
+ 2016,
2794
+ 408
2795
+ ],
2796
+ "dtype": "float32"
2797
+ },
2798
+ "finite.blocks.4.attention.qk_norm": {
2799
+ "offset": 296780000,
2800
+ "bytes": 272,
2801
+ "shape": [
2802
+ 68
2803
+ ],
2804
+ "dtype": "float32"
2805
+ },
2806
+ "finite.blocks.4.attention.head_weights": {
2807
+ "offset": 296780272,
2808
+ "bytes": 48,
2809
+ "shape": [
2810
+ 12
2811
+ ],
2812
+ "dtype": "float32"
2813
+ },
2814
+ "finite.blocks.4.attention.pair_bias": {
2815
+ "offset": 296780320,
2816
+ "bytes": 240,
2817
+ "shape": [
2818
+ 12,
2819
+ 5
2820
+ ],
2821
+ "dtype": "float32"
2822
+ },
2823
+ "finite.blocks.4.attention.output": {
2824
+ "offset": 296780560,
2825
+ "bytes": 1449216,
2826
+ "shape": [
2827
+ 408,
2828
+ 888
2829
+ ],
2830
+ "dtype": "float32"
2831
+ },
2832
+ "finite.blocks.4.ffn_norm.norm": {
2833
+ "offset": 298229776,
2834
+ "bytes": 3264,
2835
+ "shape": [
2836
+ 816
2837
+ ],
2838
+ "dtype": "float32"
2839
+ },
2840
+ "finite.blocks.4.ffn_norm.affine_weight": {
2841
+ "offset": 298233040,
2842
+ "bytes": 1331712,
2843
+ "shape": [
2844
+ 816,
2845
+ 408
2846
+ ],
2847
+ "dtype": "float32"
2848
+ },
2849
+ "finite.blocks.4.ffn_norm.affine_bias": {
2850
+ "offset": 299564752,
2851
+ "bytes": 3264,
2852
+ "shape": [
2853
+ 816
2854
+ ],
2855
+ "dtype": "float32"
2856
+ },
2857
+ "finite.blocks.4.ffn.upgate": {
2858
+ "offset": 299568016,
2859
+ "bytes": 6658560,
2860
+ "shape": [
2861
+ 4080,
2862
+ 408
2863
+ ],
2864
+ "dtype": "float32"
2865
+ },
2866
+ "finite.blocks.4.ffn.down": {
2867
+ "offset": 306226576,
2868
+ "bytes": 3329280,
2869
+ "shape": [
2870
+ 408,
2871
+ 2040
2872
+ ],
2873
+ "dtype": "float32"
2874
+ },
2875
+ "finite.lateral.outputs.4": {
2876
+ "offset": 309555856,
2877
+ "bytes": 1671168,
2878
+ "shape": [
2879
+ 408,
2880
+ 1024
2881
+ ],
2882
+ "dtype": "float32"
2883
+ },
2884
+ "finite.lateral.projections.0": {
2885
+ "offset": 311227024,
2886
+ "bytes": 1671168,
2887
+ "shape": [
2888
+ 1024,
2889
+ 408
2890
+ ],
2891
+ "dtype": "float32"
2892
+ },
2893
+ "finite.lateral.projections.1": {
2894
+ "offset": 312898192,
2895
+ "bytes": 1671168,
2896
+ "shape": [
2897
+ 1024,
2898
+ 408
2899
+ ],
2900
+ "dtype": "float32"
2901
+ },
2902
+ "finite.lateral.projections.2": {
2903
+ "offset": 314569360,
2904
+ "bytes": 1671168,
2905
+ "shape": [
2906
+ 1024,
2907
+ 408
2908
+ ],
2909
+ "dtype": "float32"
2910
+ },
2911
+ "finite.lateral.projections.3": {
2912
+ "offset": 316240528,
2913
+ "bytes": 1671168,
2914
+ "shape": [
2915
+ 1024,
2916
+ 408
2917
+ ],
2918
+ "dtype": "float32"
2919
+ },
2920
+ "finite.lateral.projections.4": {
2921
+ "offset": 317911696,
2922
+ "bytes": 1671168,
2923
+ "shape": [
2924
+ 1024,
2925
+ 408
2926
+ ],
2927
+ "dtype": "float32"
2928
+ },
2929
+ "finite.lateral.projections.5": {
2930
+ "offset": 319582864,
2931
+ "bytes": 1671168,
2932
+ "shape": [
2933
+ 1024,
2934
+ 408
2935
+ ],
2936
+ "dtype": "float32"
2937
+ },
2938
+ "finite.lateral.projections.6": {
2939
+ "offset": 321254032,
2940
+ "bytes": 1671168,
2941
+ "shape": [
2942
+ 1024,
2943
+ 408
2944
+ ],
2945
+ "dtype": "float32"
2946
+ },
2947
+ "finite.lateral.projections.7": {
2948
+ "offset": 322925200,
2949
+ "bytes": 1671168,
2950
+ "shape": [
2951
+ 1024,
2952
+ 408
2953
+ ],
2954
+ "dtype": "float32"
2955
+ },
2956
+ "finite.lateral.projections.8": {
2957
+ "offset": 324596368,
2958
+ "bytes": 1671168,
2959
+ "shape": [
2960
+ 1024,
2961
+ 408
2962
+ ],
2963
+ "dtype": "float32"
2964
+ },
2965
+ "finite.lateral.projections.9": {
2966
+ "offset": 326267536,
2967
+ "bytes": 1671168,
2968
+ "shape": [
2969
+ 1024,
2970
+ 408
2971
+ ],
2972
+ "dtype": "float32"
2973
+ },
2974
+ "finite.lateral.projections.10": {
2975
+ "offset": 327938704,
2976
+ "bytes": 1671168,
2977
+ "shape": [
2978
+ 1024,
2979
+ 408
2980
+ ],
2981
+ "dtype": "float32"
2982
+ },
2983
+ "finite.lateral.projections.11": {
2984
+ "offset": 329609872,
2985
+ "bytes": 1671168,
2986
+ "shape": [
2987
+ 1024,
2988
+ 408
2989
+ ],
2990
+ "dtype": "float32"
2991
+ },
2992
+ "finite.lateral.mixing": {
2993
+ "offset": 331281040,
2994
+ "bytes": 245760,
2995
+ "shape": [
2996
+ 5,
2997
+ 12,
2998
+ 1024
2999
+ ],
3000
+ "dtype": "float32"
3001
+ },
3002
+ "finite.endpoint_updates.0": {
3003
+ "offset": 331526800,
3004
+ "bytes": 4896,
3005
+ "shape": [
3006
+ 3,
3007
+ 408
3008
+ ],
3009
+ "dtype": "float32"
3010
+ },
3011
+ "finite.endpoint_updates.1": {
3012
+ "offset": 331531696,
3013
+ "bytes": 4896,
3014
+ "shape": [
3015
+ 3,
3016
+ 408
3017
+ ],
3018
+ "dtype": "float32"
3019
+ },
3020
+ "finite.endpoint_updates.2": {
3021
+ "offset": 331536592,
3022
+ "bytes": 4896,
3023
+ "shape": [
3024
+ 3,
3025
+ 408
3026
+ ],
3027
+ "dtype": "float32"
3028
+ }
3029
+ }
3030
+ }
webgpu/v8_ck_240000/weights.f32 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec3998a6b4013fede23f61cbd83cb224bb86ceff612a13bcb2f3bd8241910227
3
+ size 331541488