CUMTHenry commited on
Commit
3fe7f5f
·
verified ·
1 Parent(s): f9dcfde

Upload antmaze-giant-stitch-v0/diffusion/og_antM_Gi_o2d_Cd_Stgl_PadBuf_Ft64_ts512_T512/model_config.txt with huggingface_hub

Browse files
antmaze-giant-stitch-v0/diffusion/og_antM_Gi_o2d_Cd_Stgl_PadBuf_Ft64_ts512_T512/model_config.txt ADDED
@@ -0,0 +1,1010 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Unet1D_TjTi_Stgl_Cond_V1(
2
+ (st_ovlp_model): Traj_Time_Encoder(
3
+ (time_mlp): Sequential(
4
+ (0): SinusoidalPosEmb()
5
+ (1): Linear(in_features=32, out_features=128, bias=True)
6
+ (2): Mish()
7
+ (3): Linear(in_features=128, out_features=32, bias=True)
8
+ )
9
+ (downs): ModuleList(
10
+ (0): ModuleList(
11
+ (0): Hi_ResidualTemporalBlock(
12
+ (blocks): ModuleList(
13
+ (0): Conv1dBlock(
14
+ (block): Sequential(
15
+ (0): Conv1d(2, 32, kernel_size=(5,), stride=(1,), padding=(2,))
16
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
17
+ (2): GroupNorm(8, 32, eps=1e-05, affine=True)
18
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
19
+ (4): Mish()
20
+ )
21
+ )
22
+ (1): Conv1dBlock(
23
+ (block): Sequential(
24
+ (0): Conv1d(32, 32, kernel_size=(5,), stride=(1,), padding=(2,))
25
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
26
+ (2): GroupNorm(8, 32, eps=1e-05, affine=True)
27
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
28
+ (4): Mish()
29
+ )
30
+ )
31
+ )
32
+ (time_mlp): Sequential(
33
+ (0): Linear(in_features=32, out_features=64, bias=True)
34
+ (1): Mish()
35
+ (2): Linear(in_features=64, out_features=32, bias=True)
36
+ (3): Rearrange('batch t -> batch t 1')
37
+ )
38
+ (residual_conv): Conv1d(2, 32, kernel_size=(1,), stride=(1,))
39
+ )
40
+ (1): Hi_ResidualTemporalBlock(
41
+ (blocks): ModuleList(
42
+ (0-1): 2 x Conv1dBlock(
43
+ (block): Sequential(
44
+ (0): Conv1d(32, 32, kernel_size=(5,), stride=(1,), padding=(2,))
45
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
46
+ (2): GroupNorm(8, 32, eps=1e-05, affine=True)
47
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
48
+ (4): Mish()
49
+ )
50
+ )
51
+ )
52
+ (time_mlp): Sequential(
53
+ (0): Linear(in_features=32, out_features=64, bias=True)
54
+ (1): Mish()
55
+ (2): Linear(in_features=64, out_features=32, bias=True)
56
+ (3): Rearrange('batch t -> batch t 1')
57
+ )
58
+ (residual_conv): Identity()
59
+ )
60
+ (2): Downsample1d(
61
+ (conv): Conv1d(32, 32, kernel_size=(3,), stride=(2,), padding=(1,))
62
+ )
63
+ )
64
+ (1): ModuleList(
65
+ (0): Hi_ResidualTemporalBlock(
66
+ (blocks): ModuleList(
67
+ (0): Conv1dBlock(
68
+ (block): Sequential(
69
+ (0): Conv1d(32, 64, kernel_size=(5,), stride=(1,), padding=(2,))
70
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
71
+ (2): GroupNorm(8, 64, eps=1e-05, affine=True)
72
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
73
+ (4): Mish()
74
+ )
75
+ )
76
+ (1): Conv1dBlock(
77
+ (block): Sequential(
78
+ (0): Conv1d(64, 64, kernel_size=(5,), stride=(1,), padding=(2,))
79
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
80
+ (2): GroupNorm(8, 64, eps=1e-05, affine=True)
81
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
82
+ (4): Mish()
83
+ )
84
+ )
85
+ )
86
+ (time_mlp): Sequential(
87
+ (0): Linear(in_features=32, out_features=64, bias=True)
88
+ (1): Mish()
89
+ (2): Linear(in_features=64, out_features=64, bias=True)
90
+ (3): Rearrange('batch t -> batch t 1')
91
+ )
92
+ (residual_conv): Conv1d(32, 64, kernel_size=(1,), stride=(1,))
93
+ )
94
+ (1): Hi_ResidualTemporalBlock(
95
+ (blocks): ModuleList(
96
+ (0-1): 2 x Conv1dBlock(
97
+ (block): Sequential(
98
+ (0): Conv1d(64, 64, kernel_size=(5,), stride=(1,), padding=(2,))
99
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
100
+ (2): GroupNorm(8, 64, eps=1e-05, affine=True)
101
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
102
+ (4): Mish()
103
+ )
104
+ )
105
+ )
106
+ (time_mlp): Sequential(
107
+ (0): Linear(in_features=32, out_features=64, bias=True)
108
+ (1): Mish()
109
+ (2): Linear(in_features=64, out_features=64, bias=True)
110
+ (3): Rearrange('batch t -> batch t 1')
111
+ )
112
+ (residual_conv): Identity()
113
+ )
114
+ (2): Downsample1d(
115
+ (conv): Conv1d(64, 64, kernel_size=(3,), stride=(2,), padding=(1,))
116
+ )
117
+ )
118
+ (2): ModuleList(
119
+ (0): Hi_ResidualTemporalBlock(
120
+ (blocks): ModuleList(
121
+ (0): Conv1dBlock(
122
+ (block): Sequential(
123
+ (0): Conv1d(64, 96, kernel_size=(5,), stride=(1,), padding=(2,))
124
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
125
+ (2): GroupNorm(8, 96, eps=1e-05, affine=True)
126
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
127
+ (4): Mish()
128
+ )
129
+ )
130
+ (1): Conv1dBlock(
131
+ (block): Sequential(
132
+ (0): Conv1d(96, 96, kernel_size=(5,), stride=(1,), padding=(2,))
133
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
134
+ (2): GroupNorm(8, 96, eps=1e-05, affine=True)
135
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
136
+ (4): Mish()
137
+ )
138
+ )
139
+ )
140
+ (time_mlp): Sequential(
141
+ (0): Linear(in_features=32, out_features=64, bias=True)
142
+ (1): Mish()
143
+ (2): Linear(in_features=64, out_features=96, bias=True)
144
+ (3): Rearrange('batch t -> batch t 1')
145
+ )
146
+ (residual_conv): Conv1d(64, 96, kernel_size=(1,), stride=(1,))
147
+ )
148
+ (1): Hi_ResidualTemporalBlock(
149
+ (blocks): ModuleList(
150
+ (0-1): 2 x Conv1dBlock(
151
+ (block): Sequential(
152
+ (0): Conv1d(96, 96, kernel_size=(5,), stride=(1,), padding=(2,))
153
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
154
+ (2): GroupNorm(8, 96, eps=1e-05, affine=True)
155
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
156
+ (4): Mish()
157
+ )
158
+ )
159
+ )
160
+ (time_mlp): Sequential(
161
+ (0): Linear(in_features=32, out_features=64, bias=True)
162
+ (1): Mish()
163
+ (2): Linear(in_features=64, out_features=96, bias=True)
164
+ (3): Rearrange('batch t -> batch t 1')
165
+ )
166
+ (residual_conv): Identity()
167
+ )
168
+ (2): Downsample1d(
169
+ (conv): Conv1d(96, 96, kernel_size=(3,), stride=(2,), padding=(1,))
170
+ )
171
+ )
172
+ (3): ModuleList(
173
+ (0): Hi_ResidualTemporalBlock(
174
+ (blocks): ModuleList(
175
+ (0): Conv1dBlock(
176
+ (block): Sequential(
177
+ (0): Conv1d(96, 128, kernel_size=(5,), stride=(1,), padding=(2,))
178
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
179
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
180
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
181
+ (4): Mish()
182
+ )
183
+ )
184
+ (1): Conv1dBlock(
185
+ (block): Sequential(
186
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
187
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
188
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
189
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
190
+ (4): Mish()
191
+ )
192
+ )
193
+ )
194
+ (time_mlp): Sequential(
195
+ (0): Linear(in_features=32, out_features=64, bias=True)
196
+ (1): Mish()
197
+ (2): Linear(in_features=64, out_features=128, bias=True)
198
+ (3): Rearrange('batch t -> batch t 1')
199
+ )
200
+ (residual_conv): Conv1d(96, 128, kernel_size=(1,), stride=(1,))
201
+ )
202
+ (1): Hi_ResidualTemporalBlock(
203
+ (blocks): ModuleList(
204
+ (0-1): 2 x Conv1dBlock(
205
+ (block): Sequential(
206
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
207
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
208
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
209
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
210
+ (4): Mish()
211
+ )
212
+ )
213
+ )
214
+ (time_mlp): Sequential(
215
+ (0): Linear(in_features=32, out_features=64, bias=True)
216
+ (1): Mish()
217
+ (2): Linear(in_features=64, out_features=128, bias=True)
218
+ (3): Rearrange('batch t -> batch t 1')
219
+ )
220
+ (residual_conv): Identity()
221
+ )
222
+ (2): Identity()
223
+ )
224
+ )
225
+ (mid_block1): Hi_ResidualTemporalBlock(
226
+ (blocks): ModuleList(
227
+ (0-1): 2 x Conv1dBlock(
228
+ (block): Sequential(
229
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
230
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
231
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
232
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
233
+ (4): Mish()
234
+ )
235
+ )
236
+ )
237
+ (time_mlp): Sequential(
238
+ (0): Linear(in_features=32, out_features=64, bias=True)
239
+ (1): Mish()
240
+ (2): Linear(in_features=64, out_features=128, bias=True)
241
+ (3): Rearrange('batch t -> batch t 1')
242
+ )
243
+ (residual_conv): Identity()
244
+ )
245
+ (mid_block2): Hi_ResidualTemporalBlock(
246
+ (blocks): ModuleList(
247
+ (0-1): 2 x Conv1dBlock(
248
+ (block): Sequential(
249
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
250
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
251
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
252
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
253
+ (4): Mish()
254
+ )
255
+ )
256
+ )
257
+ (time_mlp): Sequential(
258
+ (0): Linear(in_features=32, out_features=64, bias=True)
259
+ (1): Mish()
260
+ (2): Linear(in_features=64, out_features=128, bias=True)
261
+ (3): Rearrange('batch t -> batch t 1')
262
+ )
263
+ (residual_conv): Identity()
264
+ )
265
+ (final_conv): Sequential(
266
+ (0): Conv1dBlock(
267
+ (block): Sequential(
268
+ (0): Conv1d(128, 128, kernel_size=(3,), stride=(1,), padding=(1,))
269
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
270
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
271
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
272
+ (4): Mish()
273
+ )
274
+ )
275
+ (1): Conv1d(128, 128, kernel_size=(1,), stride=(1,))
276
+ )
277
+ (final_mlp): Sequential(
278
+ (0): Linear(in_features=896, out_features=1280, bias=True)
279
+ (1): Mish()
280
+ (2): Linear(in_features=1280, out_features=512, bias=True)
281
+ (3): Mish()
282
+ (4): Linear(in_features=512, out_features=256, bias=True)
283
+ )
284
+ )
285
+ (end_ovlp_model): Traj_Time_Encoder(
286
+ (time_mlp): Sequential(
287
+ (0): SinusoidalPosEmb()
288
+ (1): Linear(in_features=32, out_features=128, bias=True)
289
+ (2): Mish()
290
+ (3): Linear(in_features=128, out_features=32, bias=True)
291
+ )
292
+ (downs): ModuleList(
293
+ (0): ModuleList(
294
+ (0): Hi_ResidualTemporalBlock(
295
+ (blocks): ModuleList(
296
+ (0): Conv1dBlock(
297
+ (block): Sequential(
298
+ (0): Conv1d(2, 32, kernel_size=(5,), stride=(1,), padding=(2,))
299
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
300
+ (2): GroupNorm(8, 32, eps=1e-05, affine=True)
301
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
302
+ (4): Mish()
303
+ )
304
+ )
305
+ (1): Conv1dBlock(
306
+ (block): Sequential(
307
+ (0): Conv1d(32, 32, kernel_size=(5,), stride=(1,), padding=(2,))
308
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
309
+ (2): GroupNorm(8, 32, eps=1e-05, affine=True)
310
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
311
+ (4): Mish()
312
+ )
313
+ )
314
+ )
315
+ (time_mlp): Sequential(
316
+ (0): Linear(in_features=32, out_features=64, bias=True)
317
+ (1): Mish()
318
+ (2): Linear(in_features=64, out_features=32, bias=True)
319
+ (3): Rearrange('batch t -> batch t 1')
320
+ )
321
+ (residual_conv): Conv1d(2, 32, kernel_size=(1,), stride=(1,))
322
+ )
323
+ (1): Hi_ResidualTemporalBlock(
324
+ (blocks): ModuleList(
325
+ (0-1): 2 x Conv1dBlock(
326
+ (block): Sequential(
327
+ (0): Conv1d(32, 32, kernel_size=(5,), stride=(1,), padding=(2,))
328
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
329
+ (2): GroupNorm(8, 32, eps=1e-05, affine=True)
330
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
331
+ (4): Mish()
332
+ )
333
+ )
334
+ )
335
+ (time_mlp): Sequential(
336
+ (0): Linear(in_features=32, out_features=64, bias=True)
337
+ (1): Mish()
338
+ (2): Linear(in_features=64, out_features=32, bias=True)
339
+ (3): Rearrange('batch t -> batch t 1')
340
+ )
341
+ (residual_conv): Identity()
342
+ )
343
+ (2): Downsample1d(
344
+ (conv): Conv1d(32, 32, kernel_size=(3,), stride=(2,), padding=(1,))
345
+ )
346
+ )
347
+ (1): ModuleList(
348
+ (0): Hi_ResidualTemporalBlock(
349
+ (blocks): ModuleList(
350
+ (0): Conv1dBlock(
351
+ (block): Sequential(
352
+ (0): Conv1d(32, 64, kernel_size=(5,), stride=(1,), padding=(2,))
353
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
354
+ (2): GroupNorm(8, 64, eps=1e-05, affine=True)
355
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
356
+ (4): Mish()
357
+ )
358
+ )
359
+ (1): Conv1dBlock(
360
+ (block): Sequential(
361
+ (0): Conv1d(64, 64, kernel_size=(5,), stride=(1,), padding=(2,))
362
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
363
+ (2): GroupNorm(8, 64, eps=1e-05, affine=True)
364
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
365
+ (4): Mish()
366
+ )
367
+ )
368
+ )
369
+ (time_mlp): Sequential(
370
+ (0): Linear(in_features=32, out_features=64, bias=True)
371
+ (1): Mish()
372
+ (2): Linear(in_features=64, out_features=64, bias=True)
373
+ (3): Rearrange('batch t -> batch t 1')
374
+ )
375
+ (residual_conv): Conv1d(32, 64, kernel_size=(1,), stride=(1,))
376
+ )
377
+ (1): Hi_ResidualTemporalBlock(
378
+ (blocks): ModuleList(
379
+ (0-1): 2 x Conv1dBlock(
380
+ (block): Sequential(
381
+ (0): Conv1d(64, 64, kernel_size=(5,), stride=(1,), padding=(2,))
382
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
383
+ (2): GroupNorm(8, 64, eps=1e-05, affine=True)
384
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
385
+ (4): Mish()
386
+ )
387
+ )
388
+ )
389
+ (time_mlp): Sequential(
390
+ (0): Linear(in_features=32, out_features=64, bias=True)
391
+ (1): Mish()
392
+ (2): Linear(in_features=64, out_features=64, bias=True)
393
+ (3): Rearrange('batch t -> batch t 1')
394
+ )
395
+ (residual_conv): Identity()
396
+ )
397
+ (2): Downsample1d(
398
+ (conv): Conv1d(64, 64, kernel_size=(3,), stride=(2,), padding=(1,))
399
+ )
400
+ )
401
+ (2): ModuleList(
402
+ (0): Hi_ResidualTemporalBlock(
403
+ (blocks): ModuleList(
404
+ (0): Conv1dBlock(
405
+ (block): Sequential(
406
+ (0): Conv1d(64, 96, kernel_size=(5,), stride=(1,), padding=(2,))
407
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
408
+ (2): GroupNorm(8, 96, eps=1e-05, affine=True)
409
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
410
+ (4): Mish()
411
+ )
412
+ )
413
+ (1): Conv1dBlock(
414
+ (block): Sequential(
415
+ (0): Conv1d(96, 96, kernel_size=(5,), stride=(1,), padding=(2,))
416
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
417
+ (2): GroupNorm(8, 96, eps=1e-05, affine=True)
418
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
419
+ (4): Mish()
420
+ )
421
+ )
422
+ )
423
+ (time_mlp): Sequential(
424
+ (0): Linear(in_features=32, out_features=64, bias=True)
425
+ (1): Mish()
426
+ (2): Linear(in_features=64, out_features=96, bias=True)
427
+ (3): Rearrange('batch t -> batch t 1')
428
+ )
429
+ (residual_conv): Conv1d(64, 96, kernel_size=(1,), stride=(1,))
430
+ )
431
+ (1): Hi_ResidualTemporalBlock(
432
+ (blocks): ModuleList(
433
+ (0-1): 2 x Conv1dBlock(
434
+ (block): Sequential(
435
+ (0): Conv1d(96, 96, kernel_size=(5,), stride=(1,), padding=(2,))
436
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
437
+ (2): GroupNorm(8, 96, eps=1e-05, affine=True)
438
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
439
+ (4): Mish()
440
+ )
441
+ )
442
+ )
443
+ (time_mlp): Sequential(
444
+ (0): Linear(in_features=32, out_features=64, bias=True)
445
+ (1): Mish()
446
+ (2): Linear(in_features=64, out_features=96, bias=True)
447
+ (3): Rearrange('batch t -> batch t 1')
448
+ )
449
+ (residual_conv): Identity()
450
+ )
451
+ (2): Downsample1d(
452
+ (conv): Conv1d(96, 96, kernel_size=(3,), stride=(2,), padding=(1,))
453
+ )
454
+ )
455
+ (3): ModuleList(
456
+ (0): Hi_ResidualTemporalBlock(
457
+ (blocks): ModuleList(
458
+ (0): Conv1dBlock(
459
+ (block): Sequential(
460
+ (0): Conv1d(96, 128, kernel_size=(5,), stride=(1,), padding=(2,))
461
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
462
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
463
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
464
+ (4): Mish()
465
+ )
466
+ )
467
+ (1): Conv1dBlock(
468
+ (block): Sequential(
469
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
470
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
471
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
472
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
473
+ (4): Mish()
474
+ )
475
+ )
476
+ )
477
+ (time_mlp): Sequential(
478
+ (0): Linear(in_features=32, out_features=64, bias=True)
479
+ (1): Mish()
480
+ (2): Linear(in_features=64, out_features=128, bias=True)
481
+ (3): Rearrange('batch t -> batch t 1')
482
+ )
483
+ (residual_conv): Conv1d(96, 128, kernel_size=(1,), stride=(1,))
484
+ )
485
+ (1): Hi_ResidualTemporalBlock(
486
+ (blocks): ModuleList(
487
+ (0-1): 2 x Conv1dBlock(
488
+ (block): Sequential(
489
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
490
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
491
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
492
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
493
+ (4): Mish()
494
+ )
495
+ )
496
+ )
497
+ (time_mlp): Sequential(
498
+ (0): Linear(in_features=32, out_features=64, bias=True)
499
+ (1): Mish()
500
+ (2): Linear(in_features=64, out_features=128, bias=True)
501
+ (3): Rearrange('batch t -> batch t 1')
502
+ )
503
+ (residual_conv): Identity()
504
+ )
505
+ (2): Identity()
506
+ )
507
+ )
508
+ (mid_block1): Hi_ResidualTemporalBlock(
509
+ (blocks): ModuleList(
510
+ (0-1): 2 x Conv1dBlock(
511
+ (block): Sequential(
512
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
513
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
514
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
515
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
516
+ (4): Mish()
517
+ )
518
+ )
519
+ )
520
+ (time_mlp): Sequential(
521
+ (0): Linear(in_features=32, out_features=64, bias=True)
522
+ (1): Mish()
523
+ (2): Linear(in_features=64, out_features=128, bias=True)
524
+ (3): Rearrange('batch t -> batch t 1')
525
+ )
526
+ (residual_conv): Identity()
527
+ )
528
+ (mid_block2): Hi_ResidualTemporalBlock(
529
+ (blocks): ModuleList(
530
+ (0-1): 2 x Conv1dBlock(
531
+ (block): Sequential(
532
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
533
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
534
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
535
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
536
+ (4): Mish()
537
+ )
538
+ )
539
+ )
540
+ (time_mlp): Sequential(
541
+ (0): Linear(in_features=32, out_features=64, bias=True)
542
+ (1): Mish()
543
+ (2): Linear(in_features=64, out_features=128, bias=True)
544
+ (3): Rearrange('batch t -> batch t 1')
545
+ )
546
+ (residual_conv): Identity()
547
+ )
548
+ (final_conv): Sequential(
549
+ (0): Conv1dBlock(
550
+ (block): Sequential(
551
+ (0): Conv1d(128, 128, kernel_size=(3,), stride=(1,), padding=(1,))
552
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
553
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
554
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
555
+ (4): Mish()
556
+ )
557
+ )
558
+ (1): Conv1d(128, 128, kernel_size=(1,), stride=(1,))
559
+ )
560
+ (final_mlp): Sequential(
561
+ (0): Linear(in_features=896, out_features=1280, bias=True)
562
+ (1): Mish()
563
+ (2): Linear(in_features=1280, out_features=512, bias=True)
564
+ (3): Mish()
565
+ (4): Linear(in_features=512, out_features=256, bias=True)
566
+ )
567
+ )
568
+ (st_inpaint_model): Identity()
569
+ (end_inpaint_model): Identity()
570
+ (time_mlp): Sequential(
571
+ (0): SinusoidalPosEmb()
572
+ (1): Linear(in_features=96, out_features=192, bias=True)
573
+ (2): Mish()
574
+ (3): Linear(in_features=192, out_features=192, bias=True)
575
+ (4): Mish()
576
+ (5): Linear(in_features=192, out_features=96, bias=True)
577
+ )
578
+ (downs): ModuleList(
579
+ (0): ModuleList(
580
+ (0): ResidualTemporalBlock_dd(
581
+ (blocks): ModuleList(
582
+ (0): Conv1dBlock_dd(
583
+ (block): Sequential(
584
+ (0): Conv1d(2, 128, kernel_size=(5,), stride=(1,), padding=(2,))
585
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
586
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
587
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
588
+ (4): Mish()
589
+ )
590
+ )
591
+ (1): Conv1dBlock_dd(
592
+ (block): Sequential(
593
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
594
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
595
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
596
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
597
+ (4): Mish()
598
+ )
599
+ )
600
+ )
601
+ (time_mlp): Sequential(
602
+ (0): Linear(in_features=672, out_features=1344, bias=True)
603
+ (1): Mish()
604
+ (2): Linear(in_features=1344, out_features=128, bias=True)
605
+ (3): Rearrange('batch t -> batch t 1')
606
+ )
607
+ (residual_conv): Conv1d(2, 128, kernel_size=(1,), stride=(1,))
608
+ )
609
+ (1): ResidualTemporalBlock_dd(
610
+ (blocks): ModuleList(
611
+ (0-1): 2 x Conv1dBlock_dd(
612
+ (block): Sequential(
613
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
614
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
615
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
616
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
617
+ (4): Mish()
618
+ )
619
+ )
620
+ )
621
+ (time_mlp): Sequential(
622
+ (0): Linear(in_features=672, out_features=1344, bias=True)
623
+ (1): Mish()
624
+ (2): Linear(in_features=1344, out_features=128, bias=True)
625
+ (3): Rearrange('batch t -> batch t 1')
626
+ )
627
+ (residual_conv): Identity()
628
+ )
629
+ (2): Downsample1d(
630
+ (conv): Conv1d(128, 128, kernel_size=(3,), stride=(2,), padding=(1,))
631
+ )
632
+ )
633
+ (1): ModuleList(
634
+ (0): ResidualTemporalBlock_dd(
635
+ (blocks): ModuleList(
636
+ (0): Conv1dBlock_dd(
637
+ (block): Sequential(
638
+ (0): Conv1d(128, 256, kernel_size=(5,), stride=(1,), padding=(2,))
639
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
640
+ (2): GroupNorm(8, 256, eps=1e-05, affine=True)
641
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
642
+ (4): Mish()
643
+ )
644
+ )
645
+ (1): Conv1dBlock_dd(
646
+ (block): Sequential(
647
+ (0): Conv1d(256, 256, kernel_size=(5,), stride=(1,), padding=(2,))
648
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
649
+ (2): GroupNorm(8, 256, eps=1e-05, affine=True)
650
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
651
+ (4): Mish()
652
+ )
653
+ )
654
+ )
655
+ (time_mlp): Sequential(
656
+ (0): Linear(in_features=672, out_features=1344, bias=True)
657
+ (1): Mish()
658
+ (2): Linear(in_features=1344, out_features=256, bias=True)
659
+ (3): Rearrange('batch t -> batch t 1')
660
+ )
661
+ (residual_conv): Conv1d(128, 256, kernel_size=(1,), stride=(1,))
662
+ )
663
+ (1): ResidualTemporalBlock_dd(
664
+ (blocks): ModuleList(
665
+ (0-1): 2 x Conv1dBlock_dd(
666
+ (block): Sequential(
667
+ (0): Conv1d(256, 256, kernel_size=(5,), stride=(1,), padding=(2,))
668
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
669
+ (2): GroupNorm(8, 256, eps=1e-05, affine=True)
670
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
671
+ (4): Mish()
672
+ )
673
+ )
674
+ )
675
+ (time_mlp): Sequential(
676
+ (0): Linear(in_features=672, out_features=1344, bias=True)
677
+ (1): Mish()
678
+ (2): Linear(in_features=1344, out_features=256, bias=True)
679
+ (3): Rearrange('batch t -> batch t 1')
680
+ )
681
+ (residual_conv): Identity()
682
+ )
683
+ (2): Downsample1d(
684
+ (conv): Conv1d(256, 256, kernel_size=(3,), stride=(2,), padding=(1,))
685
+ )
686
+ )
687
+ (2): ModuleList(
688
+ (0): ResidualTemporalBlock_dd(
689
+ (blocks): ModuleList(
690
+ (0): Conv1dBlock_dd(
691
+ (block): Sequential(
692
+ (0): Conv1d(256, 512, kernel_size=(5,), stride=(1,), padding=(2,))
693
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
694
+ (2): GroupNorm(8, 512, eps=1e-05, affine=True)
695
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
696
+ (4): Mish()
697
+ )
698
+ )
699
+ (1): Conv1dBlock_dd(
700
+ (block): Sequential(
701
+ (0): Conv1d(512, 512, kernel_size=(5,), stride=(1,), padding=(2,))
702
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
703
+ (2): GroupNorm(8, 512, eps=1e-05, affine=True)
704
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
705
+ (4): Mish()
706
+ )
707
+ )
708
+ )
709
+ (time_mlp): Sequential(
710
+ (0): Linear(in_features=672, out_features=1344, bias=True)
711
+ (1): Mish()
712
+ (2): Linear(in_features=1344, out_features=512, bias=True)
713
+ (3): Rearrange('batch t -> batch t 1')
714
+ )
715
+ (residual_conv): Conv1d(256, 512, kernel_size=(1,), stride=(1,))
716
+ )
717
+ (1): ResidualTemporalBlock_dd(
718
+ (blocks): ModuleList(
719
+ (0-1): 2 x Conv1dBlock_dd(
720
+ (block): Sequential(
721
+ (0): Conv1d(512, 512, kernel_size=(5,), stride=(1,), padding=(2,))
722
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
723
+ (2): GroupNorm(8, 512, eps=1e-05, affine=True)
724
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
725
+ (4): Mish()
726
+ )
727
+ )
728
+ )
729
+ (time_mlp): Sequential(
730
+ (0): Linear(in_features=672, out_features=1344, bias=True)
731
+ (1): Mish()
732
+ (2): Linear(in_features=1344, out_features=512, bias=True)
733
+ (3): Rearrange('batch t -> batch t 1')
734
+ )
735
+ (residual_conv): Identity()
736
+ )
737
+ (2): Downsample1d(
738
+ (conv): Conv1d(512, 512, kernel_size=(3,), stride=(2,), padding=(1,))
739
+ )
740
+ )
741
+ (3): ModuleList(
742
+ (0): ResidualTemporalBlock_dd(
743
+ (blocks): ModuleList(
744
+ (0): Conv1dBlock_dd(
745
+ (block): Sequential(
746
+ (0): Conv1d(512, 1024, kernel_size=(5,), stride=(1,), padding=(2,))
747
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
748
+ (2): GroupNorm(8, 1024, eps=1e-05, affine=True)
749
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
750
+ (4): Mish()
751
+ )
752
+ )
753
+ (1): Conv1dBlock_dd(
754
+ (block): Sequential(
755
+ (0): Conv1d(1024, 1024, kernel_size=(5,), stride=(1,), padding=(2,))
756
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
757
+ (2): GroupNorm(8, 1024, eps=1e-05, affine=True)
758
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
759
+ (4): Mish()
760
+ )
761
+ )
762
+ )
763
+ (time_mlp): Sequential(
764
+ (0): Linear(in_features=672, out_features=1344, bias=True)
765
+ (1): Mish()
766
+ (2): Linear(in_features=1344, out_features=1024, bias=True)
767
+ (3): Rearrange('batch t -> batch t 1')
768
+ )
769
+ (residual_conv): Conv1d(512, 1024, kernel_size=(1,), stride=(1,))
770
+ )
771
+ (1): ResidualTemporalBlock_dd(
772
+ (blocks): ModuleList(
773
+ (0-1): 2 x Conv1dBlock_dd(
774
+ (block): Sequential(
775
+ (0): Conv1d(1024, 1024, kernel_size=(5,), stride=(1,), padding=(2,))
776
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
777
+ (2): GroupNorm(8, 1024, eps=1e-05, affine=True)
778
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
779
+ (4): Mish()
780
+ )
781
+ )
782
+ )
783
+ (time_mlp): Sequential(
784
+ (0): Linear(in_features=672, out_features=1344, bias=True)
785
+ (1): Mish()
786
+ (2): Linear(in_features=1344, out_features=1024, bias=True)
787
+ (3): Rearrange('batch t -> batch t 1')
788
+ )
789
+ (residual_conv): Identity()
790
+ )
791
+ (2): Identity()
792
+ )
793
+ )
794
+ (ups): ModuleList(
795
+ (0): ModuleList(
796
+ (0): ResidualTemporalBlock_dd(
797
+ (blocks): ModuleList(
798
+ (0): Conv1dBlock_dd(
799
+ (block): Sequential(
800
+ (0): Conv1d(2048, 512, kernel_size=(5,), stride=(1,), padding=(2,))
801
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
802
+ (2): GroupNorm(8, 512, eps=1e-05, affine=True)
803
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
804
+ (4): Mish()
805
+ )
806
+ )
807
+ (1): Conv1dBlock_dd(
808
+ (block): Sequential(
809
+ (0): Conv1d(512, 512, kernel_size=(5,), stride=(1,), padding=(2,))
810
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
811
+ (2): GroupNorm(8, 512, eps=1e-05, affine=True)
812
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
813
+ (4): Mish()
814
+ )
815
+ )
816
+ )
817
+ (time_mlp): Sequential(
818
+ (0): Linear(in_features=672, out_features=1344, bias=True)
819
+ (1): Mish()
820
+ (2): Linear(in_features=1344, out_features=512, bias=True)
821
+ (3): Rearrange('batch t -> batch t 1')
822
+ )
823
+ (residual_conv): Conv1d(2048, 512, kernel_size=(1,), stride=(1,))
824
+ )
825
+ (1): ResidualTemporalBlock_dd(
826
+ (blocks): ModuleList(
827
+ (0-1): 2 x Conv1dBlock_dd(
828
+ (block): Sequential(
829
+ (0): Conv1d(512, 512, kernel_size=(5,), stride=(1,), padding=(2,))
830
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
831
+ (2): GroupNorm(8, 512, eps=1e-05, affine=True)
832
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
833
+ (4): Mish()
834
+ )
835
+ )
836
+ )
837
+ (time_mlp): Sequential(
838
+ (0): Linear(in_features=672, out_features=1344, bias=True)
839
+ (1): Mish()
840
+ (2): Linear(in_features=1344, out_features=512, bias=True)
841
+ (3): Rearrange('batch t -> batch t 1')
842
+ )
843
+ (residual_conv): Identity()
844
+ )
845
+ (2): Upsample1d(
846
+ (conv): ConvTranspose1d(512, 512, kernel_size=(4,), stride=(2,), padding=(1,))
847
+ )
848
+ )
849
+ (1): ModuleList(
850
+ (0): ResidualTemporalBlock_dd(
851
+ (blocks): ModuleList(
852
+ (0): Conv1dBlock_dd(
853
+ (block): Sequential(
854
+ (0): Conv1d(1024, 256, kernel_size=(5,), stride=(1,), padding=(2,))
855
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
856
+ (2): GroupNorm(8, 256, eps=1e-05, affine=True)
857
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
858
+ (4): Mish()
859
+ )
860
+ )
861
+ (1): Conv1dBlock_dd(
862
+ (block): Sequential(
863
+ (0): Conv1d(256, 256, kernel_size=(5,), stride=(1,), padding=(2,))
864
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
865
+ (2): GroupNorm(8, 256, eps=1e-05, affine=True)
866
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
867
+ (4): Mish()
868
+ )
869
+ )
870
+ )
871
+ (time_mlp): Sequential(
872
+ (0): Linear(in_features=672, out_features=1344, bias=True)
873
+ (1): Mish()
874
+ (2): Linear(in_features=1344, out_features=256, bias=True)
875
+ (3): Rearrange('batch t -> batch t 1')
876
+ )
877
+ (residual_conv): Conv1d(1024, 256, kernel_size=(1,), stride=(1,))
878
+ )
879
+ (1): ResidualTemporalBlock_dd(
880
+ (blocks): ModuleList(
881
+ (0-1): 2 x Conv1dBlock_dd(
882
+ (block): Sequential(
883
+ (0): Conv1d(256, 256, kernel_size=(5,), stride=(1,), padding=(2,))
884
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
885
+ (2): GroupNorm(8, 256, eps=1e-05, affine=True)
886
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
887
+ (4): Mish()
888
+ )
889
+ )
890
+ )
891
+ (time_mlp): Sequential(
892
+ (0): Linear(in_features=672, out_features=1344, bias=True)
893
+ (1): Mish()
894
+ (2): Linear(in_features=1344, out_features=256, bias=True)
895
+ (3): Rearrange('batch t -> batch t 1')
896
+ )
897
+ (residual_conv): Identity()
898
+ )
899
+ (2): Upsample1d(
900
+ (conv): ConvTranspose1d(256, 256, kernel_size=(4,), stride=(2,), padding=(1,))
901
+ )
902
+ )
903
+ (2): ModuleList(
904
+ (0): ResidualTemporalBlock_dd(
905
+ (blocks): ModuleList(
906
+ (0): Conv1dBlock_dd(
907
+ (block): Sequential(
908
+ (0): Conv1d(512, 128, kernel_size=(5,), stride=(1,), padding=(2,))
909
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
910
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
911
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
912
+ (4): Mish()
913
+ )
914
+ )
915
+ (1): Conv1dBlock_dd(
916
+ (block): Sequential(
917
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
918
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
919
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
920
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
921
+ (4): Mish()
922
+ )
923
+ )
924
+ )
925
+ (time_mlp): Sequential(
926
+ (0): Linear(in_features=672, out_features=1344, bias=True)
927
+ (1): Mish()
928
+ (2): Linear(in_features=1344, out_features=128, bias=True)
929
+ (3): Rearrange('batch t -> batch t 1')
930
+ )
931
+ (residual_conv): Conv1d(512, 128, kernel_size=(1,), stride=(1,))
932
+ )
933
+ (1): ResidualTemporalBlock_dd(
934
+ (blocks): ModuleList(
935
+ (0-1): 2 x Conv1dBlock_dd(
936
+ (block): Sequential(
937
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
938
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
939
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
940
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
941
+ (4): Mish()
942
+ )
943
+ )
944
+ )
945
+ (time_mlp): Sequential(
946
+ (0): Linear(in_features=672, out_features=1344, bias=True)
947
+ (1): Mish()
948
+ (2): Linear(in_features=1344, out_features=128, bias=True)
949
+ (3): Rearrange('batch t -> batch t 1')
950
+ )
951
+ (residual_conv): Identity()
952
+ )
953
+ (2): Upsample1d(
954
+ (conv): ConvTranspose1d(128, 128, kernel_size=(4,), stride=(2,), padding=(1,))
955
+ )
956
+ )
957
+ )
958
+ (mid_block1): ResidualTemporalBlock_dd(
959
+ (blocks): ModuleList(
960
+ (0-1): 2 x Conv1dBlock_dd(
961
+ (block): Sequential(
962
+ (0): Conv1d(1024, 1024, kernel_size=(5,), stride=(1,), padding=(2,))
963
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
964
+ (2): GroupNorm(8, 1024, eps=1e-05, affine=True)
965
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
966
+ (4): Mish()
967
+ )
968
+ )
969
+ )
970
+ (time_mlp): Sequential(
971
+ (0): Linear(in_features=672, out_features=1344, bias=True)
972
+ (1): Mish()
973
+ (2): Linear(in_features=1344, out_features=1024, bias=True)
974
+ (3): Rearrange('batch t -> batch t 1')
975
+ )
976
+ (residual_conv): Identity()
977
+ )
978
+ (mid_block2): ResidualTemporalBlock_dd(
979
+ (blocks): ModuleList(
980
+ (0-1): 2 x Conv1dBlock_dd(
981
+ (block): Sequential(
982
+ (0): Conv1d(1024, 1024, kernel_size=(5,), stride=(1,), padding=(2,))
983
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
984
+ (2): GroupNorm(8, 1024, eps=1e-05, affine=True)
985
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
986
+ (4): Mish()
987
+ )
988
+ )
989
+ )
990
+ (time_mlp): Sequential(
991
+ (0): Linear(in_features=672, out_features=1344, bias=True)
992
+ (1): Mish()
993
+ (2): Linear(in_features=1344, out_features=1024, bias=True)
994
+ (3): Rearrange('batch t -> batch t 1')
995
+ )
996
+ (residual_conv): Identity()
997
+ )
998
+ (final_conv): Sequential(
999
+ (0): Conv1dBlock(
1000
+ (block): Sequential(
1001
+ (0): Conv1d(128, 128, kernel_size=(5,), stride=(1,), padding=(2,))
1002
+ (1): Rearrange('batch channels horizon -> batch channels 1 horizon')
1003
+ (2): GroupNorm(8, 128, eps=1e-05, affine=True)
1004
+ (3): Rearrange('batch channels 1 horizon -> batch channels horizon')
1005
+ (4): Mish()
1006
+ )
1007
+ )
1008
+ (1): Conv1d(128, 2, kernel_size=(1,), stride=(1,))
1009
+ )
1010
+ )