BurnyCoder commited on
Commit
17f23c3
·
verified ·
1 Parent(s): 4307417

Publish fixed-update physics study checkpoints and measured metadata

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -7,12 +7,21 @@ tags:
7
  - attention-residuals
8
  - gphyt
9
  ---
10
- # GPhyT-S: full
11
 
12
  Final fixed-update checkpoints from the paired GPhyT Attention Residuals study by Libor Burian.
13
  The architecture uses twelve layers, width 192, MLP width 768, three heads, four context frames,
14
  128x64 fields, and five canonical channels. Mode: `full`. Training updates: 3175.
15
 
 
 
 
 
 
 
 
 
 
16
  ## Use and evaluation
17
 
18
  Clone the [study repository](https://github.com/BurnyCoder/general-physics-attention-residuals-transformer),
 
7
  - attention-residuals
8
  - gphyt
9
  ---
10
+ # GPhyT-S with Full Attention Residuals
11
 
12
  Final fixed-update checkpoints from the paired GPhyT Attention Residuals study by Libor Burian.
13
  The architecture uses twelve layers, width 192, MLP width 768, three heads, four context frames,
14
  128x64 fields, and five canonical channels. Mode: `full`. Training updates: 3175.
15
 
16
+ The [GPhyT without Attention Residuals baseline](https://huggingface.co/BurnyCoder/gphyt-attnres-standard)
17
+ contains all six seeds (0–5). It keeps the original GPhyT additive residual connections and
18
+ transformer self-attention. The primary Block Attention Residuals comparison uses the same
19
+ six seeds, identical shared backbone initialization and paired training examples, AdamW and
20
+ learning-rate schedule, effective batch size 16, BF16 autocast, and fixed update count.
21
+ The models have matched training procedures and updates, not identical GPU time.
22
+ The [baseline table and all-model physics-field examples](https://github.com/BurnyCoder/general-physics-attention-residuals-transformer#readme)
23
+ show the measured comparison; Full and Uniform Block use three exploratory seeds.
24
+
25
  ## Use and evaluation
26
 
27
  Clone the [study repository](https://github.com/BurnyCoder/general-physics-attention-residuals-transformer),