Publish fixed-update physics study checkpoints and measured metadata
Browse files
README.md
CHANGED
|
@@ -7,12 +7,21 @@ tags:
|
|
| 7 |
- attention-residuals
|
| 8 |
- gphyt
|
| 9 |
---
|
| 10 |
-
# GPhyT-S
|
| 11 |
|
| 12 |
Final fixed-update checkpoints from the paired GPhyT Attention Residuals study by Libor Burian.
|
| 13 |
The architecture uses twelve layers, width 192, MLP width 768, three heads, four context frames,
|
| 14 |
128x64 fields, and five canonical channels. Mode: `full`. Training updates: 3175.
|
| 15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
## Use and evaluation
|
| 17 |
|
| 18 |
Clone the [study repository](https://github.com/BurnyCoder/general-physics-attention-residuals-transformer),
|
|
|
|
| 7 |
- attention-residuals
|
| 8 |
- gphyt
|
| 9 |
---
|
| 10 |
+
# GPhyT-S with Full Attention Residuals
|
| 11 |
|
| 12 |
Final fixed-update checkpoints from the paired GPhyT Attention Residuals study by Libor Burian.
|
| 13 |
The architecture uses twelve layers, width 192, MLP width 768, three heads, four context frames,
|
| 14 |
128x64 fields, and five canonical channels. Mode: `full`. Training updates: 3175.
|
| 15 |
|
| 16 |
+
The [GPhyT without Attention Residuals baseline](https://huggingface.co/BurnyCoder/gphyt-attnres-standard)
|
| 17 |
+
contains all six seeds (0–5). It keeps the original GPhyT additive residual connections and
|
| 18 |
+
transformer self-attention. The primary Block Attention Residuals comparison uses the same
|
| 19 |
+
six seeds, identical shared backbone initialization and paired training examples, AdamW and
|
| 20 |
+
learning-rate schedule, effective batch size 16, BF16 autocast, and fixed update count.
|
| 21 |
+
The models have matched training procedures and updates, not identical GPU time.
|
| 22 |
+
The [baseline table and all-model physics-field examples](https://github.com/BurnyCoder/general-physics-attention-residuals-transformer#readme)
|
| 23 |
+
show the measured comparison; Full and Uniform Block use three exploratory seeds.
|
| 24 |
+
|
| 25 |
## Use and evaluation
|
| 26 |
|
| 27 |
Clone the [study repository](https://github.com/BurnyCoder/general-physics-attention-residuals-transformer),
|