Energy table: whole-node estimate column (provisional x1.17); key facts point to the energy note
Browse files
README.md
CHANGED
|
@@ -47,7 +47,7 @@ Built by [LogoLabs](https://logolabs.org), which makes AI logo generation.
|
|
| 47 |
| **What** | Text-to-image, 256 × 256, English prompts |
|
| 48 |
| **Size** | 260M parameters with TAESD, 308.5M with SD-VAE: 190.9M generator + 68.1M text encoder + decoder (as 001) |
|
| 49 |
| **Training** | 001's first 82,800 steps, then 55,210 more at batch 1,024: 138,010 steps, 186.6M images seen (≈33 epochs) |
|
| 50 |
-
| **Compute** | 187.7 GH200-hours for the whole lineage from scratch (61.0 of them for the continuation), 107.1 kWh, 3.21 kg CO₂e
|
| 51 |
| **GenEval** (official) | **0.577** (001: 0.550). SDXL 0.55, SD 2.1 0.50, PixArt-α 0.48, SD 1.5 0.43 (published) |
|
| 52 |
| **Qwen-Image-Bench** (1,000 prompts) | **28.9** (001: 28.2; SD 1.5: 29.1) |
|
| 53 |
| **Speed** | Same network as 001: 1.9 s per image on an RTX 4060 (50 steps, CUDA graphs), timed on 001 |
|
|
@@ -259,34 +259,34 @@ Every GPU job was wrapped in [perun](https://github.com/Helmholtz-AI-Energy/peru
|
|
| 259 |
of 1.3; CO₂e assumes 30 g/kWh (Swedish SE3 grid). Neither factor is confirmed by NAISS yet; seconds perun did not
|
| 260 |
cover count at idle power, so the totals are a floor.
|
| 261 |
|
| 262 |
-
| Run | Jobs | GH200-h | kWh | kg CO₂e |
|
| 263 |
-
|---|---|---|---|---|
|
| 264 |
-
| Latent cache (SD-VAE encode of the dataset) | 11 | 4.2 | 2.6 | 0.08 |
|
| 265 |
-
| FCDM v1, epochs 1-10 | 2 | 13.7 | 8.7 | 0.26 |
|
| 266 |
-
| FCDM v1, epochs 11-20 + Flan-T5 fine-tune | 1 | 20.6 | 13.5 | 0.41 |
|
| 267 |
-
| DiT reproduction, epochs 1-10 | 1 | 13.1 | 8.8 | 0.26 |
|
| 268 |
-
| fcdm2, all phases incl. restarts | 14 | 68.0 | 33.8 | 1.01 |
|
| 269 |
-
| Run 1 thinker, epochs 1-10 | 1 | 19.0 | 12.6 | 0.38 |
|
| 270 |
-
| T40r first try (diverged at step ~1,800) | 1 | 7.8 | 3.0 | 0.09 |
|
| 271 |
-
| **T40r phase 1 (epochs 1-10)** | 1 | 47.3 | 27.7 | 0.83 |
|
| 272 |
-
| **T40r phase 2 (joint Ettin training, to epoch 16)** | 1 | 37.1 | 18.8 | 0.56 |
|
| 273 |
-
| **T40r caption phase (2 nodes, 8 h, cosine anneal)** | 1 | 60.3 | 35.2 | 1.06 |
|
| 274 |
-
| T40r caption phase, two failed starts | 2 | 3.5 | 0.5 | 0.02 |
|
| 275 |
-
| **Agate 002: cap2 continuation, 82.8k to 138k** | 1 | 61.0 | 35.9 | 1.08 |
|
| 276 |
-
| 001 release benchmark and GenEval | 3 | 5.1 | 2.7 | 0.08 |
|
| 277 |
-
| A/B wave 1 (six 256 px arms) + noise-scale study | 9 | 17.5 | 8.7 | 0.26 |
|
| 278 |
-
| A/B wave 2 (does 512 px work?) | 2 | 12.1 | 6.7 | 0.20 |
|
| 279 |
-
| A/B wave 2, failed attempts | 4 | 3.0 | 1.4 | 0.04 |
|
| 280 |
-
| 512 px latents + saliency maps (data prep) | 21 | 22.5 | 14.7 | 0.44 |
|
| 281 |
-
| Perceptual-loss profiling | 2 | 1.3 | 0.5 | 0.02 |
|
| 282 |
-
| Perceptual-loss profiling, OOM | 2 | 0.6 | 0.1 | 0.00 |
|
| 283 |
-
| Research after 003: logo LoRA, router, MoE pilots | 34 | 68.5 | 32.7 | 0.98 |
|
| 284 |
-
| 512 px runs that became 003 (long1, long2, perc1) | 3 | 113.5 | 68.2 | 2.05 |
|
| 285 |
-
| Evaluations, smoke tests, benchmarks | 47 | 30.9 | 11.7 | 0.35 |
|
| 286 |
-
| **Whole Agate project to 2026-09-28** | 164 | **630.4** | **348.6** | **10.46** |
|
| 287 |
|
| 288 |
Preview 002's own lineage, counted from scratch with the caption-phase job pro-rated to the 82,800 steps 002
|
| 289 |
-
inherits, cost **187.7 GH200-hours, 107.1 kWh and 3.21 kg CO₂e**. The whole project to
|
| 290 |
date, including Preview 003 and every experiment, cost 630.4 GPU-hours.
|
| 291 |
|
| 292 |
**About these energy figures.** perun measured GPU power only, through NVML: on the GH200 superchip it does not
|
|
|
|
| 47 |
| **What** | Text-to-image, 256 × 256, English prompts |
|
| 48 |
| **Size** | 260M parameters with TAESD, 308.5M with SD-VAE: 190.9M generator + 68.1M text encoder + decoder (as 001) |
|
| 49 |
| **Training** | 001's first 82,800 steps, then 55,210 more at batch 1,024: 138,010 steps, 186.6M images seen (≈33 epochs) |
|
| 50 |
+
| **Compute** | 187.7 GH200-hours for the whole lineage from scratch (61.0 of them for the continuation), 107.1 kWh, 3.21 kg CO₂e; GPU energy measured with perun, see [About these energy figures](#compute-and-energy) |
|
| 51 |
| **GenEval** (official) | **0.577** (001: 0.550). SDXL 0.55, SD 2.1 0.50, PixArt-α 0.48, SD 1.5 0.43 (published) |
|
| 52 |
| **Qwen-Image-Bench** (1,000 prompts) | **28.9** (001: 28.2; SD 1.5: 29.1) |
|
| 53 |
| **Speed** | Same network as 001: 1.9 s per image on an RTX 4060 (50 steps, CUDA graphs), timed on 001 |
|
|
|
|
| 259 |
of 1.3; CO₂e assumes 30 g/kWh (Swedish SE3 grid). Neither factor is confirmed by NAISS yet; seconds perun did not
|
| 260 |
cover count at idle power, so the totals are a floor.
|
| 261 |
|
| 262 |
+
| Run | Jobs | GH200-h | kWh | kg CO₂e | Whole-node est. (×1.17) |
|
| 263 |
+
|---|---|---|---|---|---|
|
| 264 |
+
| Latent cache (SD-VAE encode of the dataset) | 11 | 4.2 | 2.6 | 0.08 | 3.1 kWh / 0.09 kg |
|
| 265 |
+
| FCDM v1, epochs 1-10 | 2 | 13.7 | 8.7 | 0.26 | 10.2 kWh / 0.31 kg |
|
| 266 |
+
| FCDM v1, epochs 11-20 + Flan-T5 fine-tune | 1 | 20.6 | 13.5 | 0.41 | 15.8 kWh / 0.48 kg |
|
| 267 |
+
| DiT reproduction, epochs 1-10 | 1 | 13.1 | 8.8 | 0.26 | 10.3 kWh / 0.31 kg |
|
| 268 |
+
| fcdm2, all phases incl. restarts | 14 | 68.0 | 33.8 | 1.01 | 39.6 kWh / 1.19 kg |
|
| 269 |
+
| Run 1 thinker, epochs 1-10 | 1 | 19.0 | 12.6 | 0.38 | 14.7 kWh / 0.44 kg |
|
| 270 |
+
| T40r first try (diverged at step ~1,800) | 1 | 7.8 | 3.0 | 0.09 | 3.5 kWh / 0.10 kg |
|
| 271 |
+
| **T40r phase 1 (epochs 1-10)** | 1 | 47.3 | 27.7 | 0.83 | 32.4 kWh / 0.97 kg |
|
| 272 |
+
| **T40r phase 2 (joint Ettin training, to epoch 16)** | 1 | 37.1 | 18.8 | 0.56 | 22.0 kWh / 0.66 kg |
|
| 273 |
+
| **T40r caption phase (2 nodes, 8 h, cosine anneal)** | 1 | 60.3 | 35.2 | 1.06 | 41.2 kWh / 1.24 kg |
|
| 274 |
+
| T40r caption phase, two failed starts | 2 | 3.5 | 0.5 | 0.02 | 0.6 kWh / 0.02 kg |
|
| 275 |
+
| **Agate 002: cap2 continuation, 82.8k to 138k** | 1 | 61.0 | 35.9 | 1.08 | 41.9 kWh / 1.26 kg |
|
| 276 |
+
| 001 release benchmark and GenEval | 3 | 5.1 | 2.7 | 0.08 | 3.1 kWh / 0.09 kg |
|
| 277 |
+
| A/B wave 1 (six 256 px arms) + noise-scale study | 9 | 17.5 | 8.7 | 0.26 | 10.2 kWh / 0.31 kg |
|
| 278 |
+
| A/B wave 2 (does 512 px work?) | 2 | 12.1 | 6.7 | 0.20 | 7.9 kWh / 0.24 kg |
|
| 279 |
+
| A/B wave 2, failed attempts | 4 | 3.0 | 1.4 | 0.04 | 1.7 kWh / 0.05 kg |
|
| 280 |
+
| 512 px latents + saliency maps (data prep) | 21 | 22.5 | 14.7 | 0.44 | 17.1 kWh / 0.51 kg |
|
| 281 |
+
| Perceptual-loss profiling | 2 | 1.3 | 0.5 | 0.02 | 0.6 kWh / 0.02 kg |
|
| 282 |
+
| Perceptual-loss profiling, OOM | 2 | 0.6 | 0.1 | 0.00 | 0.1 kWh / 0.00 kg |
|
| 283 |
+
| Research after 003: logo LoRA, router, MoE pilots | 34 | 68.5 | 32.7 | 0.98 | 38.2 kWh / 1.15 kg |
|
| 284 |
+
| 512 px runs that became 003 (long1, long2, perc1) | 3 | 113.5 | 68.2 | 2.05 | 79.8 kWh / 2.39 kg |
|
| 285 |
+
| Evaluations, smoke tests, benchmarks | 47 | 30.9 | 11.7 | 0.35 | 13.6 kWh / 0.41 kg |
|
| 286 |
+
| **Whole Agate project to 2026-09-28** | 164 | **630.4** | **348.6** | **10.46** | **407.9 kWh / 12.24 kg** |
|
| 287 |
|
| 288 |
Preview 002's own lineage, counted from scratch with the caption-phase job pro-rated to the 82,800 steps 002
|
| 289 |
+
inherits, cost **187.7 GH200-hours, 107.1 kWh and 3.21 kg CO₂e** (whole-node est. 125.3 kWh / 3.76 kg). The whole project to
|
| 290 |
date, including Preview 003 and every experiment, cost 630.4 GPU-hours.
|
| 291 |
|
| 292 |
**About these energy figures.** perun measured GPU power only, through NVML: on the GH200 superchip it does not
|