Incorporo-user commited on
Commit
b82fdd6
·
verified ·
1 Parent(s): 800858b

Energy table: whole-node estimate column (provisional x1.17); key facts point to the energy note

Browse files
Files changed (1) hide show
  1. README.md +27 -27
README.md CHANGED
@@ -47,7 +47,7 @@ Built by [LogoLabs](https://logolabs.org), which makes AI logo generation.
47
  | **What** | Text-to-image, 256 × 256, English prompts |
48
  | **Size** | 260M parameters with TAESD, 308.5M with SD-VAE: 190.9M generator + 68.1M text encoder + decoder (as 001) |
49
  | **Training** | 001's first 82,800 steps, then 55,210 more at batch 1,024: 138,010 steps, 186.6M images seen (≈33 epochs) |
50
- | **Compute** | 187.7 GH200-hours for the whole lineage from scratch (61.0 of them for the continuation), 107.1 kWh, 3.21 kg CO₂e, measured with perun |
51
  | **GenEval** (official) | **0.577** (001: 0.550). SDXL 0.55, SD 2.1 0.50, PixArt-α 0.48, SD 1.5 0.43 (published) |
52
  | **Qwen-Image-Bench** (1,000 prompts) | **28.9** (001: 28.2; SD 1.5: 29.1) |
53
  | **Speed** | Same network as 001: 1.9 s per image on an RTX 4060 (50 steps, CUDA graphs), timed on 001 |
@@ -259,34 +259,34 @@ Every GPU job was wrapped in [perun](https://github.com/Helmholtz-AI-Energy/peru
259
  of 1.3; CO₂e assumes 30 g/kWh (Swedish SE3 grid). Neither factor is confirmed by NAISS yet; seconds perun did not
260
  cover count at idle power, so the totals are a floor.
261
 
262
- | Run | Jobs | GH200-h | kWh | kg CO₂e |
263
- |---|---|---|---|---|
264
- | Latent cache (SD-VAE encode of the dataset) | 11 | 4.2 | 2.6 | 0.08 |
265
- | FCDM v1, epochs 1-10 | 2 | 13.7 | 8.7 | 0.26 |
266
- | FCDM v1, epochs 11-20 + Flan-T5 fine-tune | 1 | 20.6 | 13.5 | 0.41 |
267
- | DiT reproduction, epochs 1-10 | 1 | 13.1 | 8.8 | 0.26 |
268
- | fcdm2, all phases incl. restarts | 14 | 68.0 | 33.8 | 1.01 |
269
- | Run 1 thinker, epochs 1-10 | 1 | 19.0 | 12.6 | 0.38 |
270
- | T40r first try (diverged at step ~1,800) | 1 | 7.8 | 3.0 | 0.09 |
271
- | **T40r phase 1 (epochs 1-10)** | 1 | 47.3 | 27.7 | 0.83 |
272
- | **T40r phase 2 (joint Ettin training, to epoch 16)** | 1 | 37.1 | 18.8 | 0.56 |
273
- | **T40r caption phase (2 nodes, 8 h, cosine anneal)** | 1 | 60.3 | 35.2 | 1.06 |
274
- | T40r caption phase, two failed starts | 2 | 3.5 | 0.5 | 0.02 |
275
- | **Agate 002: cap2 continuation, 82.8k to 138k** | 1 | 61.0 | 35.9 | 1.08 |
276
- | 001 release benchmark and GenEval | 3 | 5.1 | 2.7 | 0.08 |
277
- | A/B wave 1 (six 256 px arms) + noise-scale study | 9 | 17.5 | 8.7 | 0.26 |
278
- | A/B wave 2 (does 512 px work?) | 2 | 12.1 | 6.7 | 0.20 |
279
- | A/B wave 2, failed attempts | 4 | 3.0 | 1.4 | 0.04 |
280
- | 512 px latents + saliency maps (data prep) | 21 | 22.5 | 14.7 | 0.44 |
281
- | Perceptual-loss profiling | 2 | 1.3 | 0.5 | 0.02 |
282
- | Perceptual-loss profiling, OOM | 2 | 0.6 | 0.1 | 0.00 |
283
- | Research after 003: logo LoRA, router, MoE pilots | 34 | 68.5 | 32.7 | 0.98 |
284
- | 512 px runs that became 003 (long1, long2, perc1) | 3 | 113.5 | 68.2 | 2.05 |
285
- | Evaluations, smoke tests, benchmarks | 47 | 30.9 | 11.7 | 0.35 |
286
- | **Whole Agate project to 2026-09-28** | 164 | **630.4** | **348.6** | **10.46** |
287
 
288
  Preview 002's own lineage, counted from scratch with the caption-phase job pro-rated to the 82,800 steps 002
289
- inherits, cost **187.7 GH200-hours, 107.1 kWh and 3.21 kg CO₂e**. The whole project to
290
  date, including Preview 003 and every experiment, cost 630.4 GPU-hours.
291
 
292
  **About these energy figures.** perun measured GPU power only, through NVML: on the GH200 superchip it does not
 
47
  | **What** | Text-to-image, 256 × 256, English prompts |
48
  | **Size** | 260M parameters with TAESD, 308.5M with SD-VAE: 190.9M generator + 68.1M text encoder + decoder (as 001) |
49
  | **Training** | 001's first 82,800 steps, then 55,210 more at batch 1,024: 138,010 steps, 186.6M images seen (≈33 epochs) |
50
+ | **Compute** | 187.7 GH200-hours for the whole lineage from scratch (61.0 of them for the continuation), 107.1 kWh, 3.21 kg CO₂e; GPU energy measured with perun, see [About these energy figures](#compute-and-energy) |
51
  | **GenEval** (official) | **0.577** (001: 0.550). SDXL 0.55, SD 2.1 0.50, PixArt-α 0.48, SD 1.5 0.43 (published) |
52
  | **Qwen-Image-Bench** (1,000 prompts) | **28.9** (001: 28.2; SD 1.5: 29.1) |
53
  | **Speed** | Same network as 001: 1.9 s per image on an RTX 4060 (50 steps, CUDA graphs), timed on 001 |
 
259
  of 1.3; CO₂e assumes 30 g/kWh (Swedish SE3 grid). Neither factor is confirmed by NAISS yet; seconds perun did not
260
  cover count at idle power, so the totals are a floor.
261
 
262
+ | Run | Jobs | GH200-h | kWh | kg CO₂e | Whole-node est. (×1.17) |
263
+ |---|---|---|---|---|---|
264
+ | Latent cache (SD-VAE encode of the dataset) | 11 | 4.2 | 2.6 | 0.08 | 3.1 kWh / 0.09 kg |
265
+ | FCDM v1, epochs 1-10 | 2 | 13.7 | 8.7 | 0.26 | 10.2 kWh / 0.31 kg |
266
+ | FCDM v1, epochs 11-20 + Flan-T5 fine-tune | 1 | 20.6 | 13.5 | 0.41 | 15.8 kWh / 0.48 kg |
267
+ | DiT reproduction, epochs 1-10 | 1 | 13.1 | 8.8 | 0.26 | 10.3 kWh / 0.31 kg |
268
+ | fcdm2, all phases incl. restarts | 14 | 68.0 | 33.8 | 1.01 | 39.6 kWh / 1.19 kg |
269
+ | Run 1 thinker, epochs 1-10 | 1 | 19.0 | 12.6 | 0.38 | 14.7 kWh / 0.44 kg |
270
+ | T40r first try (diverged at step ~1,800) | 1 | 7.8 | 3.0 | 0.09 | 3.5 kWh / 0.10 kg |
271
+ | **T40r phase 1 (epochs 1-10)** | 1 | 47.3 | 27.7 | 0.83 | 32.4 kWh / 0.97 kg |
272
+ | **T40r phase 2 (joint Ettin training, to epoch 16)** | 1 | 37.1 | 18.8 | 0.56 | 22.0 kWh / 0.66 kg |
273
+ | **T40r caption phase (2 nodes, 8 h, cosine anneal)** | 1 | 60.3 | 35.2 | 1.06 | 41.2 kWh / 1.24 kg |
274
+ | T40r caption phase, two failed starts | 2 | 3.5 | 0.5 | 0.02 | 0.6 kWh / 0.02 kg |
275
+ | **Agate 002: cap2 continuation, 82.8k to 138k** | 1 | 61.0 | 35.9 | 1.08 | 41.9 kWh / 1.26 kg |
276
+ | 001 release benchmark and GenEval | 3 | 5.1 | 2.7 | 0.08 | 3.1 kWh / 0.09 kg |
277
+ | A/B wave 1 (six 256 px arms) + noise-scale study | 9 | 17.5 | 8.7 | 0.26 | 10.2 kWh / 0.31 kg |
278
+ | A/B wave 2 (does 512 px work?) | 2 | 12.1 | 6.7 | 0.20 | 7.9 kWh / 0.24 kg |
279
+ | A/B wave 2, failed attempts | 4 | 3.0 | 1.4 | 0.04 | 1.7 kWh / 0.05 kg |
280
+ | 512 px latents + saliency maps (data prep) | 21 | 22.5 | 14.7 | 0.44 | 17.1 kWh / 0.51 kg |
281
+ | Perceptual-loss profiling | 2 | 1.3 | 0.5 | 0.02 | 0.6 kWh / 0.02 kg |
282
+ | Perceptual-loss profiling, OOM | 2 | 0.6 | 0.1 | 0.00 | 0.1 kWh / 0.00 kg |
283
+ | Research after 003: logo LoRA, router, MoE pilots | 34 | 68.5 | 32.7 | 0.98 | 38.2 kWh / 1.15 kg |
284
+ | 512 px runs that became 003 (long1, long2, perc1) | 3 | 113.5 | 68.2 | 2.05 | 79.8 kWh / 2.39 kg |
285
+ | Evaluations, smoke tests, benchmarks | 47 | 30.9 | 11.7 | 0.35 | 13.6 kWh / 0.41 kg |
286
+ | **Whole Agate project to 2026-09-28** | 164 | **630.4** | **348.6** | **10.46** | **407.9 kWh / 12.24 kg** |
287
 
288
  Preview 002's own lineage, counted from scratch with the caption-phase job pro-rated to the 82,800 steps 002
289
+ inherits, cost **187.7 GH200-hours, 107.1 kWh and 3.21 kg CO₂e** (whole-node est. 125.3 kWh / 3.76 kg). The whole project to
290
  date, including Preview 003 and every experiment, cost 630.4 GPU-hours.
291
 
292
  **About these energy figures.** perun measured GPU power only, through NVML: on the GH200 superchip it does not