ANABUR commited on
Commit
bff099f
·
verified ·
1 Parent(s): dbd9b9b

Add Photon Memory reproduction checkpoints (v3 + matched TTT -6.00)

Browse files
README.md ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - photon-memory
5
+ - rendering
6
+ - density-estimation
7
+ - test-time-training
8
+ library_name: pytorch
9
+ ---
10
+
11
+ # Photon Memory checkpoints (Rough Flower / PureLight comparison)
12
+
13
+ Companion weights for the Photon Memory reader that matches / beats PureLight on directional NLL
14
+ for the released Rough Flower luminaire. Code: [ANABUR920/renderTTT](https://github.com/ANABUR920/renderTTT) (`lightmem/`).
15
+
16
+ ## Files
17
+
18
+ | Path | Role | Size |
19
+ |------|------|------|
20
+ | `checkpoints/v3_ksched_model.pt` | Meta-trained PhotonKernel reader (`k_feat=True`) | ~0.7 MB |
21
+ | `checkpoints/big_1e8_k512_ttt.pt` | Reader-only TTT on 1e8 memory (`k=512`) | ~0.7 MB |
22
+ | `checkpoints/big_match_res2b_best.pt` | Intermediate matched TTT + residual (~NLL −4.54) | ~42 MB |
23
+ | `checkpoints/big_match_res2c_best.pt` | Final matched TTT + residual (**NLL −6.00**, render default) | ~42 MB |
24
+ | `logs/*.jsonl` | Training / eval logs for the above TTT runs | small |
25
+
26
+ ## Download
27
+
28
+ ```bash
29
+ hf download ANABUR/photon-memory --local-dir ./photon-memory-ckpts
30
+ ```
31
+
32
+ ## Reproduce the −6.00 NLL claim (same protocol as paper)
33
+
34
+ Needs: CUDA GPU (~40 GB for 1e8 + residual), traced Rough Flower photons (`flower_surface_*` 11e6 held-out + `flowerbig_surface_*` 1e8 memory), and this repo's `scripts/ttt_big.py`.
35
+
36
+ Winning warm-start chain (do not claim a cold start from the meta reader equals −6.00 in one shot):
37
+
38
+ 1. Start from `v3_ksched_model.pt` → reader-only TTT → `big_1e8_k512_ttt.pt` (~−0.53).
39
+ 2. Joint reader + residual matched TTT → `big_match_res2b_best.pt` (~−4.54).
40
+ 3. Continue:
41
+
42
+ ```bash
43
+ python scripts/ttt_big.py \
44
+ --data flowerbig_surface --N 100000000 --k 512 --wmult 2 \
45
+ --ttt_matched --n_ttt_q 1000000 --steps 8000 --residual \
46
+ --res_K 32 --res_log2 19 --res_finest 2048 \
47
+ --init_ttt checkpoints/big_match_res2b_best.pt \
48
+ --lr 5e-6 --res_lr_grid 5e-3 --res_lr_head 5e-4 \
49
+ --name big_match_res2c
50
+ ```
51
+
52
+ Zero-shot (no TTT) with `v3_ksched_model.pt` at `N=1e8, k=512` reaches RGB-mean NLL ≈ **−0.460**, matching the PureLight teacher plateau (~−0.46). The −6.00 number is **matched test-time adaptation**, not zero-shot.
53
+
54
+ ## Honest notes for reviewers / friends
55
+
56
+ - Held-out queries are always the last 20k of `default_rng(0).permutation(11_000_000)` on `flower_surface_*`.
57
+ - `--ttt_matched` trains on the non-eval remainder of that same 11e6 file while retrieving from the separately traced 1e8 memory.
58
+ - A frozen-reader hash residual alone peaks ~−0.38 and does **not** beat PureLight.
59
+ - Photons, PureLight teacher weights, and photon maps are **not** in this repo (too large / third-party). Trace with `scripts/gen_flower.py` or the PureLight assets.
60
+
61
+ ## Load in code
62
+
63
+ ```python
64
+ import torch
65
+ from lightmem.models import PhotonKernel, ResidualLobes
66
+
67
+ sd = torch.load("checkpoints/big_match_res2c_best.pt", map_location="cpu")
68
+ reader = PhotonKernel(k=512, k_feat=True)
69
+ reader.load_state_dict(sd["reader"])
70
+ residual = ResidualLobes(K=32, finest=2048, log2_table=19)
71
+ residual.load_state_dict(sd["residual"])
72
+ # sd["nll"] ≈ -6.00, sd["step"] == 8000
73
+ ```
checkpoints/big_1e8_k512_ttt.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad558a75f9ff72d883cc48a1f994841d881d8822965713ded85cbec2fd37aefe
3
+ size 692573
checkpoints/big_match_res2b_best.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec19687b034e29ce4e0a50da0d99f75b36a34e62885556ef52fee464f603ac73
3
+ size 43382771
checkpoints/big_match_res2c_best.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a79c249ed8f3d2fbbe7ef16139963a5e4615616fefd3cdc05dedf81050c6c51
3
+ size 43382771
checkpoints/v3_ksched_model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b82ce1c48e341c9439dc76384345d9a1548da8da8c8f77ec9213f6ae7fa54eb1
3
+ size 690985
logs/big_1e8_k512_ttt.jsonl ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"step": 0, "t_train": 0.0, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.41592374444007874, "r": -0.33474794030189514, "g": -0.6382720470428467, "b": -0.4071289598941803}, "nll_folded": {"mean": -0.41639819741249084, "r": -0.33529040217399597, "g": -0.6386072039604187, "b": -0.40759870409965515}, "nll_rgb_mean": -0.4600496490796407, "nll_folded_rgb_mean": -0.46049877007802326}
2
+ {"step": 250, "t_train": 62.11849665641785, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.47566184401512146, "r": -0.39098060131073, "g": -0.7210937738418579, "b": -0.46590444445610046}, "nll_folded": {"mean": -0.4760088622570038, "r": -0.3913731873035431, "g": -0.7213340401649475, "b": -0.4662478566169739}, "nll_rgb_mean": -0.5259929398695627, "nll_folded_rgb_mean": -0.5263183613618215}
3
+ {"step": 500, "t_train": 123.93830132484436, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.47065603733062744, "r": -0.3845042288303375, "g": -0.719480574131012, "b": -0.46069011092185974}, "nll_folded": {"mean": -0.4710000455379486, "r": -0.3848954439163208, "g": -0.7197187542915344, "b": -0.4610312879085541}, "nll_rgb_mean": -0.5215583046277364, "nll_folded_rgb_mean": -0.5218818287054697}
4
+ {"step": 750, "t_train": 185.66610479354858, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.4632127285003662, "r": -0.37680667638778687, "g": -0.7138007283210754, "b": -0.4531456232070923}, "nll_folded": {"mean": -0.4635639488697052, "r": -0.3772088885307312, "g": -0.7140413522720337, "b": -0.4534933269023895}, "nll_rgb_mean": -0.5145843426386515, "nll_folded_rgb_mean": -0.5149145225683848}
5
+ {"step": 1000, "t_train": 247.15037608146667, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.47820401191711426, "r": -0.3917219936847687, "g": -0.729969322681427, "b": -0.4681423306465149}, "nll_folded": {"mean": -0.47850844264030457, "r": -0.3920699656009674, "g": -0.7301878333091736, "b": -0.46844497323036194}, "nll_rgb_mean": -0.5299445490042368, "nll_folded_rgb_mean": -0.5302342573801676}
6
+ {"step": 1250, "t_train": 308.4763000011444, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.46414485573768616, "r": -0.3775854706764221, "g": -0.7161151170730591, "b": -0.4541032910346985}, "nll_folded": {"mean": -0.46446460485458374, "r": -0.3779512941837311, "g": -0.7163388133049011, "b": -0.4544225335121155}, "nll_rgb_mean": -0.5159346262613932, "nll_folded_rgb_mean": -0.5162375470002493}
7
+ {"step": 1500, "t_train": 369.7086892127991, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.46364668011665344, "r": -0.37658005952835083, "g": -0.7165608406066895, "b": -0.4536591172218323}, "nll_folded": {"mean": -0.4639832377433777, "r": -0.376962810754776, "g": -0.7167918682098389, "b": -0.45399224758148193}, "nll_rgb_mean": -0.5156000057856241, "nll_folded_rgb_mean": -0.5159156421820322}
8
+ {"step": 1750, "t_train": 431.00322580337524, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.47527483105659485, "r": -0.3882831931114197, "g": -0.7277247905731201, "b": -0.46511614322662354}, "nll_folded": {"mean": -0.4755805730819702, "r": -0.3886316120624542, "g": -0.727937638759613, "b": -0.4654216766357422}, "nll_rgb_mean": -0.5270413756370544, "nll_folded_rgb_mean": -0.5273303091526031}
9
+ {"step": 2000, "t_train": 492.24227499961853, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.47137680649757385, "r": -0.38397178053855896, "g": -0.7240060567855835, "b": -0.4610341191291809}, "nll_folded": {"mean": -0.47170835733413696, "r": -0.38434678316116333, "g": -0.7242318391799927, "b": -0.46136364340782166}, "nll_rgb_mean": -0.5230039854844412, "nll_folded_rgb_mean": -0.5233140885829926}
10
+ {"step": 2250, "t_train": 553.4816982746124, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.4684218168258667, "r": -0.3814469873905182, "g": -0.7218949794769287, "b": -0.4580366313457489}, "nll_folded": {"mean": -0.4687349200248718, "r": -0.3818056881427765, "g": -0.7221113443374634, "b": -0.4583496153354645}, "nll_rgb_mean": -0.5204595327377319, "nll_folded_rgb_mean": -0.5207555492719015}
11
+ {"step": 2500, "t_train": 614.817868232727, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.46834293007850647, "r": -0.3808448314666748, "g": -0.7219884991645813, "b": -0.457949161529541}, "nll_folded": {"mean": -0.4686621129512787, "r": -0.3812120258808136, "g": -0.7222090363502502, "b": -0.45826879143714905}, "nll_rgb_mean": -0.5202608307202657, "nll_folded_rgb_mean": -0.5205632845560709}
12
+ {"step": 2750, "t_train": 676.1335017681122, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.4686158001422882, "r": -0.3806822597980499, "g": -0.7234852313995361, "b": -0.45826926827430725}, "nll_folded": {"mean": -0.46893107891082764, "r": -0.3810407817363739, "g": -0.7237001061439514, "b": -0.45858410000801086}, "nll_rgb_mean": -0.5208122531572977, "nll_folded_rgb_mean": -0.5211083292961121}
13
+ {"step": 3000, "t_train": 737.4987847805023, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.46224164962768555, "r": -0.3749585449695587, "g": -0.7161676287651062, "b": -0.45200666785240173}, "nll_folded": {"mean": -0.46255290508270264, "r": -0.37530842423439026, "g": -0.7163809537887573, "b": -0.4523161053657532}, "nll_rgb_mean": -0.5143776138623556, "nll_folded_rgb_mean": -0.5146684944629669}
14
+ {"step": 3250, "t_train": 798.8610053062439, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.4727536141872406, "r": -0.3855133354663849, "g": -0.7272405028343201, "b": -0.46252763271331787}, "nll_folded": {"mean": -0.47305652499198914, "r": -0.38585615158081055, "g": -0.7274465560913086, "b": -0.4628300666809082}, "nll_rgb_mean": -0.5250938236713409, "nll_folded_rgb_mean": -0.5253775914510092}
15
+ {"step": 3500, "t_train": 860.0923092365265, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.4702032208442688, "r": -0.3831523656845093, "g": -0.7239845991134644, "b": -0.45982468128204346}, "nll_folded": {"mean": -0.47052228450775146, "r": -0.3835163116455078, "g": -0.7242008447647095, "b": -0.46014440059661865}, "nll_rgb_mean": -0.522320548693339, "nll_folded_rgb_mean": -0.5226205190022787}
16
+ {"step": 3750, "t_train": 921.3764193058014, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.4784814715385437, "r": -0.391272634267807, "g": -0.7324241995811462, "b": -0.4681124687194824}, "nll_folded": {"mean": -0.4788179397583008, "r": -0.39165621995925903, "g": -0.7326507568359375, "b": -0.46844878792762756}, "nll_rgb_mean": -0.5306031008561453, "nll_folded_rgb_mean": -0.5309185882409414}
17
+ {"step": 4000, "t_train": 982.7148506641388, "t_build": 2.099677085876465, "t_load": 42.777464389801025, "N": 100000000, "k": 512, "W": 1024, "S": 8, "nll": {"mean": -0.47932660579681396, "r": -0.39144155383110046, "g": -0.7359558939933777, "b": -0.468950092792511}, "nll_folded": {"mean": -0.47965767979621887, "r": -0.39182302355766296, "g": -0.7361828088760376, "b": -0.4692824184894562}, "nll_rgb_mean": -0.5321158468723297, "nll_folded_rgb_mean": -0.5324294169743856}
logs/big_match_res2c.jsonl ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"step": 0, "t_train": 0.0, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -4.518155574798584, "r": -4.466821193695068, "g": -4.621262073516846, "b": -4.54419469833374}, "nll_folded": {"mean": -4.518808841705322, "r": -4.467568397521973, "g": -4.621720790863037, "b": -4.544835567474365}, "nll_rgb_mean": -4.544092655181885, "nll_folded_rgb_mean": -4.544708251953125, "lift_vs_teacher": 59.506922789202825}
2
+ {"step": 250, "t_train": 73.05492305755615, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -4.631899833679199, "r": -4.577900409698486, "g": -4.738151550292969, "b": -4.658912658691406}, "nll_folded": {"mean": -4.632529258728027, "r": -4.578619003295898, "g": -4.738595008850098, "b": -4.659531116485596}, "nll_rgb_mean": -4.658321539560954, "nll_folded_rgb_mean": -4.658915042877197, "lift_vs_teacher": 66.707776782172}
3
+ {"step": 500, "t_train": 146.45134568214417, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -4.72928524017334, "r": -4.672645568847656, "g": -4.837964057922363, "b": -4.756930351257324}, "nll_folded": {"mean": -4.729898452758789, "r": -4.673342227935791, "g": -4.838396072387695, "b": -4.757532119750977}, "nll_rgb_mean": -4.755846659342448, "nll_folded_rgb_mean": -4.756423473358154, "lift_vs_teacher": 73.54126368319115}
4
+ {"step": 750, "t_train": 218.9581482410431, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -4.817795753479004, "r": -4.759879112243652, "g": -4.9298906326293945, "b": -4.845669269561768}, "nll_folded": {"mean": -4.818454742431641, "r": -4.760578155517578, "g": -4.9303436279296875, "b": -4.846319198608398}, "nll_rgb_mean": -4.8451463381449384, "nll_folded_rgb_mean": -4.845746994018555, "lift_vs_teacher": 80.41062652378105}
5
+ {"step": 1000, "t_train": 292.30100417137146, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -4.896246910095215, "r": -4.837878704071045, "g": -5.007709503173828, "b": -4.924131870269775}, "nll_folded": {"mean": -4.896946907043457, "r": -4.8386149406433105, "g": -5.008193492889404, "b": -4.924815654754639}, "nll_rgb_mean": -4.923240025838216, "nll_folded_rgb_mean": -4.923874696095784, "lift_vs_teacher": 86.94189533679126}
6
+ {"step": 1250, "t_train": 365.4130423069, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -4.970028400421143, "r": -4.912158966064453, "g": -5.081809043884277, "b": -4.997931957244873}, "nll_folded": {"mean": -4.970695972442627, "r": -4.912906646728516, "g": -5.082296848297119, "b": -4.998569965362549}, "nll_rgb_mean": -4.997299989064534, "nll_folded_rgb_mean": -4.9979244867960615, "lift_vs_teacher": 93.6252384844457}
7
+ {"step": 1500, "t_train": 438.66867303848267, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.041053295135498, "r": -4.982186317443848, "g": -5.154109954833984, "b": -5.068961143493652}, "nll_folded": {"mean": -5.041653633117676, "r": -4.9828782081604, "g": -5.154585838317871, "b": -5.069547653198242}, "nll_rgb_mean": -5.068419138590495, "nll_folded_rgb_mean": -5.069003899892171, "lift_vs_teacher": 100.52627524885324}
8
+ {"step": 1750, "t_train": 511.93729162216187, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.102503776550293, "r": -5.043809413909912, "g": -5.214707374572754, "b": -5.130233287811279}, "nll_folded": {"mean": -5.10306978225708, "r": -5.044451713562012, "g": -5.2151570320129395, "b": -5.130788803100586}, "nll_rgb_mean": -5.129583358764648, "nll_folded_rgb_mean": -5.130132516225179, "lift_vs_teacher": 106.86681705566986}
9
+ {"step": 2000, "t_train": 585.0410017967224, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.167092800140381, "r": -5.108266353607178, "g": -5.278469562530518, "b": -5.194474220275879}, "nll_folded": {"mean": -5.167662620544434, "r": -5.108905792236328, "g": -5.278929710388184, "b": -5.195031642913818}, "nll_rgb_mean": -5.193736712137858, "nll_folded_rgb_mean": -5.194289048512776, "lift_vs_teacher": 113.9473742172943}
10
+ {"step": 2250, "t_train": 659.179562330246, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.213595390319824, "r": -5.155357360839844, "g": -5.323973178863525, "b": -5.241100311279297}, "nll_folded": {"mean": -5.214135646820068, "r": -5.155967712402344, "g": -5.324402332305908, "b": -5.2416300773620605}, "nll_rgb_mean": -5.240143616994222, "nll_folded_rgb_mean": -5.2406667073567705, "lift_vs_teacher": 119.35993799712378}
11
+ {"step": 2500, "t_train": 731.9304831027985, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.271582126617432, "r": -5.213886260986328, "g": -5.383199214935303, "b": -5.2994232177734375}, "nll_folded": {"mean": -5.272130012512207, "r": -5.214500427246094, "g": -5.383645534515381, "b": -5.299960613250732}, "nll_rgb_mean": -5.2988362312316895, "nll_folded_rgb_mean": -5.299368858337402, "lift_vs_teacher": 126.57515358312448}
12
+ {"step": 2750, "t_train": 805.1698698997498, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.317478179931641, "r": -5.259734153747559, "g": -5.430542945861816, "b": -5.344710826873779}, "nll_folded": {"mean": -5.318005561828613, "r": -5.260326862335205, "g": -5.430967330932617, "b": -5.34522819519043}, "nll_rgb_mean": -5.344995975494385, "nll_folded_rgb_mean": -5.345507462819417, "lift_vs_teacher": 132.55477755384945}
13
+ {"step": 3000, "t_train": 877.7220025062561, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.368310928344727, "r": -5.310976505279541, "g": -5.482968807220459, "b": -5.395868301391602}, "nll_folded": {"mean": -5.368839740753174, "r": -5.311569690704346, "g": -5.483397006988525, "b": -5.396388530731201}, "nll_rgb_mean": -5.396604537963867, "nll_folded_rgb_mean": -5.3971184094746905, "lift_vs_teacher": 139.57534150798364}
14
+ {"step": 3250, "t_train": 951.1182787418365, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.413608074188232, "r": -5.357906341552734, "g": -5.526342391967773, "b": -5.441236972808838}, "nll_folded": {"mean": -5.414131164550781, "r": -5.358489036560059, "g": -5.526764869689941, "b": -5.4417500495910645}, "nll_rgb_mean": -5.441828568776448, "nll_folded_rgb_mean": -5.4423346519470215, "lift_vs_teacher": 146.03240786822693}
15
+ {"step": 3500, "t_train": 1024.4110519886017, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.458138465881348, "r": -5.402682781219482, "g": -5.5723347663879395, "b": -5.485949993133545}, "nll_folded": {"mean": -5.45864725112915, "r": -5.403249263763428, "g": -5.572748184204102, "b": -5.486447811126709}, "nll_rgb_mean": -5.486989180246989, "nll_folded_rgb_mean": -5.487481753031413, "lift_vs_teacher": 152.77850308933148}
16
+ {"step": 3750, "t_train": 1097.6942229270935, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.500306606292725, "r": -5.444188594818115, "g": -5.614315032958984, "b": -5.527507305145264}, "nll_folded": {"mean": -5.500810623168945, "r": -5.444754123687744, "g": -5.614711284637451, "b": -5.527999401092529}, "nll_rgb_mean": -5.528670310974121, "nll_folded_rgb_mean": -5.529154936472575, "lift_vs_teacher": 159.2810594095549}
17
+ {"step": 4000, "t_train": 1170.9849572181702, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.539116382598877, "r": -5.482831001281738, "g": -5.654427528381348, "b": -5.566420555114746}, "nll_folded": {"mean": -5.539639949798584, "r": -5.483407974243164, "g": -5.654849052429199, "b": -5.566930770874023}, "nll_rgb_mean": -5.567893028259277, "nll_folded_rgb_mean": -5.568395932515462, "lift_vs_teacher": 165.65263377532793}
18
+ {"step": 4250, "t_train": 1244.1924078464508, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.57306432723999, "r": -5.517429351806641, "g": -5.687057971954346, "b": -5.600513935089111}, "nll_folded": {"mean": -5.573600769042969, "r": -5.518016815185547, "g": -5.6874895095825195, "b": -5.601036548614502}, "nll_rgb_mean": -5.601667086283366, "nll_folded_rgb_mean": -5.6021809577941895, "lift_vs_teacher": 171.3429470300752}
19
+ {"step": 4500, "t_train": 1317.4194161891937, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.610436916351318, "r": -5.555005073547363, "g": -5.7256340980529785, "b": -5.637889385223389}, "nll_folded": {"mean": -5.610991477966309, "r": -5.555610656738281, "g": -5.726077079772949, "b": -5.638427257537842}, "nll_rgb_mean": -5.639509518941243, "nll_folded_rgb_mean": -5.6400383313496905, "lift_vs_teacher": 177.9512291022328}
20
+ {"step": 4750, "t_train": 1390.0100462436676, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.648894786834717, "r": -5.594119548797607, "g": -5.761602878570557, "b": -5.675934314727783}, "nll_folded": {"mean": -5.649468421936035, "r": -5.5947489738464355, "g": -5.76206636428833, "b": -5.6764936447143555}, "nll_rgb_mean": -5.677218914031982, "nll_folded_rgb_mean": -5.677769660949707, "lift_vs_teacher": 184.78979097355116}
21
+ {"step": 5000, "t_train": 1463.2093193531036, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.678136825561523, "r": -5.622813701629639, "g": -5.79103946685791, "b": -5.705017566680908}, "nll_folded": {"mean": -5.678711414337158, "r": -5.623446941375732, "g": -5.791500568389893, "b": -5.70557975769043}, "nll_rgb_mean": -5.706290245056152, "nll_folded_rgb_mean": -5.706842422485352, "lift_vs_teacher": 190.24072521788887}
22
+ {"step": 5250, "t_train": 1535.9392042160034, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.711121082305908, "r": -5.657308101654053, "g": -5.822612762451172, "b": -5.737777233123779}, "nll_folded": {"mean": -5.711714744567871, "r": -5.657965183258057, "g": -5.823083400726318, "b": -5.738358020782471}, "nll_rgb_mean": -5.739232699076335, "nll_folded_rgb_mean": -5.739802201588948, "lift_vs_teacher": 196.612089573717}
23
+ {"step": 5500, "t_train": 1609.314537525177, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.737667083740234, "r": -5.683187484741211, "g": -5.848359107971191, "b": -5.764898777008057}, "nll_folded": {"mean": -5.738273620605469, "r": -5.683857440948486, "g": -5.848835468292236, "b": -5.765495300292969}, "nll_rgb_mean": -5.765481789906819, "nll_folded_rgb_mean": -5.7660627365112305, "lift_vs_teacher": 201.84130905250453}
24
+ {"step": 5750, "t_train": 1682.584088087082, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.764825344085693, "r": -5.710522651672363, "g": -5.874909400939941, "b": -5.791360855102539}, "nll_folded": {"mean": -5.765439987182617, "r": -5.711203575134277, "g": -5.8753862380981445, "b": -5.791964530944824}, "nll_rgb_mean": -5.792264302571614, "nll_folded_rgb_mean": -5.792851448059082, "lift_vs_teacher": 207.32016777380034}
25
+ {"step": 6000, "t_train": 1755.8615062236786, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.795831203460693, "r": -5.742888927459717, "g": -5.904646396636963, "b": -5.821875095367432}, "nll_folded": {"mean": -5.796460151672363, "r": -5.743585109710693, "g": -5.905135154724121, "b": -5.8224945068359375}, "nll_rgb_mean": -5.823136806488037, "nll_folded_rgb_mean": -5.823738257090251, "lift_vs_teacher": 213.8204847096811}
26
+ {"step": 6250, "t_train": 1829.0356583595276, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.8173604011535645, "r": -5.763716220855713, "g": -5.925786972045898, "b": -5.843863010406494}, "nll_folded": {"mean": -5.818036079406738, "r": -5.764462947845459, "g": -5.926297187805176, "b": -5.844519138336182}, "nll_rgb_mean": -5.844455401102702, "nll_folded_rgb_mean": -5.8450930913289385, "lift_vs_teacher": 218.42777290518376}
27
+ {"step": 6500, "t_train": 1902.2130780220032, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.851254940032959, "r": -5.798378944396973, "g": -5.959131717681885, "b": -5.877809047698975}, "nll_folded": {"mean": -5.851943016052246, "r": -5.799147605895996, "g": -5.959644317626953, "b": -5.878481864929199}, "nll_rgb_mean": -5.878439903259277, "nll_folded_rgb_mean": -5.879091262817383, "lift_vs_teacher": 225.97850932291507}
28
+ {"step": 6750, "t_train": 1975.5256791114807, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.878608226776123, "r": -5.826084613800049, "g": -5.984999179840088, "b": -5.905590534210205}, "nll_folded": {"mean": -5.879322052001953, "r": -5.826883792877197, "g": -5.985527992248535, "b": -5.906292915344238}, "nll_rgb_mean": -5.905558109283447, "nll_folded_rgb_mean": -5.906234900156657, "lift_vs_teacher": 232.19048928734475}
29
+ {"step": 7000, "t_train": 2047.9142084121704, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.896083354949951, "r": -5.843695640563965, "g": -6.00123405456543, "b": -5.922514915466309}, "nll_folded": {"mean": -5.896781921386719, "r": -5.844478607177734, "g": -6.001747131347656, "b": -5.923202037811279}, "nll_rgb_mean": -5.922481536865234, "nll_folded_rgb_mean": -5.923142592112224, "lift_vs_teacher": 236.1533865388143}
30
+ {"step": 7250, "t_train": 2121.1276071071625, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.914400100708008, "r": -5.861038684844971, "g": -6.02038049697876, "b": -5.940700054168701}, "nll_folded": {"mean": -5.915113925933838, "r": -5.861839771270752, "g": -6.020893096923828, "b": -5.941400527954102}, "nll_rgb_mean": -5.9407064119974775, "nll_folded_rgb_mean": -5.9413777987162275, "lift_vs_teacher": 240.4967105721203}
31
+ {"step": 7500, "t_train": 2194.0640909671783, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.940813064575195, "r": -5.8875412940979, "g": -6.047412872314453, "b": -5.967374801635742}, "nll_folded": {"mean": -5.9415483474731445, "r": -5.888367652893066, "g": -6.047939300537109, "b": -5.9680962562561035}, "nll_rgb_mean": -5.967442989349365, "nll_folded_rgb_mean": -5.96813440322876, "lift_vs_teacher": 247.01349959107412}
32
+ {"step": 7750, "t_train": 2267.3212077617645, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.957876205444336, "r": -5.9049272537231445, "g": -6.063389301300049, "b": -5.984717845916748}, "nll_folded": {"mean": -5.958635330200195, "r": -5.9057793617248535, "g": -6.063929080963135, "b": -5.985462665557861}, "nll_rgb_mean": -5.9843448003133135, "nll_folded_rgb_mean": -5.98505703608195, "lift_vs_teacher": 251.22395701100118}
33
+ {"step": 8000, "t_train": 2329.7373099327087, "t_build": 2.0892491340637207, "t_load": 44.57889270782471, "N": 100000000, "k": 512, "W": 1024, "S": 8, "residual": true, "nll": {"mean": -5.974427700042725, "r": -5.921282768249512, "g": -6.080684185028076, "b": -6.0008320808410645}, "nll_folded": {"mean": -5.975205421447754, "r": -5.9221577644348145, "g": -6.081233024597168, "b": -6.0015950202941895}, "nll_rgb_mean": -6.000933011372884, "nll_folded_rgb_mean": -6.001661936442058, "lift_vs_teacher": 255.42606943999542}