Card and selection file after the cross-check: the 4:1 run at epoch 1,250, clearer provenance
Browse filesfixed_split_ckpt_plan.json is the file of contrast_experiment/w9/eval/ of the code repository (commit f9c4b8b): the 4:1 gallery-aimed run is named at epoch 1,250, the checkpoint the paper reads, with epoch 900 under `previous`; three runs gain the `extended` note.
- README.md +29 -21
- fixed_split_ckpt_plan.json +16 -7
README.md
CHANGED
|
@@ -24,13 +24,13 @@ reviews (Qwen3-Embedding-0.6B, 1,024-d) and an MLP maps the pooled result to one
|
|
| 24 |
|
| 25 |
## Contents
|
| 26 |
|
| 27 |
-
|
| 28 |
|
| 29 |
| Listed in | Checkpoints | What they are |
|
| 30 |
|---|---|---|
|
| 31 |
-
| `rank_ckpt_plan.json` | 157 | the five-fold runs the paper's numbers
|
| 32 |
-
| `i2bce_sel_pool.json` | 5 | I + SimCLR on the five folds (Figure 8), selected by the same rule |
|
| 33 |
-
| `fixed_split_ckpt_plan.json` |
|
| 34 |
| `rank_ckpt_plan.json`, field `init_ckpt` | 5 | the BYOL checkpoints the five two-stage runs started from |
|
| 35 |
| `superseded_ckpt_plan.json` | 30 | kept for the record; no number of the paper reads them |
|
| 36 |
|
|
@@ -41,9 +41,10 @@ script wrote it, with the rank score of every checkpoint of the run. The same fo
|
|
| 41 |
|
| 42 |
Every tower that a number or a figure of the paper reads is here, at the checkpoint it is read
|
| 43 |
at. A run saved a checkpoint every 50 epochs and the rank rule chose among them; the ones it did
|
| 44 |
-
not choose are not here, except for the two runs listed under `trajectory`. The
|
| 45 |
-
that
|
| 46 |
-
|
|
|
|
| 47 |
|
| 48 |
## File names
|
| 49 |
|
|
@@ -76,16 +77,17 @@ row reads at least one of the row's runs. That file also names the notebook that
|
|
| 76 |
| `i3ce_icetf_d512`, `i4ce_icetf_d512`, `ice_icetf_d512` | I-CE, 位 = 3; I-CE, 位 = 4; I-CE, 位 = 1 | 512 | 0 to 2 | Table A4 |
|
| 77 |
| `slot16i2cemean_icetf_d512`, `slot1i2cemean_icetf_d512`, `slot2i2cemean_icetf_d512`, `slot8i2cemean_icetf_d512` | I-CE, 16 latent queries; I-CE, 1 latent query; I-CE, 2 latent queries; I-CE, 8 latent queries | 512 | 0 to 2 | Table A6 |
|
| 78 |
| `vfai2ce_icetf_d512` | I-CE, views-first anchors | 512 | 5 | Table S1 |
|
| 79 |
-
| `ce_cetf_g1024`, `i2ce_icetf_g1024` | CE; I-CE, the recipe | 1,024 | 5 | Table A2, Table
|
| 80 |
-
| `ce_cetf_g2048`, `i2ce_icetf_g2048` | CE; I-CE, the recipe | 2,048 | 5 | Table
|
| 81 |
| `i2ce_icetl_g2048`, `i2cet05_icetf_g2048`, `i2cet10_icetf_g2048` | I-CE, learnable 蟿; I-CE, 蟿 = 0.05; I-CE, 蟿 = 0.10 | 2,048 | 5 | Table A3 |
|
| 82 |
| `bce_cetf_gpool`, `byol_bytf_gpool`, `epd_v20i10c20_cetf_gpool`, `mq3072i2ce_icetf_gpool` | SimCLR-style; BYOL; VICReg (batch 192); I-CE with an EMA teacher and a memory bank | pool | 5 | Figure 7, Figure 8, Table 2, Section 3.2, Table A1, Table A12, Table A15, Table A16, Table A17, Figure A2, Table S2, Table S3, Table S4 |
|
| 83 |
-
| `ce_cetf_gpool`, `i2ce_icetf_gpool` | CE; I-CE, the recipe | pool | 5 | Figure 7, Figure 8, Table 2, Section 6.1, Table A1, Table A2, Table A13, Table A14, Table A15, Table A16, Table A17, Figure A2, Table S2, Table S3, Table S4 |
|
| 84 |
| `slot8i2cemean_icetf_gpool` | I-CE, 8 latent queries | pool | 5 | Table A6 |
|
| 85 |
| `swin168step84loop2i2ce_icetf_gpool`, `swin168step84loop2i2ce_icetf_gpool_bw` | I-CE with the windowed teacher; I-CE, two-stage: BYOL warm start, then the windowed teacher | pool | 5 | Table A12, Table S2, Table S3, Table S4 |
|
| 86 |
| `dino_dntf_gpool` | DINO at its published settings, the control of Section 4.3 | pool | 0 only | Table A1 |
|
| 87 |
|
| 88 |
-
I + SimCLR (`i2bce_icetf`, files without a pack or a suffix, five folds) backs Figure 8
|
|
|
|
| 89 |
fold-0 run of `i2ce_icetf_g2048` also gives the game vectors of Figure 10. The DINO-style control
|
| 90 |
has one fold, so Table A1 gives its spread over the ten anchor draws; its file is 169 MiB because
|
| 91 |
it carries the two prototype heads (see Format).
|
|
@@ -94,7 +96,7 @@ it carries the two prototype heads (see Format).
|
|
| 94 |
|
| 95 |
| Runs | What they are | Pack | Folds | Read by |
|
| 96 |
|---|---|---|---|---|
|
| 97 |
-
| `ai25auni2_icetf_d512`, `ai2auni25_icetf_d512`, `ai4auni2_icetf_d512`, `ai6auni2_icetf_d512`, `i4uni2_icetf` | alignment + uniformity aimed at the anchor gallery, the four settings of Section 6.2 (`ai25auni2` is Table 3's a+u @ gallery row); alignment + uniformity aimed at the batch views (Table 3's a+u @ views row) | 512 | fixed split | Table 3, Section 6.2 |
|
| 98 |
| `ai2ce_icetf_d512`, `ce_cetf_d512`, `i2ce_icetf_d512` | CE + anchor-in-I; CE; I-CE, the recipe | 512 | fixed split | Table 3, Section 6.2, Table A7 |
|
| 99 |
| `ce_cetf_g2048`, `i2ce_icetf_g2048` | CE; I-CE, the recipe | 2,048 | fixed split | Figure 9, Figure A1, Figure A3, Appendix L |
|
| 100 |
| `bce_cetf`, `i2bce_icetf`, `epd_v20i10c20_cetf` | SimCLR-style; I + SimCLR; VICReg, v/i/c = 20/10/20 (the recipe weights) | 512 | fixed split | Figure 9, Figure A3, Appendix L, Table A7 |
|
|
@@ -111,11 +113,14 @@ of the test curve Appendix L describes.
|
|
| 111 |
Runs that read no anchor in training (`bce_cetf`, `i2bce_icetf`, `i4uni2_icetf` and the three
|
| 112 |
VICReg weightings; the 512 in their rows is only the pack their worker encoded at each
|
| 113 |
checkpoint) were selected after training: each of the run's 40 checkpoints encodes the
|
| 114 |
-
4,096-sentence anchor pack of the fixed split and the rank rule chooses on that.
|
| 115 |
-
|
| 116 |
-
|
| 117 |
-
|
| 118 |
-
|
|
|
|
|
|
|
|
|
|
| 119 |
|
| 120 |
## Format
|
| 121 |
|
|
@@ -177,7 +182,8 @@ repository give a run on the current packs that name themselves.
|
|
| 177 |
Runs whose loss never reads the anchors (the SimCLR-style tower, I + SimCLR, BYOL, VICReg and
|
| 178 |
alignment plus uniformity aimed at the batch views) train the same weights on either pack, so
|
| 179 |
their checkpoints were not replaced; only readings that used the 512-sentence packs were redone.
|
| 180 |
-
|
|
|
|
| 181 |
|
| 182 |
Stripped hit@1 on the ten 4,096-sentence draws, five-fold mean 卤 std, before and after:
|
| 183 |
|
|
@@ -208,11 +214,13 @@ dataset keeps the first packs as `wscan_gal_rev_rawprefix.npz`; the workers read
|
|
| 208 |
|
| 209 |
## Changes
|
| 210 |
|
| 211 |
-
- 2026-11-11, later that day.
|
| 212 |
here: the DINO-style control (fold 0), eight fixed-split runs at their selected epochs (CE and
|
| 213 |
I-CE trained at 2,048 sentences, the SimCLR-style tower, I + SimCLR, a+u @ views and the three
|
| 214 |
-
VICReg weightings),
|
| 215 |
-
|
|
|
|
|
|
|
| 216 |
- 2026-11-11. The four JSON files above replace the earlier per-campaign lists
|
| 217 |
(`docfix512_ckpt_plan.json`, `c2_docfix512_ckpt_plan.json`, `c3_docfix512_ckpt_plan.json`,
|
| 218 |
`q8_gpool_ckpt_plan.json`); no selection changed. The five BYOL checkpoints the two-stage runs
|
|
|
|
| 24 |
|
| 25 |
## Contents
|
| 26 |
|
| 27 |
+
266 checkpoints, about 580 MiB, and four JSON files that list every one of them:
|
| 28 |
|
| 29 |
| Listed in | Checkpoints | What they are |
|
| 30 |
|---|---|---|
|
| 31 |
+
| `rank_ckpt_plan.json` | 157 | the five-fold runs behind the paper's numbers, each at the epoch the validation rank rule of Section 5 selects. One is the DINO-style control of Table A1, trained on fold 0 only; five, CE capped at 2,048 sentences, are the partners of I-CE runs the paper prints and are not printed themselves |
|
| 32 |
+
| `i2bce_sel_pool.json` | 5 | I + SimCLR on the five folds (Figure 8, Appendix L), selected by the same rule |
|
| 33 |
+
| `fixed_split_ckpt_plan.json` | 69 | the fixed-split runs: 15 runs at their selected epochs, two of them with an earlier checkpoint kept beside the selected one, and 52 more checkpoints of two runs that the paper reads across their epochs (field `trajectory`) |
|
| 34 |
| `rank_ckpt_plan.json`, field `init_ckpt` | 5 | the BYOL checkpoints the five two-stage runs started from |
|
| 35 |
| `superseded_ckpt_plan.json` | 30 | kept for the record; no number of the paper reads them |
|
| 36 |
|
|
|
|
| 41 |
|
| 42 |
Every tower that a number or a figure of the paper reads is here, at the checkpoint it is read
|
| 43 |
at. A run saved a checkpoint every 50 epochs and the rank rule chose among them; the ones it did
|
| 44 |
+
not choose are not here, except for the two runs listed under `trajectory`. The other passages
|
| 45 |
+
that follow runs over training quote what the workers logged at each checkpoint: the learnable
|
| 46 |
+
temperature and the view-count sweep in Appendix C, and the decline of the views-first anchors
|
| 47 |
+
after epoch 50 in Supplement A.
|
| 48 |
|
| 49 |
## File names
|
| 50 |
|
|
|
|
| 77 |
| `i3ce_icetf_d512`, `i4ce_icetf_d512`, `ice_icetf_d512` | I-CE, 位 = 3; I-CE, 位 = 4; I-CE, 位 = 1 | 512 | 0 to 2 | Table A4 |
|
| 78 |
| `slot16i2cemean_icetf_d512`, `slot1i2cemean_icetf_d512`, `slot2i2cemean_icetf_d512`, `slot8i2cemean_icetf_d512` | I-CE, 16 latent queries; I-CE, 1 latent query; I-CE, 2 latent queries; I-CE, 8 latent queries | 512 | 0 to 2 | Table A6 |
|
| 79 |
| `vfai2ce_icetf_d512` | I-CE, views-first anchors | 512 | 5 | Table S1 |
|
| 80 |
+
| `ce_cetf_g1024`, `i2ce_icetf_g1024` | CE; I-CE, the recipe | 1,024 | 5 | Table A2, Table A10, Table A14 |
|
| 81 |
+
| `ce_cetf_g2048`, `i2ce_icetf_g2048` | CE; I-CE, the recipe | 2,048 | 5 | Table A3, Table A10 |
|
| 82 |
| `i2ce_icetl_g2048`, `i2cet05_icetf_g2048`, `i2cet10_icetf_g2048` | I-CE, learnable 蟿; I-CE, 蟿 = 0.05; I-CE, 蟿 = 0.10 | 2,048 | 5 | Table A3 |
|
| 83 |
| `bce_cetf_gpool`, `byol_bytf_gpool`, `epd_v20i10c20_cetf_gpool`, `mq3072i2ce_icetf_gpool` | SimCLR-style; BYOL; VICReg (batch 192); I-CE with an EMA teacher and a memory bank | pool | 5 | Figure 7, Figure 8, Table 2, Section 3.2, Table A1, Table A12, Table A15, Table A16, Table A17, Figure A2, Table S2, Table S3, Table S4 |
|
| 84 |
+
| `ce_cetf_gpool`, `i2ce_icetf_gpool` | CE; I-CE, the recipe | pool | 5 | Figure 7, Figure 8, Table 2, Section 6.1, Table A1, Table A2, Table A6, Table A12, Table A13, Table A14, Table A15, Table A16, Table A17, Figure A2, Table S2, Table S3, Table S4 |
|
| 85 |
| `slot8i2cemean_icetf_gpool` | I-CE, 8 latent queries | pool | 5 | Table A6 |
|
| 86 |
| `swin168step84loop2i2ce_icetf_gpool`, `swin168step84loop2i2ce_icetf_gpool_bw` | I-CE with the windowed teacher; I-CE, two-stage: BYOL warm start, then the windowed teacher | pool | 5 | Table A12, Table S2, Table S3, Table S4 |
|
| 87 |
| `dino_dntf_gpool` | DINO at its published settings, the control of Section 4.3 | pool | 0 only | Table A1 |
|
| 88 |
|
| 89 |
+
I + SimCLR (`i2bce_icetf`, files without a pack or a suffix, five folds) backs Figure 8 and the
|
| 90 |
+
five-fold readings of Appendix L. The
|
| 91 |
fold-0 run of `i2ce_icetf_g2048` also gives the game vectors of Figure 10. The DINO-style control
|
| 92 |
has one fold, so Table A1 gives its spread over the ten anchor draws; its file is 169 MiB because
|
| 93 |
it carries the two prototype heads (see Format).
|
|
|
|
| 96 |
|
| 97 |
| Runs | What they are | Pack | Folds | Read by |
|
| 98 |
|---|---|---|---|---|
|
| 99 |
+
| `ai25auni2_icetf_d512`, `ai2auni25_icetf_d512`, `ai4auni2_icetf_d512`, `ai6auni2_icetf_d512`, `i4uni2_icetf` | alignment + uniformity aimed at the anchor gallery, the four settings of Section 6.2 (`ai25auni2` is Table 3's a+u @ gallery row); alignment + uniformity aimed at the batch views (Table 3's a+u @ views row) | 512 | fixed split | Table 3, Section 6.2, Appendix L |
|
| 100 |
| `ai2ce_icetf_d512`, `ce_cetf_d512`, `i2ce_icetf_d512` | CE + anchor-in-I; CE; I-CE, the recipe | 512 | fixed split | Table 3, Section 6.2, Table A7 |
|
| 101 |
| `ce_cetf_g2048`, `i2ce_icetf_g2048` | CE; I-CE, the recipe | 2,048 | fixed split | Figure 9, Figure A1, Figure A3, Appendix L |
|
| 102 |
| `bce_cetf`, `i2bce_icetf`, `epd_v20i10c20_cetf` | SimCLR-style; I + SimCLR; VICReg, v/i/c = 20/10/20 (the recipe weights) | 512 | fixed split | Figure 9, Figure A3, Appendix L, Table A7 |
|
|
|
|
| 113 |
Runs that read no anchor in training (`bce_cetf`, `i2bce_icetf`, `i4uni2_icetf` and the three
|
| 114 |
VICReg weightings; the 512 in their rows is only the pack their worker encoded at each
|
| 115 |
checkpoint) were selected after training: each of the run's 40 checkpoints encodes the
|
| 116 |
+
4,096-sentence anchor pack of the fixed split and the rank rule chooses on that.
|
| 117 |
+
|
| 118 |
+
Ten of the fifteen runs stopped at 1,000 epochs under their first schedule and were trained on to
|
| 119 |
+
2,000 from the weights of epoch 1,000 with a fresh optimizer: those six, CE + anchor-in-I, and
|
| 120 |
+
three of the gallery-aimed settings (`ai6auni2`, `ai4auni2`, `ai2auni25`). The plan entries say so
|
| 121 |
+
under `extended`. Two selections moved with the longer runs, CE + anchor-in-I to epoch 1,650 and
|
| 122 |
+
`ai4auni2` to epoch 1,250; the checkpoints selected before (epochs 1,000 and 900) are kept and
|
| 123 |
+
named under `previous`.
|
| 124 |
|
| 125 |
## Format
|
| 126 |
|
|
|
|
| 182 |
Runs whose loss never reads the anchors (the SimCLR-style tower, I + SimCLR, BYOL, VICReg and
|
| 183 |
alignment plus uniformity aimed at the batch views) train the same weights on either pack, so
|
| 184 |
their checkpoints were not replaced; only readings that used the 512-sentence packs were redone.
|
| 185 |
+
Their files therefore carry no `_d512`: the fixed-split ones, and those of the five-fold
|
| 186 |
+
I + SimCLR.
|
| 187 |
|
| 188 |
Stripped hit@1 on the ten 4,096-sentence draws, five-fold mean 卤 std, before and after:
|
| 189 |
|
|
|
|
| 214 |
|
| 215 |
## Changes
|
| 216 |
|
| 217 |
+
- 2026-11-11, later that day. 62 checkpoints were added, so that every tower the paper reads is
|
| 218 |
here: the DINO-style control (fold 0), eight fixed-split runs at their selected epochs (CE and
|
| 219 |
I-CE trained at 2,048 sentences, the SimCLR-style tower, I + SimCLR, a+u @ views and the three
|
| 220 |
+
VICReg weightings), the 52 `trajectory` checkpoints, and epoch 1,250 of the 4:1 gallery-aimed
|
| 221 |
+
run of Section 6.2 (`ai4auni2_icetf_d512`). That run's entry in `fixed_split_ckpt_plan.json`
|
| 222 |
+
named epoch 900, its selection before it was trained on to 2,000 epochs; the paper reads epoch
|
| 223 |
+
1,250. No other earlier entry changed its checkpoint.
|
| 224 |
- 2026-11-11. The four JSON files above replace the earlier per-campaign lists
|
| 225 |
(`docfix512_ckpt_plan.json`, `c2_docfix512_ckpt_plan.json`, `c3_docfix512_ckpt_plan.json`,
|
| 226 |
`q8_gpool_ckpt_plan.json`); no selection changed. The five BYOL checkpoints the two-stage runs
|
fixed_split_ckpt_plan.json
CHANGED
|
@@ -21,7 +21,8 @@
|
|
| 21 |
"sha256": "778a94d36875894bc8872a43976a5f271152e8303605c1b4ca073ef9d6170ee3",
|
| 22 |
"ranksel": 0.8912054361316923,
|
| 23 |
"protocol": "fixed split (seed 0)",
|
| 24 |
-
"worker": "Pod/w9_a100_worker.py"
|
|
|
|
| 25 |
},
|
| 26 |
"ai2ce_icetf_fixed_d512": {
|
| 27 |
"arm": "ai2ce_icetf",
|
|
@@ -47,12 +48,19 @@
|
|
| 47 |
"fold": null,
|
| 48 |
"cap": "",
|
| 49 |
"sfx": "_d512",
|
| 50 |
-
"ep":
|
| 51 |
-
"ckpt": "
|
| 52 |
-
"sha256": "
|
| 53 |
-
"ranksel": 1.
|
| 54 |
"protocol": "fixed split (seed 0)",
|
| 55 |
-
"worker": "Pod/w9_a100_worker.py"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 56 |
},
|
| 57 |
"ai6auni2_icetf_fixed_d512": {
|
| 58 |
"arm": "ai6auni2_icetf",
|
|
@@ -64,7 +72,8 @@
|
|
| 64 |
"sha256": "d40740b355bd881d7865ca0ba004c99fff4f85b1147ec83ce090aa7ce5276996",
|
| 65 |
"ranksel": 64.68700112813966,
|
| 66 |
"protocol": "fixed split (seed 0)",
|
| 67 |
-
"worker": "Pod/w9_a100_worker.py"
|
|
|
|
| 68 |
},
|
| 69 |
"ce_cetf_fixed_d512": {
|
| 70 |
"arm": "ce_cetf",
|
|
|
|
| 21 |
"sha256": "778a94d36875894bc8872a43976a5f271152e8303605c1b4ca073ef9d6170ee3",
|
| 22 |
"ranksel": 0.8912054361316923,
|
| 23 |
"protocol": "fixed split (seed 0)",
|
| 24 |
+
"worker": "Pod/w9_a100_worker.py",
|
| 25 |
+
"extended": "2026-11-08: trained on from 1,000 to 2,000 epochs (weights of ep1000, fresh optimizer, AMP and RNG); rank rule over all 40 checkpoints, which leaves the selection where it was"
|
| 26 |
},
|
| 27 |
"ai2ce_icetf_fixed_d512": {
|
| 28 |
"arm": "ai2ce_icetf",
|
|
|
|
| 48 |
"fold": null,
|
| 49 |
"cap": "",
|
| 50 |
"sfx": "_d512",
|
| 51 |
+
"ep": 1250,
|
| 52 |
+
"ckpt": "ckpt_w9_wcle_ai4auni2_icetf_d512_fp_ep1250.pt",
|
| 53 |
+
"sha256": "c8dfd8a19a855f51d6a6c7afca635a2930d0312937c00538621f4d421bb05e64",
|
| 54 |
+
"ranksel": 1.6230743265482546,
|
| 55 |
"protocol": "fixed split (seed 0)",
|
| 56 |
+
"worker": "Pod/w9_a100_worker.py",
|
| 57 |
+
"extended": "2026-11-08: trained on from 1,000 to 2,000 epochs (weights of ep1000, fresh optimizer, AMP and RNG); rank rule over all 40 checkpoints",
|
| 58 |
+
"previous": {
|
| 59 |
+
"ep": 900,
|
| 60 |
+
"ckpt": "ckpt_w9_wcle_ai4auni2_icetf_d512_fp_ep900.pt",
|
| 61 |
+
"sha256": "34f2ee0e051da230e57f713ec7446477686739d2eb4bac6e562ae606d0f876dd",
|
| 62 |
+
"ranksel": 1.5249424624108827
|
| 63 |
+
}
|
| 64 |
},
|
| 65 |
"ai6auni2_icetf_fixed_d512": {
|
| 66 |
"arm": "ai6auni2_icetf",
|
|
|
|
| 72 |
"sha256": "d40740b355bd881d7865ca0ba004c99fff4f85b1147ec83ce090aa7ce5276996",
|
| 73 |
"ranksel": 64.68700112813966,
|
| 74 |
"protocol": "fixed split (seed 0)",
|
| 75 |
+
"worker": "Pod/w9_a100_worker.py",
|
| 76 |
+
"extended": "2026-11-08: trained on from 1,000 to 2,000 epochs (weights of ep1000, fresh optimizer, AMP and RNG); rank rule over all 40 checkpoints, which leaves the selection where it was"
|
| 77 |
},
|
| 78 |
"ce_cetf_fixed_d512": {
|
| 79 |
"arm": "ce_cetf",
|