Card: what is not in the repository, the run table by provenance cell, names in the before/after table
Browse files
README.md
CHANGED
|
@@ -28,7 +28,7 @@ reviews (Qwen3-Embedding-0.6B, 1,024-d) and an MLP maps the pooled result to one
|
|
| 28 |
|
| 29 |
| Listed in | Checkpoints | What they are |
|
| 30 |
|---|---|---|
|
| 31 |
-
| `rank_ckpt_plan.json` | 156 |
|
| 32 |
| `i2bce_sel_pool.json` | 5 | I + SimCLR on the five folds (Figure 8), selected by the same rule |
|
| 33 |
| `fixed_split_ckpt_plan.json` | 8 | the fixed-split runs of Table 3 and Section 6.2 that train with 512-sentence anchors: seven runs, one of them with an earlier checkpoint kept beside the selected one |
|
| 34 |
| `rank_ckpt_plan.json`, field `init_ckpt` | 5 | the BYOL checkpoints the five two-stage runs started from |
|
|
@@ -39,8 +39,10 @@ the file name and the file's SHA-256; `i2bce_sel_pool.json` is the selection as
|
|
| 39 |
script wrote it, with the rank score of every checkpoint of the run. The same four files are in
|
| 40 |
`contrast_experiment/w9/eval/` of the code repository, where the evaluation script reads them.
|
| 41 |
|
| 42 |
-
|
| 43 |
-
Table A7, the towers of Figure 9
|
|
|
|
|
|
|
| 44 |
|
| 45 |
## File names
|
| 46 |
|
|
@@ -66,13 +68,11 @@ row reads at least one of the row's runs. That file also names the notebook that
|
|
| 66 |
| Runs | What they are | Pack | Folds | Read by |
|
| 67 |
|---|---|---|---|---|
|
| 68 |
| `ai2ce_icetf_d512` | CE + anchor-in-I | 512 | 5 | Table 2, Section 6.2, Table A14 |
|
| 69 |
-
| `ce_cetf_d512` | CE | 512 | 5 | Table 2, Table A2, Table A3, Table A10, Table A14 |
|
| 70 |
| `d1r2_i2ce_icetf_d512`, `d1r4_i2ce_icetf_d512`, `d1r5_i2ce_icetf_d512`, `d1r5_i3ce_icetf_d512`, `d1r6_i2ce_icetf_d512` | I-CE, V = 3; I-CE, V = 5; I-CE, V = 6; I-CE, V = 6 with λ = 3; I-CE, V = 7 | 512 | 0 to 2 | Table A5 |
|
| 71 |
-
| `
|
| 72 |
-
| `i2ce_icetf_wllm_d512` | I-CE, LLM-rewritten documents | 512 | 5 | Table A18 |
|
| 73 |
| `i2cet05_icetf_d512`, `i2cet10_icetf_d512` | I-CE, τ = 0.05; I-CE, τ = 0.10 | 512 | 5 | Table A3 |
|
| 74 |
| `i3ce_icetf_d512`, `i4ce_icetf_d512`, `ice_icetf_d512` | I-CE, λ = 3; I-CE, λ = 4; I-CE, λ = 1 | 512 | 0 to 2 | Table A4 |
|
| 75 |
-
| `nodoc_i2ce_icetf_d512` | I-CE without the document view | 512 | 5 | Table A18, Table S1 |
|
| 76 |
| `slot16i2cemean_icetf_d512`, `slot1i2cemean_icetf_d512`, `slot2i2cemean_icetf_d512`, `slot8i2cemean_icetf_d512` | I-CE, 16 latent queries; I-CE, 1 latent query; I-CE, 2 latent queries; I-CE, 8 latent queries | 512 | 0 to 2 | Table A6 |
|
| 77 |
| `vfai2ce_icetf_d512` | I-CE, views-first anchors | 512 | 5 | Table S1 |
|
| 78 |
| `ce_cetf_g1024`, `i2ce_icetf_g1024` | CE; I-CE, the recipe | 1,024 | 5 | Table A2, Table A3, Table A10, Table A14 |
|
|
@@ -83,7 +83,8 @@ row reads at least one of the row's runs. That file also names the notebook that
|
|
| 83 |
| `slot8i2cemean_icetf_gpool` | I-CE, 8 latent queries | pool | 5 | Table A6 |
|
| 84 |
| `swin168step84loop2i2ce_icetf_gpool`, `swin168step84loop2i2ce_icetf_gpool_bw` | I-CE with the windowed teacher; I-CE, two-stage: BYOL warm start, then the windowed teacher | pool | 5 | Table A12, Table S2, Table S3, Table S4 |
|
| 85 |
|
| 86 |
-
I + SimCLR (`i2bce_icetf`, files without a pack or a suffix, five folds) backs Figure 8.
|
|
|
|
| 87 |
|
| 88 |
## The fixed-split runs
|
| 89 |
|
|
@@ -136,7 +137,9 @@ python contrast_experiment/w9/eval/k10_eval.py table scores.json
|
|
| 136 |
|
| 137 |
`cells` takes the 161 five-fold checkpoints of `rank_ckpt_plan.json` and `i2bce_sel_pool.json`;
|
| 138 |
`--only <regex>` keeps a subset, for example `--only "_d512$"` for the 512-sentence runs. The
|
| 139 |
-
script does not score the fixed-split towers.
|
|
|
|
|
|
|
| 140 |
|
| 141 |
## The 512-sentence packs and the `_d512` runs
|
| 142 |
|
|
@@ -156,13 +159,17 @@ Stripped hit@1 on the ten 4,096-sentence draws, five-fold mean ± std, before an
|
|
| 156 |
|
| 157 |
| Tower | on the packs as first built | on the corrected packs (`_d512`) |
|
| 158 |
|---|---|---|
|
| 159 |
-
| I-CE | 0.669 ± 0.031 | 0.715 ± 0.010 |
|
| 160 |
-
| CE | 0.638 ± 0.016 | 0.676 ± 0.013 |
|
| 161 |
-
| CE + anchor-in-I | 0.663 ± 0.014 | 0.725 ± 0.015 |
|
| 162 |
-
| I-CE
|
| 163 |
-
| I-CE, LLM-rewritten documents | 0.680 ± 0.034 | 0.711 ± 0.009 |
|
| 164 |
-
| τ = 0.05 | 0.601 ± 0.029 | 0.642 ± 0.026 |
|
| 165 |
-
| τ = 0.10 | 0.510 ± 0.022 (four folds) | 0.520 ± 0.015 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 166 |
|
| 167 |
## Superseded checkpoints
|
| 168 |
|
|
|
|
| 28 |
|
| 29 |
| Listed in | Checkpoints | What they are |
|
| 30 |
|---|---|---|
|
| 31 |
+
| `rank_ckpt_plan.json` | 156 | the five-fold runs the paper's numbers read (all but one control, see below), each at the epoch the validation rank rule of Section 5 selects |
|
| 32 |
| `i2bce_sel_pool.json` | 5 | I + SimCLR on the five folds (Figure 8), selected by the same rule |
|
| 33 |
| `fixed_split_ckpt_plan.json` | 8 | the fixed-split runs of Table 3 and Section 6.2 that train with 512-sentence anchors: seven runs, one of them with an earlier checkpoint kept beside the selected one |
|
| 34 |
| `rank_ckpt_plan.json`, field `init_ckpt` | 5 | the BYOL checkpoints the five two-stage runs started from |
|
|
|
|
| 39 |
script wrote it, with the rank score of every checkpoint of the run. The same four files are in
|
| 40 |
`contrast_experiment/w9/eval/` of the code repository, where the evaluation script reads them.
|
| 41 |
|
| 42 |
+
Not in this repository: the other fixed-split towers the paper reads (the a+u @ views row of
|
| 43 |
+
Table 3, the VICReg rows of Table A7, and the towers of Figure 9, Figures A1 and A3 and the
|
| 44 |
+
neighborhood statistics of Appendix L), and the DINO-style control of Section 4.3 (Table A1, one
|
| 45 |
+
fold), whose training code is not part of the code release either.
|
| 46 |
|
| 47 |
## File names
|
| 48 |
|
|
|
|
| 68 |
| Runs | What they are | Pack | Folds | Read by |
|
| 69 |
|---|---|---|---|---|
|
| 70 |
| `ai2ce_icetf_d512` | CE + anchor-in-I | 512 | 5 | Table 2, Section 6.2, Table A14 |
|
| 71 |
+
| `ce_cetf_d512`, `i2ce_icetf_d512` | CE; I-CE, the recipe | 512 | 5 | Table 2, Table A2, Table A3, Table A4, Table A5, Table A6, Table A10, Table A14, Table A18, Table S1 |
|
| 72 |
| `d1r2_i2ce_icetf_d512`, `d1r4_i2ce_icetf_d512`, `d1r5_i2ce_icetf_d512`, `d1r5_i3ce_icetf_d512`, `d1r6_i2ce_icetf_d512` | I-CE, V = 3; I-CE, V = 5; I-CE, V = 6; I-CE, V = 6 with λ = 3; I-CE, V = 7 | 512 | 0 to 2 | Table A5 |
|
| 73 |
+
| `i2ce_icetf_wllm_d512`, `nodoc_i2ce_icetf_d512` | I-CE, LLM-rewritten documents; I-CE without the document view | 512 | 5 | Table A18 |
|
|
|
|
| 74 |
| `i2cet05_icetf_d512`, `i2cet10_icetf_d512` | I-CE, τ = 0.05; I-CE, τ = 0.10 | 512 | 5 | Table A3 |
|
| 75 |
| `i3ce_icetf_d512`, `i4ce_icetf_d512`, `ice_icetf_d512` | I-CE, λ = 3; I-CE, λ = 4; I-CE, λ = 1 | 512 | 0 to 2 | Table A4 |
|
|
|
|
| 76 |
| `slot16i2cemean_icetf_d512`, `slot1i2cemean_icetf_d512`, `slot2i2cemean_icetf_d512`, `slot8i2cemean_icetf_d512` | I-CE, 16 latent queries; I-CE, 1 latent query; I-CE, 2 latent queries; I-CE, 8 latent queries | 512 | 0 to 2 | Table A6 |
|
| 77 |
| `vfai2ce_icetf_d512` | I-CE, views-first anchors | 512 | 5 | Table S1 |
|
| 78 |
| `ce_cetf_g1024`, `i2ce_icetf_g1024` | CE; I-CE, the recipe | 1,024 | 5 | Table A2, Table A3, Table A10, Table A14 |
|
|
|
|
| 83 |
| `slot8i2cemean_icetf_gpool` | I-CE, 8 latent queries | pool | 5 | Table A6 |
|
| 84 |
| `swin168step84loop2i2ce_icetf_gpool`, `swin168step84loop2i2ce_icetf_gpool_bw` | I-CE with the windowed teacher; I-CE, two-stage: BYOL warm start, then the windowed teacher | pool | 5 | Table A12, Table S2, Table S3, Table S4 |
|
| 85 |
|
| 86 |
+
I + SimCLR (`i2bce_icetf`, files without a pack or a suffix, five folds) backs Figure 8. The
|
| 87 |
+
fold-0 run of `i2ce_icetf_g2048` also gives the game vectors of Figure 10.
|
| 88 |
|
| 89 |
## The fixed-split runs
|
| 90 |
|
|
|
|
| 137 |
|
| 138 |
`cells` takes the 161 five-fold checkpoints of `rank_ckpt_plan.json` and `i2bce_sel_pool.json`;
|
| 139 |
`--only <regex>` keeps a subset, for example `--only "_d512$"` for the 512-sentence runs. The
|
| 140 |
+
script does not score the fixed-split towers. In its table the five families of the main
|
| 141 |
+
comparison go by the paper's names (`I-CE`, `CE`, `SimCLR`, `VICReg`, `BYOL`) and every other
|
| 142 |
+
family by its plan key without the fold.
|
| 143 |
|
| 144 |
## The 512-sentence packs and the `_d512` runs
|
| 145 |
|
|
|
|
| 159 |
|
| 160 |
| Tower | on the packs as first built | on the corrected packs (`_d512`) |
|
| 161 |
|---|---|---|
|
| 162 |
+
| I-CE (`i2ce_icetf`) | 0.669 ± 0.031 | 0.715 ± 0.010 |
|
| 163 |
+
| CE (`ce_cetf`) | 0.638 ± 0.016 | 0.676 ± 0.013 |
|
| 164 |
+
| CE + anchor-in-I (`ai2ce_icetf`) | 0.663 ± 0.014 | 0.725 ± 0.015 |
|
| 165 |
+
| I-CE without the document view (`nodoc_i2ce_icetf`) | 0.650 ± 0.022 | 0.683 ± 0.025 |
|
| 166 |
+
| I-CE, LLM-rewritten documents (`i2ce_icetf`, `_wllm`) | 0.680 ± 0.034 | 0.711 ± 0.009 |
|
| 167 |
+
| I-CE, τ = 0.05 (`i2cet05_icetf`) | 0.601 ± 0.029 | 0.642 ± 0.026 |
|
| 168 |
+
| I-CE, τ = 0.10 (`i2cet10_icetf`) | 0.510 ± 0.022 (four folds) | 0.520 ± 0.015 |
|
| 169 |
+
|
| 170 |
+
The checkpoints behind the left column are the superseded files of the next section, except
|
| 171 |
+
those of CE + anchor-in-I, whose first runs were not uploaded. The other `_d512` families (the
|
| 172 |
+
sweeps on folds 0 to 2 and the views-first anchors) have no earlier counterpart here.
|
| 173 |
|
| 174 |
## Superseded checkpoints
|
| 175 |
|