Augmentation study: RUNBOOK v2.2 Phase 5 (chain-aware band attenuation) - negative result, F3_s0 stays main model
Browse files- AUG_STUDY_LOG.md +44 -2
- aug_study/FINAL_REPORT.md +4 -0
- aug_study/PREREG_v2.md +111 -0
- aug_study/phase5/band_reliance.csv +57 -0
- aug_study/phase5/band_survival.csv +121 -0
- aug_study/phase5/proxy_results.csv +73 -0
- aug_study/phase5/proxy_table.csv +5 -0
- aug_study/phase5/summary.md +97 -0
AUG_STUDY_LOG.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
# Forensic augmentation study for the pixel expert E3′: research log
|
| 2 |
|
| 3 |
-
*Last update: 2026-10-28 (RUNBOOK v2.
|
| 4 |
|
| 5 |
Related logs in this repo: `RESEARCH_LOG.md` (MoE detector), `REPRODUCE.md`.
|
| 6 |
|
|
@@ -19,6 +19,8 @@ Related logs in this repo: `RESEARCH_LOG.md` (MoE detector), `REPRODUCE.md`.
|
|
| 19 |
- **Main weakness:** the score shift toward "fake" at many re-encodes is not solved.
|
| 20 |
The real TNR at 20 re-encodes is 0.284 for (E2, F3_s0) and 0.248 for (E2, E3′).
|
| 21 |
The band test shows the cause: the new models rely strongly on the diagonal and H/V high-frequency bands, and repost chains change these bands most.
|
|
|
|
|
|
|
| 22 |
|
| 23 |
## 1. Purpose
|
| 24 |
|
|
@@ -311,6 +313,7 @@ Inject: the real frame gets the fake's band group, and the table gives the TNR.
|
|
| 311 |
3. **The open problem is the score shift.** F2 keeps the highest real TNR at 20 re-encodes (0.634 fused), but it has a lower AUC.
|
| 312 |
A model that combines the chain augmentation with an explicit shift control is the next step.
|
| 313 |
For example: depth-conditioned calibration, or diagonal-band dropout. This is outside the RUNBOOK v2.1 scope.
|
|
|
|
| 314 |
|
| 315 |
|
| 316 |
## 16. Reference: DINOv2 WaveRep baselines on mix (`phase4/mix_reference.md`; report only, no selection)
|
|
@@ -349,7 +352,42 @@ E1 is the released WaveRep (DINOv2 ViT-B/14 reg4, stored MoE scores). D2wr is ou
|
|
| 349 |
- **Band test:** the band groups use FSWT for all models, which includes F3 (trained with SWT).
|
| 350 |
|
| 351 |
|
| 352 |
-
## 17.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 353 |
|
| 354 |
Uploaded next to this log, under `aug_study/`:
|
| 355 |
|
|
@@ -366,3 +404,7 @@ Uploaded next to this log, under `aug_study/`:
|
|
| 366 |
- `phase3b/`: `g0_summary.md`, `selection.md`, `mixval_metrics.csv`, `attribution.csv`, `shift.csv`.
|
| 367 |
- `phase4/`: `mix_summary.md`, `mix_overall.csv`, `mix_groups.csv`, `mix_delta.csv`, `mix_shift.csv`, `band_reliance.csv`,
|
| 368 |
`mix_reference.md`, `mix_reference.csv`, `mix_reference_groups.csv`, `mix_reference_delta.csv`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Forensic augmentation study for the pixel expert E3′: research log
|
| 2 |
|
| 3 |
+
*Last update: 2026-10-28 (RUNBOOK v2.2 Phase 5 complete: negative result). This is a private working log. All numbers come from local runs. There is no peer review yet. The text follows ASD-STE100 Simplified Technical English.*
|
| 4 |
|
| 5 |
Related logs in this repo: `RESEARCH_LOG.md` (MoE detector), `REPRODUCE.md`.
|
| 6 |
|
|
|
|
| 19 |
- **Main weakness:** the score shift toward "fake" at many re-encodes is not solved.
|
| 20 |
The real TNR at 20 re-encodes is 0.284 for (E2, F3_s0) and 0.248 for (E2, E3′).
|
| 21 |
The band test shows the cause: the new models rely strongly on the diagonal and H/V high-frequency bands, and repost chains change these bands most.
|
| 22 |
+
- **Phase 5 (RUNBOOK v2.2): band attenuation does not help.** Random attenuation of the bands that repost chains destroy (DD, CBA, UBA) does not raise the
|
| 23 |
+
AUC at 10 and 20 re-encodes (ΔS_deep −0.003 to −0.007; the rule needs +0.010). F4 was not trained, mix was not scored again, and F3_s0 stays the main model (Section 17).
|
| 24 |
|
| 25 |
## 1. Purpose
|
| 26 |
|
|
|
|
| 313 |
3. **The open problem is the score shift.** F2 keeps the highest real TNR at 20 re-encodes (0.634 fused), but it has a lower AUC.
|
| 314 |
A model that combines the chain augmentation with an explicit shift control is the next step.
|
| 315 |
For example: depth-conditioned calibration, or diagonal-band dropout. This is outside the RUNBOOK v2.1 scope.
|
| 316 |
+
- Update (Phase 5): diagonal-band dropout and chain-aware band attenuation were tested and did not help (Section 17).
|
| 317 |
|
| 318 |
|
| 319 |
## 16. Reference: DINOv2 WaveRep baselines on mix (`phase4/mix_reference.md`; report only, no selection)
|
|
|
|
| 352 |
- **Band test:** the band groups use FSWT for all models, which includes F3 (trained with SWT).
|
| 353 |
|
| 354 |
|
| 355 |
+
## 17. Phase 5: chain-aware band attenuation (RUNBOOK v2.2; `phase5/summary.md`, `PREREG_v2.md`)
|
| 356 |
+
|
| 357 |
+
**Hypothesis (pre-registered in `PREREG_v2.md` before any metric):** if the training randomly attenuates the bands that repost chains destroy, then the AUC at 10 and 20 re-encodes increases, the AUC at 1 re-encode stays the same, and the reliance on the diagonal bands decreases. A chain-aware weighting is also better than a uniform attenuation of the same mean strength.
|
| 358 |
+
|
| 359 |
+
**Step 5.0, band survival:** s_b(5) = the band energy after 5 re-encodes divided by the energy before (Y channel, median over 5 VAEs). The finest diagonal band survives least: (HH, 1) 0.07, (HH, 2) 0.10. (LH, 1) and (HL, 1) are at 0.53–0.56. The coarse H/V bands survive fully.
|
| 360 |
+
|
| 361 |
+
**Variants** (SWT Haar, 3 levels; each chosen band is multiplied by a factor α drawn from U(0, 1); the real and the fake of a training pair get the same draw):
|
| 362 |
+
|
| 363 |
+
| ID | Band probability q_b |
|
| 364 |
+
| --- | --- |
|
| 365 |
+
| DD | 0.3 for (HH, 1) only |
|
| 366 |
+
| CBA | 0.3 · (1 − s_b(5)), for the 9 detail bands (sum 0.97) |
|
| 367 |
+
| UBA | 0.108 for all 9 detail bands (the mean of CBA) |
|
| 368 |
+
|
| 369 |
+
**Proxy protocol:** the B4onA2 recipe (ViT-L/16, 5k iterations, seed 0, chain6), two folds (LTX, SKY). The test sets are 456 validation reals + 300 gen4 fakes of the held-out generator, both at the same chain12 depth d ∈ {1, 5, 10, 20}. S_deep = the mean AUC at d = 10 and 20. S_light = the AUC at d = 1. The values are the mean of the two folds. No mix label was used.
|
| 370 |
+
|
| 371 |
+
| Variant | S_light AUC / F1 | S_deep AUC / F1 | router_val AUC / F1 | ΔS_deep | ΔS_light | Δrouter_val | Pass |
|
| 372 |
+
| --- | --- | --- | --- | --- | --- | --- | --- |
|
| 373 |
+
| base (B4onA2) | 0.997 / 0.968 | 0.925 / 0.834 | 0.916 / 0.834 | — | — | — | — |
|
| 374 |
+
| DD | 0.998 / 0.979 | 0.922 / 0.824 | 0.906 / 0.823 | −0.003 | +0.001 | −0.010 | no |
|
| 375 |
+
| CBA | 0.997 / 0.972 | 0.921 / 0.825 | 0.909 / 0.817 | −0.004 | +0.000 | −0.007 | no |
|
| 376 |
+
| UBA | 0.997 / 0.977 | 0.918 / 0.816 | 0.902 / 0.823 | −0.007 | −0.000 | −0.014 | no |
|
| 377 |
+
|
| 378 |
+
Promotion rule: ΔS_deep ≥ +0.010, ΔS_light ≥ −0.005, Δrouter_val ≥ −0.010.
|
| 379 |
+
|
| 380 |
+
**Findings:**
|
| 381 |
+
- No variant passes. All three are slightly lower than the base at 10 and 20 re-encodes. At 20 re-encodes on fold LTX, the AUC is 0.848–0.862 vs 0.867, and the Macro F1 is 0.73–0.74 vs 0.79.
|
| 382 |
+
- At 1 re-encode, the AUC is the same, and the Macro F1 is approximately 0.01 higher.
|
| 383 |
+
- The chain-aware weighting (CBA) is not better than the uniform one (UBA) by the rule margin: ΔS_deep 0.004.
|
| 384 |
+
- Band test (240 validation reconstruction pairs, logit 0): with the FSWT diagonal bands replaced, the fake TPR increases from 0.39 (base) to 0.43–0.62 (CBA highest). The SWT diagonal results do not change. Thus, the attenuation decreases the reliance on the diagonal bands a little, but this does not improve the detection at many re-encodes.
|
| 385 |
+
|
| 386 |
+
**Decision:** the hypothesis is not supported. Phase 5 stops (PREREG_v2 Section 4, rule 3). F4 was not trained, mix was not scored a second time, and F3_s0 stays the main model.
|
| 387 |
+
|
| 388 |
+
**Deviations:** P5-D1 reuses the existing chain12 clips at d = 5, 10, 20 (a different seed formula; same distribution). P5-D2 trains two proxies per GPU (slower, same iterations). P5-D3 reruns the band test on the GPU (max |Δ logit| 0.025 vs the CPU version).
|
| 389 |
+
|
| 390 |
+
## 18. Files
|
| 391 |
|
| 392 |
Uploaded next to this log, under `aug_study/`:
|
| 393 |
|
|
|
|
| 404 |
- `phase3b/`: `g0_summary.md`, `selection.md`, `mixval_metrics.csv`, `attribution.csv`, `shift.csv`.
|
| 405 |
- `phase4/`: `mix_summary.md`, `mix_overall.csv`, `mix_groups.csv`, `mix_delta.csv`, `mix_shift.csv`, `band_reliance.csv`,
|
| 406 |
`mix_reference.md`, `mix_reference.csv`, `mix_reference_groups.csv`, `mix_reference_delta.csv`.
|
| 407 |
+
- Version 2.2 (Phase 5):
|
| 408 |
+
- `PREREG_v2.md`: the Phase 5 hypothesis, variants, promotion rule (written before any Phase 5 metric), and the result (Section 6).
|
| 409 |
+
- `phase5/`: `summary.md` (band survival, proxy tables, decision), `band_survival.csv`, `proxy_table.csv`, `proxy_results.csv`, `band_reliance.csv`.
|
| 410 |
+
- `FINAL_REPORT.md`: Section 6c added.
|
aug_study/FINAL_REPORT.md
CHANGED
|
@@ -179,6 +179,10 @@ E1 is the released WaveRep (DINOv2 ViT-B/14 reg4, stored MoE scores). D2wr is ou
|
|
| 179 |
- Confound: the backbone size is different (ViT-L vs ViT-B). Each model has one seed.
|
| 180 |
- The released WaveRep (E1) is the weakest pixel expert on mix: (E2, E1) is −0.090 AUC below (E2, F3_s0).
|
| 181 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 182 |
## 7. Recommendation
|
| 183 |
|
| 184 |
1. **Replace E3′ with F3_s0 in the mean-of-z fusion with D3.** On mix it gives +0.008 AUC (significant) and +0.004 Macro F1 (not significant).
|
|
|
|
| 179 |
- Confound: the backbone size is different (ViT-L vs ViT-B). Each model has one seed.
|
| 180 |
- The released WaveRep (E1) is the weakest pixel expert on mix: (E2, E1) is −0.090 AUC below (E2, F3_s0).
|
| 181 |
|
| 182 |
+
## 6c. Phase 5: chain-aware band attenuation (RUNBOOK v2.2; `phase5/summary.md`, `PREREG_v2.md`)
|
| 183 |
+
|
| 184 |
+
Proxy test on the B4onA2 recipe (5k iterations, two folds). Variants: DD (q = 0.3 on HH level 1), CBA (q_b = 0.3 (1 - s_b(5)) from the measured band survival), UBA (q = 0.108 on all 9 detail bands). No variant reached the S_deep gain of +0.010: every variant is lower than the base at 10 and 20 re-encodes (dS_deep DD -0.003, CBA -0.004, UBA -0.007), and DD and UBA also lose more than 0.010 on router_val. The hypothesis is not supported. F4 was not trained, mix was not scored again, and F3_s0 stays the main model. Band test: attenuation lowers the fake TPR loss under FSWT diagonal replacement (0.39 -> 0.43-0.62) but does not change the SWT diagonal results.
|
| 185 |
+
|
| 186 |
## 7. Recommendation
|
| 187 |
|
| 188 |
1. **Replace E3′ with F3_s0 in the mean-of-z fusion with D3.** On mix it gives +0.008 AUC (significant) and +0.004 Macro F1 (not significant).
|
aug_study/PREREG_v2.md
ADDED
|
@@ -0,0 +1,111 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# PREREG_v2: Phase 5 (chain-aware band attenuation), RUNBOOK v2.2 Section 12
|
| 2 |
+
|
| 3 |
+
Written 2026-10-28 16:10, before Step 5.0 and before any Phase 5 metric. Do not edit Sections 1–5 after the first proxy metric exists.
|
| 4 |
+
Section 6 (results) is filled later.
|
| 5 |
+
|
| 6 |
+
## 1. Hypothesis (copied from RUNBOOK 12)
|
| 7 |
+
Compared with the F3 recipe, chain-aware band attenuation (1) raises the AUC at 10 and 20 re-encodes, (2) keeps the AUC at 1 re-encode,
|
| 8 |
+
(3) lowers the reliance on the diagonal bands. The chain-aware weighting is also better than a uniform attenuation with the same average strength.
|
| 9 |
+
|
| 10 |
+
## 2. Variants (fixed)
|
| 11 |
+
`band_attenuate` in `src/bandrep.py`: SWT Haar, 3 levels; candidate bands = the 9 detail bands (LH, HL, HH at levels 1–3; level 1 = finest);
|
| 12 |
+
the lowest band (LL, 3) is never changed. Each candidate band b is chosen with probability q_b; a chosen band is multiplied by α ~ U(0, 1).
|
| 13 |
+
Both samples that the trainer yields together (the real and the fake of a reconstruction pair, or the real and the gen4 fake of a non-pair step)
|
| 14 |
+
get the same chosen bands and the same α. Order: chain variant → band replacement → band attenuation → blur / JPEG (crop is before band
|
| 15 |
+
replacement in `train_aug.py`, as in all earlier runs).
|
| 16 |
+
|
| 17 |
+
| ID | q_b |
|
| 18 |
+
| --- | --- |
|
| 19 |
+
| DD | 0.3 for (HH, 1), 0 for the others |
|
| 20 |
+
| CBA | 0.3 · (1 − s_b(5)); s_b from `phase5/band_survival.csv` (Y channel) |
|
| 21 |
+
| UBA | the mean of the 9 CBA values, for all 9 bands |
|
| 22 |
+
|
| 23 |
+
## 3. Proxy protocol (fixed)
|
| 24 |
+
- Base: the stored `runs/B4onA2_{LTX,SKY}_s0/best.pt` (not retrained).
|
| 25 |
+
- Runs: P5_{DD,CBA,UBA}_{LTX,SKY}_s0, the B4onA2 settings (ViT-L/16, 5k iterations, seed 0, chain6, `--pipeline paired --rule official
|
| 26 |
+
--donor auto --recon all --real_swap 0 --transform swt --wavelet haar --levels 3 --mask paper --mode hard --p_a 0.1 --p_b 0.1 --bs 32`)
|
| 27 |
+
plus `--band_atten <id>`. Checkpoint = `best.pt` (fold validation, as in all proxy runs).
|
| 28 |
+
- Scorer: the `eval_aug.py` protocol (16 uniform frames, 448 centre crop, video score = mean frame logit).
|
| 29 |
+
- Sets: `heldout_ltx_c12` (fold LTX) = 456 val reals + 300 ltx2 gen4 fakes; `heldout_sky_c12` (fold SKY) = 456 val reals + 300 skyreels3
|
| 30 |
+
gen4 fakes; both members of each AUC at the same chain12 depth d ∈ {1, 5, 10, 20}. router_val = `moe_data/manifest.csv` split router_val.
|
| 31 |
+
- Metrics (mean of fold LTX on `heldout_ltx_c12` and fold SKY on `heldout_sky_c12`):
|
| 32 |
+
S_deep = mean of the AUC at d = 10 and d = 20; S_light = the AUC at d = 1; router_val = the router_val AUC (mean of the two folds).
|
| 33 |
+
- Report only: the Phase 4 band-reliance test (240 val reconstruction pairs) with the FSWT groups (baseband / H-V / diagonal) and the SWT
|
| 34 |
+
groups (LL3 / LH+HL levels 1–3 / HH levels 1–3), at logit 0.
|
| 35 |
+
|
| 36 |
+
## 4. Promotion rule (copied from RUNBOOK 12.4)
|
| 37 |
+
1. A variant passes if S_deep ≥ base + 0.010, S_light ≥ base − 0.005, and router_val ≥ base − 0.010.
|
| 38 |
+
2. If more than one variant passes, promote the one with the highest S_deep. If CBA and UBA are within 0.005 in S_deep, promote UBA (the
|
| 39 |
+
simpler one), and record that the chain-aware weighting is not supported.
|
| 40 |
+
3. If no variant passes, stop Phase 5 and report the negative result. F3_s0 stays the main model.
|
| 41 |
+
|
| 42 |
+
## 5. F4 and the main-model rule (copied from RUNBOOK 12.5)
|
| 43 |
+
- F4 = the F3_s0 command (`src/launch_f3_gpu1.sh`: fold ALL, 20k iterations, chain12, `--bs 16 --accum 2`, SWT) plus the promoted
|
| 44 |
+
`--band_atten`. Seed 0; seed 1 if a GPU is free.
|
| 45 |
+
- Scored like the F models: router lists, mixval (all sets, also `mixval_gen`), splice sets, band-reliance test.
|
| 46 |
+
- Fusion on mixval as `phase3b_eval.py` (Platt on router calib_fit, mean of z with E2). `mixval_gen` = all mixval reals (656 per depth) and
|
| 47 |
+
the 114 gen4 validation fakes (family `gen4_*`), depths 1, 5, 10, 20 pooled.
|
| 48 |
+
- F4 replaces F3_s0 as the main model only if all three conditions hold, fused with E2, on mixval:
|
| 49 |
+
1. the mean AUC over `mixval_depth_10` and `mixval_depth_20` is at least 0.010 higher than for F3_s0;
|
| 50 |
+
2. the AUC on `mixval_main` is not more than 0.005 lower than for F3_s0;
|
| 51 |
+
3. the AUC on `mixval_gen` (all depths) is not more than 0.010 lower than for F3_s0.
|
| 52 |
+
If any condition fails, F3_s0 stays the main model and F4 is an ablation.
|
| 53 |
+
- mix: F4 is scored one time, after the decision is written in Section 6. Only F4_s0 (the seed-0 model, as F3_s0) is scored on mix;
|
| 54 |
+
F4_s1, if trained, is scored on the router lists and mixval only (seed variation). The main-model rule uses F4_s0. F1, F2, F3 are not scored again. The report states that this is a
|
| 55 |
+
second evaluation on mix, made after the first results were known.
|
| 56 |
+
|
| 57 |
+
## Deviations recorded before any metric
|
| 58 |
+
- P5-D1 (seed formula): the chain12 evaluation clips at d = 5, 10, 20 already exist (`phase1/eval_chain12/`, seed `crc32(f"{clip_id}-{d}")`).
|
| 59 |
+
They are reused (d = 20 used a derived seed; see the list). d = 1 is encoded with `crc32(f"{clip_id}-1")` (`lists/chain12_eval_h1.csv`). RUNBOOK 12.3 asks for `crc32(f"{clip_id}-{d}-c12")`; the seed only selects the
|
| 60 |
+
platform sequence, so the sets are equivalent in distribution. This avoids about 4,400 new chain encodes.
|
| 61 |
+
- P5-D2 (GPU packing): two proxy runs per GPU (GPUs 0, 1, 2), all 6 at the same time (RUNBOOK 12.6 allows this if each run loses < 30% of
|
| 62 |
+
its speed; measured in STATUS.md).
|
| 63 |
+
|
| 64 |
+
## 6. Results and decisions (filled later)
|
| 65 |
+
|
| 66 |
+
Written 2026-10-28 20:45 from `phase5/proxy_table.csv` (`src/p5_summary.py`).
|
| 67 |
+
- P5-D3 (GPU rule 3): the band test first ran as `src/p5_band.py` (CPU swaps, ~3 GB per GPU, below the 70 GB rule). It was stopped at 20:30 before it wrote any output and rerun as `src/p5_band_gpu.py` (same groups and frames; swaps on the GPU in float64; the 13 conditions of a pair in one bf16 forward; 7 pair shards per GPU, ~80 GB on GPUs 0/1). Check against phase4 F3_s0 scores on 2 pairs: max |diff| 0.025 (bf16). The proxy evals (`p5_eval.py`, ~3 GB per GPU, 18:46-20:28) also ran below 70 GB; their results are not affected.
|
| 68 |
+
|
| 69 |
+
|
| 70 |
+
## Proxy results (PREREG_v2 Sections 3-4; mean of fold LTX on heldout_ltx_c12 and fold SKY on heldout_sky_c12; Macro F1 at logit 0)
|
| 71 |
+
|
| 72 |
+
| variant | S_deep | S_deep_F1 | S_light | S_light_F1 | router_val | router_val_F1 | dS_deep | dS_light | drouter_val | pass |
|
| 73 |
+
|:----------|---------:|------------:|----------:|-------------:|-------------:|----------------:|----------:|-----------:|--------------:|-------:|
|
| 74 |
+
| base | 0.925 | 0.8335 | 0.9967 | 0.9677 | 0.9159 | 0.8336 | nan | nan | nan | nan |
|
| 75 |
+
| DD | 0.9223 | 0.8244 | 0.9975 | 0.9794 | 0.9055 | 0.8234 | -0.0027 | 0.0007 | -0.0103 | 0 |
|
| 76 |
+
| CBA | 0.9213 | 0.8245 | 0.9971 | 0.9718 | 0.9085 | 0.8166 | -0.0037 | 0.0004 | -0.0074 | 0 |
|
| 77 |
+
| UBA | 0.9176 | 0.8161 | 0.9965 | 0.9766 | 0.9024 | 0.8229 | -0.0074 | -0.0002 | -0.0135 | 0 |
|
| 78 |
+
|
| 79 |
+
Per fold and depth (AUC / Macro F1):
|
| 80 |
+
|
| 81 |
+
| | base | DD | CBA | UBA |
|
| 82 |
+
|:-------------------|:--------------|:--------------|:--------------|:--------------|
|
| 83 |
+
| LTX_d1_AUC | 0.996 / 0.964 | 0.997 / 0.977 | 0.996 / 0.967 | 0.995 / 0.974 |
|
| 84 |
+
| LTX_d5_AUC | 0.968 / 0.887 | 0.97 / 0.91 | 0.963 / 0.88 | 0.96 / 0.889 |
|
| 85 |
+
| LTX_d10_AUC | 0.922 / 0.829 | 0.926 / 0.836 | 0.919 / 0.827 | 0.915 / 0.821 |
|
| 86 |
+
| LTX_d20_AUC | 0.867 / 0.786 | 0.862 / 0.743 | 0.851 / 0.74 | 0.848 / 0.728 |
|
| 87 |
+
| LTX_router_val_AUC | 0.917 / 0.83 | 0.901 / 0.828 | 0.904 / 0.811 | 0.904 / 0.825 |
|
| 88 |
+
| SKY_d1_AUC | 0.998 / 0.971 | 0.998 / 0.982 | 0.999 / 0.977 | 0.998 / 0.979 |
|
| 89 |
+
| SKY_d5_AUC | 0.981 / 0.919 | 0.978 / 0.922 | 0.982 / 0.924 | 0.977 / 0.92 |
|
| 90 |
+
| SKY_d10_AUC | 0.966 / 0.892 | 0.964 / 0.894 | 0.972 / 0.903 | 0.965 / 0.892 |
|
| 91 |
+
| SKY_d20_AUC | 0.945 / 0.827 | 0.938 / 0.825 | 0.942 / 0.828 | 0.942 / 0.823 |
|
| 92 |
+
| SKY_router_val_AUC | 0.915 / 0.837 | 0.91 / 0.819 | 0.913 / 0.822 | 0.901 / 0.821 |
|
| 93 |
+
|
| 94 |
+
Thresholds: S_deep >= base + 0.010, S_light >= base - 0.005, router_val >= base - 0.010.
|
| 95 |
+
|
| 96 |
+
**Decision:** No variant passes. Phase 5 stops; F3_s0 stays the main model (PREREG_v2 Section 4, rule 3).
|
| 97 |
+
|
| 98 |
+
## Band test (report only; 240 val reconstruction pairs; logit 0). Real TNR after injection / fake TPR after replacement
|
| 99 |
+
|
| 100 |
+
| model | fswt_HV | fswt_baseband | fswt_diagonal | none | swt_HV | swt_baseband | swt_diagonal |
|
| 101 |
+
|:--------------|:--------------|:----------------|:----------------|:--------------|:--------------|:---------------|:---------------|
|
| 102 |
+
| B4onA2_LTX_s0 | 0.579 / 0.938 | 0.912 / 0.958 | 0.138 / 0.392 | 0.996 / 0.958 | 0.004 / 0.954 | 0.742 / 0.975 | 0.05 / 1.0 |
|
| 103 |
+
| B4onA2_SKY_s0 | 0.633 / 0.921 | 0.892 / 0.962 | 0.129 / 0.396 | 0.988 / 0.954 | 0.004 / 0.962 | 0.679 / 0.979 | 0.042 / 1.0 |
|
| 104 |
+
| P5_CBA_LTX_s0 | 0.446 / 0.925 | 0.912 / 0.962 | 0.138 / 0.554 | 0.988 / 0.962 | 0.004 / 0.958 | 0.725 / 0.975 | 0.1 / 0.996 |
|
| 105 |
+
| P5_CBA_SKY_s0 | 0.412 / 0.925 | 0.904 / 0.954 | 0.117 / 0.617 | 0.988 / 0.954 | 0.012 / 0.925 | 0.733 / 0.967 | 0.142 / 0.992 |
|
| 106 |
+
| P5_DD_LTX_s0 | 0.5 / 0.95 | 0.883 / 0.971 | 0.088 / 0.475 | 0.992 / 0.967 | 0.0 / 0.983 | 0.688 / 0.988 | 0.033 / 1.0 |
|
| 107 |
+
| P5_DD_SKY_s0 | 0.558 / 0.933 | 0.892 / 0.962 | 0.1 / 0.446 | 0.983 / 0.958 | 0.004 / 0.946 | 0.688 / 0.979 | 0.05 / 1.0 |
|
| 108 |
+
| P5_UBA_LTX_s0 | 0.575 / 0.942 | 0.925 / 0.962 | 0.112 / 0.454 | 0.983 / 0.962 | 0.012 / 0.946 | 0.717 / 0.988 | 0.096 / 0.992 |
|
| 109 |
+
| P5_UBA_SKY_s0 | 0.579 / 0.929 | 0.921 / 0.958 | 0.117 / 0.429 | 0.988 / 0.962 | 0.008 / 0.933 | 0.746 / 0.975 | 0.112 / 0.992 |
|
| 110 |
+
|
| 111 |
+
PROMOTION DECISION: no variant passes (best dS_deep = -0.0027, DD). Phase 5 stops here (Section 4, rule 3). F4 is not trained, nothing new is scored on mix, and F3_s0 stays the main model.
|
aug_study/phase5/band_reliance.csv
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model,band_group,n_pairs,TNR_real_inject_0,TPR_fake_replace_0,TNR_real_inject_thr,TPR_fake_replace_thr,median_real,median_fake,thr
|
| 2 |
+
B4onA2_LTX_s0,none,240,0.9958333333333332,0.9583333333333334,0.9958333333333332,0.9583333333333334,-6.282470703125,6.66845703125,0.0
|
| 3 |
+
B4onA2_LTX_s0,fswt_baseband,240,0.9125,0.9583333333333334,0.9125,0.9583333333333334,-5.0150146484375,6.83203125,0.0
|
| 4 |
+
B4onA2_LTX_s0,fswt_HV,240,0.5791666666666667,0.9375,0.5791666666666667,0.9375,-0.7902565002441406,4.8887939453125,0.0
|
| 5 |
+
B4onA2_LTX_s0,fswt_diagonal,240,0.1375,0.3916666666666666,0.1375,0.3916666666666666,3.42449951171875,-0.790191650390625,0.0
|
| 6 |
+
B4onA2_LTX_s0,swt_baseband,240,0.7416666666666667,0.975,0.7416666666666667,0.975,-3.493824005126953,6.9775390625,0.0
|
| 7 |
+
B4onA2_LTX_s0,swt_HV,240,0.0041666666666666,0.9541666666666668,0.0041666666666666,0.9541666666666668,7.15234375,5.9730224609375,0.0
|
| 8 |
+
B4onA2_LTX_s0,swt_diagonal,240,0.05,1.0,0.05,1.0,5.7266845703125,7.2431640625,0.0
|
| 9 |
+
B4onA2_SKY_s0,none,240,0.9875,0.9541666666666668,0.9875,0.9541666666666668,-6.201171875,6.708984375,0.0
|
| 10 |
+
B4onA2_SKY_s0,fswt_baseband,240,0.8916666666666667,0.9625,0.8916666666666667,0.9625,-4.7263946533203125,6.8017578125,0.0
|
| 11 |
+
B4onA2_SKY_s0,fswt_HV,240,0.6333333333333333,0.9208333333333332,0.6333333333333333,0.9208333333333332,-1.32769775390625,5.122589111328125,0.0
|
| 12 |
+
B4onA2_SKY_s0,fswt_diagonal,240,0.1291666666666666,0.3958333333333333,0.1291666666666666,0.3958333333333333,3.790771484375,-1.1031036376953125,0.0
|
| 13 |
+
B4onA2_SKY_s0,swt_baseband,240,0.6791666666666667,0.9791666666666666,0.6791666666666667,0.9791666666666666,-2.78662109375,7.0283203125,0.0
|
| 14 |
+
B4onA2_SKY_s0,swt_HV,240,0.0041666666666666,0.9625,0.0041666666666666,0.9625,6.947021484375,6.0196533203125,0.0
|
| 15 |
+
B4onA2_SKY_s0,swt_diagonal,240,0.0416666666666666,1.0,0.0416666666666666,1.0,5.86279296875,7.189453125,0.0
|
| 16 |
+
P5_CBA_LTX_s0,none,240,0.9875,0.9625,0.9875,0.9625,-6.11376953125,6.6220703125,0.0
|
| 17 |
+
P5_CBA_LTX_s0,fswt_baseband,240,0.9125,0.9625,0.9125,0.9625,-4.7177734375,6.6123046875,0.0
|
| 18 |
+
P5_CBA_LTX_s0,fswt_HV,240,0.4458333333333333,0.925,0.4458333333333333,0.925,0.323150634765625,4.56982421875,0.0
|
| 19 |
+
P5_CBA_LTX_s0,fswt_diagonal,240,0.1375,0.5541666666666667,0.1375,0.5541666666666667,3.15777587890625,0.4029464721679687,0.0
|
| 20 |
+
P5_CBA_LTX_s0,swt_baseband,240,0.725,0.975,0.725,0.975,-3.2724609375,6.86767578125,0.0
|
| 21 |
+
P5_CBA_LTX_s0,swt_HV,240,0.0041666666666666,0.9583333333333334,0.0041666666666666,0.9583333333333334,7.092041015625,5.3529052734375,0.0
|
| 22 |
+
P5_CBA_LTX_s0,swt_diagonal,240,0.1,0.9958333333333332,0.1,0.9958333333333332,4.36962890625,7.2578125,0.0
|
| 23 |
+
P5_CBA_SKY_s0,none,240,0.9875,0.9541666666666668,0.9875,0.9541666666666668,-5.9876708984375,6.33935546875,0.0
|
| 24 |
+
P5_CBA_SKY_s0,fswt_baseband,240,0.9041666666666668,0.9541666666666668,0.9041666666666668,0.9541666666666668,-4.786102294921875,6.4375,0.0
|
| 25 |
+
P5_CBA_SKY_s0,fswt_HV,240,0.4125,0.925,0.4125,0.925,0.6141204833984375,5.240966796875,0.0
|
| 26 |
+
P5_CBA_SKY_s0,fswt_diagonal,240,0.1166666666666666,0.6166666666666667,0.1166666666666666,0.6166666666666667,3.91717529296875,0.8315277099609375,0.0
|
| 27 |
+
P5_CBA_SKY_s0,swt_baseband,240,0.7333333333333333,0.9666666666666668,0.7333333333333333,0.9666666666666668,-2.969482421875,6.681640625,0.0
|
| 28 |
+
P5_CBA_SKY_s0,swt_HV,240,0.0125,0.925,0.0125,0.925,7.0556640625,5.865936279296875,0.0
|
| 29 |
+
P5_CBA_SKY_s0,swt_diagonal,240,0.1416666666666666,0.9916666666666668,0.1416666666666666,0.9916666666666668,4.436279296875,7.060546875,0.0
|
| 30 |
+
P5_DD_LTX_s0,none,240,0.9916666666666668,0.9666666666666668,0.9916666666666668,0.9666666666666668,-6.0235595703125,6.8798828125,0.0
|
| 31 |
+
P5_DD_LTX_s0,fswt_baseband,240,0.8833333333333333,0.9708333333333332,0.8833333333333333,0.9708333333333332,-4.60009765625,6.9744873046875,0.0
|
| 32 |
+
P5_DD_LTX_s0,fswt_HV,240,0.5,0.95,0.5,0.95,0.0202217102050781,5.336181640625,0.0
|
| 33 |
+
P5_DD_LTX_s0,fswt_diagonal,240,0.0875,0.475,0.0875,0.475,4.165069580078125,-0.1732940673828125,0.0
|
| 34 |
+
P5_DD_LTX_s0,swt_baseband,240,0.6875,0.9875,0.6875,0.9875,-3.115478515625,7.1865234375,0.0
|
| 35 |
+
P5_DD_LTX_s0,swt_HV,240,0.0,0.9833333333333332,0.0,0.9833333333333332,7.0791015625,6.27294921875,0.0
|
| 36 |
+
P5_DD_LTX_s0,swt_diagonal,240,0.0333333333333333,1.0,0.0333333333333333,1.0,6.0458984375,7.1669921875,0.0
|
| 37 |
+
P5_DD_SKY_s0,none,240,0.9833333333333332,0.9583333333333334,0.9833333333333332,0.9583333333333334,-6.2412109375,6.634246826171875,0.0
|
| 38 |
+
P5_DD_SKY_s0,fswt_baseband,240,0.8916666666666667,0.9625,0.8916666666666667,0.9625,-4.75537109375,6.7431640625,0.0
|
| 39 |
+
P5_DD_SKY_s0,fswt_HV,240,0.5583333333333333,0.9333333333333332,0.5583333333333333,0.9333333333333332,-0.737091064453125,5.5013427734375,0.0
|
| 40 |
+
P5_DD_SKY_s0,fswt_diagonal,240,0.1,0.4458333333333333,0.1,0.4458333333333333,4.315689086914063,-0.7057952880859375,0.0
|
| 41 |
+
P5_DD_SKY_s0,swt_baseband,240,0.6875,0.9791666666666666,0.6875,0.9791666666666666,-3.395610809326172,7.076171875,0.0
|
| 42 |
+
P5_DD_SKY_s0,swt_HV,240,0.0041666666666666,0.9458333333333332,0.0041666666666666,0.9458333333333332,7.134765625,6.203125,0.0
|
| 43 |
+
P5_DD_SKY_s0,swt_diagonal,240,0.05,1.0,0.05,1.0,5.848667144775391,7.2724609375,0.0
|
| 44 |
+
P5_UBA_LTX_s0,none,240,0.9833333333333332,0.9625,0.9833333333333332,0.9625,-5.22021484375,6.2119140625,0.0
|
| 45 |
+
P5_UBA_LTX_s0,fswt_baseband,240,0.925,0.9625,0.925,0.9625,-4.2708740234375,6.036865234375,0.0
|
| 46 |
+
P5_UBA_LTX_s0,fswt_HV,240,0.575,0.9416666666666668,0.575,0.9416666666666668,-0.405120849609375,3.88848876953125,0.0
|
| 47 |
+
P5_UBA_LTX_s0,fswt_diagonal,240,0.1125,0.4541666666666666,0.1125,0.4541666666666666,3.061767578125,-0.341552734375,0.0
|
| 48 |
+
P5_UBA_LTX_s0,swt_baseband,240,0.7166666666666667,0.9875,0.7166666666666667,0.9875,-2.491561889648437,6.565185546875,0.0
|
| 49 |
+
P5_UBA_LTX_s0,swt_HV,240,0.0125,0.9458333333333332,0.0125,0.9458333333333332,6.71929931640625,4.823974609375,0.0
|
| 50 |
+
P5_UBA_LTX_s0,swt_diagonal,240,0.0958333333333333,0.9916666666666668,0.0958333333333333,0.9916666666666668,4.031463623046875,6.876708984375,0.0
|
| 51 |
+
P5_UBA_SKY_s0,none,240,0.9875,0.9625,0.9875,0.9625,-6.0283203125,6.38818359375,0.0
|
| 52 |
+
P5_UBA_SKY_s0,fswt_baseband,240,0.9208333333333332,0.9583333333333334,0.9208333333333332,0.9583333333333334,-4.931396484375,6.3929443359375,0.0
|
| 53 |
+
P5_UBA_SKY_s0,fswt_HV,240,0.5791666666666667,0.9291666666666668,0.5791666666666667,0.9291666666666668,-0.6424560546875,4.85821533203125,0.0
|
| 54 |
+
P5_UBA_SKY_s0,fswt_diagonal,240,0.1166666666666666,0.4291666666666666,0.1166666666666666,0.4291666666666666,3.685150146484375,-0.4978981018066406,0.0
|
| 55 |
+
P5_UBA_SKY_s0,swt_baseband,240,0.7458333333333333,0.975,0.7458333333333333,0.975,-3.44390869140625,6.748291015625,0.0
|
| 56 |
+
P5_UBA_SKY_s0,swt_HV,240,0.0083333333333333,0.9333333333333332,0.0083333333333333,0.9333333333333332,7.064453125,5.63507080078125,0.0
|
| 57 |
+
P5_UBA_SKY_s0,swt_diagonal,240,0.1125,0.9916666666666668,0.1125,0.9916666666666668,4.796875,7.26513671875,0.0
|
aug_study/phase5/band_survival.csv
ADDED
|
@@ -0,0 +1,121 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
channel,band,hop,s_cogx,s_hunyuan15,s_ltx2,s_wan21,s_wan22,s
|
| 2 |
+
Cb,"('HH', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 3 |
+
Cb,"('HH', 1)",1,0.08285388775026824,3.070221617302532,0.019626559418547736,0.11077187903097584,0.69897136862942,0.11077187903097584
|
| 4 |
+
Cb,"('HH', 1)",5,1.2345863182566998,3.059168652264555,0.039979052743471445,0.14163607283268254,1.9089773521380429,1.0
|
| 5 |
+
Cb,"('HH', 1)",10,2.2132369834188346,4.628618896211335,0.0066448543004414265,0.19179336618259255,2.582633050096915,1.0
|
| 6 |
+
Cb,"('HH', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 7 |
+
Cb,"('HH', 2)",1,0.23179806475262885,8.366278802930779,0.066650312031823,0.1760416603173932,1.937563994284118,0.23179806475262885
|
| 8 |
+
Cb,"('HH', 2)",5,4.1351868349951735,9.791879950388765,0.1469394451359963,0.28012798211371387,9.36187922657911,1.0
|
| 9 |
+
Cb,"('HH', 2)",10,6.026924357188965,9.135338008431193,0.036761119011836776,0.31915923189132156,7.0119625888611345,1.0
|
| 10 |
+
Cb,"('HH', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 11 |
+
Cb,"('HH', 3)",1,0.5942523592260172,30.309868354645577,0.2046751385048964,0.22171923763004764,5.825140128293361,0.5942523592260172
|
| 12 |
+
Cb,"('HH', 3)",5,15.039314890861354,46.67297945302815,0.5040350082810485,0.6125644789713548,59.365454424218335,1.0
|
| 13 |
+
Cb,"('HH', 3)",10,16.153078015873337,24.50978173121657,0.20112614611579108,0.5235165184608397,24.750914820990783,1.0
|
| 14 |
+
Cb,"('HL', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 15 |
+
Cb,"('HL', 1)",1,0.07416065954549139,8.034943943997556,0.2803927934830189,0.11846994808916375,1.3323221913601164,0.2803927934830189
|
| 16 |
+
Cb,"('HL', 1)",5,6.6988780619872825,15.8992905499328,0.4614039549563757,0.22899200014304358,32.748071409158065,1.0
|
| 17 |
+
Cb,"('HL', 1)",10,14.693896774575538,11.589920616441905,0.26844564001496,0.36831877568060856,16.950197202630598,1.0
|
| 18 |
+
Cb,"('HL', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 19 |
+
Cb,"('HL', 2)",1,0.12346225572695745,28.282634811354708,0.7361370767659199,0.22867195718071362,4.58048216328574,0.7361370767659199
|
| 20 |
+
Cb,"('HL', 2)",5,10.181960919624617,62.322021880243554,1.1000105412822516,0.45639607425934886,140.13631519606577,1.0
|
| 21 |
+
Cb,"('HL', 2)",10,17.26286458462171,37.54403966998099,0.719685588239743,0.5599845248788209,54.18076372666034,1.0
|
| 22 |
+
Cb,"('HL', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 23 |
+
Cb,"('HL', 3)",1,0.2413739192179962,129.5518334603414,1.2689083832041088,0.5147995703848255,27.79148608331432,1.0
|
| 24 |
+
Cb,"('HL', 3)",5,15.782880042659249,313.7462774542703,1.8248136734204898,1.0541500014589689,728.1884319199387,1.0
|
| 25 |
+
Cb,"('HL', 3)",10,17.759030910321236,145.19651003684592,1.267790800610352,0.9469728225147873,203.95407270418954,1.0
|
| 26 |
+
Cb,"('LH', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 27 |
+
Cb,"('LH', 1)",1,0.4156249785138336,10.080706951060883,0.16866426296236603,0.21246646220153825,3.734645147487253,0.4156249785138336
|
| 28 |
+
Cb,"('LH', 1)",5,6.435932154975864,13.92499039481933,0.26414338917834024,0.3273136956493877,14.454712962570415,1.0
|
| 29 |
+
Cb,"('LH', 1)",10,9.213124569222217,16.229779881415094,0.16456014926906762,0.3714290806537858,8.702933053875748,1.0
|
| 30 |
+
Cb,"('LH', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 31 |
+
Cb,"('LH', 2)",1,0.9839506708075437,29.98053992628971,0.7565767297399476,0.26651725389845327,12.180142021851461,0.9839506708075437
|
| 32 |
+
Cb,"('LH', 2)",5,16.92685825699756,52.18312643527037,1.1280959540600055,0.5139583289138662,81.27283682824867,1.0
|
| 33 |
+
Cb,"('LH', 2)",10,18.19825010089827,22.66930238103456,0.7234626580802853,0.4706441076443434,28.35621052642151,1.0
|
| 34 |
+
Cb,"('LH', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 35 |
+
Cb,"('LH', 3)",1,1.213846309080073,92.3143599542072,1.461968509154193,0.40120871635698585,39.12369817249215,1.0
|
| 36 |
+
Cb,"('LH', 3)",5,29.371297206856877,237.89696874647302,2.1009114606630632,0.9881863346505085,429.1934400807757,1.0
|
| 37 |
+
Cb,"('LH', 3)",10,27.652472319878694,49.99928656320469,1.4945375044697247,0.8600275961772453,105.70507299225626,1.0
|
| 38 |
+
Cb,"('LL', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 39 |
+
Cb,"('LL', 3)",1,0.8000009210740189,522.0083977513606,0.45487060408943325,0.329044446808917,318.6999685463213,0.8000009210740189
|
| 40 |
+
Cb,"('LL', 3)",5,60.24322948652297,1457.4253141747993,3.0669609465939893,1.0757508760282766,4106.740255715395,1.0
|
| 41 |
+
Cb,"('LL', 3)",10,80.0064021994006,468.3530866680942,0.09212998176444989,0.8292284585824496,1032.8814690959662,1.0
|
| 42 |
+
Cr,"('HH', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 43 |
+
Cr,"('HH', 1)",1,0.224765045383618,0.849881869977547,0.0019543050848834856,0.06082219100108032,0.04288928093068377,0.06082219100108032
|
| 44 |
+
Cr,"('HH', 1)",5,1.1595542236174032,1.6383837867606128,0.004811222793935197,0.05175485537266886,0.08533827405399995,0.08533827405399995
|
| 45 |
+
Cr,"('HH', 1)",10,2.8566120485523516,2.8203168010088002,0.0017667963250348488,0.01252779783349138,3.2854002652410124,1.0
|
| 46 |
+
Cr,"('HH', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 47 |
+
Cr,"('HH', 2)",1,0.610583449495981,2.746388424260489,0.016845113875621754,0.11736258288231632,0.1688414702259533,0.1688414702259533
|
| 48 |
+
Cr,"('HH', 2)",5,4.223384516521558,4.327730318066916,0.026261692059618178,0.1595776735228985,0.3933202204955632,0.3933202204955632
|
| 49 |
+
Cr,"('HH', 2)",10,7.537702049684263,7.643053578877268,0.015142599734307195,0.026126873268716457,8.108742779871434,1.0
|
| 50 |
+
Cr,"('HH', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 51 |
+
Cr,"('HH', 3)",1,1.5887633888418011,8.138839994707,0.09986717525468221,0.21326093733488682,0.3240215991123905,0.3240215991123905
|
| 52 |
+
Cr,"('HH', 3)",5,15.34676530631792,13.436654532144804,0.11582139606656376,0.6465022569561057,1.5769336902870454,1.0
|
| 53 |
+
Cr,"('HH', 3)",10,17.287409696784117,18.326750536822175,0.10038601045288058,0.0767738757575656,17.853276308511752,1.0
|
| 54 |
+
Cr,"('HL', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 55 |
+
Cr,"('HL', 1)",1,0.2932802796343201,2.208375660734241,0.05823259254042943,0.08633345688021807,0.025007074356076714,0.08633345688021807
|
| 56 |
+
Cr,"('HL', 1)",5,8.323046520137357,3.616485465468805,0.07455117280478513,0.34760262005706977,1.1185548353666197,1.0
|
| 57 |
+
Cr,"('HL', 1)",10,23.966438308591798,4.239928113552925,0.04759812860269122,0.047913270302317935,6.231341996437254,1.0
|
| 58 |
+
Cr,"('HL', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 59 |
+
Cr,"('HL', 2)",1,0.4483478457173604,8.053177954382528,0.17147093811509415,0.1953401312536316,0.07904869270945446,0.1953401312536316
|
| 60 |
+
Cr,"('HL', 2)",5,13.316721865851747,13.060861672204267,0.18137980766471787,0.7838796715046109,4.756245979326558,1.0
|
| 61 |
+
Cr,"('HL', 2)",10,28.436182726893986,11.919575870232316,0.1418005034235861,0.11502171668413914,15.168946740188202,1.0
|
| 62 |
+
Cr,"('HL', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 63 |
+
Cr,"('HL', 3)",1,0.7682694125717537,30.929900636708084,0.5254948626818192,0.49199588060613825,0.30929466985241333,0.5254948626818192
|
| 64 |
+
Cr,"('HL', 3)",5,21.668713088344184,61.00614087243635,0.5400799574499223,1.7249933064589422,22.994242540403828,1.0
|
| 65 |
+
Cr,"('HL', 3)",10,27.98153584888119,42.2360874915597,0.45573210979700035,0.2574299059905721,52.78830780828769,1.0
|
| 66 |
+
Cr,"('LH', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 67 |
+
Cr,"('LH', 1)",1,0.6947855325323048,3.3351828369197425,0.034013163942106385,0.1664513599792473,0.04341012544654723,0.1664513599792473
|
| 68 |
+
Cr,"('LH', 1)",5,5.972283599764446,5.4173669138354965,0.035294621802020656,0.2651060955435793,0.23674082823632273,0.2651060955435793
|
| 69 |
+
Cr,"('LH', 1)",10,10.105746765513645,10.867493106649588,0.03151087843477558,0.028721013640187146,11.063370453967304,1.0
|
| 70 |
+
Cr,"('LH', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 71 |
+
Cr,"('LH', 2)",1,1.6306640142721618,9.099721161875081,0.16446808695121237,0.26359097064513276,0.13513662232965543,0.26359097064513276
|
| 72 |
+
Cr,"('LH', 2)",5,14.577768946349915,13.695175074607352,0.1609543167342964,0.7036863066960434,1.1158282403475364,1.0
|
| 73 |
+
Cr,"('LH', 2)",10,16.256119044521256,16.531122560644327,0.15082664817204602,0.05779714500647623,26.561917173790075,1.0
|
| 74 |
+
Cr,"('LH', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 75 |
+
Cr,"('LH', 3)",1,1.6856009885872019,21.432797330910734,0.42425563198502036,0.38703464338249943,0.36294873149886997,0.42425563198502036
|
| 76 |
+
Cr,"('LH', 3)",5,29.5382840976311,40.80401398473341,0.40426086453807036,1.326358567827823,4.999203120081547,1.0
|
| 77 |
+
Cr,"('LH', 3)",10,26.855827135553543,31.4423867623685,0.4136424012806819,0.10864240617548969,62.27140905005455,1.0
|
| 78 |
+
Cr,"('LL', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 79 |
+
Cr,"('LL', 3)",1,1.3696277194852868,73.68379804173867,0.008353609668570485,0.03203566779813548,2.2230288799986484,1.0
|
| 80 |
+
Cr,"('LL', 3)",5,63.41909399557474,226.82879594960812,1.5112589274034027,0.14583900753741183,78.81911133192168,1.0
|
| 81 |
+
Cr,"('LL', 3)",10,80.76608125855763,131.3645983572737,0.009586091579561506,0.0050174649359326084,315.2539604112116,1.0
|
| 82 |
+
Y,"('HH', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 83 |
+
Y,"('HH', 1)",1,0.061176235357916484,1.2065575574166008,0.02043038368478203,0.010884666526070941,1.0529646007649727,0.061176235357916484
|
| 84 |
+
Y,"('HH', 1)",5,0.07231594128232664,1.4234462642486894,0.015382838682491061,0.014646478515506035,1.2318915981697842,0.07231594128232664
|
| 85 |
+
Y,"('HH', 1)",10,0.079246608171326,1.556282578552365,0.011390642604903262,0.02779992356662473,1.3592168659651127,0.079246608171326
|
| 86 |
+
Y,"('HH', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 87 |
+
Y,"('HH', 2)",1,0.047241363476736076,1.2208320772442403,0.12703039736642627,0.013583814316028238,1.2107246224660941,0.12703039736642627
|
| 88 |
+
Y,"('HH', 2)",5,0.06945895355307255,1.7390435428284918,0.10264392692238701,0.02836943778342255,1.7879947441449986,0.10264392692238701
|
| 89 |
+
Y,"('HH', 2)",10,0.08856272884554363,2.1908716421926195,0.07899799306316109,0.09390584248907376,2.2933303845220308,0.09390584248907376
|
| 90 |
+
Y,"('HH', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 91 |
+
Y,"('HH', 3)",1,0.018864402067103506,1.2217821860547584,0.6622836668006271,0.042233673597704774,1.280502661339718,0.6622836668006271
|
| 92 |
+
Y,"('HH', 3)",5,0.03145547182809213,1.9170180398129844,0.5739255674069219,0.11534356893472197,2.171619086689799,0.5739255674069219
|
| 93 |
+
Y,"('HH', 3)",10,0.0448344463746775,2.6893970002493237,0.5144278016874332,0.5244119050197676,3.123169607995873,0.5244119050197676
|
| 94 |
+
Y,"('HL', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 95 |
+
Y,"('HL', 1)",1,0.0007312465614122507,1.1978422658901449,0.6050759236253503,0.11059163741470517,1.1593114061114898,0.6050759236253503
|
| 96 |
+
Y,"('HL', 1)",5,0.0012464215388791658,1.9936035481796401,0.5639608938383195,0.12229484590242758,1.974986872439658,0.5639608938383195
|
| 97 |
+
Y,"('HL', 1)",10,0.001816810988456687,2.886112448406845,0.6255304849520571,0.13177615751790506,2.9038711603148712,0.6255304849520571
|
| 98 |
+
Y,"('HL', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 99 |
+
Y,"('HL', 2)",1,0.00032465141564713067,1.1953341048597799,0.8967730625895751,0.1373543022107418,1.2101470414517856,0.8967730625895751
|
| 100 |
+
Y,"('HL', 2)",5,0.0005753038631555262,2.04147733691884,0.9219369685468574,0.1502276818283002,2.1930187789858504,0.9219369685468574
|
| 101 |
+
Y,"('HL', 2)",10,0.0008899643858896415,3.1285070055365463,1.0176665221514467,0.16206939041240884,3.4454409063552762,1.0
|
| 102 |
+
Y,"('HL', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 103 |
+
Y,"('HL', 3)",1,0.00011810390579789224,1.1926045063680963,1.0304265745861936,0.16795612568315654,1.272508524438147,1.0
|
| 104 |
+
Y,"('HL', 3)",5,0.0002195577678145927,2.1659141698712587,1.1070595425838756,0.18057118941123876,2.5163481986028495,1.0
|
| 105 |
+
Y,"('HL', 3)",10,0.00034535767271157543,3.4397860216166167,1.150023745203025,0.19566692888751877,4.096411130215199,1.0
|
| 106 |
+
Y,"('LH', 1)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 107 |
+
Y,"('LH', 1)",1,0.005721194355578225,1.1745675221569534,0.5823667882644751,0.054053807313037175,1.138388449330217,0.5823667882644751
|
| 108 |
+
Y,"('LH', 1)",5,0.009310668872742267,1.8642617075598695,0.5265999097324885,0.029520433723330065,1.853789388762107,0.5265999097324885
|
| 109 |
+
Y,"('LH', 1)",10,0.013249341583510573,2.6177250196406847,0.5341137336036204,0.1034023586121118,2.6512962153480686,0.5341137336036204
|
| 110 |
+
Y,"('LH', 2)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 111 |
+
Y,"('LH', 2)",1,0.004009270570799208,1.1534089607606788,1.2332700497111462,0.11814499822439864,1.1625384965667236,1.0
|
| 112 |
+
Y,"('LH', 2)",5,0.006791773664752086,1.885434167947114,1.1365161895666598,0.06027082858033109,2.018248057120383,1.0
|
| 113 |
+
Y,"('LH', 2)",10,0.010231095917517056,2.7965620386580827,1.1682210344419872,0.21036228038920865,3.0803658061071446,1.0
|
| 114 |
+
Y,"('LH', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 115 |
+
Y,"('LH', 3)",1,0.001232923892197724,1.1503003140625108,1.3399064122905184,0.1811001608787034,1.2015306606398866,1.0
|
| 116 |
+
Y,"('LH', 3)",5,0.00225448880701275,2.048896363915531,1.2560189836166926,0.08266237952716658,2.32799813703214,1.0
|
| 117 |
+
Y,"('LH', 3)",10,0.00350102484796935,3.1845909757791953,1.2649377989005872,0.27734298379641736,3.726208226613707,1.0
|
| 118 |
+
Y,"('LL', 3)",0,1.0,1.0,1.0,1.0,1.0,1.0
|
| 119 |
+
Y,"('LL', 3)",1,0.5060831564298548,1.4029857591256465,0.640073991230632,0.09389896927375252,1.2527347023728013,0.640073991230632
|
| 120 |
+
Y,"('LL', 3)",5,1.23607922674529,3.30370632043842,0.7187256008285272,0.14602092474360165,3.2784255631361363,1.0
|
| 121 |
+
Y,"('LL', 3)",10,1.2619252226880509,5.590478803807807,0.8303233922954883,0.22152958467233738,5.47099794468624,1.0
|
aug_study/phase5/proxy_results.csv
ADDED
|
@@ -0,0 +1,73 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
run_id,phase,stage,variant_id,fold,seed,backbone,iters,eval_set,hop,auc,bacc,tpr_at_1fpr,nll,ece,frame_auc,n_real,n_fake,ckpt_path,timestamp,notes
|
| 2 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.9948318713450293,0.9757456140350877,0.8333333333333334,0.09277829522299784,0.026428812964469528,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.9739
|
| 3 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.9992763157894737,0.984078947368421,0.97,0.06867837389837458,0.03283359689721789,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.9808
|
| 4 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.959656432748538,0.8906578947368421,0.44666666666666666,0.25964828480764046,0.028431647215728408,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.8886
|
| 5 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.9917909356725146,0.9406578947368421,0.8733333333333333,0.1767098166061,0.07670700868650797,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.9309
|
| 6 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9154459064327486,0.8284649122807017,0.31333333333333335,0.3806137630500228,0.05766181950334204,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.8210
|
| 7 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9889729532163742,0.9034649122807017,0.76,0.2609054328797221,0.12770217801961634,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.8838
|
| 8 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.8479422514619884,0.7535526315789474,0.17333333333333334,0.6020762735815157,0.16148904949505494,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.7285
|
| 9 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.9701900584795322,0.8135526315789473,0.6066666666666667,0.5023633586428351,0.22342421046936164,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.7764
|
| 10 |
+
P5_UBA_LTX_s0,5,P5,P5_UBA,LTX,0,dinov3_vitl16,5000,router_val,-1,0.9040907891264187,0.8035259963050936,0.5688888888888889,0.5103957200830697,0.11339138313009182,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_LTX_s0/best.pt,2026-10-28 18:54:21,macro_f1=0.8248
|
| 11 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.9956432748538011,0.9674122807017544,0.8533333333333334,0.08259376323662258,0.013990215962092389,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.9669
|
| 12 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.9991374269005847,0.9824122807017543,0.9666666666666667,0.05658329194449362,0.02174116717405104,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.9794
|
| 13 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.962938596491228,0.8766228070175439,0.51,0.24576725276749428,0.029147708138066622,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.8800
|
| 14 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.9932090643274853,0.9482894736842106,0.9166666666666666,0.14198102897110706,0.056206674847219674,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.9414
|
| 15 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9194480994152046,0.8270175438596491,0.35,0.36186064052108796,0.035308261337892076,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.8272
|
| 16 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9891374269005848,0.9236842105263158,0.7966666666666666,0.21354357928882886,0.09644428567675054,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.9098
|
| 17 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.8510745614035087,0.7594298245614035,0.18,0.5869307629331373,0.1439927257104683,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.7396
|
| 18 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.973391812865497,0.8310964912280701,0.61,0.4705490397678832,0.2103645852988674,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.7976
|
| 19 |
+
P5_CBA_LTX_s0,5,P5,P5_CBA,LTX,0,dinov3_vitl16,5000,router_val,-1,0.9037951966218,0.789158089205595,0.5777777777777777,0.5821971481774275,0.12639985177896618,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_LTX_s0/best.pt,2026-10-28 18:56:10,macro_f1=0.8112
|
| 20 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.9995540935672514,0.9862719298245614,0.9933333333333333,0.04210272225733475,0.019820194735768275,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.9835
|
| 21 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.9985526315789474,0.977938596491228,0.9566666666666667,0.05384393343911383,0.015578646967975954,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.9766
|
| 22 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.9884941520467837,0.9443859649122808,0.77,0.14564005002416683,0.03580025061176567,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.9386
|
| 23 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.9819078947368421,0.9277192982456142,0.7866666666666666,0.17483815171299427,0.026113786732176767,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.9245
|
| 24 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9697002923976609,0.906798245614035,0.4766666666666667,0.23314056209916503,0.043801423137583756,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.9017
|
| 25 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9722624269005848,0.9084649122807017,0.5333333333333333,0.22783660866944094,0.04872892974388031,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.9031
|
| 26 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.9189327485380118,0.8338157894736843,0.17666666666666667,0.4254768236366097,0.11654234218790575,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.8170
|
| 27 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.9423026315789473,0.8471491228070176,0.3233333333333333,0.3977381152246534,0.1334728115686664,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.8280
|
| 28 |
+
P5_CBA_SKY_s0,5,P5,P5_CBA,SKY,0,dinov3_vitl16,5000,router_val,-1,0.9131802586434414,0.7983531274742676,0.6044444444444445,0.5459492704874314,0.11695335724682263,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_CBA_SKY_s0/best.pt,2026-10-28 18:56:22,macro_f1=0.8220
|
| 29 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.9955043859649123,0.965219298245614,0.8766666666666667,0.08208175498563193,0.018661937033314063,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.9642
|
| 30 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.9990789473684211,0.9785526315789473,0.97,0.05598317441620917,0.020879984140967724,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.9753
|
| 31 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.9676535087719298,0.8809210526315789,0.49,0.23788575149467245,0.035665257355917704,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.8874
|
| 32 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.9907748538011697,0.9542543859649123,0.8266666666666667,0.12683359563772453,0.03288467382647531,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.9506
|
| 33 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9222478070175438,0.8210964912280702,0.2833333333333333,0.36779750590073285,0.05479286143940593,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.8291
|
| 34 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9877997076023391,0.9377631578947367,0.6866666666666666,0.1649073402420587,0.04995525555645743,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.9318
|
| 35 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.8669298245614034,0.7890789473684211,0.27666666666666667,0.4765247674419442,0.07936223486941012,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.7855
|
| 36 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.9711732456140351,0.8874122807017544,0.7366666666666667,0.3083942994635821,0.12290304811996597,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.8690
|
| 37 |
+
B4onA2_LTX_s0,5,P5,B4,LTX,0,dinov3_vitl16,5000,router_val,-1,0.9166798627606229,0.8062074425969913,0.6133333333333333,0.5642027884217891,0.11804215876449003,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_LTX_s0/best.pt,2026-10-28 18:59:25,macro_f1=0.8301
|
| 38 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.999312865497076,0.981359649122807,0.9966666666666667,0.05696273527728553,0.025544285113928165,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.9767
|
| 39 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.9979824561403509,0.9746929824561404,0.95,0.06813523668409159,0.018528283834851608,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.9712
|
| 40 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.9911769005847952,0.9566228070175439,0.7966666666666666,0.13832876498419971,0.04192808023087248,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.9483
|
| 41 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.9811038011695906,0.9216228070175438,0.78,0.17863031580666772,0.029682264727338266,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.9190
|
| 42 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9657090643274855,0.9107456140350877,0.45666666666666667,0.25031939706364437,0.05060818573095338,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.9034
|
| 43 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9658187134502924,0.8974122807017544,0.47,0.2491601570351921,0.05054602029156828,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.8922
|
| 44 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.9163596491228071,0.8217105263157894,0.3233333333333333,0.4297179571861369,0.12526475456321523,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.8039
|
| 45 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.9450000000000001,0.8500438596491228,0.38,0.39390714357162965,0.14389492318073593,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.8272
|
| 46 |
+
B4onA2_SKY_s0,5,P5,B4,SKY,0,dinov3_vitl16,5000,router_val,-1,0.9150277117973079,0.8158247558722618,0.5288888888888889,0.5552090146759868,0.1146271200129768,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/B4onA2_SKY_s0/best.pt,2026-10-28 18:59:26,macro_f1=0.8370
|
| 47 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.9994736842105264,0.9890350877192983,0.9966666666666667,0.04903504194661133,0.022674257201807824,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.9863
|
| 48 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.9979751461988304,0.9840350877192983,0.96,0.0631052261788879,0.01786655499033195,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.9821
|
| 49 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.9897149122807019,0.9510526315789474,0.78,0.14171424166290317,0.03857616376545693,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.9441
|
| 50 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.9780921052631578,0.9243859649122808,0.7633333333333333,0.18611741251327288,0.02295315876189206,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.9217
|
| 51 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9646637426900584,0.9161842105263158,0.44,0.24580472580407606,0.04713670719198134,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.9112
|
| 52 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9636147660818714,0.8961842105263158,0.5066666666666667,0.25180335767830786,0.03841555165373301,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.8941
|
| 53 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.9067397660818713,0.8145175438596493,0.25666666666666665,0.44810614202372673,0.12306233783247608,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.7972
|
| 54 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.9375219298245614,0.8478508771929825,0.38,0.41154049519925606,0.14423673205747806,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.8246
|
| 55 |
+
P5_DD_SKY_s0,5,P5,P5_DD,SKY,0,dinov3_vitl16,5000,router_val,-1,0.9103985220374771,0.7959778305621535,0.5466666666666666,0.5714856453306415,0.12126511745962197,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_SKY_s0/best.pt,2026-10-28 19:01:01,macro_f1=0.8188
|
| 56 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.9994663742690059,0.9901315789473685,0.9866666666666667,0.04783522682486191,0.022059529778306122,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.9876
|
| 57 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.998157894736842,0.9801315789473685,0.9266666666666666,0.0618327035159892,0.018202674323840727,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.9793
|
| 58 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.9868311403508773,0.9510087719298246,0.6733333333333333,0.1577255140961377,0.04218650124868544,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.9454
|
| 59 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.9768274853801169,0.9210087719298247,0.69,0.19853499596367194,0.02887028329340474,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.9200
|
| 60 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9671454678362573,0.9051754385964912,0.5033333333333333,0.24319654148111733,0.046091777723400854,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.8991
|
| 61 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9650804093567251,0.8968421052631579,0.55,0.2486643544697371,0.04588748884224702,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.8921
|
| 62 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.9193201754385965,0.8200000000000001,0.31,0.4097296139060596,0.10759336332834901,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.8036
|
| 63 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.941812865497076,0.8433333333333333,0.4033333333333333,0.38186550442098266,0.12465029477915436,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.8229
|
| 64 |
+
P5_UBA_SKY_s0,5,P5,P5_UBA,SKY,0,dinov3_vitl16,5000,router_val,-1,0.9006281340723146,0.7982000527843758,0.5466666666666666,0.5873225512422388,0.12136701241008731,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_UBA_SKY_s0/best.pt,2026-10-28 19:04:29,macro_f1=0.8210
|
| 65 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,1,0.9969444444444445,0.9785087719298246,0.9033333333333333,0.07164623338061449,0.01260107575432848,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.9766
|
| 66 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,1,0.9995029239766082,0.9868421052631579,0.98,0.052301005904694275,0.022922365556633652,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.9835
|
| 67 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,5,0.9704824561403509,0.9058771929824561,0.6633333333333333,0.22119862275380117,0.030773820328432584,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.9105
|
| 68 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,5,0.993764619883041,0.9675438596491228,0.9566666666666667,0.1261494430981796,0.050326097953729526,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.9630
|
| 69 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,10,0.9261915204678361,0.8341228070175438,0.2866666666666667,0.34404195110393976,0.03378510593421874,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.8360
|
| 70 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,10,0.9910380116959064,0.9324561403508772,0.7666666666666667,0.18931219826061918,0.08440155802028519,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.9204
|
| 71 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_ltx_c12,20,0.8617105263157895,0.7587280701754386,0.17666666666666667,0.5368368538675852,0.13189919726558463,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.7427
|
| 72 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,heldout_sky_c12,20,0.9788230994152046,0.8353947368421053,0.6933333333333334,0.4099195372182679,0.1897396474840149,,456,300,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.8054
|
| 73 |
+
P5_DD_LTX_s0,5,P5,P5_DD,LTX,0,dinov3_vitl16,5000,router_val,-1,0.9006598046978094,0.8059012932172076,0.5688888888888889,0.5808384929880595,0.11590560224633836,,421,225,/data/xinyuan/xr/model/vf_model/claude_workspace/aug_study/runs/P5_DD_LTX_s0/best.pt,2026-10-28 19:04:32,macro_f1=0.8280
|
aug_study/phase5/proxy_table.csv
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
variant,LTX_d1_AUC,LTX_d1_F1,LTX_d5_AUC,LTX_d5_F1,LTX_d10_AUC,LTX_d10_F1,LTX_d20_AUC,LTX_d20_F1,LTX_router_val_AUC,LTX_router_val_F1,LTX_S_deep,SKY_d1_AUC,SKY_d1_F1,SKY_d5_AUC,SKY_d5_F1,SKY_d10_AUC,SKY_d10_F1,SKY_d20_AUC,SKY_d20_F1,SKY_router_val_AUC,SKY_router_val_F1,SKY_S_deep,S_deep,S_light,router_val,S_deep_F1,S_light_F1,router_val_F1
|
| 2 |
+
base,0.9955043859649124,0.9642,0.9676535087719298,0.8874,0.9222478070175438,0.8291,0.8669298245614034,0.7855,0.9166798627606229,0.8301,0.8945888157894737,0.9979824561403507,0.9712,0.9811038011695906,0.919,0.9658187134502924,0.8922,0.945,0.8272,0.915027711797308,0.837,0.9554093567251462,0.9249990862573099,0.9967434210526316,0.9158537872789654,0.8334999999999999,0.9677,0.83355
|
| 3 |
+
DD,0.9969444444444444,0.9766,0.9704824561403508,0.9105,0.926191520467836,0.836,0.8617105263157895,0.7427,0.9006598046978094,0.828,0.8939510233918128,0.9979751461988304,0.9821,0.9780921052631578,0.9217,0.9636147660818714,0.8941,0.9375219298245614,0.8246,0.9103985220374772,0.8188,0.9505683479532163,0.9222596856725145,0.9974597953216374,0.9055291633676432,0.8243499999999999,0.9793499999999999,0.8233999999999999
|
| 4 |
+
CBA,0.9956432748538012,0.9669,0.962938596491228,0.88,0.9194480994152046,0.8272,0.8510745614035087,0.7396,0.9037951966218,0.8112,0.8852613304093566,0.9985526315789474,0.9766,0.981907894736842,0.9245,0.9722624269005848,0.9031,0.9423026315789472,0.828,0.9131802586434414,0.822,0.957282529239766,0.9212719298245613,0.9970979532163743,0.9084877276326206,0.824475,0.97175,0.8166
|
| 5 |
+
UBA,0.9948318713450292,0.9739,0.959656432748538,0.8886,0.9154459064327486,0.821,0.8479422514619884,0.7285,0.9040907891264188,0.8248,0.8816940789473685,0.998157894736842,0.9793,0.9768274853801168,0.92,0.9650804093567252,0.8921,0.941812865497076,0.8229,0.9006281340723146,0.821,0.9534466374269006,0.9175703581871346,0.9964948830409356,0.9023594615993666,0.816125,0.9765999999999999,0.8229
|
aug_study/phase5/summary.md
ADDED
|
@@ -0,0 +1,97 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Phase 5 summary
|
| 2 |
+
|
| 3 |
+
## Step 5.0: band survival s_b(h) = D_b(h) / D_b(0), median over 5 VAEs (cogx, hunyuan15, ltx2, wan21, wan22), clipped to [0, 1]
|
| 4 |
+
|
| 5 |
+
Source: `phase0/band_stats.csv` (SWT Haar L3, chain6 re-encodes, 200 pairs per VAE). Level 1 = finest. LL3 is never attenuated.
|
| 6 |
+
|
| 7 |
+
### Y
|
| 8 |
+
|
| 9 |
+
| band | 1 | 5 | 10 | q_CBA | q_UBA |
|
| 10 |
+
|:----------|------:|------:|------:|--------:|--------:|
|
| 11 |
+
| ('LH', 1) | 0.582 | 0.527 | 0.534 | 0.142 | 0.108 |
|
| 12 |
+
| ('HL', 1) | 0.605 | 0.564 | 0.626 | 0.131 | 0.108 |
|
| 13 |
+
| ('HH', 1) | 0.061 | 0.072 | 0.079 | 0.278 | 0.108 |
|
| 14 |
+
| ('LH', 2) | 1 | 1 | 1 | 0 | 0.108 |
|
| 15 |
+
| ('HL', 2) | 0.897 | 0.922 | 1 | 0.023 | 0.108 |
|
| 16 |
+
| ('HH', 2) | 0.127 | 0.103 | 0.094 | 0.269 | 0.108 |
|
| 17 |
+
| ('LH', 3) | 1 | 1 | 1 | 0 | 0.108 |
|
| 18 |
+
| ('HL', 3) | 1 | 1 | 1 | 0 | 0.108 |
|
| 19 |
+
| ('HH', 3) | 0.662 | 0.574 | 0.524 | 0.128 | 0.108 |
|
| 20 |
+
| ('LL', 3) | 0.64 | 1 | 1 | nan | nan |
|
| 21 |
+
|
| 22 |
+
### Cb
|
| 23 |
+
|
| 24 |
+
| band | 1 | 5 | 10 |
|
| 25 |
+
|:----------|------:|----:|-----:|
|
| 26 |
+
| ('LH', 1) | 0.416 | 1 | 1 |
|
| 27 |
+
| ('HL', 1) | 0.28 | 1 | 1 |
|
| 28 |
+
| ('HH', 1) | 0.111 | 1 | 1 |
|
| 29 |
+
| ('LH', 2) | 0.984 | 1 | 1 |
|
| 30 |
+
| ('HL', 2) | 0.736 | 1 | 1 |
|
| 31 |
+
| ('HH', 2) | 0.232 | 1 | 1 |
|
| 32 |
+
| ('LH', 3) | 1 | 1 | 1 |
|
| 33 |
+
| ('HL', 3) | 1 | 1 | 1 |
|
| 34 |
+
| ('HH', 3) | 0.594 | 1 | 1 |
|
| 35 |
+
| ('LL', 3) | 0.8 | 1 | 1 |
|
| 36 |
+
|
| 37 |
+
### Cr
|
| 38 |
+
|
| 39 |
+
| band | 1 | 5 | 10 |
|
| 40 |
+
|:----------|------:|------:|-----:|
|
| 41 |
+
| ('LH', 1) | 0.166 | 0.265 | 1 |
|
| 42 |
+
| ('HL', 1) | 0.086 | 1 | 1 |
|
| 43 |
+
| ('HH', 1) | 0.061 | 0.085 | 1 |
|
| 44 |
+
| ('LH', 2) | 0.264 | 1 | 1 |
|
| 45 |
+
| ('HL', 2) | 0.195 | 1 | 1 |
|
| 46 |
+
| ('HH', 2) | 0.169 | 0.393 | 1 |
|
| 47 |
+
| ('LH', 3) | 0.424 | 1 | 1 |
|
| 48 |
+
| ('HL', 3) | 0.525 | 1 | 1 |
|
| 49 |
+
| ('HH', 3) | 0.324 | 1 | 1 |
|
| 50 |
+
| ('LL', 3) | 1 | 1 | 1 |
|
| 51 |
+
|
| 52 |
+
Lowest Y survival at 5 re-encodes: ('HH', 1) (s = 0.072). Level-1 diagonal ('HH', 1): s = 0.072. The level-1 diagonal band has the lowest survival: DD is kept.
|
| 53 |
+
|
| 54 |
+
Note: s > 1 (clipped to 1) means that D_b grows under the chains (the re-encode differences between the two members are larger than the decoder trace); these bands get q_CBA = 0. Cb / Cr ratios are noisy (small D_b(0)) and are reported only.
|
| 55 |
+
|
| 56 |
+
|
| 57 |
+
|
| 58 |
+
## Proxy results (PREREG_v2 Sections 3-4; mean of fold LTX on heldout_ltx_c12 and fold SKY on heldout_sky_c12; Macro F1 at logit 0)
|
| 59 |
+
|
| 60 |
+
| variant | S_deep | S_deep_F1 | S_light | S_light_F1 | router_val | router_val_F1 | dS_deep | dS_light | drouter_val | pass |
|
| 61 |
+
|:----------|---------:|------------:|----------:|-------------:|-------------:|----------------:|----------:|-----------:|--------------:|-------:|
|
| 62 |
+
| base | 0.925 | 0.8335 | 0.9967 | 0.9677 | 0.9159 | 0.8336 | nan | nan | nan | nan |
|
| 63 |
+
| DD | 0.9223 | 0.8244 | 0.9975 | 0.9794 | 0.9055 | 0.8234 | -0.0027 | 0.0007 | -0.0103 | 0 |
|
| 64 |
+
| CBA | 0.9213 | 0.8245 | 0.9971 | 0.9718 | 0.9085 | 0.8166 | -0.0037 | 0.0004 | -0.0074 | 0 |
|
| 65 |
+
| UBA | 0.9176 | 0.8161 | 0.9965 | 0.9766 | 0.9024 | 0.8229 | -0.0074 | -0.0002 | -0.0135 | 0 |
|
| 66 |
+
|
| 67 |
+
Per fold and depth (AUC / Macro F1):
|
| 68 |
+
|
| 69 |
+
| | base | DD | CBA | UBA |
|
| 70 |
+
|:-------------------|:--------------|:--------------|:--------------|:--------------|
|
| 71 |
+
| LTX_d1_AUC | 0.996 / 0.964 | 0.997 / 0.977 | 0.996 / 0.967 | 0.995 / 0.974 |
|
| 72 |
+
| LTX_d5_AUC | 0.968 / 0.887 | 0.97 / 0.91 | 0.963 / 0.88 | 0.96 / 0.889 |
|
| 73 |
+
| LTX_d10_AUC | 0.922 / 0.829 | 0.926 / 0.836 | 0.919 / 0.827 | 0.915 / 0.821 |
|
| 74 |
+
| LTX_d20_AUC | 0.867 / 0.786 | 0.862 / 0.743 | 0.851 / 0.74 | 0.848 / 0.728 |
|
| 75 |
+
| LTX_router_val_AUC | 0.917 / 0.83 | 0.901 / 0.828 | 0.904 / 0.811 | 0.904 / 0.825 |
|
| 76 |
+
| SKY_d1_AUC | 0.998 / 0.971 | 0.998 / 0.982 | 0.999 / 0.977 | 0.998 / 0.979 |
|
| 77 |
+
| SKY_d5_AUC | 0.981 / 0.919 | 0.978 / 0.922 | 0.982 / 0.924 | 0.977 / 0.92 |
|
| 78 |
+
| SKY_d10_AUC | 0.966 / 0.892 | 0.964 / 0.894 | 0.972 / 0.903 | 0.965 / 0.892 |
|
| 79 |
+
| SKY_d20_AUC | 0.945 / 0.827 | 0.938 / 0.825 | 0.942 / 0.828 | 0.942 / 0.823 |
|
| 80 |
+
| SKY_router_val_AUC | 0.915 / 0.837 | 0.91 / 0.819 | 0.913 / 0.822 | 0.901 / 0.821 |
|
| 81 |
+
|
| 82 |
+
Thresholds: S_deep >= base + 0.010, S_light >= base - 0.005, router_val >= base - 0.010.
|
| 83 |
+
|
| 84 |
+
**Decision:** No variant passes. Phase 5 stops; F3_s0 stays the main model (PREREG_v2 Section 4, rule 3).
|
| 85 |
+
|
| 86 |
+
## Band test (report only; 240 val reconstruction pairs; logit 0). Real TNR after injection / fake TPR after replacement
|
| 87 |
+
|
| 88 |
+
| model | fswt_HV | fswt_baseband | fswt_diagonal | none | swt_HV | swt_baseband | swt_diagonal |
|
| 89 |
+
|:--------------|:--------------|:----------------|:----------------|:--------------|:--------------|:---------------|:---------------|
|
| 90 |
+
| B4onA2_LTX_s0 | 0.579 / 0.938 | 0.912 / 0.958 | 0.138 / 0.392 | 0.996 / 0.958 | 0.004 / 0.954 | 0.742 / 0.975 | 0.05 / 1.0 |
|
| 91 |
+
| B4onA2_SKY_s0 | 0.633 / 0.921 | 0.892 / 0.962 | 0.129 / 0.396 | 0.988 / 0.954 | 0.004 / 0.962 | 0.679 / 0.979 | 0.042 / 1.0 |
|
| 92 |
+
| P5_CBA_LTX_s0 | 0.446 / 0.925 | 0.912 / 0.962 | 0.138 / 0.554 | 0.988 / 0.962 | 0.004 / 0.958 | 0.725 / 0.975 | 0.1 / 0.996 |
|
| 93 |
+
| P5_CBA_SKY_s0 | 0.412 / 0.925 | 0.904 / 0.954 | 0.117 / 0.617 | 0.988 / 0.954 | 0.012 / 0.925 | 0.733 / 0.967 | 0.142 / 0.992 |
|
| 94 |
+
| P5_DD_LTX_s0 | 0.5 / 0.95 | 0.883 / 0.971 | 0.088 / 0.475 | 0.992 / 0.967 | 0.0 / 0.983 | 0.688 / 0.988 | 0.033 / 1.0 |
|
| 95 |
+
| P5_DD_SKY_s0 | 0.558 / 0.933 | 0.892 / 0.962 | 0.1 / 0.446 | 0.983 / 0.958 | 0.004 / 0.946 | 0.688 / 0.979 | 0.05 / 1.0 |
|
| 96 |
+
| P5_UBA_LTX_s0 | 0.575 / 0.942 | 0.925 / 0.962 | 0.112 / 0.454 | 0.983 / 0.962 | 0.012 / 0.946 | 0.717 / 0.988 | 0.096 / 0.992 |
|
| 97 |
+
| P5_UBA_SKY_s0 | 0.579 / 0.929 | 0.921 / 0.958 | 0.117 / 0.429 | 0.988 / 0.962 | 0.008 / 0.933 | 0.746 / 0.975 | 0.112 / 0.992 |
|