Spaces:
Running
Running
org card: per-experiment hyperparameters and VQA/caption results
Browse files- README.md +8 -0
- index.html +4 -0
README.md
CHANGED
|
@@ -117,3 +117,11 @@ The top eight runs are statistically tied: every confidence interval against the
|
|
| 117 |
- **Extra QA per image does not help.** 4-QA and 6-QA mixtures tie with 2-QA.
|
| 118 |
- **Larger batch trades generality for domain fit.** Effective batch 64 gives the best in-domain captioning in the table and the worst RSICD VQA.
|
| 119 |
- **Data is the remaining lever**, not hyperparameters.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 117 |
- **Extra QA per image does not help.** 4-QA and 6-QA mixtures tie with 2-QA.
|
| 118 |
- **Larger batch trades generality for domain fit.** Effective batch 64 gives the best in-domain captioning in the table and the worst RSICD VQA.
|
| 119 |
- **Data is the remaining lever**, not hyperparameters.
|
| 120 |
+
|
| 121 |
+
## Status
|
| 122 |
+
|
| 123 |
+
The hyperparameter search is **closed**. Every axis available in this setup has been swept — rank, alpha, dropout, learning rate, schedule, weight decay, gradient clipping, vision-tower freezing, QA-per-image, caption prompt pool, batch geometry, effective batch size, and learning rate at large batch. Seventeen recipes were trained and evaluated under identical conditions, and none displaced the reference recipe by more than the paired error bar.
|
| 124 |
+
|
| 125 |
+
The final three runs illustrate the ceiling. Effective batch 16 came in at **-0.59** overall, batch 64 at 2e-4 at **-0.56**, and batch 64 at 3e-4 at **-0.34** overall and **-0.87** in-domain; batch 64 at 4e-4 was stopped at epoch 4 while declining. In each case captioning held steady or improved while VQA fell, which is the same trade seen across the whole sweep.
|
| 126 |
+
|
| 127 |
+
Any further gain has to come from the training corpus: more in-domain imagery, denser or higher-quality question-answer pairs, or a different caption source.
|
index.html
CHANGED
|
@@ -163,6 +163,10 @@ a { color: #0969da; }
|
|
| 163 |
<li><strong>Larger batch trades generality for domain fit.</strong> Effective batch 64 gives the best in-domain captioning in the table and the worst RSICD VQA.</li>
|
| 164 |
<li><strong>Data is the remaining lever</strong>, not hyperparameters.</li>
|
| 165 |
</ul>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 166 |
</main>
|
| 167 |
</body>
|
| 168 |
</html>
|
|
|
|
| 163 |
<li><strong>Larger batch trades generality for domain fit.</strong> Effective batch 64 gives the best in-domain captioning in the table and the worst RSICD VQA.</li>
|
| 164 |
<li><strong>Data is the remaining lever</strong>, not hyperparameters.</li>
|
| 165 |
</ul>
|
| 166 |
+
<h2>Status</h2>
|
| 167 |
+
<p>The hyperparameter search is <strong>closed</strong>. Every axis available in this setup has been swept — rank, alpha, dropout, learning rate, schedule, weight decay, gradient clipping, vision-tower freezing, QA-per-image, caption prompt pool, batch geometry, effective batch size, and learning rate at large batch. Seventeen recipes were trained and evaluated under identical conditions, and none displaced the reference recipe by more than the paired error bar.</p>
|
| 168 |
+
<p>The final three runs illustrate the ceiling. Effective batch 16 came in at <strong>-0.59</strong> overall, batch 64 at 2e-4 at <strong>-0.56</strong>, and batch 64 at 3e-4 at <strong>-0.34</strong> overall and <strong>-0.87</strong> in-domain; batch 64 at 4e-4 was stopped at epoch 4 while declining. In each case captioning held steady or improved while VQA fell, which is the same trade seen across the whole sweep.</p>
|
| 169 |
+
<p>Any further gain has to come from the training corpus: more in-domain imagery, denser or higher-quality question-answer pairs, or a different caption source.</p>
|
| 170 |
</main>
|
| 171 |
</body>
|
| 172 |
</html>
|