Ordered roughly by expected value for the research question.
- Uncertainty in the numbers themselves. Repeated grouped splits with paired ablations are implemented
(
scripts/evaluate_multisplit.py); show them on the website's Experiments page as well, and extend them to the
collection-disjoint experiments.
- More institutions. The Art Institute of Chicago (its API was blocked for programmatic clients during development;
its CC0 data dump is an alternative), the Rijksmuseum, the Smithsonian Open Access, Europeana providers with explicit
CC0/PDM rights. More institutions make collection-disjoint evaluation far more informative.
- Better out-of-distribution evaluation. A held-out set of non-paintings (sculpture, photographs, prints) and of
traditions absent from training, to measure the abstention and out-of-scope rules directly.
- Representation comparisons. Fine-tuned DINOv2 (linear-probe vs. partial fine-tuning with grouped cross-validation),
other self-supervised encoders, multi-crop or tiled embeddings for extreme aspect ratios (handscrolls).
- Ordinal and range-aware period models. Ordinal regression or interval-censored losses that use date ranges directly
instead of discarding works that span several bins.
- Hierarchical modelling. Joint region–tradition models; conformal prediction sets ("one of these two regions")
instead of a single abstention threshold.
- Explanations that are actually computed. Patch-level similarity maps between an upload and its nearest neighbours
(DINOv2 patch tokens), shown as evidence of where images are similar — with the caveat that similarity is not
reasoning.
- Other media. Prints, textiles, ceramics, sculpture — each with its own photographic conventions and evaluation.
- Curator-in-the-loop review. A reviewed sample of region mappings and failure cases (see annotation_protocol.md)
to estimate label noise.