Is it better to show a model too many images once (Diversity), or extract as much information from a small set of images?
I have always wanted to do an ablation study on this and recently I got the chance to do exactly that. Why? In applied domains like robotics, manufacturing, or banking, we rarely have the luxury of internet-scale diverse image datasets. We are often "Data Poor" in terms of diversity but "Data Rich" in depth.
The takeaway? Density is efficient for facts but dangerous for reasoning (logical collapse) if you don't have larger scale data.
For anyone who likes to get their papers summarized, I've tried to make a bentocard summarizer for research papers, that enables us to get overviews of the papers, with possible deepdives where interested. Of course, this has to be improved a lot, so do check the space and give your feedback!