Spaces:
Running
Slider filter for number of samples and features
I think a slider filter should be implemented for number of samples and features. This allows for full customisation of these parameters. The simple options available currently are OK, but it will never be enough for people to fully tailor the results to their needs. TabBench implemented this very well.
Heyho, thank you for the suggestion!
Unfortunately, this won't be possible unless we recompute Elo and all the other metrics live. Unfortunately, this recomputation is still too expensive for most of our important metrics. Moreover, we want the selected slices to be meaningfully curated and statistically significant, which the sliders would make impossible to ensure (note that not all our slices are there yet, but will be with TabArena-v0.2).
So, this feature isn't intended for TabArena. If a specific slice combination is missing, let me know, and we can curate it.
In general, the design goal is for each user to find a slice that represents their problem scale (approximately, to ensure statistical significance).