Hugging Face's logo

Spaces:
multabench
/
leaderboard
Running

App Files Community
leaderboard
File size: 6,553 Bytes
b4a0516
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
entry,model,encoding,train_s_per_1k,inference_s_per_1k,finetune_s_per_1k,text_encode_s_per_1k,image_encode_s_per_1k,gpu,cpu
ConTextTab,ConTextTab,end-to-end,0.0321,4.3638,0.0,0.0,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5-Fast (TAR),TabPFN-3.5-Fast,tar,0.2132,0.5061,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
LightGBM (TAR),LightGBM,tar,0.2232,0.0219,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabPFN-3.5-Fast (Frozen),TabPFN-3.5-Fast,frozen,0.2249,0.4954,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3 (TAR),TabPFN-3,tar,0.2292,0.8196,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5 (Frozen),TabPFN-3.5,frozen,0.239,0.8666,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3.5 (TAR),TabPFN-3.5,tar,0.2456,0.8896,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT-1.3 (TAR),TabDPT-1.3,tar,0.2456,0.225,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-3 (Frozen),TabPFN-3,frozen,0.2493,0.7986,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT (TAR),TabDPT,tar,0.2547,37.017,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabICLv2 (TAR),TabICLv2,tar,0.2589,0.4671,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabDPT (Frozen),TabDPT,frozen,0.2619,25.8213,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabICLv2 (Frozen),TabICLv2,frozen,0.2718,0.4714,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
LightGBM (Frozen),LightGBM,frozen,0.2751,0.0197,0.0,1.1081,11.5298,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabDPT-1.3 (Frozen),TabDPT-1.3,frozen,0.2847,0.2223,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Causilo (Frozen),Causilo,frozen,0.3145,0.5456,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Causilo (TAR),Causilo,tar,0.3228,0.5502,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-Small (TAR),Kumo-Tabular-Small,tar,0.3672,0.1174,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
EXAONE-Tabular (Frozen),EXAONE-Tabular,frozen,0.4243,2.7887,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
EXAONE-Tabular (TAR),EXAONE-Tabular,tar,0.4305,2.7526,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2p5 (TAR),TabPFN-v2p5,tar,0.4337,1.3744,100.6949,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Xiaomi-TabLDM (TAR),Xiaomi-TabLDM,tar,0.4742,0.5767,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
XGBoost (TAR),XGBoost,tar,0.4845,0.0214,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
Kumo-Tabular-Small (Frozen),Kumo-Tabular-Small,frozen,0.4932,0.1156,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2p5 (Frozen),TabPFN-v2p5,frozen,0.501,1.3786,0.0,1.127,11.8119,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Xiaomi-TabLDM (Frozen),Xiaomi-TabLDM,frozen,0.521,0.5792,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-Medium (TAR),Kumo-Tabular-Medium,tar,0.5263,0.2165,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
XGBoost (Frozen),XGBoost,frozen,0.5454,0.0254,0.0,1.1081,11.5298,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
LimiX-2 (TAR),LimiX-2,tar,0.5789,16.6645,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RandomForest (TAR),RandomForest,tar,0.5832,0.038,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
LimiX-2 (Frozen),LimiX-2,frozen,0.5883,17.6665,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabM (Frozen),TabM,frozen,0.6253,0.0519,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RandomForest (Frozen),RandomForest,frozen,0.6489,0.0348,0.0,1.1081,11.5298,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabM (TAR),TabM,tar,0.6497,0.0574,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular-Medium (Frozen),Kumo-Tabular-Medium,frozen,0.6741,0.2237,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2 (TAR),TabPFN-v2,tar,0.738,1.7376,100.6949,0.7399,6.9181,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular (TAR),Kumo-Tabular,tar,0.7969,0.4124,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabPFN-v2 (Frozen),TabPFN-v2,frozen,0.8065,1.6817,0.0,1.127,11.8119,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Kumo-Tabular (Frozen),Kumo-Tabular,frozen,1.0881,0.4179,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
CatBoost (TAR),CatBoost,tar,1.2119,0.017,101.5254,0.7333,6.7195,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
CatBoost (Frozen),CatBoost,frozen,1.4845,0.0137,0.0,1.1081,11.5298,,INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz
TabFM (TAR),TabFM,tar,1.6469,11.9643,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabFM (Frozen),TabFM,frozen,1.6532,12.0212,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RealMLP (Frozen),RealMLP,frozen,4.4161,0.096,0.0,1.1081,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
RealMLP (TAR),RealMLP,tar,5.4987,0.1267,101.5254,0.7333,6.7195,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
TabSTAR-v1.1,TabSTAR-v1.1,end-to-end,16.0753,1.3799,0.0,0.0,11.5298,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Mitra-v2 (Frozen),Mitra-v2,frozen,152.0977,4.1145,0.0,1.0255,11.9673,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz
Mitra-v2 (TAR),Mitra-v2,tar,152.7409,4.1459,95.4327,0.6839,7.0091,NVIDIA H100 80GB HBM3,Intel(R) Xeon(R) Platinum 8481C CPU @ 2.70GHz