MiniMax-H3-Duo-AIPod / docs /PERFORMANCE_COMPARE.csv
manateelazycat's picture
MiniMax-H3-Duo LPK 0.2.0: final-acceptance
93a7208 verified
Raw History Blame Contribute Delete
5.92 kB
scope,candidate,full_generation_median_s,sampling_median_s,conditioning_cache,pixel_audio_exact,extended_quality,warm_samples,width,height,frames,fps,video_duration_s
initial,initial,98.42476572305895,89.98980901599862,False,True,historical native quality,3,832,480,56,24,2.3333333333333335
ten_round_independent,ten_round_independent,84.36691123014316,79.08570507494733,True,True,historical native quality,3,832,480,56,24,2.3333333333333335
additional,async-f2,74.2933985509444,67.9021373221185,False,True,,3,832,480,56,24,2.3333333333333335
additional,cublas-f2,62.15148134203628,55.79787907283753,False,True,,3,832,480,56,24,2.3333333333333335
additional,graph-cublas-f2,58.04502247599885,51.669990526046604,False,True,,3,832,480,56,24,2.3333333333333335
additional,graph-nccl,70.71879545110278,64.35055528301746,False,True,,3,832,480,56,24,2.3333333333333335
additional,graph-memops-f2,58.11213763104752,51.605593604035676,False,True,,3,832,480,56,24,2.3333333333333335
additional,zc4-g4-h4-cap16,56.842866860097274,50.53695769282058,False,True,,3,832,480,56,24,2.3333333333333335
additional,qg4-g2-h4-cap16,53.632815778953955,47.24550898000598,False,True,,3,832,480,56,24,2.3333333333333335
additional,qg4-g2-h7-cap16,52.86879129195586,46.52703320211731,False,True,,3,832,480,56,24,2.3333333333333335
additional,qg64flat-g2-h7-cap16,51.02579611702822,44.68408896308392,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-clean-g2-h7-cap16,46.585976772010326,40.272954117972404,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-g2-h14-cap16,47.89575097709894,41.56862962106243,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-g4-h7-cap16,46.68190084211528,40.361108070006594,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-g2-h6-cap16,46.813854411942884,40.443671309854835,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-f2-g2-h7-cap16,46.342772101052105,40.02522736182436,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-f2-g2-h5-cap16,46.7052891170606,40.38148791505955,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-f2-g2-h4-cap16,47.13566989800893,40.81412284588441,False,True,,3,832,480,56,24,2.3333333333333335
additional,fused-f2-cached-g2-h7-cap16,45.18186802510172,39.88764652307145,True,True,,3,832,480,56,24,2.3333333333333335
additional,modcache-f2-g2-h7-cap16,45.15342677710578,38.807102592196316,False,True,,3,832,480,56,24,2.3333333333333335
additional,fusedmodv2-f2-g2-h7-cap16,43.92833978496492,37.57764693396166,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,packet-direct-f2-g2-h7-cap16,43.794672997901216,37.44553100387566,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,packet-project-f2-g2-h7-cap16,43.60915864305571,37.241041898028925,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,packet-baseline-repeat-f2-g2-h7-cap16,44.056777755962685,37.688115888042375,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,vae-tiles-f2-g2-h7-cap16,43.19526031706482,37.44904460804537,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,native-control-f2-g2-h7-cap16,43.100821315078065,37.36127969203517,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,native-sage-f2-g2-h7-cap16,42.044037614017725,36.28966054087505,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,native-sage-rope-f2-g2-h7-cap16,41.39705613302067,35.65594592108391,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,ropev2-staged-f2-g2-h7-cap16,41.045743092894554,35.6185822149273,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,ropev2-coherent-f2-g2-h7-cap16,55.362956644035876,49.891998067032546,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,attention-boundary-staged-f2-g2-h7-cap16,41.563484290847555,36.12793922214769,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,attention-asym-staged-f2-g2-h7-cap16,41.05122848297469,35.61787490104325,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,attention-asym-coherent-f2-g2-h7-cap16,43.460762057919055,38.03377710701898,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,native-bsh-staged-f2-g2-h7-cap16,40.484607729827985,35.013366079190746,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,native-bsh-coherent-f2-g2-h7-cap16,42.892279437044635,37.42518610088155,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,quant-heads-v2-f2-g2-h7-cap16,42.6980273029767,37.234038206981495,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,ro-state-f2-g2-h7-cap16,40.35117129399441,34.8431460140273,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,retained-independent-v1,40.426270531956106,34.98447591206059,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,quant-tuned-v2-f2-g2-h7-cap16,39.70099224499427,34.27255070814863,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,attention-send-only-f2-g2-h7-cap16,40.65798653708771,35.206052344990894,False,True,not-run-slower-candidate,3,832,480,56,24,2.3333333333333335
additional,compute-fusion-f2-g2-h7-cap16,39.13625146308914,33.70071863895282,False,True,passed,3,832,480,56,24,2.3333333333333335
additional,retained-independent-v2,39.3770983510185,33.94285936304368,False,True,passed,3,832,480,56,24,2.3333333333333335
same_source_two_batches,retained source aggregate,39.3656812509289,33.85339425154962,False,True,source-identical repeat,6,832,480,56,24,2.3333333333333335
production,compiler-free runtime,38.23157397983596,33.83719758410007,True,True,production acceptance,3,832,480,56,24,2.3333333333333335
installed,final LPK,37.7707042630002,33.37877863999984,True,True,installed LPK acceptance,3,832,480,56,24,2.3333333333333335