PACE / performance /test_model_comparison.csv
rocky250's picture
Upload PACE-SME proposed inference model and evaluation assets
6cbbcc4 verified
Raw History Blame Contribute Delete
2.64 kB
n,evaluation_weight_sum,effective_sample_size,positive_rate,threshold,accuracy,balanced_accuracy,precision,recall,specificity,negative_predictive_value,mcc,f1_macro,alert_count,alert_share,true_negative,false_positive,false_negative,true_positive,brier,ece,roc_auc,pr_auc,model,validation_pr_auc,validation_threshold,selected_calibration_method,validation_weighted_error_cost,test_weighted_error_cost,test_weighted_error_cost_per_case,test_cost_is_reporting_only,selected_on_validation,is_proposed_pace_architecture
240,240.0,240.0,0.25416666666666665,0.18413703819805452,0.6416666666666667,0.69493543364777,0.3983739837398374,0.8032786885245902,0.5865921787709497,0.8974358974358975,0.33959925637223404,0.6210340775558167,123,0.5125,105.0,74.0,12.0,49.0,0.15007812956253685,0.028939999890003995,0.7905485850352596,0.57955576009116,LightGBM_Unweighted,0.4377390719231052,0.18413703819805452,sigmoid,94.0,134.0,0.5583333333333333,True,True,False
240,240.0,240.0,0.25416666666666665,0.22682374024878768,0.6791666666666667,0.7200750984522393,0.4298245614035088,0.8032786885245902,0.6368715083798883,0.9047619047619048,0.3837555197834689,0.6537704918032787,114,0.475,114.0,65.0,12.0,49.0,0.14867123005093147,0.019425255616746365,0.7910522941661324,0.5844628769710181,PACE_Proposed,0.4763557579842879,0.22682374024878768,isotonic,95.0,125.0,0.5208333333333334,True,False,True
240,240.0,240.0,0.25416666666666665,0.18357069160652448,0.6666666666666666,0.7062917849619929,0.41739130434782606,0.7868852459016393,0.6256983240223464,0.896,0.3595832353307929,0.6411483253588517,115,0.4791666666666667,112.0,67.0,13.0,48.0,0.14999969329298418,0.02559250633385094,0.7905485850352597,0.566264650742579,CatBoost_Unweighted,0.5068125800878094,0.18357069160652448,sigmoid,98.0,132.0,0.55,True,False,False
240,240.0,240.0,0.25416666666666665,0.27742241938337947,0.7,0.6746039014561773,0.4367816091954023,0.6229508196721312,0.7262569832402235,0.8496732026143791,0.31627876227430407,0.6483230218169977,87,0.3625,130.0,49.0,23.0,38.0,0.1648318646505202,0.056896358772106276,0.752907775437311,0.4665372151676643,Random_Forest_Unweighted,0.4584422034509623,0.27742241938337947,sigmoid,106.0,164.0,0.6833333333333333,True,False,False
240,240.0,240.0,0.25416666666666665,0.2911463280719015,0.7083333333333334,0.6315596666361388,0.43283582089552236,0.47540983606557374,0.7877094972067039,0.815028901734104,0.2553781520804498,0.6271306818181819,67,0.2791666666666667,141.0,38.0,32.0,29.0,0.17419403294978,0.06063549040957894,0.7074823701804194,0.44296505336737324,Extra_Trees_Unweighted,0.450221132106621,0.2911463280719015,sigmoid,110.0,198.0,0.825,True,False,False