Reflex-1 / a32-efficiency.json
cbarkinozer's picture
Focus on base, Reflex-1 and matched Laya results across four benchmarks
7a22425 verified
Raw History Blame Contribute Delete
1.03 kB
{
"points": [
{
"id": "run-01",
"label": "Reflex-1",
"accuracy": 91.11111111111111,
"latency_s": 31.364144939161097,
"sampled_pss_mib": 1090.6455078125
},
{
"id": "qwen-legacy-cached-fresh180",
"label": "Base Qwen, cached app router",
"accuracy": 54.44444444444444,
"latency_s": 35.395459384916684,
"sampled_pss_mib": 854.8271484375
}
],
"observed_frontiers": {
"latency_s": [
"run-01"
],
"sampled_pss_mib": [
"run-01",
"qwen-legacy-cached-fresh180"
]
},
"input_sha256": "9928dd52c5b4946850e58502e014eefef54ff63aa2047f99283b167e3351a37a",
"generator": "tools/plot_a32_efficiency.py",
"matplotlib_version": "3.9.4",
"definition": "Maximize accuracy and minimize the named cost; strict improvement in at least one objective.",
"limitations": "Single runs; profile/policy and starting temperature differ. Sampled PSS is not in-flight peak memory. No measured energy or cross-model Decision Index frontier."
}