Archive Sol and Opus baseline and DeepAgents evaluation results

results/README.md

@@ -0,0 +1,14 @@
+# InferenceNet 实验结果归档
+
+目录按 `results/<model>/<baseline|deepagents>/` 排列，不增加日期层。实验批次和时间记录在各目录的 config.json；更新历史由 Space 的 Git commit 保留。
+
+| 模型 | 单次生成 | DeepAgents |
+|---|---|---|
+| GPT-5.6 Sol | [1,000 题](gpt-5.6-sol/baseline/) | [1,000 题](gpt-5.6-sol/deepagents/) |
+| Claude Opus 4.8 | [1,000 题](claude-opus-4-8/baseline/) | [1,000 题](claude-opus-4-8/deepagents/) |
+
+这里先保存完成的实验产物。页面仍只读取根目录 `/results.csv`，本次没有更新它或修改页面代码。等各模型结果齐备，再核对数据、评分和协议后统一整理正式榜单。
+
+每组均保留失败、无预测与未知记录，固定分母为 1,000。历史恢复与补充协议写入元数据。四维离线导出与旧 local-paper-v1 指标分开保存，目前不声称已与官方 scorer 完全对齐。
+
+只归档选定最终预测、状态、指标及配置；没有重新调用模型或执行实验。原始数据、隐藏答案、API 请求/响应和凭据不在上传范围内。

results/claude-opus-4-8/baseline/README.md

@@ -0,0 +1,11 @@
+# claude-opus-4-8 / baseline
+
+已完成的 1,000 题结果归档；不自动更新正式榜单。
+
+- `results.jsonl` / `results.csv`：逐题预测、执行/评分状态和四维指标；两种格式内容相同。
+- `summary.json`：固定 1,000 题分母、未知计数，以及分别保存的四维导出和旧诊断指标。
+- `config.json`：数据 revision、完整任务 ID 清单、生成/执行预算及来源哈希。
+
+这是经过中断处置与恢复的历史对照（amended comparison）。完成计数包含失败和未知，不能当作成功率。四维导出依据榜单页面文字解释，尚未验证与实际官方评分器完全一致；正式整理榜单时再统一核对。
+
+JSON null / CSV 空单元格表示未知或不可用，不表示 0。原始输入数据、隐藏参考答案、完整提示词/API 轨迹、凭据和本机路径未包含在这个归档中。

results/claude-opus-4-8/baseline/config.json

@@ -0,0 +1,1072 @@
+{
+  "schema_version": 1,
+  "model": "claude-opus-4-8",
+  "arm": "baseline",
+  "harness": "none",
+  "source_run_name": "opus48-deepagents-full1000-20260912-recovery02",
+  "archived_at_utc": "2026-09-15T07:29:39.569697+00:00",
+  "dataset": {
+    "repo_id": "CamoAiLab/InferenceNet",
+    "revision": "59f9512a38e594528807744214a60ee00367434e",
+    "csv_sha256": "5338c8af548b35dab0e92a63b0acfebb0bc29c7901da4088851025f5709d6bb3",
+    "expected_tasks": 1000,
+    "official_metadata_sha256": "afd1712981d218c6cf3a093635968b3c07222aa0387a5bf01adabcef5707d4aa",
+    "task_ids": [
+      1,
+      2,
+      3,
+      4,
+      5,
+      6,
+      7,
+      8,
+      9,
+      10,
+      11,
+      12,
+      13,
+      14,
+      15,
+      16,
+      17,
+      18,
+      19,
+      20,
+      21,
+      22,
+      23,
+      24,
+      25,
+      26,
+      27,
+      28,
+      29,
+      30,
+      31,
+      32,
+      33,
+      34,
+      35,
+      36,
+      37,
+      38,
+      39,
+      40,
+      41,
+      42,
+      43,
+      44,
+      45,
+      46,
+      47,
+      48,
+      49,
+      50,
+      51,
+      52,
+      53,
+      54,
+      55,
+      56,
+      57,
+      58,
+      59,
+      60,
+      61,
+      62,
+      63,
+      64,
+      65,
+      66,
+      67,
+      68,
+      69,
+      70,
+      71,
+      72,
+      73,
+      74,
+      75,
+      76,
+      77,
+      78,
+      79,
+      80,
+      81,
+      82,
+      83,
+      84,
+      85,
+      86,
+      87,
+      88,
+      89,
+      90,
+      91,
+      92,
+      93,
+      94,
+      95,
+      96,
+      97,
+      98,
+      100,
+      101,
+      102,
+      103,
+      104,
+      105,
+      106,
+      107,
+      108,
+      109,
+      110,
+      111,
+      112,
+      113,
+      114,
+      115,
+      116,
+      117,
+      118,
+      119,
+      120,
+      121,
+      122,
+      123,
+      124,
+      125,
+      126,
+      127,
+      128,
+      129,
+      130,
+      131,
+      132,
+      133,
+      134,
+      135,
+      136,
+      137,
+      138,
+      139,
+      140,
+      141,
+      142,
+      143,
+      144,
+      145,
+      146,
+      147,
+      148,
+      149,
+      150,
+      151,
+      152,
+      153,
+      154,
+      155,
+      156,
+      157,
+      158,
+      159,
+      160,
+      161,
+      162,
+      163,
+      164,
+      165,
+      166,
+      167,
+      168,
+      169,
+      170,
+      171,
+      172,
+      173,
+      174,
+      175,
+      176,
+      177,
+      178,
+      179,
+      180,
+      181,
+      182,
+      183,
+      184,
+      185,
+      186,
+      187,
+      188,
+      189,
+      190,
+      191,
+      192,
+      193,
+      194,
+      195,
+      196,
+      197,
+      198,
+      199,
+      200,
+      201,
+      202,
+      203,
+      204,
+      205,
+      206,
+      207,
+      208,
+      209,
+      210,
+      211,
+      212,
+      213,
+      214,
+      215,
+      216,
+      217,
+      218,
+      219,
+      220,
+      221,
+      222,
+      223,
+      224,
+      225,
+      226,
+      227,
+      228,
+      229,
+      230,
+      231,
+      232,
+      233,
+      234,
+      235,
+      236,
+      237,
+      238,
+      239,
+      240,
+      241,
+      242,
+      248,
+      249,
+      250,
+      251,
+      252,
+      253,
+      254,
+      255,
+      256,
+      257,
+      258,
+      259,
+      261,
+      262,
+      263,
+      264,
+      265,
+      266,
+      290,
+      291,
+      292,
+      293,
+      294,
+      295,
+      302,
+      303,
+      304,
+      305,
+      306,
+      307,
+      308,
+      309,
+      310,
+      311,
+      312,
+      313,
+      314,
+      315,
+      316,
+      317,
+      318,
+      319,
+      320,
+      321,
+      322,
+      323,
+      324,
+      325,
+      326,
+      327,
+      328,
+      329,
+      330,
+      331,
+      332,
+      333,
+      334,
+      335,
+      336,
+      337,
+      338,
+      339,
+      340,
+      341,
+      342,
+      343,
+      344,
+      345,
+      346,
+      347,
+      348,
+      349,
+      350,
+      351,
+      352,
+      353,
+      354,
+      355,
+      356,
+      357,
+      358,
+      359,
+      360,
+      361,
+      362,
+      363,
+      364,
+      365,
+      366,
+      367,
+      368,
+      369,
+      370,
+      371,
+      372,
+      373,
+      374,
+      375,
+      376,
+      377,
+      378,
+      379,
+      380,
+      381,
+      382,
+      383,
+      384,
+      385,
+      386,
+      387,
+      388,
+      389,
+      390,
+      391,
+      392,
+      393,
+      394,
+      395,
+      396,
+      397,
+      398,
+      399,
+      400,
+      401,
+      402,
+      403,
+      404,
+      405,
+      406,
+      407,
+      408,
+      409,
+      410,
+      411,
+      412,
+      413,
+      414,
+      415,
+      416,
+      417,
+      418,
+      419,
+      420,
+      421,
+      422,
+      423,
+      424,
+      425,
+      426,
+      427,
+      428,
+      429,
+      430,
+      431,
+      432,
+      433,
+      434,
+      435,
+      436,
+      437,
+      438,
+      439,
+      440,
+      441,
+      442,
+      443,
+      444,
+      445,
+      446,
+      447,
+      448,
+      449,
+      450,
+      451,
+      452,
+      453,
+      454,
+      455,
+      456,
+      457,
+      458,
+      459,
+      460,
+      461,
+      462,
+      463,
+      464,
+      465,
+      466,
+      467,
+      468,
+      469,
+      470,
+      471,
+      472,
+      473,
+      474,
+      475,
+      476,
+      477,
+      478,
+      479,
+      480,
+      481,
+      482,
+      483,
+      484,
+      485,
+      486,
+      487,
+      488,
+      489,
+      490,
+      491,
+      492,
+      493,
+      494,
+      495,
+      496,
+      497,
+      498,
+      499,
+      500,
+      501,
+      502,
+      503,
+      504,
+      505,
+      506,
+      507,
+      508,
+      509,
+      510,
+      511,
+      512,
+      513,
+      514,
+      515,
+      516,
+      517,
+      518,
+      519,
+      520,
+      521,
+      522,
+      523,
+      524,
+      525,
+      526,
+      527,
+      528,
+      529,
+      530,
+      531,
+      532,
+      533,
+      534,
+      535,
+      536,
+      537,
+      538,
+      539,
+      540,
+      541,
+      542,
+      543,
+      544,
+      545,
+      546,
+      547,
+      548,
+      549,
+      550,
+      551,
+      552,
+      553,
+      554,
+      555,
+      556,
+      557,
+      558,
+      559,
+      560,
+      561,
+      562,
+      563,
+      565,
+      566,
+      567,
+      568,
+      570,
+      571,
+      572,
+      573,
+      574,
+      575,
+      576,
+      577,
+      578,
+      579,
+      580,
+      581,
+      582,
+      583,
+      584,
+      585,
+      586,
+      587,
+      588,
+      589,
+      590,
+      591,
+      592,
+      593,
+      594,
+      595,
+      596,
+      597,
+      598,
+      601,
+      602,
+      603,
+      604,
+      605,
+      606,
+      607,
+      608,
+      609,
+      610,
+      611,
+      612,
+      613,
+      614,
+      615,
+      616,
+      617,
+      618,
+      619,
+      620,
+      621,
+      622,
+      623,
+      624,
+      664,
+      665,
+      666,
+      667,
+      668,
+      669,
+      670,
+      671,
+      672,
+      673,
+      674,
+      675,
+      676,
+      677,
+      678,
+      679,
+      680,
+      681,
+      682,
+      683,
+      684,
+      685,
+      686,
+      687,
+      688,
+      689,
+      690,
+      691,
+      692,
+      693,
+      694,
+      695,
+      696,
+      697,
+      698,
+      699,
+      700,
+      701,
+      702,
+      703,
+      704,
+      705,
+      706,
+      707,
+      708,
+      709,
+      710,
+      711,
+      712,
+      713,
+      714,
+      715,
+      716,
+      717,
+      718,
+      719,
+      720,
+      721,
+      722,
+      723,
+      724,
+      725,
+      726,
+      727,
+      728,
+      729,
+      730,
+      731,
+      732,
+      733,
+      734,
+      735,
+      736,
+      737,
+      739,
+      740,
+      741,
+      742,
+      743,
+      744,
+      745,
+      746,
+      747,
+      748,
+      749,
+      750,
+      751,
+      752,
+      753,
+      754,
+      755,
+      756,
+      757,
+      758,
+      759,
+      760,
+      761,
+      762,
+      763,
+      764,
+      765,
+      766,
+      767,
+      768,
+      772,
+      773,
+      774,
+      775,
+      776,
+      777,
+      778,
+      779,
+      780,
+      781,
+      782,
+      783,
+      784,
+      785,
+      786,
+      787,
+      788,
+      789,
+      790,
+      791,
+      793,
+      794,
+      795,
+      796,
+      797,
+      798,
+      799,
+      800,
+      801,
+      802,
+      803,
+      804,
+      805,
+      806,
+      807,
+      808,
+      825,
+      826,
+      827,
+      828,
+      829,
+      830,
+      831,
+      832,
+      833,
+      834,
+      835,
+      836,
+      837,
+      838,
+      839,
+      840,
+      841,
+      842,
+      843,
+      844,
+      845,
+      846,
+      847,
+      848,
+      849,
+      850,
+      851,
+      852,
+      853,
+      854,
+      855,
+      856,
+      857,
+      858,
+      859,
+      860,
+      861,
+      862,
+      863,
+      864,
+      865,
+      866,
+      867,
+      868,
+      869,
+      870,
+      871,
+      872,
+      873,
+      874,
+      875,
+      876,
+      877,
+      878,
+      879,
+      880,
+      881,
+      882,
+      883,
+      884,
+      885,
+      886,
+      887,
+      888,
+      889,
+      890,
+      891,
+      892,
+      893,
+      894,
+      895,
+      896,
+      897,
+      898,
+      899,
+      900,
+      901,
+      902,
+      903,
+      906,
+      907,
+      913,
+      914,
+      915,
+      917,
+      920,
+      921,
+      922,
+      923,
+      924,
+      925,
+      926,
+      927,
+      928,
+      929,
+      930,
+      931,
+      932,
+      933,
+      934,
+      935,
+      936,
+      937,
+      938,
+      939,
+      940,
+      941,
+      942,
+      943,
+      944,
+      945,
+      946,
+      947,
+      948,
+      949,
+      950,
+      951,
+      952,
+      953,
+      954,
+      955,
+      956,
+      957,
+      958,
+      959,
+      960,
+      961,
+      962,
+      963,
+      964,
+      965,
+      966,
+      967,
+      968,
+      969,
+      970,
+      971,
+      972,
+      973,
+      974,
+      975,
+      976,
+      977,
+      978,
+      979,
+      980,
+      981,
+      982,
+      983,
+      984,
+      985,
+      1001,
+      1002,
+      1003,
+      1004,
+      1005,
+      1006,
+      1007,
+      1008,
+      1009,
+      1010,
+      1011,
+      1012,
+      1013,
+      1014,
+      1015,
+      1016,
+      1017,
+      1018,
+      1019,
+      1020,
+      1021,
+      1022,
+      1023,
+      1024,
+      1025,
+      1026,
+      1027,
+      1028,
+      1029,
+      1030,
+      1031,
+      1032,
+      1033,
+      1034,
+      1035,
+      1036,
+      1037,
+      1038,
+      1039,
+      1040,
+      1041,
+      1042,
+      1043,
+      1044,
+      1045,
+      1046,
+      1047,
+      1048,
+      1049,
+      1050,
+      1051,
+      1052,
+      1053,
+      1054,
+      1055,
+      1056,
+      1057,
+      1058,
+      1059,
+      1060,
+      1061,
+      1062,
+      1063,
+      1064,
+      1065,
+      1066,
+      1067,
+      1068,
+      1069,
+      1070,
+      1071,
+      1072,
+      1073,
+      1074,
+      1075,
+      1076,
+      1077,
+      1078,
+      1079,
+      1080,
+      1081,
+      1082,
+      1083,
+      1084,
+      1085,
+      1086,
+      1087,
+      1088,
+      1089,
+      1090,
+      1091,
+      1092,
+      1093,
+      1094,
+      1095,
+      1096,
+      1097,
+      1098,
+      1099,
+      1100,
+      1101,
+      1102,
+      1103,
+      1104,
+      1105,
+      1106,
+      1107,
+      1108,
+      1109,
+      1110,
+      1111,
+      1112,
+      1113,
+      1114,
+      1115,
+      1116,
+      1117,
+      1118,
+      1119,
+      1120,
+      1121,
+      1122,
+      1123,
+      1124,
+      1125
+    ]
+  },
+  "generation": {
+    "provider": "responses",
+    "reasoning_effort": "high",
+    "max_output_tokens": 32768,
+    "timeout": 600,
+    "stream": false,
+    "prompt_profile": "legacy",
+    "schema_context_chars": 24000,
+    "model": "claude-opus-4-8"
+  },
+  "execution": {
+    "timeout": 90,
+    "memory": "6g",
+    "cpus": 2.0,
+    "tmpfs": "256m",
+    "image": "inferencenet-eval:20260911"
+  },
+  "original_campaign": {
+    "workers": 3,
+    "execution_workers": 3,
+    "max_attempts": 1,
+    "stop_after_errors": 3
+  },
+  "original_limits_for_this_arm": {
+    "output_tokens": 32768,
+    "wall_seconds": 600,
+    "model_calls": 1,
+    "tool_calls": 0,
+    "tool_timeout": 90
+  },
+  "original_scoring": {
+    "profile": "local-paper-v1"
+  },
+  "schedule_seed": 20260911,
+  "transport_compatibility": {
+    "additional_drop_params": [
+      "_encrypted_content_affinity_pinned"
+    ]
+  },
+  "final_phase_policy": null,
+  "final_amendment_summary": null,
+  "evidence_class": "amended_comparison",
+  "source_identity": {
+    "original_protocol_sha256": "b656e378461f5a8ef59b4f90f05303c85112f81f0ec793b2525e3095fe430f68",
+    "accepted_summary_sha256": "a43ebcccde5edccbf17b0a15c504c65f252adad8694cc912564811603b896ff9",
+    "accepted_private_audit_sha256": "5d9d2a59fe53fce98dfdda2715f550a3d3db79ce0c19fcde07a069648e682fa7",
+    "metric_function_source_sha256": "f6a6190e97f8bf5c499e97de74f0b882ebb8322dea92e0543711d523ffe6cba3",
+    "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f"
+  },
+  "notes": [
+    "Archived historical amended comparison; this upload does not rerun the experiment.",
+    "Source identities are hashes of the frozen protocol and accepted export; no latest-framework commit is substituted.",
+    "Null amendment or phase fields mean absent from the selected run root, not proof of an uninterrupted run.",
+    "No complete verified token or monetary totals are supplied; missing usage is not zero."
+  ]
+}

results/claude-opus-4-8/baseline/summary.json

@@ -0,0 +1,121 @@
+{
+  "schema_version": 1,
+  "kind": "inferencenet-offline-leaderboard-export",
+  "generated_at": "2026-09-13T17:50:43.870921+00:00",
+  "model": "claude-opus-4-8",
+  "metric_profile": "hf-leaderboard-v1",
+  "definitions": {
+    "compilation_success": "Trusted evidence of complete code execution; no prediction JSON gate.",
+    "partial_replication": "Coefficient relative error <= .05; no standard-error or p-value gate.",
+    "coefficient_direction": "Matching strictly positive or strictly negative coefficient signs.",
+    "significance_level": "Equal p-value category: p < .01, p < .05, p < .1, otherwise; no direction gate."
+  },
+  "assumptions": {
+    "official_rules": "Webpage interpretation only; official scorer parity is not verified.",
+    "compilation_evidence": "Caller supplies True, False, or None from verified execution evidence, including exit status, timeout, termination confirmation, and execution errors. Missing or uncertain evidence maps to None.",
+    "prediction_evidence": "Only execution_status=succeeded and scoring_status=scored rows are evaluated. The current caller requires a complete valid prediction triplet; invalid outputs are not recovered here.",
+    "coefficient_boundary": "5% includes equality. Numeric decimal representations are compared exactly without epsilon.",
+    "zero_reference_coefficient": "A zero reference coefficient is unknown for relative error and positive/negative direction; it does not block significance. A zero prediction against a nonzero reference is incorrect.",
+    "significance_categories": "Four categories use strict .01, .05, and .1 boundaries. Both p-values must be numeric and within [0, 1]. These boundaries and the absent direction gate are explicit local choices.",
+    "field_validation": "Each metric requires only its own finite numeric fields. Booleans, numeric strings, and inequalities are not coerced. Standard errors do not affect any of these three formulas.",
+    "denominator": "All planned tasks remain in every denominator. Confirmed compilation failures are False; missing or uncertain execution evidence is unknown. For the three result metrics, failed execution, missing predictions, unscored rows, and unsupported reference fields are unknown. Unknowns contribute no successes and are counted separately.",
+    "attempt_selection": "The caller supplies one row per task under its frozen attempt policy."
+  },
+  "definition_source": "https://huggingface.co/spaces/CamoAiLab/InferenceNet-Leaderboard/blob/bc367a8b8cabc9b06aac093406942b72cc5837a7/index.html#L616",
+  "official_parity_verified": false,
+  "evidence_class": "amended_comparison",
+  "original_protocol_complete": false,
+  "complete": true,
+  "dataset_revision": "59f9512a38e594528807744214a60ee00367434e",
+  "protocol_sha256": "b656e378461f5a8ef59b4f90f05303c85112f81f0ec793b2525e3095fe430f68",
+  "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f",
+  "arm": "baseline",
+  "included_in_displayed_leaderboard": false,
+  "publication_kind": "results_archive",
+  "result": {
+    "metrics": {
+      "compilation_success": {
+        "count": 467,
+        "denominator": 1000,
+        "rate": 0.467,
+        "score": 46.7,
+        "unknown_count": 0
+      },
+      "partial_replication": {
+        "count": 305,
+        "denominator": 1000,
+        "rate": 0.305,
+        "score": 30.5,
+        "unknown_count": 537
+      },
+      "coefficient_direction": {
+        "count": 437,
+        "denominator": 1000,
+        "rate": 0.437,
+        "score": 43.7,
+        "unknown_count": 537
+      },
+      "significance_level": {
+        "count": 370,
+        "denominator": 1000,
+        "rate": 0.37,
+        "score": 37.0,
+        "unknown_count": 537
+      }
+    },
+    "row": {
+      "Model ID": "claude-opus-4-8 baseline",
+      "Compilation Success": 46.7,
+      "Partial Replication": 30.5,
+      "Correct Coefficient Direction": 43.7,
+      "Significant Level Correctness": 37.0
+    },
+    "columns": [
+      "Model ID",
+      "Compilation Success",
+      "Partial Replication",
+      "Correct Coefficient Direction",
+      "Significant Level Correctness"
+    ],
+    "expected_count": 1000,
+    "resolved_count": 1000,
+    "valid_prediction_count": 464,
+    "interruption_count": 0
+  },
+  "legacy_local_paper": {
+    "verified": true,
+    "profile": "local-paper-v1",
+    "metrics": {
+      "perfect": {
+        "count": 184,
+        "denominator": 1000,
+        "rate": 0.184,
+        "unknown_count": 538
+      },
+      "partial": {
+        "count": 235,
+        "denominator": 1000,
+        "rate": 0.235,
+        "unknown_count": 538
+      },
+      "coefficient_only": {
+        "count": 304,
+        "denominator": 1000,
+        "rate": 0.304,
+        "unknown_count": 538
+      },
+      "direction": {
+        "count": 436,
+        "denominator": 1000,
+        "rate": 0.436,
+        "unknown_count": 538
+      },
+      "significance": {
+        "count": 355,
+        "denominator": 1000,
+        "rate": 0.355,
+        "unknown_count": 538
+      }
+    }
+  }
+}

results/claude-opus-4-8/deepagents/README.md

@@ -0,0 +1,11 @@
+# claude-opus-4-8 / deepagents
+
+已完成的 1,000 题结果归档；不自动更新正式榜单。
+
+- `results.jsonl` / `results.csv`：逐题预测、执行/评分状态和四维指标；两种格式内容相同。
+- `summary.json`：固定 1,000 题分母、未知计数，以及分别保存的四维导出和旧诊断指标。
+- `config.json`：数据 revision、完整任务 ID 清单、生成/执行预算及来源哈希。
+
+这是经过中断处置与恢复的历史对照（amended comparison）。完成计数包含失败和未知，不能当作成功率。四维导出依据榜单页面文字解释，尚未验证与实际官方评分器完全一致；正式整理榜单时再统一核对。
+
+JSON null / CSV 空单元格表示未知或不可用，不表示 0。原始输入数据、隐藏参考答案、完整提示词/API 轨迹、凭据和本机路径未包含在这个归档中。

results/claude-opus-4-8/deepagents/config.json

@@ -0,0 +1,1072 @@
+{
+  "schema_version": 1,
+  "model": "claude-opus-4-8",
+  "arm": "deepagents",
+  "harness": "DeepAgents",
+  "source_run_name": "opus48-deepagents-full1000-20260912-recovery02",
+  "archived_at_utc": "2026-09-15T07:29:39.569697+00:00",
+  "dataset": {
+    "repo_id": "CamoAiLab/InferenceNet",
+    "revision": "59f9512a38e594528807744214a60ee00367434e",
+    "csv_sha256": "5338c8af548b35dab0e92a63b0acfebb0bc29c7901da4088851025f5709d6bb3",
+    "expected_tasks": 1000,
+    "official_metadata_sha256": "afd1712981d218c6cf3a093635968b3c07222aa0387a5bf01adabcef5707d4aa",
+    "task_ids": [
+      1,
+      2,
+      3,
+      4,
+      5,
+      6,
+      7,
+      8,
+      9,
+      10,
+      11,
+      12,
+      13,
+      14,
+      15,
+      16,
+      17,
+      18,
+      19,
+      20,
+      21,
+      22,
+      23,
+      24,
+      25,
+      26,
+      27,
+      28,
+      29,
+      30,
+      31,
+      32,
+      33,
+      34,
+      35,
+      36,
+      37,
+      38,
+      39,
+      40,
+      41,
+      42,
+      43,
+      44,
+      45,
+      46,
+      47,
+      48,
+      49,
+      50,
+      51,
+      52,
+      53,
+      54,
+      55,
+      56,
+      57,
+      58,
+      59,
+      60,
+      61,
+      62,
+      63,
+      64,
+      65,
+      66,
+      67,
+      68,
+      69,
+      70,
+      71,
+      72,
+      73,
+      74,
+      75,
+      76,
+      77,
+      78,
+      79,
+      80,
+      81,
+      82,
+      83,
+      84,
+      85,
+      86,
+      87,
+      88,
+      89,
+      90,
+      91,
+      92,
+      93,
+      94,
+      95,
+      96,
+      97,
+      98,
+      100,
+      101,
+      102,
+      103,
+      104,
+      105,
+      106,
+      107,
+      108,
+      109,
+      110,
+      111,
+      112,
+      113,
+      114,
+      115,
+      116,
+      117,
+      118,
+      119,
+      120,
+      121,
+      122,
+      123,
+      124,
+      125,
+      126,
+      127,
+      128,
+      129,
+      130,
+      131,
+      132,
+      133,
+      134,
+      135,
+      136,
+      137,
+      138,
+      139,
+      140,
+      141,
+      142,
+      143,
+      144,
+      145,
+      146,
+      147,
+      148,
+      149,
+      150,
+      151,
+      152,
+      153,
+      154,
+      155,
+      156,
+      157,
+      158,
+      159,
+      160,
+      161,
+      162,
+      163,
+      164,
+      165,
+      166,
+      167,
+      168,
+      169,
+      170,
+      171,
+      172,
+      173,
+      174,
+      175,
+      176,
+      177,
+      178,
+      179,
+      180,
+      181,
+      182,
+      183,
+      184,
+      185,
+      186,
+      187,
+      188,
+      189,
+      190,
+      191,
+      192,
+      193,
+      194,
+      195,
+      196,
+      197,
+      198,
+      199,
+      200,
+      201,
+      202,
+      203,
+      204,
+      205,
+      206,
+      207,
+      208,
+      209,
+      210,
+      211,
+      212,
+      213,
+      214,
+      215,
+      216,
+      217,
+      218,
+      219,
+      220,
+      221,
+      222,
+      223,
+      224,
+      225,
+      226,
+      227,
+      228,
+      229,
+      230,
+      231,
+      232,
+      233,
+      234,
+      235,
+      236,
+      237,
+      238,
+      239,
+      240,
+      241,
+      242,
+      248,
+      249,
+      250,
+      251,
+      252,
+      253,
+      254,
+      255,
+      256,
+      257,
+      258,
+      259,
+      261,
+      262,
+      263,
+      264,
+      265,
+      266,
+      290,
+      291,
+      292,
+      293,
+      294,
+      295,
+      302,
+      303,
+      304,
+      305,
+      306,
+      307,
+      308,
+      309,
+      310,
+      311,
+      312,
+      313,
+      314,
+      315,
+      316,
+      317,
+      318,
+      319,
+      320,
+      321,
+      322,
+      323,
+      324,
+      325,
+      326,
+      327,
+      328,
+      329,
+      330,
+      331,
+      332,
+      333,
+      334,
+      335,
+      336,
+      337,
+      338,
+      339,
+      340,
+      341,
+      342,
+      343,
+      344,
+      345,
+      346,
+      347,
+      348,
+      349,
+      350,
+      351,
+      352,
+      353,
+      354,
+      355,
+      356,
+      357,
+      358,
+      359,
+      360,
+      361,
+      362,
+      363,
+      364,
+      365,
+      366,
+      367,
+      368,
+      369,
+      370,
+      371,
+      372,
+      373,
+      374,
+      375,
+      376,
+      377,
+      378,
+      379,
+      380,
+      381,
+      382,
+      383,
+      384,
+      385,
+      386,
+      387,
+      388,
+      389,
+      390,
+      391,
+      392,
+      393,
+      394,
+      395,
+      396,
+      397,
+      398,
+      399,
+      400,
+      401,
+      402,
+      403,
+      404,
+      405,
+      406,
+      407,
+      408,
+      409,
+      410,
+      411,
+      412,
+      413,
+      414,
+      415,
+      416,
+      417,
+      418,
+      419,
+      420,
+      421,
+      422,
+      423,
+      424,
+      425,
+      426,
+      427,
+      428,
+      429,
+      430,
+      431,
+      432,
+      433,
+      434,
+      435,
+      436,
+      437,
+      438,
+      439,
+      440,
+      441,
+      442,
+      443,
+      444,
+      445,
+      446,
+      447,
+      448,
+      449,
+      450,
+      451,
+      452,
+      453,
+      454,
+      455,
+      456,
+      457,
+      458,
+      459,
+      460,
+      461,
+      462,
+      463,
+      464,
+      465,
+      466,
+      467,
+      468,
+      469,
+      470,
+      471,
+      472,
+      473,
+      474,
+      475,
+      476,
+      477,
+      478,
+      479,
+      480,
+      481,
+      482,
+      483,
+      484,
+      485,
+      486,
+      487,
+      488,
+      489,
+      490,
+      491,
+      492,
+      493,
+      494,
+      495,
+      496,
+      497,
+      498,
+      499,
+      500,
+      501,
+      502,
+      503,
+      504,
+      505,
+      506,
+      507,
+      508,
+      509,
+      510,
+      511,
+      512,
+      513,
+      514,
+      515,
+      516,
+      517,
+      518,
+      519,
+      520,
+      521,
+      522,
+      523,
+      524,
+      525,
+      526,
+      527,
+      528,
+      529,
+      530,
+      531,
+      532,
+      533,
+      534,
+      535,
+      536,
+      537,
+      538,
+      539,
+      540,
+      541,
+      542,
+      543,
+      544,
+      545,
+      546,
+      547,
+      548,
+      549,
+      550,
+      551,
+      552,
+      553,
+      554,
+      555,
+      556,
+      557,
+      558,
+      559,
+      560,
+      561,
+      562,
+      563,
+      565,
+      566,
+      567,
+      568,
+      570,
+      571,
+      572,
+      573,
+      574,
+      575,
+      576,
+      577,
+      578,
+      579,
+      580,
+      581,
+      582,
+      583,
+      584,
+      585,
+      586,
+      587,
+      588,
+      589,
+      590,
+      591,
+      592,
+      593,
+      594,
+      595,
+      596,
+      597,
+      598,
+      601,
+      602,
+      603,
+      604,
+      605,
+      606,
+      607,
+      608,
+      609,
+      610,
+      611,
+      612,
+      613,
+      614,
+      615,
+      616,
+      617,
+      618,
+      619,
+      620,
+      621,
+      622,
+      623,
+      624,
+      664,
+      665,
+      666,
+      667,
+      668,
+      669,
+      670,
+      671,
+      672,
+      673,
+      674,
+      675,
+      676,
+      677,
+      678,
+      679,
+      680,
+      681,
+      682,
+      683,
+      684,
+      685,
+      686,
+      687,
+      688,
+      689,
+      690,
+      691,
+      692,
+      693,
+      694,
+      695,
+      696,
+      697,
+      698,
+      699,
+      700,
+      701,
+      702,
+      703,
+      704,
+      705,
+      706,
+      707,
+      708,
+      709,
+      710,
+      711,
+      712,
+      713,
+      714,
+      715,
+      716,
+      717,
+      718,
+      719,
+      720,
+      721,
+      722,
+      723,
+      724,
+      725,
+      726,
+      727,
+      728,
+      729,
+      730,
+      731,
+      732,
+      733,
+      734,
+      735,
+      736,
+      737,
+      739,
+      740,
+      741,
+      742,
+      743,
+      744,
+      745,
+      746,
+      747,
+      748,
+      749,
+      750,
+      751,
+      752,
+      753,
+      754,
+      755,
+      756,
+      757,
+      758,
+      759,
+      760,
+      761,
+      762,
+      763,
+      764,
+      765,
+      766,
+      767,
+      768,
+      772,
+      773,
+      774,
+      775,
+      776,
+      777,
+      778,
+      779,
+      780,
+      781,
+      782,
+      783,
+      784,
+      785,
+      786,
+      787,
+      788,
+      789,
+      790,
+      791,
+      793,
+      794,
+      795,
+      796,
+      797,
+      798,
+      799,
+      800,
+      801,
+      802,
+      803,
+      804,
+      805,
+      806,
+      807,
+      808,
+      825,
+      826,
+      827,
+      828,
+      829,
+      830,
+      831,
+      832,
+      833,
+      834,
+      835,
+      836,
+      837,
+      838,
+      839,
+      840,
+      841,
+      842,
+      843,
+      844,
+      845,
+      846,
+      847,
+      848,
+      849,
+      850,
+      851,
+      852,
+      853,
+      854,
+      855,
+      856,
+      857,
+      858,
+      859,
+      860,
+      861,
+      862,
+      863,
+      864,
+      865,
+      866,
+      867,
+      868,
+      869,
+      870,
+      871,
+      872,
+      873,
+      874,
+      875,
+      876,
+      877,
+      878,
+      879,
+      880,
+      881,
+      882,
+      883,
+      884,
+      885,
+      886,
+      887,
+      888,
+      889,
+      890,
+      891,
+      892,
+      893,
+      894,
+      895,
+      896,
+      897,
+      898,
+      899,
+      900,
+      901,
+      902,
+      903,
+      906,
+      907,
+      913,
+      914,
+      915,
+      917,
+      920,
+      921,
+      922,
+      923,
+      924,
+      925,
+      926,
+      927,
+      928,
+      929,
+      930,
+      931,
+      932,
+      933,
+      934,
+      935,
+      936,
+      937,
+      938,
+      939,
+      940,
+      941,
+      942,
+      943,
+      944,
+      945,
+      946,
+      947,
+      948,
+      949,
+      950,
+      951,
+      952,
+      953,
+      954,
+      955,
+      956,
+      957,
+      958,
+      959,
+      960,
+      961,
+      962,
+      963,
+      964,
+      965,
+      966,
+      967,
+      968,
+      969,
+      970,
+      971,
+      972,
+      973,
+      974,
+      975,
+      976,
+      977,
+      978,
+      979,
+      980,
+      981,
+      982,
+      983,
+      984,
+      985,
+      1001,
+      1002,
+      1003,
+      1004,
+      1005,
+      1006,
+      1007,
+      1008,
+      1009,
+      1010,
+      1011,
+      1012,
+      1013,
+      1014,
+      1015,
+      1016,
+      1017,
+      1018,
+      1019,
+      1020,
+      1021,
+      1022,
+      1023,
+      1024,
+      1025,
+      1026,
+      1027,
+      1028,
+      1029,
+      1030,
+      1031,
+      1032,
+      1033,
+      1034,
+      1035,
+      1036,
+      1037,
+      1038,
+      1039,
+      1040,
+      1041,
+      1042,
+      1043,
+      1044,
+      1045,
+      1046,
+      1047,
+      1048,
+      1049,
+      1050,
+      1051,
+      1052,
+      1053,
+      1054,
+      1055,
+      1056,
+      1057,
+      1058,
+      1059,
+      1060,
+      1061,
+      1062,
+      1063,
+      1064,
+      1065,
+      1066,
+      1067,
+      1068,
+      1069,
+      1070,
+      1071,
+      1072,
+      1073,
+      1074,
+      1075,
+      1076,
+      1077,
+      1078,
+      1079,
+      1080,
+      1081,
+      1082,
+      1083,
+      1084,
+      1085,
+      1086,
+      1087,
+      1088,
+      1089,
+      1090,
+      1091,
+      1092,
+      1093,
+      1094,
+      1095,
+      1096,
+      1097,
+      1098,
+      1099,
+      1100,
+      1101,
+      1102,
+      1103,
+      1104,
+      1105,
+      1106,
+      1107,
+      1108,
+      1109,
+      1110,
+      1111,
+      1112,
+      1113,
+      1114,
+      1115,
+      1116,
+      1117,
+      1118,
+      1119,
+      1120,
+      1121,
+      1122,
+      1123,
+      1124,
+      1125
+    ]
+  },
+  "generation": {
+    "provider": "responses",
+    "reasoning_effort": "high",
+    "max_output_tokens": 32768,
+    "timeout": 600,
+    "stream": false,
+    "prompt_profile": "legacy",
+    "schema_context_chars": 24000,
+    "model": "claude-opus-4-8"
+  },
+  "execution": {
+    "timeout": 90,
+    "memory": "6g",
+    "cpus": 2.0,
+    "tmpfs": "256m",
+    "image": "inferencenet-eval:20260911"
+  },
+  "original_campaign": {
+    "workers": 3,
+    "execution_workers": 3,
+    "max_attempts": 1,
+    "stop_after_errors": 3
+  },
+  "original_limits_for_this_arm": {
+    "output_tokens": 32768,
+    "wall_seconds": 600,
+    "model_calls": 6,
+    "tool_calls": 4,
+    "tool_timeout": 90
+  },
+  "original_scoring": {
+    "profile": "local-paper-v1"
+  },
+  "schedule_seed": 20260911,
+  "transport_compatibility": {
+    "additional_drop_params": [
+      "_encrypted_content_affinity_pinned"
+    ]
+  },
+  "final_phase_policy": null,
+  "final_amendment_summary": null,
+  "evidence_class": "amended_comparison",
+  "source_identity": {
+    "original_protocol_sha256": "b656e378461f5a8ef59b4f90f05303c85112f81f0ec793b2525e3095fe430f68",
+    "accepted_summary_sha256": "a43ebcccde5edccbf17b0a15c504c65f252adad8694cc912564811603b896ff9",
+    "accepted_private_audit_sha256": "5d9d2a59fe53fce98dfdda2715f550a3d3db79ce0c19fcde07a069648e682fa7",
+    "metric_function_source_sha256": "f6a6190e97f8bf5c499e97de74f0b882ebb8322dea92e0543711d523ffe6cba3",
+    "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f"
+  },
+  "notes": [
+    "Archived historical amended comparison; this upload does not rerun the experiment.",
+    "Source identities are hashes of the frozen protocol and accepted export; no latest-framework commit is substituted.",
+    "Null amendment or phase fields mean absent from the selected run root, not proof of an uninterrupted run.",
+    "No complete verified token or monetary totals are supplied; missing usage is not zero."
+  ]
+}

results/claude-opus-4-8/deepagents/summary.json

@@ -0,0 +1,121 @@
+{
+  "schema_version": 1,
+  "kind": "inferencenet-offline-leaderboard-export",
+  "generated_at": "2026-09-13T17:50:43.870921+00:00",
+  "model": "claude-opus-4-8",
+  "metric_profile": "hf-leaderboard-v1",
+  "definitions": {
+    "compilation_success": "Trusted evidence of complete code execution; no prediction JSON gate.",
+    "partial_replication": "Coefficient relative error <= .05; no standard-error or p-value gate.",
+    "coefficient_direction": "Matching strictly positive or strictly negative coefficient signs.",
+    "significance_level": "Equal p-value category: p < .01, p < .05, p < .1, otherwise; no direction gate."
+  },
+  "assumptions": {
+    "official_rules": "Webpage interpretation only; official scorer parity is not verified.",
+    "compilation_evidence": "Caller supplies True, False, or None from verified execution evidence, including exit status, timeout, termination confirmation, and execution errors. Missing or uncertain evidence maps to None.",
+    "prediction_evidence": "Only execution_status=succeeded and scoring_status=scored rows are evaluated. The current caller requires a complete valid prediction triplet; invalid outputs are not recovered here.",
+    "coefficient_boundary": "5% includes equality. Numeric decimal representations are compared exactly without epsilon.",
+    "zero_reference_coefficient": "A zero reference coefficient is unknown for relative error and positive/negative direction; it does not block significance. A zero prediction against a nonzero reference is incorrect.",
+    "significance_categories": "Four categories use strict .01, .05, and .1 boundaries. Both p-values must be numeric and within [0, 1]. These boundaries and the absent direction gate are explicit local choices.",
+    "field_validation": "Each metric requires only its own finite numeric fields. Booleans, numeric strings, and inequalities are not coerced. Standard errors do not affect any of these three formulas.",
+    "denominator": "All planned tasks remain in every denominator. Confirmed compilation failures are False; missing or uncertain execution evidence is unknown. For the three result metrics, failed execution, missing predictions, unscored rows, and unsupported reference fields are unknown. Unknowns contribute no successes and are counted separately.",
+    "attempt_selection": "The caller supplies one row per task under its frozen attempt policy."
+  },
+  "definition_source": "https://huggingface.co/spaces/CamoAiLab/InferenceNet-Leaderboard/blob/bc367a8b8cabc9b06aac093406942b72cc5837a7/index.html#L616",
+  "official_parity_verified": false,
+  "evidence_class": "amended_comparison",
+  "original_protocol_complete": false,
+  "complete": true,
+  "dataset_revision": "59f9512a38e594528807744214a60ee00367434e",
+  "protocol_sha256": "b656e378461f5a8ef59b4f90f05303c85112f81f0ec793b2525e3095fe430f68",
+  "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f",
+  "arm": "deepagents",
+  "included_in_displayed_leaderboard": false,
+  "publication_kind": "results_archive",
+  "result": {
+    "metrics": {
+      "compilation_success": {
+        "count": 834,
+        "denominator": 1000,
+        "rate": 0.834,
+        "score": 83.39999999999999,
+        "unknown_count": 4
+      },
+      "partial_replication": {
+        "count": 621,
+        "denominator": 1000,
+        "rate": 0.621,
+        "score": 62.1,
+        "unknown_count": 170
+      },
+      "coefficient_direction": {
+        "count": 793,
+        "denominator": 1000,
+        "rate": 0.793,
+        "score": 79.3,
+        "unknown_count": 170
+      },
+      "significance_level": {
+        "count": 696,
+        "denominator": 1000,
+        "rate": 0.696,
+        "score": 69.6,
+        "unknown_count": 172
+      }
+    },
+    "row": {
+      "Model ID": "claude-opus-4-8 + DeepAgents",
+      "Compilation Success": 83.39999999999999,
+      "Partial Replication": 62.1,
+      "Correct Coefficient Direction": 79.3,
+      "Significant Level Correctness": 69.6
+    },
+    "columns": [
+      "Model ID",
+      "Compilation Success",
+      "Partial Replication",
+      "Correct Coefficient Direction",
+      "Significant Level Correctness"
+    ],
+    "expected_count": 1000,
+    "resolved_count": 1000,
+    "valid_prediction_count": 831,
+    "interruption_count": 4
+  },
+  "legacy_local_paper": {
+    "verified": true,
+    "profile": "local-paper-v1",
+    "metrics": {
+      "perfect": {
+        "count": 392,
+        "denominator": 1000,
+        "rate": 0.392,
+        "unknown_count": 174
+      },
+      "partial": {
+        "count": 508,
+        "denominator": 1000,
+        "rate": 0.508,
+        "unknown_count": 174
+      },
+      "coefficient_only": {
+        "count": 619,
+        "denominator": 1000,
+        "rate": 0.619,
+        "unknown_count": 174
+      },
+      "direction": {
+        "count": 789,
+        "denominator": 1000,
+        "rate": 0.789,
+        "unknown_count": 174
+      },
+      "significance": {
+        "count": 673,
+        "denominator": 1000,
+        "rate": 0.673,
+        "unknown_count": 174
+      }
+    }
+  }
+}

results/gpt-5.6-sol/baseline/README.md

@@ -0,0 +1,11 @@
+# gpt-5.6-sol / baseline
+
+已完成的 1,000 题结果归档；不自动更新正式榜单。
+
+- `results.jsonl` / `results.csv`：逐题预测、执行/评分状态和四维指标；两种格式内容相同。
+- `summary.json`：固定 1,000 题分母、未知计数，以及分别保存的四维导出和旧诊断指标。
+- `config.json`：数据 revision、完整任务 ID 清单、生成/执行预算及来源哈希。
+
+这是经过中断处置与恢复的历史对照（amended comparison）。完成计数包含失败和未知，不能当作成功率。四维导出依据榜单页面文字解释，尚未验证与实际官方评分器完全一致；正式整理榜单时再统一核对。
+
+JSON null / CSV 空单元格表示未知或不可用，不表示 0。原始输入数据、隐藏参考答案、完整提示词/API 轨迹、凭据和本机路径未包含在这个归档中。

results/gpt-5.6-sol/baseline/config.json

@@ -0,0 +1,1083 @@
+{
+  "schema_version": 1,
+  "model": "gpt-5.6-sol",
+  "arm": "baseline",
+  "harness": "none",
+  "source_run_name": "sol-deepagents-full1000-20260912-external-04",
+  "archived_at_utc": "2026-09-15T07:29:39.569697+00:00",
+  "dataset": {
+    "repo_id": "CamoAiLab/InferenceNet",
+    "revision": "59f9512a38e594528807744214a60ee00367434e",
+    "csv_sha256": "5338c8af548b35dab0e92a63b0acfebb0bc29c7901da4088851025f5709d6bb3",
+    "expected_tasks": 1000,
+    "official_metadata_sha256": "afd1712981d218c6cf3a093635968b3c07222aa0387a5bf01adabcef5707d4aa",
+    "task_ids": [
+      1,
+      2,
+      3,
+      4,
+      5,
+      6,
+      7,
+      8,
+      9,
+      10,
+      11,
+      12,
+      13,
+      14,
+      15,
+      16,
+      17,
+      18,
+      19,
+      20,
+      21,
+      22,
+      23,
+      24,
+      25,
+      26,
+      27,
+      28,
+      29,
+      30,
+      31,
+      32,
+      33,
+      34,
+      35,
+      36,
+      37,
+      38,
+      39,
+      40,
+      41,
+      42,
+      43,
+      44,
+      45,
+      46,
+      47,
+      48,
+      49,
+      50,
+      51,
+      52,
+      53,
+      54,
+      55,
+      56,
+      57,
+      58,
+      59,
+      60,
+      61,
+      62,
+      63,
+      64,
+      65,
+      66,
+      67,
+      68,
+      69,
+      70,
+      71,
+      72,
+      73,
+      74,
+      75,
+      76,
+      77,
+      78,
+      79,
+      80,
+      81,
+      82,
+      83,
+      84,
+      85,
+      86,
+      87,
+      88,
+      89,
+      90,
+      91,
+      92,
+      93,
+      94,
+      95,
+      96,
+      97,
+      98,
+      100,
+      101,
+      102,
+      103,
+      104,
+      105,
+      106,
+      107,
+      108,
+      109,
+      110,
+      111,
+      112,
+      113,
+      114,
+      115,
+      116,
+      117,
+      118,
+      119,
+      120,
+      121,
+      122,
+      123,
+      124,
+      125,
+      126,
+      127,
+      128,
+      129,
+      130,
+      131,
+      132,
+      133,
+      134,
+      135,
+      136,
+      137,
+      138,
+      139,
+      140,
+      141,
+      142,
+      143,
+      144,
+      145,
+      146,
+      147,
+      148,
+      149,
+      150,
+      151,
+      152,
+      153,
+      154,
+      155,
+      156,
+      157,
+      158,
+      159,
+      160,
+      161,
+      162,
+      163,
+      164,
+      165,
+      166,
+      167,
+      168,
+      169,
+      170,
+      171,
+      172,
+      173,
+      174,
+      175,
+      176,
+      177,
+      178,
+      179,
+      180,
+      181,
+      182,
+      183,
+      184,
+      185,
+      186,
+      187,
+      188,
+      189,
+      190,
+      191,
+      192,
+      193,
+      194,
+      195,
+      196,
+      197,
+      198,
+      199,
+      200,
+      201,
+      202,
+      203,
+      204,
+      205,
+      206,
+      207,
+      208,
+      209,
+      210,
+      211,
+      212,
+      213,
+      214,
+      215,
+      216,
+      217,
+      218,
+      219,
+      220,
+      221,
+      222,
+      223,
+      224,
+      225,
+      226,
+      227,
+      228,
+      229,
+      230,
+      231,
+      232,
+      233,
+      234,
+      235,
+      236,
+      237,
+      238,
+      239,
+      240,
+      241,
+      242,
+      248,
+      249,
+      250,
+      251,
+      252,
+      253,
+      254,
+      255,
+      256,
+      257,
+      258,
+      259,
+      261,
+      262,
+      263,
+      264,
+      265,
+      266,
+      290,
+      291,
+      292,
+      293,
+      294,
+      295,
+      302,
+      303,
+      304,
+      305,
+      306,
+      307,
+      308,
+      309,
+      310,
+      311,
+      312,
+      313,
+      314,
+      315,
+      316,
+      317,
+      318,
+      319,
+      320,
+      321,
+      322,
+      323,
+      324,
+      325,
+      326,
+      327,
+      328,
+      329,
+      330,
+      331,
+      332,
+      333,
+      334,
+      335,
+      336,
+      337,
+      338,
+      339,
+      340,
+      341,
+      342,
+      343,
+      344,
+      345,
+      346,
+      347,
+      348,
+      349,
+      350,
+      351,
+      352,
+      353,
+      354,
+      355,
+      356,
+      357,
+      358,
+      359,
+      360,
+      361,
+      362,
+      363,
+      364,
+      365,
+      366,
+      367,
+      368,
+      369,
+      370,
+      371,
+      372,
+      373,
+      374,
+      375,
+      376,
+      377,
+      378,
+      379,
+      380,
+      381,
+      382,
+      383,
+      384,
+      385,
+      386,
+      387,
+      388,
+      389,
+      390,
+      391,
+      392,
+      393,
+      394,
+      395,
+      396,
+      397,
+      398,
+      399,
+      400,
+      401,
+      402,
+      403,
+      404,
+      405,
+      406,
+      407,
+      408,
+      409,
+      410,
+      411,
+      412,
+      413,
+      414,
+      415,
+      416,
+      417,
+      418,
+      419,
+      420,
+      421,
+      422,
+      423,
+      424,
+      425,
+      426,
+      427,
+      428,
+      429,
+      430,
+      431,
+      432,
+      433,
+      434,
+      435,
+      436,
+      437,
+      438,
+      439,
+      440,
+      441,
+      442,
+      443,
+      444,
+      445,
+      446,
+      447,
+      448,
+      449,
+      450,
+      451,
+      452,
+      453,
+      454,
+      455,
+      456,
+      457,
+      458,
+      459,
+      460,
+      461,
+      462,
+      463,
+      464,
+      465,
+      466,
+      467,
+      468,
+      469,
+      470,
+      471,
+      472,
+      473,
+      474,
+      475,
+      476,
+      477,
+      478,
+      479,
+      480,
+      481,
+      482,
+      483,
+      484,
+      485,
+      486,
+      487,
+      488,
+      489,
+      490,
+      491,
+      492,
+      493,
+      494,
+      495,
+      496,
+      497,
+      498,
+      499,
+      500,
+      501,
+      502,
+      503,
+      504,
+      505,
+      506,
+      507,
+      508,
+      509,
+      510,
+      511,
+      512,
+      513,
+      514,
+      515,
+      516,
+      517,
+      518,
+      519,
+      520,
+      521,
+      522,
+      523,
+      524,
+      525,
+      526,
+      527,
+      528,
+      529,
+      530,
+      531,
+      532,
+      533,
+      534,
+      535,
+      536,
+      537,
+      538,
+      539,
+      540,
+      541,
+      542,
+      543,
+      544,
+      545,
+      546,
+      547,
+      548,
+      549,
+      550,
+      551,
+      552,
+      553,
+      554,
+      555,
+      556,
+      557,
+      558,
+      559,
+      560,
+      561,
+      562,
+      563,
+      565,
+      566,
+      567,
+      568,
+      570,
+      571,
+      572,
+      573,
+      574,
+      575,
+      576,
+      577,
+      578,
+      579,
+      580,
+      581,
+      582,
+      583,
+      584,
+      585,
+      586,
+      587,
+      588,
+      589,
+      590,
+      591,
+      592,
+      593,
+      594,
+      595,
+      596,
+      597,
+      598,
+      601,
+      602,
+      603,
+      604,
+      605,
+      606,
+      607,
+      608,
+      609,
+      610,
+      611,
+      612,
+      613,
+      614,
+      615,
+      616,
+      617,
+      618,
+      619,
+      620,
+      621,
+      622,
+      623,
+      624,
+      664,
+      665,
+      666,
+      667,
+      668,
+      669,
+      670,
+      671,
+      672,
+      673,
+      674,
+      675,
+      676,
+      677,
+      678,
+      679,
+      680,
+      681,
+      682,
+      683,
+      684,
+      685,
+      686,
+      687,
+      688,
+      689,
+      690,
+      691,
+      692,
+      693,
+      694,
+      695,
+      696,
+      697,
+      698,
+      699,
+      700,
+      701,
+      702,
+      703,
+      704,
+      705,
+      706,
+      707,
+      708,
+      709,
+      710,
+      711,
+      712,
+      713,
+      714,
+      715,
+      716,
+      717,
+      718,
+      719,
+      720,
+      721,
+      722,
+      723,
+      724,
+      725,
+      726,
+      727,
+      728,
+      729,
+      730,
+      731,
+      732,
+      733,
+      734,
+      735,
+      736,
+      737,
+      739,
+      740,
+      741,
+      742,
+      743,
+      744,
+      745,
+      746,
+      747,
+      748,
+      749,
+      750,
+      751,
+      752,
+      753,
+      754,
+      755,
+      756,
+      757,
+      758,
+      759,
+      760,
+      761,
+      762,
+      763,
+      764,
+      765,
+      766,
+      767,
+      768,
+      772,
+      773,
+      774,
+      775,
+      776,
+      777,
+      778,
+      779,
+      780,
+      781,
+      782,
+      783,
+      784,
+      785,
+      786,
+      787,
+      788,
+      789,
+      790,
+      791,
+      793,
+      794,
+      795,
+      796,
+      797,
+      798,
+      799,
+      800,
+      801,
+      802,
+      803,
+      804,
+      805,
+      806,
+      807,
+      808,
+      825,
+      826,
+      827,
+      828,
+      829,
+      830,
+      831,
+      832,
+      833,
+      834,
+      835,
+      836,
+      837,
+      838,
+      839,
+      840,
+      841,
+      842,
+      843,
+      844,
+      845,
+      846,
+      847,
+      848,
+      849,
+      850,
+      851,
+      852,
+      853,
+      854,
+      855,
+      856,
+      857,
+      858,
+      859,
+      860,
+      861,
+      862,
+      863,
+      864,
+      865,
+      866,
+      867,
+      868,
+      869,
+      870,
+      871,
+      872,
+      873,
+      874,
+      875,
+      876,
+      877,
+      878,
+      879,
+      880,
+      881,
+      882,
+      883,
+      884,
+      885,
+      886,
+      887,
+      888,
+      889,
+      890,
+      891,
+      892,
+      893,
+      894,
+      895,
+      896,
+      897,
+      898,
+      899,
+      900,
+      901,
+      902,
+      903,
+      906,
+      907,
+      913,
+      914,
+      915,
+      917,
+      920,
+      921,
+      922,
+      923,
+      924,
+      925,
+      926,
+      927,
+      928,
+      929,
+      930,
+      931,
+      932,
+      933,
+      934,
+      935,
+      936,
+      937,
+      938,
+      939,
+      940,
+      941,
+      942,
+      943,
+      944,
+      945,
+      946,
+      947,
+      948,
+      949,
+      950,
+      951,
+      952,
+      953,
+      954,
+      955,
+      956,
+      957,
+      958,
+      959,
+      960,
+      961,
+      962,
+      963,
+      964,
+      965,
+      966,
+      967,
+      968,
+      969,
+      970,
+      971,
+      972,
+      973,
+      974,
+      975,
+      976,
+      977,
+      978,
+      979,
+      980,
+      981,
+      982,
+      983,
+      984,
+      985,
+      1001,
+      1002,
+      1003,
+      1004,
+      1005,
+      1006,
+      1007,
+      1008,
+      1009,
+      1010,
+      1011,
+      1012,
+      1013,
+      1014,
+      1015,
+      1016,
+      1017,
+      1018,
+      1019,
+      1020,
+      1021,
+      1022,
+      1023,
+      1024,
+      1025,
+      1026,
+      1027,
+      1028,
+      1029,
+      1030,
+      1031,
+      1032,
+      1033,
+      1034,
+      1035,
+      1036,
+      1037,
+      1038,
+      1039,
+      1040,
+      1041,
+      1042,
+      1043,
+      1044,
+      1045,
+      1046,
+      1047,
+      1048,
+      1049,
+      1050,
+      1051,
+      1052,
+      1053,
+      1054,
+      1055,
+      1056,
+      1057,
+      1058,
+      1059,
+      1060,
+      1061,
+      1062,
+      1063,
+      1064,
+      1065,
+      1066,
+      1067,
+      1068,
+      1069,
+      1070,
+      1071,
+      1072,
+      1073,
+      1074,
+      1075,
+      1076,
+      1077,
+      1078,
+      1079,
+      1080,
+      1081,
+      1082,
+      1083,
+      1084,
+      1085,
+      1086,
+      1087,
+      1088,
+      1089,
+      1090,
+      1091,
+      1092,
+      1093,
+      1094,
+      1095,
+      1096,
+      1097,
+      1098,
+      1099,
+      1100,
+      1101,
+      1102,
+      1103,
+      1104,
+      1105,
+      1106,
+      1107,
+      1108,
+      1109,
+      1110,
+      1111,
+      1112,
+      1113,
+      1114,
+      1115,
+      1116,
+      1117,
+      1118,
+      1119,
+      1120,
+      1121,
+      1122,
+      1123,
+      1124,
+      1125
+    ]
+  },
+  "generation": {
+    "provider": "responses",
+    "reasoning_effort": "high",
+    "max_output_tokens": 32768,
+    "timeout": 600,
+    "stream": false,
+    "prompt_profile": "legacy",
+    "schema_context_chars": 24000,
+    "model": "gpt-5.6-sol"
+  },
+  "execution": {
+    "timeout": 90,
+    "memory": "6g",
+    "cpus": 2.0,
+    "tmpfs": "256m",
+    "image": "inferencenet-eval:20260911"
+  },
+  "original_campaign": {
+    "workers": 12,
+    "execution_workers": 3,
+    "max_attempts": 1,
+    "stop_after_errors": 3
+  },
+  "original_limits_for_this_arm": {
+    "output_tokens": 32768,
+    "wall_seconds": 600,
+    "model_calls": 1,
+    "tool_calls": 0,
+    "tool_timeout": 90
+  },
+  "original_scoring": {
+    "profile": "local-paper-v1"
+  },
+  "schedule_seed": 20260911,
+  "transport_compatibility": null,
+  "final_phase_policy": {
+    "dispatch_workers": 3,
+    "execution_workers": 3,
+    "reason": "Retain the actual parent operating point symmetrically. Preserve original model, route, credentials, prompts, budgets, execution capacity and all source identities; no correctness scores informed this policy."
+  },
+  "final_amendment_summary": {
+    "id": "sol-deepagents-external-20260912-04",
+    "adopted_at_utc": "2026-09-11T18:53:33.663029+00:00",
+    "reason": "User authorized continuation after the unsealed external process stop. Preserve 1528 inherited resolutions and all original evidence, separately adjudicate three audited externally interrupted slots without inventing results or retrying requests, and allow first dispatch of all 469 never-attempted slots. Preserve the same 3/3 operating conditions. Full denominator, unknown usage and all 32 interrupted slots remain in the analysis. Exact parent exit cause remains unknown; no new HTTP 429 or cooldown receipt is invented.",
+    "timing_policy": "active_elapsed_excluding_documented_pause",
+    "unknown_policy": "global_halt",
+    "phase_policy": {
+      "dispatch_workers": 3,
+      "execution_workers": 3,
+      "reason": "Retain the actual parent operating point symmetrically. Preserve original model, route, credentials, prompts, budgets, execution capacity and all source identities; no correctness scores informed this policy."
+    }
+  },
+  "evidence_class": "amended_comparison",
+  "source_identity": {
+    "original_protocol_sha256": "82273270dbfe6e2969eb036bbf89f5d38e82d41c2169324f869d41937de06f17",
+    "accepted_summary_sha256": "a50fe4b4c45ca6aa199cf41d85a1c866d819766aa44c7f63004631020a795057",
+    "accepted_private_audit_sha256": "c5daf0bc9a8d3c8ba69d5b188fa9a55ed5a64fa1e84141dddd1f03a7c555b5a6",
+    "metric_function_source_sha256": "f6a6190e97f8bf5c499e97de74f0b882ebb8322dea92e0543711d523ffe6cba3",
+    "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f"
+  },
+  "notes": [
+    "Archived historical amended comparison; this upload does not rerun the experiment.",
+    "Source identities are hashes of the frozen protocol and accepted export; no latest-framework commit is substituted.",
+    "Null amendment or phase fields mean absent from the selected run root, not proof of an uninterrupted run.",
+    "No complete verified token or monetary totals are supplied; missing usage is not zero."
+  ]
+}

results/gpt-5.6-sol/baseline/summary.json

@@ -0,0 +1,121 @@
+{
+  "schema_version": 1,
+  "kind": "inferencenet-offline-leaderboard-export",
+  "generated_at": "2026-09-13T17:49:16.537733+00:00",
+  "model": "gpt-5.6-sol",
+  "metric_profile": "hf-leaderboard-v1",
+  "definitions": {
+    "compilation_success": "Trusted evidence of complete code execution; no prediction JSON gate.",
+    "partial_replication": "Coefficient relative error <= .05; no standard-error or p-value gate.",
+    "coefficient_direction": "Matching strictly positive or strictly negative coefficient signs.",
+    "significance_level": "Equal p-value category: p < .01, p < .05, p < .1, otherwise; no direction gate."
+  },
+  "assumptions": {
+    "official_rules": "Webpage interpretation only; official scorer parity is not verified.",
+    "compilation_evidence": "Caller supplies True, False, or None from verified execution evidence, including exit status, timeout, termination confirmation, and execution errors. Missing or uncertain evidence maps to None.",
+    "prediction_evidence": "Only execution_status=succeeded and scoring_status=scored rows are evaluated. The current caller requires a complete valid prediction triplet; invalid outputs are not recovered here.",
+    "coefficient_boundary": "5% includes equality. Numeric decimal representations are compared exactly without epsilon.",
+    "zero_reference_coefficient": "A zero reference coefficient is unknown for relative error and positive/negative direction; it does not block significance. A zero prediction against a nonzero reference is incorrect.",
+    "significance_categories": "Four categories use strict .01, .05, and .1 boundaries. Both p-values must be numeric and within [0, 1]. These boundaries and the absent direction gate are explicit local choices.",
+    "field_validation": "Each metric requires only its own finite numeric fields. Booleans, numeric strings, and inequalities are not coerced. Standard errors do not affect any of these three formulas.",
+    "denominator": "All planned tasks remain in every denominator. Confirmed compilation failures are False; missing or uncertain execution evidence is unknown. For the three result metrics, failed execution, missing predictions, unscored rows, and unsupported reference fields are unknown. Unknowns contribute no successes and are counted separately.",
+    "attempt_selection": "The caller supplies one row per task under its frozen attempt policy."
+  },
+  "definition_source": "https://huggingface.co/spaces/CamoAiLab/InferenceNet-Leaderboard/blob/bc367a8b8cabc9b06aac093406942b72cc5837a7/index.html#L616",
+  "official_parity_verified": false,
+  "evidence_class": "amended_comparison",
+  "original_protocol_complete": false,
+  "complete": true,
+  "dataset_revision": "59f9512a38e594528807744214a60ee00367434e",
+  "protocol_sha256": "82273270dbfe6e2969eb036bbf89f5d38e82d41c2169324f869d41937de06f17",
+  "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f",
+  "arm": "baseline",
+  "included_in_displayed_leaderboard": false,
+  "publication_kind": "results_archive",
+  "result": {
+    "metrics": {
+      "compilation_success": {
+        "count": 557,
+        "denominator": 1000,
+        "rate": 0.557,
+        "score": 55.7,
+        "unknown_count": 3
+      },
+      "partial_replication": {
+        "count": 430,
+        "denominator": 1000,
+        "rate": 0.43,
+        "score": 43.0,
+        "unknown_count": 444
+      },
+      "coefficient_direction": {
+        "count": 537,
+        "denominator": 1000,
+        "rate": 0.537,
+        "score": 53.7,
+        "unknown_count": 444
+      },
+      "significance_level": {
+        "count": 485,
+        "denominator": 1000,
+        "rate": 0.485,
+        "score": 48.5,
+        "unknown_count": 444
+      }
+    },
+    "row": {
+      "Model ID": "gpt-5.6-sol baseline",
+      "Compilation Success": 55.7,
+      "Partial Replication": 43.0,
+      "Correct Coefficient Direction": 53.7,
+      "Significant Level Correctness": 48.5
+    },
+    "columns": [
+      "Model ID",
+      "Compilation Success",
+      "Partial Replication",
+      "Correct Coefficient Direction",
+      "Significant Level Correctness"
+    ],
+    "expected_count": 1000,
+    "resolved_count": 1000,
+    "valid_prediction_count": 556,
+    "interruption_count": 3
+  },
+  "legacy_local_paper": {
+    "verified": true,
+    "profile": "local-paper-v1",
+    "metrics": {
+      "perfect": {
+        "count": 338,
+        "denominator": 1000,
+        "rate": 0.338,
+        "unknown_count": 445
+      },
+      "partial": {
+        "count": 377,
+        "denominator": 1000,
+        "rate": 0.377,
+        "unknown_count": 445
+      },
+      "coefficient_only": {
+        "count": 429,
+        "denominator": 1000,
+        "rate": 0.429,
+        "unknown_count": 445
+      },
+      "direction": {
+        "count": 536,
+        "denominator": 1000,
+        "rate": 0.536,
+        "unknown_count": 445
+      },
+      "significance": {
+        "count": 473,
+        "denominator": 1000,
+        "rate": 0.473,
+        "unknown_count": 445
+      }
+    }
+  }
+}

results/gpt-5.6-sol/deepagents/README.md

@@ -0,0 +1,11 @@
+# gpt-5.6-sol / deepagents
+
+已完成的 1,000 题结果归档；不自动更新正式榜单。
+
+- `results.jsonl` / `results.csv`：逐题预测、执行/评分状态和四维指标；两种格式内容相同。
+- `summary.json`：固定 1,000 题分母、未知计数，以及分别保存的四维导出和旧诊断指标。
+- `config.json`：数据 revision、完整任务 ID 清单、生成/执行预算及来源哈希。
+
+这是经过中断处置与恢复的历史对照（amended comparison）。完成计数包含失败和未知，不能当作成功率。四维导出依据榜单页面文字解释，尚未验证与实际官方评分器完全一致；正式整理榜单时再统一核对。
+
+JSON null / CSV 空单元格表示未知或不可用，不表示 0。原始输入数据、隐藏参考答案、完整提示词/API 轨迹、凭据和本机路径未包含在这个归档中。

results/gpt-5.6-sol/deepagents/config.json

@@ -0,0 +1,1083 @@
+{
+  "schema_version": 1,
+  "model": "gpt-5.6-sol",
+  "arm": "deepagents",
+  "harness": "DeepAgents",
+  "source_run_name": "sol-deepagents-full1000-20260912-external-04",
+  "archived_at_utc": "2026-09-15T07:29:39.569697+00:00",
+  "dataset": {
+    "repo_id": "CamoAiLab/InferenceNet",
+    "revision": "59f9512a38e594528807744214a60ee00367434e",
+    "csv_sha256": "5338c8af548b35dab0e92a63b0acfebb0bc29c7901da4088851025f5709d6bb3",
+    "expected_tasks": 1000,
+    "official_metadata_sha256": "afd1712981d218c6cf3a093635968b3c07222aa0387a5bf01adabcef5707d4aa",
+    "task_ids": [
+      1,
+      2,
+      3,
+      4,
+      5,
+      6,
+      7,
+      8,
+      9,
+      10,
+      11,
+      12,
+      13,
+      14,
+      15,
+      16,
+      17,
+      18,
+      19,
+      20,
+      21,
+      22,
+      23,
+      24,
+      25,
+      26,
+      27,
+      28,
+      29,
+      30,
+      31,
+      32,
+      33,
+      34,
+      35,
+      36,
+      37,
+      38,
+      39,
+      40,
+      41,
+      42,
+      43,
+      44,
+      45,
+      46,
+      47,
+      48,
+      49,
+      50,
+      51,
+      52,
+      53,
+      54,
+      55,
+      56,
+      57,
+      58,
+      59,
+      60,
+      61,
+      62,
+      63,
+      64,
+      65,
+      66,
+      67,
+      68,
+      69,
+      70,
+      71,
+      72,
+      73,
+      74,
+      75,
+      76,
+      77,
+      78,
+      79,
+      80,
+      81,
+      82,
+      83,
+      84,
+      85,
+      86,
+      87,
+      88,
+      89,
+      90,
+      91,
+      92,
+      93,
+      94,
+      95,
+      96,
+      97,
+      98,
+      100,
+      101,
+      102,
+      103,
+      104,
+      105,
+      106,
+      107,
+      108,
+      109,
+      110,
+      111,
+      112,
+      113,
+      114,
+      115,
+      116,
+      117,
+      118,
+      119,
+      120,
+      121,
+      122,
+      123,
+      124,
+      125,
+      126,
+      127,
+      128,
+      129,
+      130,
+      131,
+      132,
+      133,
+      134,
+      135,
+      136,
+      137,
+      138,
+      139,
+      140,
+      141,
+      142,
+      143,
+      144,
+      145,
+      146,
+      147,
+      148,
+      149,
+      150,
+      151,
+      152,
+      153,
+      154,
+      155,
+      156,
+      157,
+      158,
+      159,
+      160,
+      161,
+      162,
+      163,
+      164,
+      165,
+      166,
+      167,
+      168,
+      169,
+      170,
+      171,
+      172,
+      173,
+      174,
+      175,
+      176,
+      177,
+      178,
+      179,
+      180,
+      181,
+      182,
+      183,
+      184,
+      185,
+      186,
+      187,
+      188,
+      189,
+      190,
+      191,
+      192,
+      193,
+      194,
+      195,
+      196,
+      197,
+      198,
+      199,
+      200,
+      201,
+      202,
+      203,
+      204,
+      205,
+      206,
+      207,
+      208,
+      209,
+      210,
+      211,
+      212,
+      213,
+      214,
+      215,
+      216,
+      217,
+      218,
+      219,
+      220,
+      221,
+      222,
+      223,
+      224,
+      225,
+      226,
+      227,
+      228,
+      229,
+      230,
+      231,
+      232,
+      233,
+      234,
+      235,
+      236,
+      237,
+      238,
+      239,
+      240,
+      241,
+      242,
+      248,
+      249,
+      250,
+      251,
+      252,
+      253,
+      254,
+      255,
+      256,
+      257,
+      258,
+      259,
+      261,
+      262,
+      263,
+      264,
+      265,
+      266,
+      290,
+      291,
+      292,
+      293,
+      294,
+      295,
+      302,
+      303,
+      304,
+      305,
+      306,
+      307,
+      308,
+      309,
+      310,
+      311,
+      312,
+      313,
+      314,
+      315,
+      316,
+      317,
+      318,
+      319,
+      320,
+      321,
+      322,
+      323,
+      324,
+      325,
+      326,
+      327,
+      328,
+      329,
+      330,
+      331,
+      332,
+      333,
+      334,
+      335,
+      336,
+      337,
+      338,
+      339,
+      340,
+      341,
+      342,
+      343,
+      344,
+      345,
+      346,
+      347,
+      348,
+      349,
+      350,
+      351,
+      352,
+      353,
+      354,
+      355,
+      356,
+      357,
+      358,
+      359,
+      360,
+      361,
+      362,
+      363,
+      364,
+      365,
+      366,
+      367,
+      368,
+      369,
+      370,
+      371,
+      372,
+      373,
+      374,
+      375,
+      376,
+      377,
+      378,
+      379,
+      380,
+      381,
+      382,
+      383,
+      384,
+      385,
+      386,
+      387,
+      388,
+      389,
+      390,
+      391,
+      392,
+      393,
+      394,
+      395,
+      396,
+      397,
+      398,
+      399,
+      400,
+      401,
+      402,
+      403,
+      404,
+      405,
+      406,
+      407,
+      408,
+      409,
+      410,
+      411,
+      412,
+      413,
+      414,
+      415,
+      416,
+      417,
+      418,
+      419,
+      420,
+      421,
+      422,
+      423,
+      424,
+      425,
+      426,
+      427,
+      428,
+      429,
+      430,
+      431,
+      432,
+      433,
+      434,
+      435,
+      436,
+      437,
+      438,
+      439,
+      440,
+      441,
+      442,
+      443,
+      444,
+      445,
+      446,
+      447,
+      448,
+      449,
+      450,
+      451,
+      452,
+      453,
+      454,
+      455,
+      456,
+      457,
+      458,
+      459,
+      460,
+      461,
+      462,
+      463,
+      464,
+      465,
+      466,
+      467,
+      468,
+      469,
+      470,
+      471,
+      472,
+      473,
+      474,
+      475,
+      476,
+      477,
+      478,
+      479,
+      480,
+      481,
+      482,
+      483,
+      484,
+      485,
+      486,
+      487,
+      488,
+      489,
+      490,
+      491,
+      492,
+      493,
+      494,
+      495,
+      496,
+      497,
+      498,
+      499,
+      500,
+      501,
+      502,
+      503,
+      504,
+      505,
+      506,
+      507,
+      508,
+      509,
+      510,
+      511,
+      512,
+      513,
+      514,
+      515,
+      516,
+      517,
+      518,
+      519,
+      520,
+      521,
+      522,
+      523,
+      524,
+      525,
+      526,
+      527,
+      528,
+      529,
+      530,
+      531,
+      532,
+      533,
+      534,
+      535,
+      536,
+      537,
+      538,
+      539,
+      540,
+      541,
+      542,
+      543,
+      544,
+      545,
+      546,
+      547,
+      548,
+      549,
+      550,
+      551,
+      552,
+      553,
+      554,
+      555,
+      556,
+      557,
+      558,
+      559,
+      560,
+      561,
+      562,
+      563,
+      565,
+      566,
+      567,
+      568,
+      570,
+      571,
+      572,
+      573,
+      574,
+      575,
+      576,
+      577,
+      578,
+      579,
+      580,
+      581,
+      582,
+      583,
+      584,
+      585,
+      586,
+      587,
+      588,
+      589,
+      590,
+      591,
+      592,
+      593,
+      594,
+      595,
+      596,
+      597,
+      598,
+      601,
+      602,
+      603,
+      604,
+      605,
+      606,
+      607,
+      608,
+      609,
+      610,
+      611,
+      612,
+      613,
+      614,
+      615,
+      616,
+      617,
+      618,
+      619,
+      620,
+      621,
+      622,
+      623,
+      624,
+      664,
+      665,
+      666,
+      667,
+      668,
+      669,
+      670,
+      671,
+      672,
+      673,
+      674,
+      675,
+      676,
+      677,
+      678,
+      679,
+      680,
+      681,
+      682,
+      683,
+      684,
+      685,
+      686,
+      687,
+      688,
+      689,
+      690,
+      691,
+      692,
+      693,
+      694,
+      695,
+      696,
+      697,
+      698,
+      699,
+      700,
+      701,
+      702,
+      703,
+      704,
+      705,
+      706,
+      707,
+      708,
+      709,
+      710,
+      711,
+      712,
+      713,
+      714,
+      715,
+      716,
+      717,
+      718,
+      719,
+      720,
+      721,
+      722,
+      723,
+      724,
+      725,
+      726,
+      727,
+      728,
+      729,
+      730,
+      731,
+      732,
+      733,
+      734,
+      735,
+      736,
+      737,
+      739,
+      740,
+      741,
+      742,
+      743,
+      744,
+      745,
+      746,
+      747,
+      748,
+      749,
+      750,
+      751,
+      752,
+      753,
+      754,
+      755,
+      756,
+      757,
+      758,
+      759,
+      760,
+      761,
+      762,
+      763,
+      764,
+      765,
+      766,
+      767,
+      768,
+      772,
+      773,
+      774,
+      775,
+      776,
+      777,
+      778,
+      779,
+      780,
+      781,
+      782,
+      783,
+      784,
+      785,
+      786,
+      787,
+      788,
+      789,
+      790,
+      791,
+      793,
+      794,
+      795,
+      796,
+      797,
+      798,
+      799,
+      800,
+      801,
+      802,
+      803,
+      804,
+      805,
+      806,
+      807,
+      808,
+      825,
+      826,
+      827,
+      828,
+      829,
+      830,
+      831,
+      832,
+      833,
+      834,
+      835,
+      836,
+      837,
+      838,
+      839,
+      840,
+      841,
+      842,
+      843,
+      844,
+      845,
+      846,
+      847,
+      848,
+      849,
+      850,
+      851,
+      852,
+      853,
+      854,
+      855,
+      856,
+      857,
+      858,
+      859,
+      860,
+      861,
+      862,
+      863,
+      864,
+      865,
+      866,
+      867,
+      868,
+      869,
+      870,
+      871,
+      872,
+      873,
+      874,
+      875,
+      876,
+      877,
+      878,
+      879,
+      880,
+      881,
+      882,
+      883,
+      884,
+      885,
+      886,
+      887,
+      888,
+      889,
+      890,
+      891,
+      892,
+      893,
+      894,
+      895,
+      896,
+      897,
+      898,
+      899,
+      900,
+      901,
+      902,
+      903,
+      906,
+      907,
+      913,
+      914,
+      915,
+      917,
+      920,
+      921,
+      922,
+      923,
+      924,
+      925,
+      926,
+      927,
+      928,
+      929,
+      930,
+      931,
+      932,
+      933,
+      934,
+      935,
+      936,
+      937,
+      938,
+      939,
+      940,
+      941,
+      942,
+      943,
+      944,
+      945,
+      946,
+      947,
+      948,
+      949,
+      950,
+      951,
+      952,
+      953,
+      954,
+      955,
+      956,
+      957,
+      958,
+      959,
+      960,
+      961,
+      962,
+      963,
+      964,
+      965,
+      966,
+      967,
+      968,
+      969,
+      970,
+      971,
+      972,
+      973,
+      974,
+      975,
+      976,
+      977,
+      978,
+      979,
+      980,
+      981,
+      982,
+      983,
+      984,
+      985,
+      1001,
+      1002,
+      1003,
+      1004,
+      1005,
+      1006,
+      1007,
+      1008,
+      1009,
+      1010,
+      1011,
+      1012,
+      1013,
+      1014,
+      1015,
+      1016,
+      1017,
+      1018,
+      1019,
+      1020,
+      1021,
+      1022,
+      1023,
+      1024,
+      1025,
+      1026,
+      1027,
+      1028,
+      1029,
+      1030,
+      1031,
+      1032,
+      1033,
+      1034,
+      1035,
+      1036,
+      1037,
+      1038,
+      1039,
+      1040,
+      1041,
+      1042,
+      1043,
+      1044,
+      1045,
+      1046,
+      1047,
+      1048,
+      1049,
+      1050,
+      1051,
+      1052,
+      1053,
+      1054,
+      1055,
+      1056,
+      1057,
+      1058,
+      1059,
+      1060,
+      1061,
+      1062,
+      1063,
+      1064,
+      1065,
+      1066,
+      1067,
+      1068,
+      1069,
+      1070,
+      1071,
+      1072,
+      1073,
+      1074,
+      1075,
+      1076,
+      1077,
+      1078,
+      1079,
+      1080,
+      1081,
+      1082,
+      1083,
+      1084,
+      1085,
+      1086,
+      1087,
+      1088,
+      1089,
+      1090,
+      1091,
+      1092,
+      1093,
+      1094,
+      1095,
+      1096,
+      1097,
+      1098,
+      1099,
+      1100,
+      1101,
+      1102,
+      1103,
+      1104,
+      1105,
+      1106,
+      1107,
+      1108,
+      1109,
+      1110,
+      1111,
+      1112,
+      1113,
+      1114,
+      1115,
+      1116,
+      1117,
+      1118,
+      1119,
+      1120,
+      1121,
+      1122,
+      1123,
+      1124,
+      1125
+    ]
+  },
+  "generation": {
+    "provider": "responses",
+    "reasoning_effort": "high",
+    "max_output_tokens": 32768,
+    "timeout": 600,
+    "stream": false,
+    "prompt_profile": "legacy",
+    "schema_context_chars": 24000,
+    "model": "gpt-5.6-sol"
+  },
+  "execution": {
+    "timeout": 90,
+    "memory": "6g",
+    "cpus": 2.0,
+    "tmpfs": "256m",
+    "image": "inferencenet-eval:20260911"
+  },
+  "original_campaign": {
+    "workers": 12,
+    "execution_workers": 3,
+    "max_attempts": 1,
+    "stop_after_errors": 3
+  },
+  "original_limits_for_this_arm": {
+    "output_tokens": 32768,
+    "wall_seconds": 600,
+    "model_calls": 6,
+    "tool_calls": 4,
+    "tool_timeout": 90
+  },
+  "original_scoring": {
+    "profile": "local-paper-v1"
+  },
+  "schedule_seed": 20260911,
+  "transport_compatibility": null,
+  "final_phase_policy": {
+    "dispatch_workers": 3,
+    "execution_workers": 3,
+    "reason": "Retain the actual parent operating point symmetrically. Preserve original model, route, credentials, prompts, budgets, execution capacity and all source identities; no correctness scores informed this policy."
+  },
+  "final_amendment_summary": {
+    "id": "sol-deepagents-external-20260912-04",
+    "adopted_at_utc": "2026-09-11T18:53:33.663029+00:00",
+    "reason": "User authorized continuation after the unsealed external process stop. Preserve 1528 inherited resolutions and all original evidence, separately adjudicate three audited externally interrupted slots without inventing results or retrying requests, and allow first dispatch of all 469 never-attempted slots. Preserve the same 3/3 operating conditions. Full denominator, unknown usage and all 32 interrupted slots remain in the analysis. Exact parent exit cause remains unknown; no new HTTP 429 or cooldown receipt is invented.",
+    "timing_policy": "active_elapsed_excluding_documented_pause",
+    "unknown_policy": "global_halt",
+    "phase_policy": {
+      "dispatch_workers": 3,
+      "execution_workers": 3,
+      "reason": "Retain the actual parent operating point symmetrically. Preserve original model, route, credentials, prompts, budgets, execution capacity and all source identities; no correctness scores informed this policy."
+    }
+  },
+  "evidence_class": "amended_comparison",
+  "source_identity": {
+    "original_protocol_sha256": "82273270dbfe6e2969eb036bbf89f5d38e82d41c2169324f869d41937de06f17",
+    "accepted_summary_sha256": "a50fe4b4c45ca6aa199cf41d85a1c866d819766aa44c7f63004631020a795057",
+    "accepted_private_audit_sha256": "c5daf0bc9a8d3c8ba69d5b188fa9a55ed5a64fa1e84141dddd1f03a7c555b5a6",
+    "metric_function_source_sha256": "f6a6190e97f8bf5c499e97de74f0b882ebb8322dea92e0543711d523ffe6cba3",
+    "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f"
+  },
+  "notes": [
+    "Archived historical amended comparison; this upload does not rerun the experiment.",
+    "Source identities are hashes of the frozen protocol and accepted export; no latest-framework commit is substituted.",
+    "Null amendment or phase fields mean absent from the selected run root, not proof of an uninterrupted run.",
+    "No complete verified token or monetary totals are supplied; missing usage is not zero."
+  ]
+}

results/gpt-5.6-sol/deepagents/summary.json

@@ -0,0 +1,121 @@
+{
+  "schema_version": 1,
+  "kind": "inferencenet-offline-leaderboard-export",
+  "generated_at": "2026-09-13T17:49:16.537733+00:00",
+  "model": "gpt-5.6-sol",
+  "metric_profile": "hf-leaderboard-v1",
+  "definitions": {
+    "compilation_success": "Trusted evidence of complete code execution; no prediction JSON gate.",
+    "partial_replication": "Coefficient relative error <= .05; no standard-error or p-value gate.",
+    "coefficient_direction": "Matching strictly positive or strictly negative coefficient signs.",
+    "significance_level": "Equal p-value category: p < .01, p < .05, p < .1, otherwise; no direction gate."
+  },
+  "assumptions": {
+    "official_rules": "Webpage interpretation only; official scorer parity is not verified.",
+    "compilation_evidence": "Caller supplies True, False, or None from verified execution evidence, including exit status, timeout, termination confirmation, and execution errors. Missing or uncertain evidence maps to None.",
+    "prediction_evidence": "Only execution_status=succeeded and scoring_status=scored rows are evaluated. The current caller requires a complete valid prediction triplet; invalid outputs are not recovered here.",
+    "coefficient_boundary": "5% includes equality. Numeric decimal representations are compared exactly without epsilon.",
+    "zero_reference_coefficient": "A zero reference coefficient is unknown for relative error and positive/negative direction; it does not block significance. A zero prediction against a nonzero reference is incorrect.",
+    "significance_categories": "Four categories use strict .01, .05, and .1 boundaries. Both p-values must be numeric and within [0, 1]. These boundaries and the absent direction gate are explicit local choices.",
+    "field_validation": "Each metric requires only its own finite numeric fields. Booleans, numeric strings, and inequalities are not coerced. Standard errors do not affect any of these three formulas.",
+    "denominator": "All planned tasks remain in every denominator. Confirmed compilation failures are False; missing or uncertain execution evidence is unknown. For the three result metrics, failed execution, missing predictions, unscored rows, and unsupported reference fields are unknown. Unknowns contribute no successes and are counted separately.",
+    "attempt_selection": "The caller supplies one row per task under its frozen attempt policy."
+  },
+  "definition_source": "https://huggingface.co/spaces/CamoAiLab/InferenceNet-Leaderboard/blob/bc367a8b8cabc9b06aac093406942b72cc5837a7/index.html#L616",
+  "official_parity_verified": false,
+  "evidence_class": "amended_comparison",
+  "original_protocol_complete": false,
+  "complete": true,
+  "dataset_revision": "59f9512a38e594528807744214a60ee00367434e",
+  "protocol_sha256": "82273270dbfe6e2969eb036bbf89f5d38e82d41c2169324f869d41937de06f17",
+  "exporter_source_sha256": "c4bc5b16c438543d09d262123e4e93b499796d79355645819e37f51d677e594f",
+  "arm": "deepagents",
+  "included_in_displayed_leaderboard": false,
+  "publication_kind": "results_archive",
+  "result": {
+    "metrics": {
+      "compilation_success": {
+        "count": 910,
+        "denominator": 1000,
+        "rate": 0.91,
+        "score": 91.0,
+        "unknown_count": 10
+      },
+      "partial_replication": {
+        "count": 699,
+        "denominator": 1000,
+        "rate": 0.699,
+        "score": 69.89999999999999,
+        "unknown_count": 92
+      },
+      "coefficient_direction": {
+        "count": 879,
+        "denominator": 1000,
+        "rate": 0.879,
+        "score": 87.9,
+        "unknown_count": 92
+      },
+      "significance_level": {
+        "count": 787,
+        "denominator": 1000,
+        "rate": 0.787,
+        "score": 78.7,
+        "unknown_count": 93
+      }
+    },
+    "row": {
+      "Model ID": "gpt-5.6-sol + DeepAgents",
+      "Compilation Success": 91.0,
+      "Partial Replication": 69.89999999999999,
+      "Correct Coefficient Direction": 87.9,
+      "Significant Level Correctness": 78.7
+    },
+    "columns": [
+      "Model ID",
+      "Compilation Success",
+      "Partial Replication",
+      "Correct Coefficient Direction",
+      "Significant Level Correctness"
+    ],
+    "expected_count": 1000,
+    "resolved_count": 1000,
+    "valid_prediction_count": 909,
+    "interruption_count": 10
+  },
+  "legacy_local_paper": {
+    "verified": true,
+    "profile": "local-paper-v1",
+    "metrics": {
+      "perfect": {
+        "count": 518,
+        "denominator": 1000,
+        "rate": 0.518,
+        "unknown_count": 95
+      },
+      "partial": {
+        "count": 606,
+        "denominator": 1000,
+        "rate": 0.606,
+        "unknown_count": 95
+      },
+      "coefficient_only": {
+        "count": 697,
+        "denominator": 1000,
+        "rate": 0.697,
+        "unknown_count": 95
+      },
+      "direction": {
+        "count": 876,
+        "denominator": 1000,
+        "rate": 0.876,
+        "unknown_count": 95
+      },
+      "significance": {
+        "count": 775,
+        "denominator": 1000,
+        "rate": 0.775,
+        "unknown_count": 95
+      }
+    }
+  }
+}

results/index.json

@@ -0,0 +1,32 @@
+{
+  "schema_version": 1,
+  "kind": "results_archive",
+  "archived_at_utc": "2026-09-15T07:29:39.569697+00:00",
+  "displayed_leaderboard_updated": false,
+  "entries": [
+    {
+      "model": "gpt-5.6-sol",
+      "arm": "baseline",
+      "rows": 1000,
+      "path": "results/gpt-5.6-sol/baseline"
+    },
+    {
+      "model": "gpt-5.6-sol",
+      "arm": "deepagents",
+      "rows": 1000,
+      "path": "results/gpt-5.6-sol/deepagents"
+    },
+    {
+      "model": "claude-opus-4-8",
+      "arm": "baseline",
+      "rows": 1000,
+      "path": "results/claude-opus-4-8/baseline"
+    },
+    {
+      "model": "claude-opus-4-8",
+      "arm": "deepagents",
+      "rows": 1000,
+      "path": "results/claude-opus-4-8/deepagents"
+    }
+  ]
+}

results/manifest.sha256

@@ -0,0 +1,22 @@
+a81742c1a2a8c7667409f699b7aac78c4318141bcf6b3d33b3e3980d2976a61e  README.md
+2ad22f4778525b1460f1857e1095f2eea5620063fba1ffa6314ca7fd50f14703  claude-opus-4-8/baseline/README.md
+8058afcd14c34d666277c0f32ac5962398b10618df5b1aa0e13cd9862344dc56  claude-opus-4-8/baseline/config.json
+4d5f859e472b79195c9be6b1f0e9c5feecf59a81dfe32ac08eb4c1d4967ed98e  claude-opus-4-8/baseline/results.csv
+b9d6bd51c9eb81a634e78e422c86da16f655d97da87d3f5afa4c9aa0f96809f4  claude-opus-4-8/baseline/results.jsonl
+7b5b06bd9b3d7b47952b1dc424a01fcdf04ddccca0b3f64d04132358d6380cdc  claude-opus-4-8/baseline/summary.json
+dfb00967c2a2ff320d5a6d8c142cbc6ef37d4fb144abcc7a451673515c2b4c50  claude-opus-4-8/deepagents/README.md
+12215dfcba5d2d692268a305364514a03ff7579094b2d4af12f493383b8e0f21  claude-opus-4-8/deepagents/config.json
+bafc0a72cd4d8f53c1da33030250171f36ce441488bc8456cba8c3f52b80e6bd  claude-opus-4-8/deepagents/results.csv
+3bef3b9850f24b9cb0b5806efd8425c4e4cc650735a6b28b45befdd55a6ec28a  claude-opus-4-8/deepagents/results.jsonl
+f86da9c76f8becb75b4970c486160013209a6aa4239923018b217e55f1b0a614  claude-opus-4-8/deepagents/summary.json
+ed22b41edf2afe7a500f4caf1b61f0b4c6e6c73759522c543fb86ce478eb4d04  gpt-5.6-sol/baseline/README.md
+90ec4e0781b57498fef52de31eacf5c8ec9424549643865a7140a1ccdb04c1d4  gpt-5.6-sol/baseline/config.json
+a54171a3d3e7ecda3e61311414a84131e74a680bfa1342e8627cfaa32fc7c873  gpt-5.6-sol/baseline/results.csv
+3b12160382043e27531ff5cb3e23bccc9a8f7807e4121a82ffa13df28f65a859  gpt-5.6-sol/baseline/results.jsonl
+6d6ab1aaffe754e08f9656dcb5f51fcd5c772e60660dc34d86cfc21f3c5c03d7  gpt-5.6-sol/baseline/summary.json
+99a2c4edc5f8a2984e09211c7608f08cc29131e37241cc79b6c77b774d3b21fe  gpt-5.6-sol/deepagents/README.md
+a3e24175f2395cffbbcd6d9d3c89689bd3a3b22dd4ce61bb78d5da33c6b6cc1b  gpt-5.6-sol/deepagents/config.json
+27abe57119d4be49c56b29c318a1bc2757a97f44427764d7fc8d188be4d10671  gpt-5.6-sol/deepagents/results.csv
+378cdec8e7a880f091ba442649d1c034997acefdc623898b60a063baad29d7be  gpt-5.6-sol/deepagents/results.jsonl
+821ca6e55a66006c7fb958951a7859a9dccde29d87de8415d5c3f07f523563c5  gpt-5.6-sol/deepagents/summary.json
+72096fb6d8744ef0cbc32e6b169627a7a0f936e2902dad9ad42857ec8f3f1ec3  index.json