maxffarrell commited on
Commit
2a07692
·
verified ·
1 Parent(s): 1baf215

Publish completed seed-42 robustness diagnostics; full study pending

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +10 -0
  2. studies/robustness-seed42-20261011/.pytest_cache/.gitignore +2 -0
  3. studies/robustness-seed42-20261011/.pytest_cache/CACHEDIR.TAG +4 -0
  4. studies/robustness-seed42-20261011/.pytest_cache/README.md +8 -0
  5. studies/robustness-seed42-20261011/.pytest_cache/v/cache/nodeids +56 -0
  6. studies/robustness-seed42-20261011/LICENSE +21 -0
  7. studies/robustness-seed42-20261011/README.md +11 -0
  8. studies/robustness-seed42-20261011/SHA256SUMS +326 -0
  9. studies/robustness-seed42-20261011/artifacts/full/transformer/seed-42/checkpoint.pt +3 -0
  10. studies/robustness-seed42-20261011/artifacts/full/transformer/seed-42/normalization.json +993 -0
  11. studies/robustness-seed42-20261011/artifacts/full/transformer/seed-42/run.json +0 -0
  12. studies/robustness-seed42-20261011/artifacts/poc/data/manifest.json +0 -0
  13. studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/citylearn_battery_common_scale-assessments.json +0 -0
  14. studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/citylearn_battery_scale_shift-assessments.json +0 -0
  15. studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/original_heldout-assessments.json +0 -0
  16. studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/thresholds.json +344 -0
  17. studies/robustness-seed42-20261011/artifacts/robustness/behavior/behavior-diagnostic.json +0 -0
  18. studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/auditorium_3node-assessments.json +0 -0
  19. studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/original_heldout-assessments.json +0 -0
  20. studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/parameter_shift_2node-assessments.json +0 -0
  21. studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/small_room_3node-assessments.json +0 -0
  22. studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/thresholds.json +376 -0
  23. studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/interventions.json +0 -0
  24. studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/provenance.json +1598 -0
  25. studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/summary.json +1147 -0
  26. studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/verification.json +19 -0
  27. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/README.md +11 -0
  28. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/config.json +8 -0
  29. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283127.npz +0 -0
  30. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283128.npz +0 -0
  31. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283129.npz +0 -0
  32. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283130.npz +0 -0
  33. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283131.npz +0 -0
  34. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283132.npz +0 -0
  35. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283133.npz +0 -0
  36. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283134.npz +0 -0
  37. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283135.npz +0 -0
  38. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283136.npz +0 -0
  39. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283137.npz +0 -0
  40. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283138.npz +0 -0
  41. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283139.npz +0 -0
  42. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283140.npz +0 -0
  43. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283141.npz +0 -0
  44. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283142.npz +0 -0
  45. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283143.npz +0 -0
  46. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283144.npz +0 -0
  47. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283145.npz +0 -0
  48. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283146.npz +0 -0
  49. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283147.npz +0 -0
  50. studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283148.npz +0 -0
.gitattributes CHANGED
@@ -1,3 +1,13 @@
1
  *.pt filter=lfs diff=lfs merge=lfs -text
2
  *.onnx filter=lfs diff=lfs merge=lfs -text
3
  *.tar.gz filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
1
  *.pt filter=lfs diff=lfs merge=lfs -text
2
  *.onnx filter=lfs diff=lfs merge=lfs -text
3
  *.tar.gz filter=lfs diff=lfs merge=lfs -text
4
+ studies/robustness-seed42-20261011/artifacts/robustness/history/current_only-test.npz filter=lfs diff=lfs merge=lfs -text
5
+ studies/robustness-seed42-20261011/artifacts/robustness/history/full_history-test.npz filter=lfs diff=lfs merge=lfs -text
6
+ studies/robustness-seed42-20261011/artifacts/robustness/history/history_branch_disabled-test.npz filter=lfs diff=lfs merge=lfs -text
7
+ studies/robustness-seed42-20261011/artifacts/robustness/history/matched_family_swap-test.npz filter=lfs diff=lfs merge=lfs -text
8
+ studies/robustness-seed42-20261011/artifacts/robustness/history/past_state_only-test.npz filter=lfs diff=lfs merge=lfs -text
9
+ studies/robustness-seed42-20261011/artifacts/robustness/history/temporal_shuffle-test.npz filter=lfs diff=lfs merge=lfs -text
10
+ studies/robustness-seed42-20261011/artifacts/robustness/history/thermal_temperature_only-test.npz filter=lfs diff=lfs merge=lfs -text
11
+ studies/robustness-seed42-20261011/artifacts/robustness/history/truncate_4-test.npz filter=lfs diff=lfs merge=lfs -text
12
+ studies/robustness-seed42-20261011/artifacts/robustness/history/truncate_8-test.npz filter=lfs diff=lfs merge=lfs -text
13
+ studies/robustness-seed42-20261011/artifacts/robustness/thermal-evaluation/current_only/auditorium_3node-predictions.npz filter=lfs diff=lfs merge=lfs -text
studies/robustness-seed42-20261011/.pytest_cache/.gitignore ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ # Created by pytest automatically.
2
+ *
studies/robustness-seed42-20261011/.pytest_cache/CACHEDIR.TAG ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ Signature: 8a477f597d28d172789f06886806bc55
2
+ # This file is a cache directory tag created by pytest.
3
+ # For information about cache directory tags, see:
4
+ # https://bford.info/cachedir/spec.html
studies/robustness-seed42-20261011/.pytest_cache/README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ # pytest cache directory #
2
+
3
+ This directory contains data from the pytest's cache plugin,
4
+ which provides the `--lf` and `--ff` options, as well as the `cache` fixture.
5
+
6
+ **Do not** commit this to version control.
7
+
8
+ See [the docs](https://docs.pytest.org/en/stable/how-to/cache.html) for more information.
studies/robustness-seed42-20261011/.pytest_cache/v/cache/nodeids ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ "tests/test_behavior_support.py::test_backtest_alignment_and_only_known_past_plan",
3
+ "tests/test_behavior_support.py::test_constant_driver_good_fit_still_flags_low_excitation",
4
+ "tests/test_behavior_support.py::test_matching_schema_and_availability_required_without_pooled_threshold",
5
+ "tests/test_behavior_support.py::test_no_future_target_or_hidden_parameter_leak_and_behavior_shift_detection",
6
+ "tests/test_behavior_support.py::test_no_history_or_missing_past_plan_skips_inference",
7
+ "tests/test_behavior_support.py::test_training_only_thresholds_and_provenance_guard",
8
+ "tests/test_challenge_interventions.py::test_changed_plan_same_exogenous_and_no_hidden_metadata_features",
9
+ "tests/test_challenge_interventions.py::test_intervention_report_end_to_end_is_bound_to_unseen_cohorts",
10
+ "tests/test_challenge_interventions.py::test_observed_plan_replays_independent_hidden_snapshot_exactly[auditorium_3node]",
11
+ "tests/test_challenge_interventions.py::test_observed_plan_replays_independent_hidden_snapshot_exactly[parameter_shift_2node]",
12
+ "tests/test_challenge_interventions.py::test_observed_plan_replays_independent_hidden_snapshot_exactly[small_room_3node]",
13
+ "tests/test_challenge_interventions.py::test_public_clipping_still_changes_fully_saturated_requested_plan",
14
+ "tests/test_citylearn_validation.py::test_actual_native_code_zero_input_and_energy_units",
15
+ "tests/test_citylearn_validation.py::test_adapter_soc_only_no_hidden_or_future_applied_power",
16
+ "tests/test_citylearn_validation.py::test_native_saturation_preserves_requested_action",
17
+ "tests/test_citylearn_validation.py::test_native_standby_loss_applies_exactly_once",
18
+ "tests/test_citylearn_validation.py::test_precommitted_public_request_schedule",
19
+ "tests/test_citylearn_validation.py::test_replay_limits_and_observation_availability[citylearn_battery_common_scale]",
20
+ "tests/test_citylearn_validation.py::test_replay_limits_and_observation_availability[citylearn_battery_scale_shift]",
21
+ "tests/test_context_uncertainty.py::test_calibration_provenance_and_separate_systems",
22
+ "tests/test_context_uncertainty.py::test_insufficient_sample_fallback_is_explicit_then_unavailable",
23
+ "tests/test_context_uncertainty.py::test_missing_history_still_allows_estimate_and_missing_drivers_are_explicit",
24
+ "tests/test_context_uncertainty.py::test_no_hidden_target_leak",
25
+ "tests/test_context_uncertainty.py::test_shift_intervals_never_claim_coverage_and_metrics_include_width",
26
+ "tests/test_context_uncertainty.py::test_support_train_only_and_detects_supplied_future_control_shift",
27
+ "tests/test_context_uncertainty.py::test_weak_excitation_is_heuristic_and_does_not_reject",
28
+ "tests/test_evaluate_citylearn.py::test_soc_mae_and_bounds_are_raw_unclipped",
29
+ "tests/test_evaluate_citylearn.py::test_sparse_original_calibration_matches_external_two_field_schema",
30
+ "tests/test_history_diagnostics.py::test_diagnostic_end_to_end_binds_exact_anchors_and_reserved_calibration",
31
+ "tests/test_history_diagnostics.py::test_donors_are_other_system_same_family_and_ignore_targets",
32
+ "tests/test_history_diagnostics.py::test_history_branch_disabled_restores_flag_and_labels_never_enter_model",
33
+ "tests/test_history_diagnostics.py::test_history_conditions_preserve_labels_current_and_future_plan",
34
+ "tests/test_history_diagnostics.py::test_reserved_calibration_partition_leakage_is_rejected",
35
+ "tests/test_history_diagnostics.py::test_temperature_only_retains_plans_and_scores_only_observed_temperature",
36
+ "tests/test_history_diagnostics.py::test_temporal_shuffle_joint_order_and_target_independence",
37
+ "tests/test_robustness_release.py::test_copy_refuses_training_resume_artifact",
38
+ "tests/test_robustness_release.py::test_provenance_rejects_changed_bytes",
39
+ "tests/test_robustness_release.py::test_provenance_rejects_external_and_symlink_paths",
40
+ "tests/test_robustness_release.py::test_running_diagnostic_blocks_publication_before_output_created",
41
+ "tests/test_thermal_challenges.py::test_adapter_is_train_free_and_does_not_leak_hidden_features",
42
+ "tests/test_thermal_challenges.py::test_capacity_and_heater_shifts_are_outside_training_bounds",
43
+ "tests/test_thermal_challenges.py::test_closed_energy_meter_without_lag",
44
+ "tests/test_thermal_challenges.py::test_instantaneous_heat_accounting[auditorium_3node]",
45
+ "tests/test_thermal_challenges.py::test_instantaneous_heat_accounting[parameter_shift_2node]",
46
+ "tests/test_thermal_challenges.py::test_instantaneous_heat_accounting[small_room_3node]",
47
+ "tests/test_thermal_challenges.py::test_integrated_meter_and_storage_with_lag",
48
+ "tests/test_thermal_challenges.py::test_replay_physical_bounds_and_mapping[auditorium_3node]",
49
+ "tests/test_thermal_challenges.py::test_replay_physical_bounds_and_mapping[parameter_shift_2node]",
50
+ "tests/test_thermal_challenges.py::test_replay_physical_bounds_and_mapping[small_room_3node]",
51
+ "tests/test_thermal_challenges.py::test_zero_input_equilibrium[auditorium_3node]",
52
+ "tests/test_thermal_challenges.py::test_zero_input_equilibrium[parameter_shift_2node]",
53
+ "tests/test_thermal_challenges.py::test_zero_input_equilibrium[small_room_3node]",
54
+ "tests/test_thermal_evaluation.py::test_matched_mask_calibration_and_train_support_provenance_integration",
55
+ "tests/test_thermal_evaluation.py::test_temperature_only_scores_air_and_preserves_physical_delta_units"
56
+ ]
studies/robustness-seed42-20261011/LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2026 Max Farrell
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
studies/robustness-seed42-20261011/README.md ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Completed robustness diagnostics — frozen full-data seed 42
2
+
3
+ This is a preliminary research evidence bundle, not a replacement for the v0.1.0 model release. Only seed 42's full-data training is included. The full three-seed/MLP/GRU/specialist study and five retrained robustness controls are still pending. Scaling is deferred.
4
+
5
+ [Findings](artifacts/robustness/preliminary-results.md) include negative intervention results and severe interval undercoverage on independent thermal and actual CityLearn battery-device physics. CityLearn validation is synthetic device validation, not building or real-world validation. Richer evidence flags remain experimental helpers, not deployed API behavior.
6
+
7
+ This folder preserves its own paths and checksums. Download this study prefix, install the pinned uv.lock environment, and run helpers from this folder. The original 1,200-system dataset is the immutable archive at [v0.1.0](https://huggingface.co/maxffarrell/transition-foundation-model/resolve/v0.1.0/datasets/synthetic-1200-v0.1.2.tar.gz); extract it here before original-distribution diagnostics. Its manifest SHA256 must match release.json. CityLearn-generated episodes and source-package hashes are included; the third-party runtime is installed separately. CityLearn's MIT license is retained in licenses/. Historical absolute paths in provenance identify the generating workstation; executable helper defaults use relative paths.
8
+
9
+ Run `uv sync --locked --extra dev --extra baselines --extra export` and `uv run --no-sync python -m pytest -q`. Native CityLearn generation tests require separately installed CityLearn 3.0.2 with compatible NumPy<2; data reading and inference do not.
10
+
11
+ The original smoke CatBoost counterfactual numbers predate corrected inactive-field padding; use subsequent corrected reports for action-effect comparisons.
studies/robustness-seed42-20261011/SHA256SUMS ADDED
@@ -0,0 +1,326 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ba2f860a3c2cba35f85f21ac65fea46c603900544f90ddad503e3ba9e44dce43 LICENSE
2
+ 2fc0b0828168bfc79931e93ee8f8154963f011f9a83eba3585b358aaa66e747e README.md
3
+ 41485d6dd0c72f09a9ca67ced83bc4a0725f9cde731276d1672902304675ebec artifacts/full/transformer/seed-42/checkpoint.pt
4
+ 33b890560ea8c2a881a2a4e125f19e2beb7a69029ec406d4b7e6a13b9880f3e4 artifacts/full/transformer/seed-42/normalization.json
5
+ 13c74ef434c51be324c208a534cc31a93374dff44927bafd6a7a9c3d02e2ae42 artifacts/full/transformer/seed-42/run.json
6
+ bfa4012aa501c8645851c8bf03095b8eacaa63da8f7ae4b2a559ac01d3cd41b7 artifacts/poc/data/manifest.json
7
+ 7696f63f59bfb0bb5e1c36cc405a1685b229984d3d8613e2a79c604dd4dd84f5 artifacts/robustness/behavior/battery/citylearn_battery_common_scale-assessments.json
8
+ 6a26ca1d2ce0dc6054223dc327ace2c83e79b01cd5614c8d7f81369cd4ef969b artifacts/robustness/behavior/battery/citylearn_battery_scale_shift-assessments.json
9
+ fa8644d2c4a3bafc758ec69fcea9185207ca2b47d8dccebd8d8b7c4a98acb179 artifacts/robustness/behavior/battery/original_heldout-assessments.json
10
+ 86e2379b21dbf77cb77c703d489f9e7fe3a3c4fb7d836f92190cbc28761144cb artifacts/robustness/behavior/battery/thresholds.json
11
+ 2fd1d7dae2538f18ce9bf74c46846eb468a2a88a09c2fb164ba0154cfbaccf2a artifacts/robustness/behavior/behavior-diagnostic.json
12
+ 46c9a4d90377deac53c802906de4ae4e9813c236fb09a5ef65fa196a30f5e885 artifacts/robustness/behavior/thermal/auditorium_3node-assessments.json
13
+ d37fc14e47a7488e3dc5b18d18246da4aa29025b64c203ec8e27ad1139d8408b artifacts/robustness/behavior/thermal/original_heldout-assessments.json
14
+ edf78b3dbcc92504d135e08a33d4a1b48f1c04b5f983fdc29c43a566b56342bc artifacts/robustness/behavior/thermal/parameter_shift_2node-assessments.json
15
+ 51a2ab552220624aabc40fb2f71e143eac7b2667b992ce1294ed20c5849f1ecd artifacts/robustness/behavior/thermal/small_room_3node-assessments.json
16
+ 9fcada67a04b02a7d650e323ac22173bdece47080250f5488ea865dcb444bc35 artifacts/robustness/behavior/thermal/thresholds.json
17
+ c558198983e314b8d9fb3b860c9031dabdc91797a2806349bb66b3d19433a7b0 artifacts/robustness/challenge-interventions/interventions.json
18
+ 35977663cd38d3ca6dbd3edf7c0768174d6ddbf2288797dbcdea13e541de92c6 artifacts/robustness/challenge-interventions/provenance.json
19
+ 1580aacc75ecafabd59a2990eaf69d7964a6323bdd16989a79dc56c72c71a452 artifacts/robustness/challenge-interventions/summary.json
20
+ 23bbd3238463308df0d3c9569c3d3834c67e858b70f97efe08d77e5c70155886 artifacts/robustness/challenge-interventions/verification.json
21
+ 690b26d7c5656d5e23667ea62c943b3d07d38956f8f7c2e45bd4db24bfe01f4c artifacts/robustness/citylearn/README.md
22
+ 703f38e13b5b93ecf2cbeaaeac8d274a30d795976d3f666ec1f6ddd0a851cffc artifacts/robustness/citylearn/config.json
23
+ 3a656d7b5a3fb3c0dc6034af2b7ef330e27f7b20f2df3c9022381950a45386e0 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283127.npz
24
+ 0b906e82b0dec454ee92242e96997d9049f0ba74cad88fbbe5d486dbba1e523f artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283128.npz
25
+ 84816b3c049cb99a415efd554aa96a717e41836a22db810c32cb5b53030e71c4 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283129.npz
26
+ 74edf4f38e8f23b2b28a1129505066af6cc67cced5bdc9ca693286461a243b9d artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283130.npz
27
+ 330845003fb6266d69649e765979ccd2ab0ee45723bc9f4c5167cbae2e8b3092 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283131.npz
28
+ 5bb02061fb1b0762f8802cf30b0160980a177bc437e9e186c12cbb00b0ebba9b artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283132.npz
29
+ eeebd8797fdef8e8ea6423c218b90f3a0e52630464f517fa0d18f1a2a21b1eb1 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283133.npz
30
+ af5339d1f033dc3f4adc26377d03f1b81c3679c7e23767d1bd4e7046ccd65ca9 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283134.npz
31
+ 8738f1cdb1fc3ee858fc77ee660b2336280a37d2a2f9a502f2fa2401bd583dc0 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283135.npz
32
+ e522e9223d3999c13b852b237b161ac56b4d5414845a519a6106385ee1deb81b artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283136.npz
33
+ 9ee6c1953f967d938b0318e226024685d80ed94fc0266bab6b181439b4b7c630 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283137.npz
34
+ d3e3ac191ffa148656dce742e073536d5c1eb8998c394f47d5667aa97ab956c2 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283138.npz
35
+ 985a537ef3cb5b25e3ca6802dafec0d02919b2e7bf0c84c4b611b318c989fe6c artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283139.npz
36
+ c14dd583ae98e783b6445978e315644bc2ddd145fcbf1d802e577068cf37021a artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283140.npz
37
+ 761fc5439b5e961499541a41196e3be80fd16a1960576e6da74246cf4793c08e artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283141.npz
38
+ 7f96abafde3becae97c2809520227c56e5f7349f4b91b162a68949fe9aaddcd0 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283142.npz
39
+ d01baabdcc924d66411a4db06335b57419386e270d0e262da50fbb29bed4dc79 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283143.npz
40
+ 0902e10dd7b87eb8b04d9270cfda5faa540eb28463d5b017191c7569cf06022e artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283144.npz
41
+ e8488ea88f55b569e9e122d43c1cbbc4da214ada235577ee0b2763e2bc0ed45e artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283145.npz
42
+ f887e01b7eb6975d2bd758292820fd154df1761891cef9be9af902ca0e989cfb artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283146.npz
43
+ 2c53bbb86877cee9340e2da00dd92387c9e252d603f267e7582fbaf24c2c9aba artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283147.npz
44
+ ef443224210275826550ae2dedfd0ce4f7117a2f1c0c5ca19114d858f73eb83f artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283148.npz
45
+ 3b5fe4e6abd5bda6f34830444f68c185d4d87fce395382100a1b73796038174b artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283149.npz
46
+ e5b912ee964ffb305b07bbc1bec4ac6954c80ad66f6bbd035450883f2afb9e61 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283150.npz
47
+ 6412d6baf0d8dd319101fa79b51580b47e58864ce0275d5ff13da73447871122 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383127.npz
48
+ 7c4d6e551e7ab9c7ab58013cc7fe73d16f465a70caf39f2db69f26e73a1b9518 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383128.npz
49
+ 5b9850cc0f6083a37f5133d12a985527ca6e9403830f63b9d555c76176ec19f8 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383129.npz
50
+ 07e1b198dbadee4571cf9ae8bb462083becb45a77e88ca08ef00e7302c8025f1 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383130.npz
51
+ a46c8bd1160e440566f53c109663db779e75b7ffc7392ab7739c0788dfdc146f artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383131.npz
52
+ 6ecd37a48e1067feee56e068cf488f1fb943e175b096a1639e2150906fb63186 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383132.npz
53
+ df4d61f69ce47cb019befb40168a1f2d798cec79bb3f6cdb5b3eadeaed048a1f artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383133.npz
54
+ 0be8416fbc74db11968a8ee3297ddd679652d41d250019f0d3e7c7ca597755f3 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383134.npz
55
+ 12f0ec3e5da009ad5fcd0b9dfb03498a9a04dd28a9e5857cd1a1503126dcecab artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383135.npz
56
+ da317f6280925b26081ed1ca16480b64939e8e3ac456120acf7ea0cb0f0508e9 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383136.npz
57
+ e3cccafe45147443aad53046dd790839b5c6e16cba8080f502a16222a98de3e0 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383137.npz
58
+ 389029c45375c86472856388ae015cc47881dab29107001eee29db958fa8ce73 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383138.npz
59
+ 4123544a9b719bf31e226ea087d19eb12a35d0d7a1a3fe23dcfe9a0f7632f6c4 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383139.npz
60
+ 5afa22cfa22164836b9af26741171e7be27fd9cc112928a93d6797d4fb3e4209 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383140.npz
61
+ ce3e1e8354fe9162722ca156be6ea8a95e2346f5c251e27043f8af8355ad2a6e artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383141.npz
62
+ 568b1350bd88b461e29012d83fc9349aec01dfb47c6d554bdd87d2883186daa7 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383142.npz
63
+ 546b338e261bcf2358ebf1d2d44ba17b3f17fdb6225fad01f6659418bfc06559 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383143.npz
64
+ 218a807ad448a45cc5de0b8fa5d834962c647f6f54c93633c87f9615b1554db9 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383144.npz
65
+ 49ba8f48f8bb878778eafe1067878a4ee29937261cbf256b0a40711d32f1b4e5 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383145.npz
66
+ 8b4e2e86eb7d1c5315aa71badd11a71918280e299dd39e6a2efd32996e52ff07 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383146.npz
67
+ 183da4c43014589a9a888d7373cddf2399440503bbce1fd03f0c63098ae53614 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383147.npz
68
+ d8bbf04c719018620fb9e4046e274491de49db7e6f608a5488a934400b21e18a artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383148.npz
69
+ 3e98521775823223184bad88edab14461bba596ebbfbda00bae0dc298465e236 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383149.npz
70
+ 90bf17f620b9ef55ad2c90932a993df0b8553c1aca758264df66f28fae39cc37 artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_scale_shift-383150.npz
71
+ 37d242cc2dbe62e9ad3edc9c201643add9cc1c1a69814e5a4473cf3f56669552 artifacts/robustness/citylearn/evaluation/citylearn-evaluation.json
72
+ fe8e8114a221c30e31c65f48a97dc46c3f5373efe1d81ac766b4049df586b538 artifacts/robustness/citylearn/evaluation/citylearn_battery_common_scale-context.json
73
+ 5ddbed3757f16cb0f85bc400548a4cf912658521f4be9b1c0e94153f87304e19 artifacts/robustness/citylearn/evaluation/citylearn_battery_common_scale-history_linear-predictions.npz
74
+ d0c788759996e8d8539086a9c2127087d07528a876a90f1e2effca6ab6d2a23f artifacts/robustness/citylearn/evaluation/citylearn_battery_common_scale-persistence-predictions.npz
75
+ 16a031a5dd0757b0d42f884f9f06337a028a226655c49b0db9b23bcc340e0e8b artifacts/robustness/citylearn/evaluation/citylearn_battery_common_scale-transformer-predictions.npz
76
+ 3220d9234b201463ec500677c0531294a23abf36a6488a8e8ba196ea803dc854 artifacts/robustness/citylearn/evaluation/citylearn_battery_scale_shift-context.json
77
+ b30c0efd747a5e9b73ea766dda84cec48b3ebaae939dd7733dceeed0909a2ce3 artifacts/robustness/citylearn/evaluation/citylearn_battery_scale_shift-history_linear-predictions.npz
78
+ 84ad3863f5e8fa2345c3e20ed8a74aebfc623fc47aef8a68f2a60b16d431816c artifacts/robustness/citylearn/evaluation/citylearn_battery_scale_shift-persistence-predictions.npz
79
+ a7a3f2e3edb305e35a21ff73b14d5686c607078cf2a4c66919e7883c12a96b33 artifacts/robustness/citylearn/evaluation/citylearn_battery_scale_shift-transformer-predictions.npz
80
+ 8363d6b49c4a1999e8a733217cbbacbe0356e39a8298691cef0b7ec06209ec61 artifacts/robustness/citylearn/evaluation/history_linear-sparse-calibration.json
81
+ e87830f0a2545b552c9d51c85275416f4bf4a1f81e571d0c508828e9725e10e3 artifacts/robustness/citylearn/evaluation/persistence-sparse-calibration.json
82
+ dbdbc4ba688e19ca3f4367a35034cb79dbd29466bfac419587dc1852ff2cf5ec artifacts/robustness/citylearn/evaluation/support.json
83
+ c0fea2ca00b24c37a8a60a6b6eac29e7da3f38c4d343b9a9f675ff3b1d12247d artifacts/robustness/citylearn/evaluation/transformer-sparse-calibration.json
84
+ 2f18ff1700da91594e1fdc1c59c88715c4397ac18523e1c7b8e271c74291aba0 artifacts/robustness/citylearn/manifest.json
85
+ 2165efc49ba2d648faf1532c347fb1d36619ba5209d140f8bcf75eb0548cba19 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283127.npz
86
+ cc37bc707c3c5b1b6638a265d8ac98fd630cb68fe908569a582d875b5890cc4d artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283128.npz
87
+ 7c603724a1b9a30535846ba4e0be170914fb340c6a9ab8a14e6c410364924f07 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283129.npz
88
+ dfdaa62f61bdec0a78a194a599ebd924728981580519e50e6103130bad211d74 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283130.npz
89
+ a31e597ec6b34117ee0e8e39a174dbf9336a40e5bb7245050f319314bb694414 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283131.npz
90
+ b79acce7fcc241d1a23159763fa1039222492553cfa4b6290107c574dfe3157f artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283132.npz
91
+ afcfa02601b328b771bfcf79a4a172fae18ba2d7906b3d4c7713b4d403d96778 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283133.npz
92
+ 1962aa6e09889bccf0a9ca21e5700d9eb57da0577e63b5420b12e42391ec4d43 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283134.npz
93
+ f8b7922854465029e6b5944c26e8b098af2436a565c858a86f8f3f2710c55b31 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283135.npz
94
+ 98c0fcc0074741d8b53dd93b6508e9099302472e871f7b3a7e790dab021dae57 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283136.npz
95
+ 74ae97840e37974662e4b5e0afad0705e03a882e22724df200d1b8fcb4058e33 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283137.npz
96
+ 5fdd20680cb157bad663f91f7693c8971e42b9d52ef72a9c96de579eea1f0236 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283138.npz
97
+ 59bf748e766a62fe414df823f8623a288f6789b1191d6b229b20eb0d436df0ae artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283139.npz
98
+ 0527035e40e53f049b1120fbe71f090a3832e0b26b492f345d068cfc7675e8e0 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283140.npz
99
+ 0c186830fa66b17f044c6338491eb9f5d4a8e63a27ee39ba9d52c102ecb966de artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283141.npz
100
+ 9a152c1b7eefe69435338ba748d413d16a84d3bdbc9843a0ee30de8491b80eb1 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283142.npz
101
+ 8878aeceada539d08705be287bb71a4efde8d73c52dfd20afc792a85bde70ecc artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283143.npz
102
+ 56ba723b42400b7d84be3513cd531fdfc830ac2c28d0d1eb8fe092c8d9255320 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283144.npz
103
+ 835f4460d3e1475f914b6721f72b6f5e2ffd1073b2d700135f851213c91c86ae artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283145.npz
104
+ 041ff8353433c6f966def54bd542a4f93723fcba8530d90684c47b42a8874576 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283146.npz
105
+ 29ef659c6f96910bcfbf8f1666c14d3adad186e6486f0d3aefbe7562aa6a0575 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283147.npz
106
+ 2b4823d9f7e916528b4bf0327d0c5869f92cc60ce67993b7083cb1e4635ef484 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283148.npz
107
+ 3d5311a66bbef60f349f8b8b0b0a6ee59867b5ab9457bed19ecac3b1278f0785 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283149.npz
108
+ fab2face65b42d7689d22f7a141f21a966125dbebd7395f51e20642575a2db53 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_common_scale-283150.npz
109
+ 85120699ca7618de8e028d925b7d563b11673090426d6308c9d0cb0a8d1051c3 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383127.npz
110
+ b1278fe2525b65f74097f4cedd99c34dda03347e03b5d0df4d32c2304b85952f artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383128.npz
111
+ cd32591eba15230b0d09349d2fec39931ed6df724a46d07bcfba8fabc96967d1 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383129.npz
112
+ 053a1bc8f9413ce72514413744028c71caeca48713dcfbad3a9dc9d0dd5abc88 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383130.npz
113
+ f4bdf4b595efab8b2638afc76404bfceaede8cf376f07513a23c58404aa7305a artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383131.npz
114
+ a10f4b29563d1ee4644d5cde8ad5e59bd14ab15c3280106d368d0ac7a52492a2 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383132.npz
115
+ d7b00e4a45276b32770952a976b8eb0282d55a632011e4ddfa17985e2436ae61 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383133.npz
116
+ e8a58c8e4f404962c7d4863d535dc071634ba7291283c89bad7f5b99882be760 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383134.npz
117
+ fae09169da6085792d576ddced74c0fd8a476075ae92f8b314d118bf7052b239 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383135.npz
118
+ 592fbaa417c5bc22f7276a5631b8881987ce2488ff8c4fc8d4e15b7aaab6cdb8 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383136.npz
119
+ eb5768551660060b74b18e0ff020d4af9a3798aaf1dced98d522ace64645d705 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383137.npz
120
+ e3239c9daca3239feefa41dd74cb46aa2db36cb1df611b7c0178d85086a517a6 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383138.npz
121
+ 22f17f1cd26d5c1079e0e648f2afe30e122fb8f35984b90578861a178f9f8e26 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383139.npz
122
+ f420935b2af62c7babfa64140937c6ddf3be375a35a471d9862e70ba480d990b artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383140.npz
123
+ 723d39d540cb4653158c7c45e494a7d0bb4293c680c10a48094e537264adcbc6 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383141.npz
124
+ 530dfd260d90182de3344dd3bfd4ab139314b77f005111f22bec47063cb84c37 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383142.npz
125
+ 2fcd6030d66bf540d399f8d43590f96452dd0526c7f19fc5d8026c152ccab4d0 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383143.npz
126
+ 9fa0a4bed08946b76860c505fabba56323d7ca99e40f6fbf87e352c7992e200f artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383144.npz
127
+ bd1d1bf801f33be637a5e28495f84bb67fc56581f7ac26dc141c1086b2a18474 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383145.npz
128
+ d644952648233c51997e0d804cbadb2632710fd71a3d1091838e0b1551117115 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383146.npz
129
+ 18049abb942329f7425e136e3e136421b80334fbb0362b12674382a7d51cb736 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383147.npz
130
+ 8f2e77fe40ca2b77f09e7a75cac0ebdcfc7d359903aab8a90c305495d15fc7e8 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383148.npz
131
+ 161ca0e4eb80a0b1967067d9ab85f1f4045e67ae231d612057e35f10b54e5a49 artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383149.npz
132
+ 400afa7160a10701e3ee4d0031e37c6c92de662cb814752181f6a170f61f55ad artifacts/robustness/citylearn/native-audit/citylearn-device-citylearn_battery_scale_shift-383150.npz
133
+ b10367d242f6ca0bafe11a6b1d068778d4064c3a2e28d5a3d86e56bcf8d4f169 artifacts/robustness/citylearn/verification.json
134
+ 4b1fda0fb4d38a7c7306c93c84fef6b17fcf38850d495fd1d5257b0bae86216d artifacts/robustness/history/calibration-current_only.json
135
+ 83fe0d8bf2142383c9086fdef3e2f508094e60b078aab9df26239a06eb4e104e artifacts/robustness/history/calibration-full_history.json
136
+ 0f4154262c04696d40aa6b7a828874893f2732f1981f93ea5e8fabfedddb1869 artifacts/robustness/history/calibration-history_branch_disabled.json
137
+ f55a8bb058b612b7c0b94e95de68b0b15cabe306a8d5ccf63d5b796f261b024f artifacts/robustness/history/calibration-matched_family_swap.json
138
+ a777fdd83b5547963a28e4cc0d4f604feb325035c26c3d527fcf4e1ac5176fce artifacts/robustness/history/calibration-past_state_only.json
139
+ 43a25d9e34a024ff059b0d5365c87c59a280a28e275a27e32c13d235401408b7 artifacts/robustness/history/calibration-temporal_shuffle.json
140
+ 9fc985eec8e4cf2a14bf5f5d1ae914096b064a22e9787432506cf40c7ba4658d artifacts/robustness/history/calibration-thermal_temperature_only.json
141
+ efe0df5815eeb180509db240981193e08e3e7cb2a072061d9df570fe9a169555 artifacts/robustness/history/calibration-truncate_4.json
142
+ 5e95f2bc33633df3371254ed31bae814d1fb18aec7c8044fff1f3b44f223086d artifacts/robustness/history/calibration-truncate_8.json
143
+ 3a094d50ab0dddc70a919f31a294c6283fe375be19f00279688333f1cbc27de4 artifacts/robustness/history/current_only-calibration.npz
144
+ 788b5f5f17fa38785bf5dfe0c90a3569f8e6afd6882b1c74fbaaac04f215e10b artifacts/robustness/history/current_only-test.npz
145
+ 6383f9263fc371bb716f643137e26b734a2d7c937e39042357b394062f9e4c88 artifacts/robustness/history/full_history-calibration.npz
146
+ fbc1501f289b8bb8bf5f439a54a96dbf6121cb243dcb621d4224f8af0364c844 artifacts/robustness/history/full_history-test.npz
147
+ 2a2a44d85306f3f560593e240995d7861c0e44ada24549152f9d06f944524cd2 artifacts/robustness/history/history-diagnostics.json
148
+ 60bb54cb16d74de879f90e205f5d84aba0bed9980f95b4219eda743862edeeb8 artifacts/robustness/history/history_branch_disabled-calibration.npz
149
+ ea0b575fdb03e38f8bc41a60ad46aa78a38d76c6da4bd3875ca983f2aa7d9780 artifacts/robustness/history/history_branch_disabled-test.npz
150
+ db6e8eca61ebc39d4e4a35be219a2a69e13dacc50657ac2d412652668c7c92f2 artifacts/robustness/history/matched_family_swap-calibration.npz
151
+ d2c7f2e7e387effbe4f9685752335a00e28e74a2d1618c0b35bff00b6895b06d artifacts/robustness/history/matched_family_swap-test.npz
152
+ cd8bcf85d23895f7a01c55257a93e591af424d1e7ca776d218be2e67d507dd5d artifacts/robustness/history/past_state_only-calibration.npz
153
+ bea6faaaa7e7064d004a5a2704304c25ca2366767e22957bfa4de3ad18638810 artifacts/robustness/history/past_state_only-test.npz
154
+ 6ce68f1f54cff30fd0c9699bac235eb77b6e9326d9ff7d4ac93128af626d8c18 artifacts/robustness/history/provenance.json
155
+ 0144bf198cdfd4a66fad46967c7ad10b1024a796eede274ebb2e6908e4f05d83 artifacts/robustness/history/summary.json
156
+ d8440855974c3dc767c0354a912bab5b961374ebd586863b145538701211db25 artifacts/robustness/history/temporal_shuffle-calibration.npz
157
+ 51a093233d877c57c35bb964c20ea913243456aa2ad3c2ad6a2fd972a761bcc7 artifacts/robustness/history/temporal_shuffle-test.npz
158
+ 7f3da8c6427eff9e88f7375dd01f7e203b346ba513e741456e05cb0d8949b60b artifacts/robustness/history/thermal_temperature_only-calibration.npz
159
+ fff0f371ed9e9446b895bcab23769075e6dde35122e8273bc227b28267336052 artifacts/robustness/history/thermal_temperature_only-test.npz
160
+ eb5d97a9fe51af808c42b07e28e7f7fb826440eb795e15d95ccbc06081a6900e artifacts/robustness/history/truncate_4-calibration.npz
161
+ 546125f1d16ab9887b47cb52a735e402c338959a25a508c4019d501e45ef40aa artifacts/robustness/history/truncate_4-test.npz
162
+ c8dabdee185dc72eda7f4db1dd94cbd224a50a936016c5477ea1f65ca230998e artifacts/robustness/history/truncate_8-calibration.npz
163
+ e052b15d95f30b80d9bb353dc2031b769fcc666eaefe18d08d192c11385d48c6 artifacts/robustness/history/truncate_8-test.npz
164
+ 0d9ac2969f909500dbd43998b8169c820acb9d5fc5c8aff5faa256891c3c3122 artifacts/robustness/preliminary-results.md
165
+ 971df9a8db923a00dbf49cd2b4de31f336c421712dc06cee94bd1b7eb99472ee artifacts/robustness/preliminary-verification.json
166
+ 728d82cbc917ebf05012116ad25897ac4398c0cb94caf20dc7f08eb4a7547aff artifacts/robustness/thermal-challenges/README.md
167
+ 8d884e7b9249df93d30e0ebdc82155960b33e8b21483a9954388b64efcb07162 artifacts/robustness/thermal-challenges/config.json
168
+ 909c4df4c3e16f8c9d6927b7b538cdd0bdc3773e46b648e31ab35fe233d2ba95 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041230.npz
169
+ cb101b90a5649efc479bb5d8a812a20e814a420c12129d81b225d307b191d825 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041231.npz
170
+ 797163c7811deedcbbda4f8434512b1e9712a77b9dddacd3f2d28f7e02b0449c artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041232.npz
171
+ 08b48742612b07b0a97b2bad7f4c03e0745c78404808b04469b1f47e46caff8a artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041233.npz
172
+ 3b1e7873e7db1b4a1191c85a82461b75040967f73962e3b05cb8d53d150a8d20 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041234.npz
173
+ d75e02840e80cc8fbfd4488662a0db5c610847f4e57aeca447714ab6b1ba3766 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041235.npz
174
+ 7802684e0b5608ad658b6daafcca4aada0eb3bf68dc9c11239d9f1ebd4cc3438 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041236.npz
175
+ 7c920dada0b947d5c419ec3b8bfd945e9fbbcd96100bcaf029ac303e17a85eda artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041237.npz
176
+ aa2e43363343f3f825705ddf61d0d491ee830ed87f9fefb6b360e17534468bc7 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041238.npz
177
+ a3381546d34eaba15c1556b78771ab3ddfe4701cc266e24c92c780f859ccb616 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041239.npz
178
+ 7fda0071578634c230c7b0075b20a40939c688183688d3bdd4766a450b86b799 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041240.npz
179
+ bf5e5024f9d6c677ee46665af75b09ca093944396a0729814059d29bdcdc9e38 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041241.npz
180
+ a307e864df7e4a04711a150be16600647d78f4e7b7f6ad472803100652ca2620 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041242.npz
181
+ bbadc4730e9f34e2c4dfd05c1b453489a687ee4f8f8cbd6440d1f27051cd4fe8 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041243.npz
182
+ 98a6a98da2590f92f5d07aa5c17f515b0d55f25286943d3798f52ce83d0022b1 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041244.npz
183
+ 20c19df7e264082055d9fc64e12d7076e631e777d2d5160e05711b529318bdb6 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041245.npz
184
+ 412c2843571614356c67318322f30ffabec7043fc8b01f79735930784cb141ca artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041246.npz
185
+ 04cba1063d4f7ff83ad34cd4ccb7b9a49c1e9edbdf3fb9ff108fe73fe2a2100a artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041247.npz
186
+ 76353c885a993fff08524ef8516367875d74d79be905f4d4e5705eb8700765f5 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041248.npz
187
+ 6f1ecd89b215404fdeb2c395fcc21a374b7dcce15d46aeb09a1a8348aea451b5 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041249.npz
188
+ 47ac85908002c115eaacc257c84a3dfb614a31d4c54c69238c4cde0cfefda159 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041250.npz
189
+ 12b3f1d1f776e348bcc59a91b9aeef7376fe08cd53f4695efcc43ccf0d654e0e artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041251.npz
190
+ 8f9e82273cf94eb7ef675fbbfdb0bf18c42dabca995c061cae02c9160c688fb6 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041252.npz
191
+ 84d907e9ba3111bb87ff9bcacafac6ec24f2c822585bbf0d233bba87ebf2a318 artifacts/robustness/thermal-challenges/episodes/challenge-auditorium_3node-1041253.npz
192
+ 6f39bab4317626cb46e49588877a361fec560a65727c5f7b227f24a396db8dbf artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841230.npz
193
+ 9748e865dd8c3511b479217e550006c51ce0775f2c86a8722d68206e50c77c15 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841231.npz
194
+ 612e3e996bd4bef2b270abe04047780a9d52eb7e663453c52d1acc62f09ab507 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841232.npz
195
+ a6dbbde1e006cf8a63611b0e626d8880198c3cb68eb7f4cf6df356fced9fa025 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841233.npz
196
+ 35112a75b7a84d8feae255e0bdba38393852f70a379ad8b2be950c363bb54077 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841234.npz
197
+ a55856798c69008ca186e6ecbfa72e5f1008b2313886682a0abea6b5f6f6bb04 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841235.npz
198
+ 6f1a7accdd6716b081974151d632b6d108e9965d3aefc9023e0deb4966d723d5 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841236.npz
199
+ 8800e013e1e92fff833c38ef71120f5bb6ca9e4c8e186248e741e5da1e59290d artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841237.npz
200
+ 0ccf54ae0c2fa75e4e5e5bd4f54ddba92a62984fd018c80ab5e5187b52cc4bb0 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841238.npz
201
+ ed88464398eee594dfc1454c42f77abd14042b237295f7d721c16d59c1f99a55 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841239.npz
202
+ 6ef701a2f2fe539c0ac12ad37f2bfd3d7f5b99cd30c5b106d4fddede16db98b0 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841240.npz
203
+ 93fdd052163100a2e77a42284c7d6ac64a777622b18c88407e62e88f85daf85b artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841241.npz
204
+ 0c2bde725f7b553eee8dfd4e203bb3e72643398d80e354edef5e960c89937028 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841242.npz
205
+ 18f98668832e8ccbd1b2f779287d1395f40f8d58621cda285137666b1b93083d artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841243.npz
206
+ 2f2c54cb541044d3062422c086ec54b2061257bd6616d06f3afb01f9a773cd33 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841244.npz
207
+ 5e78f8f28c110165e230bd3ad4c1b7c2af164881fdb1f966ad95e0d6fd2b5156 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841245.npz
208
+ ec3b33d6367463721e34cb4c57efa7bee626de9a43b5368eb1bd518e53644adf artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841246.npz
209
+ 309a99fa1882dfe77abec497c511e60280ea0deb3efa9137c28bf6b2d6c3d037 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841247.npz
210
+ db9138d5e2893fbbb068ad7a4abf09f630ebf977f219ff86891d667b6c8d7673 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841248.npz
211
+ 55b3b2ef27c54859f216fdd0f30edb113d57dfb27a2c3e0ff919b91a72baf6a7 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841249.npz
212
+ e82eb18a63bcecaa07655f8bfabc119eab4aee397aad3f274f1088cb2985ddae artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841250.npz
213
+ 59c8f9dab9e8b94ec8ac4f31af34755a51f140c649e907705971e7eb4843e88d artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841251.npz
214
+ 8687142c157c1973d5ba13a1871f5774591b2cbf4c4648d11eb5131da21f8191 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841252.npz
215
+ 460f8ef7608c9b3bc8ffeec3017128d256e7bd2f6b02ce642306bc55fa0e5406 artifacts/robustness/thermal-challenges/episodes/challenge-parameter_shift_2node-841253.npz
216
+ eff1fdbf357934387d9c86f61b4e448576e303382a8c5bcfd55885c688e4c89f artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941230.npz
217
+ 7df8a10f5859612d7b948b25ee05a7e7d426e338605ec8d16f6c083b8ec98b1c artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941231.npz
218
+ 7f0d2d0e22fea02d388a1c7309bda3a6e1b96eff4b02b81194ddf6e18c6b5ac9 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941232.npz
219
+ b92dc8b4fafce39c4b63b9defd136b4bd1f895c822f67255ef48eaf94a5bf4fa artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941233.npz
220
+ 6ff72d6f58bd2ea1b0119e87eb036c56bafebb48a360a7b62e69de30820f4726 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941234.npz
221
+ bc62810f057c326d68b28497d618438bd3853aa1f9964dded6e538390f4ee63d artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941235.npz
222
+ bbff3ad44986c27ef4dc94de5bbf1f6d556cd0fea08a55ef47a6979925690f2d artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941236.npz
223
+ a3bf02e113176c1b9d201f643cb23e5ef7f675a5a4209672d3bf472fc4d2d535 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941237.npz
224
+ ecf10d4247e7ee09b9850f85e6da7f2f698241c834b6adcfbb3b38c44addaad2 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941238.npz
225
+ f1a5ecea1c670170ccf129a7ce960a674f4c805f49afce358c7787fb334dcecc artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941239.npz
226
+ 08da29ee77eb6c1428cbd64e7a5dbd1d1011aba96d334acb773421b03d34af85 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941240.npz
227
+ 2f39fbdadd72c4b54867bdb16aa5363b76c0688ded7e7d60f358c233c709ddda artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941241.npz
228
+ 0c15d7d2963085871a778ff723df58f1dacf2f78bb1448d00019dec6768d7cba artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941242.npz
229
+ 459cd4d44b839d99111f9181e32e472e1e4994126a890fe38018d3bb9d5b8c62 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941243.npz
230
+ f32b1cd4cc1f3a92c2498302a7aa1de363db2b6f95286f8285a1556fb7ac2b9e artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941244.npz
231
+ 0a3f4c9e209134a12dd486ac9196b5037be9db9020a3ce3f9a2ec6a681e058f8 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941245.npz
232
+ ad81061d314250c36028184084db1b375549526389833fe254a6618a47d9c30a artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941246.npz
233
+ d43fc56346191c048ddd07e606cb566937cce73d964887d63d063e2e343ce45d artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941247.npz
234
+ 8bce37f0e3bf02097cbf830d5b62520c524ca3e4e61239bad3a124dc6c0dfcf9 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941248.npz
235
+ c65bd39ef584f0908fb2061be0d8a4b2617dbf6b40544175218a4d08b7dbf22c artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941249.npz
236
+ 4cc062ad3832f9c5d84ba57d33bd6820b604dabd35e5e162f7a0e8b8751edbec artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941250.npz
237
+ 478876d37fe92ab306ef0b57c95013f1592f7b563a0c28896ad334d2b9e23b80 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941251.npz
238
+ ebf7c7726ba56b9eff24d17df9ad5db68a0772e14eb55f3d18d6aa3157aee7e1 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941252.npz
239
+ 9ab95a58eaab18d39ad2bde69ddbdb48c95f65a499df19a1e6ff3dea6f33c1f4 artifacts/robustness/thermal-challenges/episodes/challenge-small_room_3node-941253.npz
240
+ a3b9d662ff085243832ff1cc17d6cd5122e7179791f0d712069d3358ac389d9f artifacts/robustness/thermal-challenges/manifest.json
241
+ 8ea5fe8970bf88fa9a7241caabac218870c9d3459941332920fc1fb14f7a23e9 artifacts/robustness/thermal-challenges/verification.json
242
+ 40f3dd62cf84535793263e8101e3198f481b5e41a1a49e0246410f6e177fa510 artifacts/robustness/thermal-evaluation/current_only/auditorium_3node-context.json
243
+ a34a38ff9264d315106aa98b33a02c32f18cad7fe057f51336ea528a161b186f artifacts/robustness/thermal-evaluation/current_only/auditorium_3node-predictions.npz
244
+ e6f787063eacbce062b24025b9772d8baba53a13764f4442ba0a8db7966be079 artifacts/robustness/thermal-evaluation/current_only/calibration.json
245
+ 1f099edadf69ae75b1c39c350a4c0d9c2431a4ba3d386d045cc018b57255e9c1 artifacts/robustness/thermal-evaluation/current_only/parameter_shift_2node-context.json
246
+ 5345e1042a1c9d89604671b8892b9b3b9d34b9fc2a835e097f42d2512ce65ea0 artifacts/robustness/thermal-evaluation/current_only/parameter_shift_2node-predictions.npz
247
+ 065a2223901c5089e8217859a5004be9a4e3e30a3d545984310ecdae6873b22c artifacts/robustness/thermal-evaluation/current_only/small_room_3node-context.json
248
+ f119ea07d493e7efcec5a79acd21bee815fbe7d1c5a47f0211d5d73b80c24019 artifacts/robustness/thermal-evaluation/current_only/small_room_3node-predictions.npz
249
+ 17629e4c0582e9803b8c942158335b915e347cff4858dff8cd6f15829f5e895b artifacts/robustness/thermal-evaluation/current_only/support.json
250
+ 4a8b32aef8dde9ccd1a22d091edd292066157fda55b38e1320219ffd7b78d428 artifacts/robustness/thermal-evaluation/full_history/auditorium_3node-context.json
251
+ bcb5acbc99ea8f73b65abfb9495c253154ae5e3be7806bf79740c964a77e6079 artifacts/robustness/thermal-evaluation/full_history/auditorium_3node-predictions.npz
252
+ 83edbd7344fb5f767384a22fdc3e70144b1520003b52db2e4e8b67bf0ed4456a artifacts/robustness/thermal-evaluation/full_history/calibration.json
253
+ 47c2318d6b155bbcca054f67d0d0171174ce44a570e278fc204add04f07dd624 artifacts/robustness/thermal-evaluation/full_history/parameter_shift_2node-context.json
254
+ 01aee73627cde532e0e973b80a1d97b837684e6cae6878756b7d55a1e642b0c0 artifacts/robustness/thermal-evaluation/full_history/parameter_shift_2node-predictions.npz
255
+ 1550a63d836c9138d73641ff8243e106b5f92e703d290f0e4bd001a053877501 artifacts/robustness/thermal-evaluation/full_history/small_room_3node-context.json
256
+ 9052b77ab6661143e5688260ea8cdd84b5e52bc12b4d1d7d3b751d1e85f34b9e artifacts/robustness/thermal-evaluation/full_history/small_room_3node-predictions.npz
257
+ e8459445a41b3ab862d2ad942d9af57f84d5596715628d5fbf80907607fe27ba artifacts/robustness/thermal-evaluation/full_history/support.json
258
+ 19d9b9c4116509e5cc7f1124808a5c5f2c0691a30af53dc53581b279d71c62ec artifacts/robustness/thermal-evaluation/thermal-evaluation.json
259
+ cb828f093dfd6f8b57ef7e7814f1c459ec06f5248de63e9ceb892c00ea328367 artifacts/robustness/thermal-evaluation/thermal_temperature_only/auditorium_3node-context.json
260
+ 6a4002c042779a1bbab8709c0c89b11428d2f1e4aa64e6756cce6d0e0d17aa72 artifacts/robustness/thermal-evaluation/thermal_temperature_only/auditorium_3node-predictions.npz
261
+ 9dc836aa7e47538b04d31c641d198aea37b634098964fe32e5e2e77f8090013d artifacts/robustness/thermal-evaluation/thermal_temperature_only/calibration.json
262
+ faa41a69c307447c613981f5e5cdedade72730e95446a2612e4864ab86f24b99 artifacts/robustness/thermal-evaluation/thermal_temperature_only/parameter_shift_2node-context.json
263
+ b984d04ffef460e34270c8d850a0337f3a59c00cc52ce0a5ae8fc48cd941e30a artifacts/robustness/thermal-evaluation/thermal_temperature_only/parameter_shift_2node-predictions.npz
264
+ 4bfdbb4be5159a58cecfba8dd1f9e3f0ec3d6fd259ed3b96f64367dfb4299a76 artifacts/robustness/thermal-evaluation/thermal_temperature_only/small_room_3node-context.json
265
+ e45f4434fd6c625969ecb9b4bf00b2a88ad2930fc4fb0361e6a77d84e8f3ca34 artifacts/robustness/thermal-evaluation/thermal_temperature_only/small_room_3node-predictions.npz
266
+ edafa68742986afb6abc3bc1c325ca21d13ee4aa6b80a4da15415ab20bab2dbe artifacts/robustness/thermal-evaluation/thermal_temperature_only/support.json
267
+ c3988bca613ff29bab16a80ab12b7e58e385085b82bdca6d7a2ae9d6a1b8c326 configs/full-study.json
268
+ ad133d98de7bccc0130e11077b7503c4d40ac67633e6765496fdfc3d5bdf65fc configs/poc.json
269
+ 210c4425b9c931c612e852e2402021b20399fac368c2c3840c499288caa52cb1 configs/robustness-study.json
270
+ 1913ec4925af9029694c4e1ffc8cb51b1a29ea53f850f1f0f8f68c610f0bc52e configs/smoke.json
271
+ 7feab5d6e5a479dd23cd55af3926cb430902940b55d62bc8882a6f337dea06c1 docs/context-uncertainty.md
272
+ 3029bf21f52c59bd67460abb162a19b174b8597085382c67334777e128eebc98 docs/contracts.md
273
+ cd3349693d1fcc8ae8371a1cf951706881dea2b1efd6080ed76f1b4799421fdc docs/robustness-study.md
274
+ 5a136b692e5288cfc83099df5f21d4dc6ebbb20303ceaf7116f231158c333ea3 licenses/CityLearn-3.0.2-LICENSE
275
+ 254144cbe213232223dc274f607069f715ca3844f67d6799dbfe93d5e4cbfcd8 pyproject.toml
276
+ 5d03cbe545faf8645b56cf9ffa31edb78064c2b90be9a3288b8d761c8ed90794 release.json
277
+ fde731bd86dbd989031b2ba34d31dfa483c34b476753d09bfd5575110480b27d scripts/behavior_support.py
278
+ ab2a1aba89abf527757a839c12978554ed3ea6956b0472d790a0c0e863bdfd24 scripts/build_robustness_release.py
279
+ cf7f85ff76891fea7a759b17f8d38a6062cfe6e69154376f3b0fcbbb20f0443f scripts/challenge_interventions.py
280
+ 7593a9a71f77e835b06cec23de4a4d4c169aed82c2508f777557b26e3394f2d3 scripts/citylearn_validation.py
281
+ 1e734bb91f0c34e56010d5f8665e3f05d4d349166baf852947e21e541d6cc989 scripts/context_uncertainty.py
282
+ bc2085006b4fb12893ad5e6e839f7f47c4288f5f18badc550f35b721e0f50422 scripts/evaluate_citylearn.py
283
+ f10b5c12c182361780bdf2548d98aca103b2f3568045a7aaebfbb6da038db9a5 scripts/evaluate_thermal_challenges.py
284
+ bce3097a1271cd787a01be728ab104fae840832681ac512132066c52f3ba45fa scripts/history_diagnostics.py
285
+ 4dc1b47589232fcc2619ddc4c5a93e7cce4270cda376d29af2c236fbc67b4162 scripts/thermal_challenges.py
286
+ ace1139d3866614b34ee73598bfd3cd190c035d446ebd86518ae7bc5d73dea2c tests/test_behavior_support.py
287
+ 135f07e9ccd3ab92c340813d22e8e2d5e53654c2b6c3502d31feb6abe18fa54c tests/test_challenge_interventions.py
288
+ 4a95a1d17b88445d5580f0a952e11eb39d2b7a02835532998a8a2c138f0664c5 tests/test_citylearn_validation.py
289
+ c54717a329d3b6ab3e67643f9befd5d74bbb76077640b13cdeb8d3ce3ace0552 tests/test_context_uncertainty.py
290
+ fed121f6a5e4ec864842d0c256b2bbf75d93af2ac52613269fe7daa5d6b9df00 tests/test_evaluate_citylearn.py
291
+ 47cc6e270f9759fb76d3db4e4323b07022beb335615e7ceed087c920b63951ce tests/test_history_diagnostics.py
292
+ 54bd1e9e943e311b6f21484810618b65e847c93e902c71438aa5fec553546c05 tests/test_robustness_release.py
293
+ 06e4930f7253596eb9af4495418b18e1ac92ec6bce674a21a5bdd737f2cc64b7 tests/test_thermal_challenges.py
294
+ d26e8cc8ee9fda48335dc2417e08e92f93b0e56de95d18817e48b164a45055cc tests/test_thermal_evaluation.py
295
+ c4f4c4c5f9d9f9d6d8b54e62cbfbf8167b8a5423bf204d809d5135fbefc059fa tfm/__init__.py
296
+ e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 tfm/api/__init__.py
297
+ 9de088be206053b13ab515d12e308d14a93c5fb2ff1db5773c1f6f23777abc32 tfm/api/profile.py
298
+ 428bd963c2833c04b47f19c26573f2f28296585d394d05544ac6de860a47e33d tfm/api/server.py
299
+ 2bd24e2f5d48edc4678ad827f3a3046de256b8d5731d90f19c6fabee269daa66 tfm/data/__init__.py
300
+ a512ba251e45017ee75d9278385bb8f3d26f5ac43bf9d994c912d8e15cead803 tfm/data/episodes.py
301
+ 6a00cd71156b423b02a180f5d6db31d83953320ec4380a8ced6f005427df51e3 tfm/data/external.py
302
+ a3cffad4440a1aa9cd41eac48dcf43fbdc19b4d169200e33bf7dcf0e760d33e3 tfm/data/generate.py
303
+ 8f51104b43c2855944c550f9f8699654605196c71214e9d7746d90500a05a3a3 tfm/data/normalization.py
304
+ c1e09c0b273e0cb31044e5d7575b4e6387ff2a5d7fd2d550c6b23bc72ccc2078 tfm/data/schema.py
305
+ b23a0ff480d3c49b325abd266298243eae7be9c279ee91516fc4d01c5a145f12 tfm/data/windows.py
306
+ fd447a5e6bf4b857d9b0670f8ac8c70111bf3dfe5755eefbe68c4d86b13a36d5 tfm/evaluation/__init__.py
307
+ 2dd709f31cbef652b252bec7e4ad63425933f7141657e73b9803f4f98eeda843 tfm/evaluation/baselines.py
308
+ 2f817104b27c343bab44940840b93a9aae4fb9f42d5851c6496920c1eb5d2155 tfm/evaluation/benchmark.py
309
+ cf5bdbccccd6f13628ae871b8fd7e7b1900306e1ebdf00003147d083cf3cc5ca tfm/evaluation/calibration.py
310
+ 5b70bb928cc29b4f09cbaacaed716208e1fc5b507f8cd4811b52c770e9268d0d tfm/evaluation/catboost_artifact.py
311
+ c53cf03e4a689b2d85c00a52dca6303216c92f61ec91a4b68f66f36a3cc588de tfm/evaluation/comparison.py
312
+ f7f981c0b9d635681c7c4e8ee606e279b0bf6eacbe3f3a8a2d6a4fd1279e97e9 tfm/evaluation/context.py
313
+ 6d8c00284449997e8c338b227ebd2f4d72885c555a6d4bef0fb290742be95259 tfm/evaluation/counterfactual.py
314
+ cb4ad0870c90b7ce54ad082cd5cb8289d4036ff81418732fa5280eee25b5a03d tfm/evaluation/experiments.py
315
+ 04016e0647788caa5d5cd1b9a036018761d7867b29f10cc064bbb4ae2351dcd7 tfm/evaluation/metrics.py
316
+ 3296ca3f3fd036a2173edc71c23d6430f57ca8f141a20c8e5a7cc6a20cffd7e0 tfm/evaluation/runner.py
317
+ 6605555f6139827b57c5485ccd0fbb0cf60367da21c2a12009ef0a48b1cc176f tfm/evaluation/train_catboost.py
318
+ e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 tfm/export/__init__.py
319
+ 3cec8744848d40551ae0c770aa0cc1d4177189a1a1ac20f2bd5c3bd04f2ce40d tfm/export/onnx.py
320
+ c20432c425b2305a275f22968a539619a57037c7c8af67baceca979a4ee0e35c tfm/models/__init__.py
321
+ 53c6c32671006759d3a1aeab93cc2349371203414a0a1febf618e9c2b779a0c5 tfm/models/core.py
322
+ 0c2179025d61bad9948adb2e4ae3130a844ddf92e1094ba3b93836d6d75b1e8b tfm/simulators/__init__.py
323
+ 03893cd813d86f12d0e335cbdbd4ea588d2c8ac97566254725fb32e774c413cc tfm/simulators/physics.py
324
+ 5fdc517285d815cc8972aac6a60c974f82354ce29f6413d3e0c856c30edcf5bd tfm/training/__init__.py
325
+ d9e58852db730ccecff009c24654e794b3be40a3d8d6985c4757774ab6e0898d tfm/training/train.py
326
+ 622b4c7d12d2d20f0061f132b6f50e505de99852a1285ad280cba9b2aa32509f uv.lock
studies/robustness-seed42-20261011/artifacts/full/transformer/seed-42/checkpoint.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41485d6dd0c72f09a9ca67ced83bc4a0725f9cde731276d1672902304675ebec
3
+ size 6474292
studies/robustness-seed42-20261011/artifacts/full/transformer/seed-42/normalization.json ADDED
@@ -0,0 +1,993 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bounds": {
3
+ "ambient_temp": [
4
+ -30,
5
+ 60
6
+ ],
7
+ "battery_power": [
8
+ -20,
9
+ 20
10
+ ],
11
+ "battery_temp": [
12
+ -30,
13
+ 80
14
+ ],
15
+ "demand": [
16
+ 0,
17
+ 10
18
+ ],
19
+ "energy_kwh": [
20
+ 0,
21
+ 1000000.0
22
+ ],
23
+ "flow": [
24
+ 0,
25
+ 20
26
+ ],
27
+ "hvac_power": [
28
+ -15,
29
+ 15
30
+ ],
31
+ "indoor_temp": [
32
+ -30,
33
+ 70
34
+ ],
35
+ "inlet_temp": [
36
+ -5,
37
+ 60
38
+ ],
39
+ "mass_temp": [
40
+ -30,
41
+ 70
42
+ ],
43
+ "occupancy_gain": [
44
+ 0,
45
+ 3
46
+ ],
47
+ "outdoor_temp": [
48
+ -30,
49
+ 60
50
+ ],
51
+ "pressure": [
52
+ 0,
53
+ 300
54
+ ],
55
+ "pump_output": [
56
+ 0,
57
+ 1
58
+ ],
59
+ "solar_gain": [
60
+ 0,
61
+ 5
62
+ ],
63
+ "state_of_charge": [
64
+ 0,
65
+ 1
66
+ ],
67
+ "terminal_voltage": [
68
+ 10,
69
+ 70
70
+ ],
71
+ "valve_position": [
72
+ 0,
73
+ 1
74
+ ],
75
+ "water_level": [
76
+ 0,
77
+ 50
78
+ ],
79
+ "water_temp": [
80
+ -5,
81
+ 80
82
+ ]
83
+ },
84
+ "field_names": [
85
+ "indoor_temp",
86
+ "mass_temp",
87
+ "energy_kwh",
88
+ "water_level",
89
+ "water_temp",
90
+ "flow",
91
+ "pressure",
92
+ "state_of_charge",
93
+ "battery_temp",
94
+ "terminal_voltage",
95
+ "hvac_power",
96
+ "valve_position",
97
+ "pump_output",
98
+ "battery_power",
99
+ "outdoor_temp",
100
+ "solar_gain",
101
+ "occupancy_gain",
102
+ "demand",
103
+ "inlet_temp",
104
+ "ambient_temp"
105
+ ],
106
+ "mean": [
107
+ 21.260110190522674,
108
+ 21.294143809908295,
109
+ 458.2616030734551,
110
+ 10.349678152535423,
111
+ 15.87959941777483,
112
+ 0.5373690927540696,
113
+ 38.43412944961296,
114
+ 0.4826127376021479,
115
+ 22.252339221724515,
116
+ 38.748503193739225,
117
+ 0.24556926961433975,
118
+ 0.5992653670099126,
119
+ 0.3955478955261828,
120
+ 0.14853332874202788,
121
+ 15.793682454917644,
122
+ 0.5707246923134439,
123
+ 0.3623995421049213,
124
+ 1.1325604382639707,
125
+ 15.342054774785314,
126
+ 15.83001136338815
127
+ ],
128
+ "scale": [
129
+ 8.045533406510737,
130
+ 3.8168959904494413,
131
+ 286.08492714119444,
132
+ 5.02593998333158,
133
+ 0.9135711299377679,
134
+ 0.5343871434744538,
135
+ 37.75881915571558,
136
+ 0.36395720653308616,
137
+ 7.623231511617394,
138
+ 16.91282588005527,
139
+ 8.974730874580919,
140
+ 0.3249119350991334,
141
+ 0.33614533488560966,
142
+ 11.180001252068704,
143
+ 6.335063827555018,
144
+ 0.784610751286015,
145
+ 0.23292416227299456,
146
+ 0.7266014200582064,
147
+ 0.9463622850092638,
148
+ 6.399157351553315
149
+ ],
150
+ "training_system_ids": [
151
+ "battery-00002",
152
+ "battery-00005",
153
+ "battery-00008",
154
+ "battery-00014",
155
+ "battery-00020",
156
+ "battery-00026",
157
+ "battery-00032",
158
+ "battery-00035",
159
+ "battery-00044",
160
+ "battery-00050",
161
+ "battery-00053",
162
+ "battery-00056",
163
+ "battery-00059",
164
+ "battery-00062",
165
+ "battery-00065",
166
+ "battery-00071",
167
+ "battery-00077",
168
+ "battery-00089",
169
+ "battery-00092",
170
+ "battery-00098",
171
+ "battery-00101",
172
+ "battery-00110",
173
+ "battery-00113",
174
+ "battery-00116",
175
+ "battery-00122",
176
+ "battery-00125",
177
+ "battery-00131",
178
+ "battery-00137",
179
+ "battery-00140",
180
+ "battery-00143",
181
+ "battery-00155",
182
+ "battery-00170",
183
+ "battery-00173",
184
+ "battery-00179",
185
+ "battery-00182",
186
+ "battery-00185",
187
+ "battery-00191",
188
+ "battery-00197",
189
+ "battery-00200",
190
+ "battery-00203",
191
+ "battery-00206",
192
+ "battery-00209",
193
+ "battery-00215",
194
+ "battery-00218",
195
+ "battery-00221",
196
+ "battery-00227",
197
+ "battery-00233",
198
+ "battery-00236",
199
+ "battery-00242",
200
+ "battery-00245",
201
+ "battery-00248",
202
+ "battery-00251",
203
+ "battery-00254",
204
+ "battery-00257",
205
+ "battery-00269",
206
+ "battery-00272",
207
+ "battery-00278",
208
+ "battery-00284",
209
+ "battery-00293",
210
+ "battery-00302",
211
+ "battery-00311",
212
+ "battery-00314",
213
+ "battery-00323",
214
+ "battery-00326",
215
+ "battery-00329",
216
+ "battery-00332",
217
+ "battery-00335",
218
+ "battery-00338",
219
+ "battery-00344",
220
+ "battery-00350",
221
+ "battery-00356",
222
+ "battery-00359",
223
+ "battery-00362",
224
+ "battery-00368",
225
+ "battery-00371",
226
+ "battery-00374",
227
+ "battery-00383",
228
+ "battery-00386",
229
+ "battery-00389",
230
+ "battery-00392",
231
+ "battery-00395",
232
+ "battery-00398",
233
+ "battery-00401",
234
+ "battery-00404",
235
+ "battery-00407",
236
+ "battery-00410",
237
+ "battery-00419",
238
+ "battery-00422",
239
+ "battery-00425",
240
+ "battery-00428",
241
+ "battery-00431",
242
+ "battery-00434",
243
+ "battery-00437",
244
+ "battery-00440",
245
+ "battery-00443",
246
+ "battery-00449",
247
+ "battery-00452",
248
+ "battery-00455",
249
+ "battery-00458",
250
+ "battery-00461",
251
+ "battery-00467",
252
+ "battery-00470",
253
+ "battery-00473",
254
+ "battery-00476",
255
+ "battery-00485",
256
+ "battery-00488",
257
+ "battery-00491",
258
+ "battery-00494",
259
+ "battery-00497",
260
+ "battery-00503",
261
+ "battery-00506",
262
+ "battery-00509",
263
+ "battery-00512",
264
+ "battery-00515",
265
+ "battery-00518",
266
+ "battery-00521",
267
+ "battery-00524",
268
+ "battery-00530",
269
+ "battery-00536",
270
+ "battery-00539",
271
+ "battery-00542",
272
+ "battery-00545",
273
+ "battery-00548",
274
+ "battery-00551",
275
+ "battery-00554",
276
+ "battery-00557",
277
+ "battery-00560",
278
+ "battery-00563",
279
+ "battery-00569",
280
+ "battery-00572",
281
+ "battery-00575",
282
+ "battery-00584",
283
+ "battery-00590",
284
+ "battery-00596",
285
+ "battery-00602",
286
+ "battery-00611",
287
+ "battery-00614",
288
+ "battery-00617",
289
+ "battery-00620",
290
+ "battery-00623",
291
+ "battery-00626",
292
+ "battery-00629",
293
+ "battery-00638",
294
+ "battery-00641",
295
+ "battery-00644",
296
+ "battery-00647",
297
+ "battery-00650",
298
+ "battery-00656",
299
+ "battery-00662",
300
+ "battery-00668",
301
+ "battery-00671",
302
+ "battery-00680",
303
+ "battery-00683",
304
+ "battery-00686",
305
+ "battery-00689",
306
+ "battery-00692",
307
+ "battery-00695",
308
+ "battery-00698",
309
+ "battery-00701",
310
+ "battery-00707",
311
+ "battery-00710",
312
+ "battery-00713",
313
+ "battery-00716",
314
+ "battery-00725",
315
+ "battery-00728",
316
+ "battery-00731",
317
+ "battery-00734",
318
+ "battery-00740",
319
+ "battery-00743",
320
+ "battery-00746",
321
+ "battery-00749",
322
+ "battery-00755",
323
+ "battery-00758",
324
+ "battery-00776",
325
+ "battery-00779",
326
+ "battery-00785",
327
+ "battery-00791",
328
+ "battery-00794",
329
+ "battery-00800",
330
+ "battery-00809",
331
+ "battery-00812",
332
+ "battery-00815",
333
+ "battery-00818",
334
+ "battery-00821",
335
+ "battery-00824",
336
+ "battery-00827",
337
+ "battery-00836",
338
+ "battery-00842",
339
+ "battery-00845",
340
+ "battery-00848",
341
+ "battery-00851",
342
+ "battery-00854",
343
+ "battery-00863",
344
+ "battery-00866",
345
+ "battery-00869",
346
+ "battery-00872",
347
+ "battery-00875",
348
+ "battery-00884",
349
+ "battery-00887",
350
+ "battery-00896",
351
+ "battery-00902",
352
+ "battery-00905",
353
+ "battery-00911",
354
+ "battery-00914",
355
+ "battery-00917",
356
+ "battery-00920",
357
+ "battery-00923",
358
+ "battery-00926",
359
+ "battery-00929",
360
+ "battery-00932",
361
+ "battery-00935",
362
+ "battery-00938",
363
+ "battery-00941",
364
+ "battery-00944",
365
+ "battery-00953",
366
+ "battery-00956",
367
+ "battery-00959",
368
+ "battery-00965",
369
+ "battery-00968",
370
+ "battery-00971",
371
+ "battery-00974",
372
+ "battery-00977",
373
+ "battery-00980",
374
+ "battery-00986",
375
+ "battery-00995",
376
+ "battery-00998",
377
+ "battery-01001",
378
+ "battery-01004",
379
+ "battery-01007",
380
+ "battery-01013",
381
+ "battery-01019",
382
+ "battery-01022",
383
+ "battery-01028",
384
+ "battery-01031",
385
+ "battery-01034",
386
+ "battery-01037",
387
+ "battery-01040",
388
+ "battery-01043",
389
+ "battery-01046",
390
+ "battery-01049",
391
+ "battery-01055",
392
+ "battery-01058",
393
+ "battery-01061",
394
+ "battery-01064",
395
+ "battery-01067",
396
+ "battery-01070",
397
+ "battery-01073",
398
+ "battery-01076",
399
+ "battery-01079",
400
+ "battery-01085",
401
+ "battery-01088",
402
+ "battery-01091",
403
+ "battery-01094",
404
+ "battery-01097",
405
+ "battery-01103",
406
+ "battery-01106",
407
+ "battery-01109",
408
+ "battery-01115",
409
+ "battery-01118",
410
+ "battery-01121",
411
+ "battery-01124",
412
+ "battery-01130",
413
+ "battery-01133",
414
+ "battery-01136",
415
+ "battery-01139",
416
+ "battery-01142",
417
+ "battery-01145",
418
+ "battery-01151",
419
+ "battery-01157",
420
+ "battery-01160",
421
+ "battery-01166",
422
+ "battery-01169",
423
+ "battery-01172",
424
+ "battery-01175",
425
+ "battery-01178",
426
+ "battery-01184",
427
+ "battery-01187",
428
+ "battery-01193",
429
+ "battery-01196",
430
+ "battery-01199",
431
+ "tank-00001",
432
+ "tank-00004",
433
+ "tank-00007",
434
+ "tank-00013",
435
+ "tank-00016",
436
+ "tank-00019",
437
+ "tank-00022",
438
+ "tank-00025",
439
+ "tank-00028",
440
+ "tank-00031",
441
+ "tank-00034",
442
+ "tank-00037",
443
+ "tank-00040",
444
+ "tank-00043",
445
+ "tank-00049",
446
+ "tank-00055",
447
+ "tank-00058",
448
+ "tank-00061",
449
+ "tank-00064",
450
+ "tank-00067",
451
+ "tank-00070",
452
+ "tank-00073",
453
+ "tank-00076",
454
+ "tank-00082",
455
+ "tank-00085",
456
+ "tank-00088",
457
+ "tank-00091",
458
+ "tank-00094",
459
+ "tank-00103",
460
+ "tank-00106",
461
+ "tank-00109",
462
+ "tank-00115",
463
+ "tank-00118",
464
+ "tank-00121",
465
+ "tank-00124",
466
+ "tank-00133",
467
+ "tank-00136",
468
+ "tank-00145",
469
+ "tank-00154",
470
+ "tank-00157",
471
+ "tank-00163",
472
+ "tank-00166",
473
+ "tank-00169",
474
+ "tank-00172",
475
+ "tank-00178",
476
+ "tank-00181",
477
+ "tank-00184",
478
+ "tank-00193",
479
+ "tank-00196",
480
+ "tank-00199",
481
+ "tank-00202",
482
+ "tank-00208",
483
+ "tank-00214",
484
+ "tank-00220",
485
+ "tank-00223",
486
+ "tank-00226",
487
+ "tank-00229",
488
+ "tank-00232",
489
+ "tank-00235",
490
+ "tank-00238",
491
+ "tank-00244",
492
+ "tank-00247",
493
+ "tank-00250",
494
+ "tank-00259",
495
+ "tank-00262",
496
+ "tank-00265",
497
+ "tank-00268",
498
+ "tank-00274",
499
+ "tank-00277",
500
+ "tank-00280",
501
+ "tank-00283",
502
+ "tank-00289",
503
+ "tank-00295",
504
+ "tank-00301",
505
+ "tank-00304",
506
+ "tank-00307",
507
+ "tank-00310",
508
+ "tank-00316",
509
+ "tank-00319",
510
+ "tank-00322",
511
+ "tank-00328",
512
+ "tank-00334",
513
+ "tank-00340",
514
+ "tank-00343",
515
+ "tank-00346",
516
+ "tank-00349",
517
+ "tank-00352",
518
+ "tank-00355",
519
+ "tank-00358",
520
+ "tank-00361",
521
+ "tank-00364",
522
+ "tank-00367",
523
+ "tank-00370",
524
+ "tank-00373",
525
+ "tank-00379",
526
+ "tank-00382",
527
+ "tank-00385",
528
+ "tank-00388",
529
+ "tank-00394",
530
+ "tank-00397",
531
+ "tank-00403",
532
+ "tank-00406",
533
+ "tank-00409",
534
+ "tank-00415",
535
+ "tank-00418",
536
+ "tank-00421",
537
+ "tank-00424",
538
+ "tank-00427",
539
+ "tank-00430",
540
+ "tank-00439",
541
+ "tank-00442",
542
+ "tank-00445",
543
+ "tank-00451",
544
+ "tank-00454",
545
+ "tank-00457",
546
+ "tank-00463",
547
+ "tank-00469",
548
+ "tank-00472",
549
+ "tank-00478",
550
+ "tank-00490",
551
+ "tank-00493",
552
+ "tank-00496",
553
+ "tank-00499",
554
+ "tank-00508",
555
+ "tank-00511",
556
+ "tank-00514",
557
+ "tank-00520",
558
+ "tank-00529",
559
+ "tank-00538",
560
+ "tank-00541",
561
+ "tank-00547",
562
+ "tank-00550",
563
+ "tank-00556",
564
+ "tank-00559",
565
+ "tank-00562",
566
+ "tank-00580",
567
+ "tank-00589",
568
+ "tank-00595",
569
+ "tank-00598",
570
+ "tank-00604",
571
+ "tank-00607",
572
+ "tank-00610",
573
+ "tank-00613",
574
+ "tank-00619",
575
+ "tank-00622",
576
+ "tank-00646",
577
+ "tank-00649",
578
+ "tank-00652",
579
+ "tank-00655",
580
+ "tank-00658",
581
+ "tank-00664",
582
+ "tank-00667",
583
+ "tank-00670",
584
+ "tank-00673",
585
+ "tank-00676",
586
+ "tank-00685",
587
+ "tank-00688",
588
+ "tank-00691",
589
+ "tank-00694",
590
+ "tank-00697",
591
+ "tank-00700",
592
+ "tank-00703",
593
+ "tank-00709",
594
+ "tank-00712",
595
+ "tank-00715",
596
+ "tank-00718",
597
+ "tank-00721",
598
+ "tank-00724",
599
+ "tank-00727",
600
+ "tank-00730",
601
+ "tank-00733",
602
+ "tank-00736",
603
+ "tank-00739",
604
+ "tank-00742",
605
+ "tank-00745",
606
+ "tank-00748",
607
+ "tank-00751",
608
+ "tank-00760",
609
+ "tank-00763",
610
+ "tank-00766",
611
+ "tank-00778",
612
+ "tank-00781",
613
+ "tank-00787",
614
+ "tank-00790",
615
+ "tank-00793",
616
+ "tank-00802",
617
+ "tank-00805",
618
+ "tank-00811",
619
+ "tank-00814",
620
+ "tank-00817",
621
+ "tank-00820",
622
+ "tank-00823",
623
+ "tank-00829",
624
+ "tank-00832",
625
+ "tank-00835",
626
+ "tank-00838",
627
+ "tank-00844",
628
+ "tank-00847",
629
+ "tank-00850",
630
+ "tank-00853",
631
+ "tank-00856",
632
+ "tank-00859",
633
+ "tank-00865",
634
+ "tank-00868",
635
+ "tank-00871",
636
+ "tank-00877",
637
+ "tank-00889",
638
+ "tank-00892",
639
+ "tank-00895",
640
+ "tank-00898",
641
+ "tank-00901",
642
+ "tank-00904",
643
+ "tank-00907",
644
+ "tank-00910",
645
+ "tank-00916",
646
+ "tank-00919",
647
+ "tank-00922",
648
+ "tank-00925",
649
+ "tank-00931",
650
+ "tank-00937",
651
+ "tank-00946",
652
+ "tank-00949",
653
+ "tank-00955",
654
+ "tank-00958",
655
+ "tank-00961",
656
+ "tank-00964",
657
+ "tank-00970",
658
+ "tank-00973",
659
+ "tank-00979",
660
+ "tank-00982",
661
+ "tank-00985",
662
+ "tank-00988",
663
+ "tank-00991",
664
+ "tank-00997",
665
+ "tank-01000",
666
+ "tank-01003",
667
+ "tank-01006",
668
+ "tank-01012",
669
+ "tank-01018",
670
+ "tank-01021",
671
+ "tank-01024",
672
+ "tank-01027",
673
+ "tank-01030",
674
+ "tank-01033",
675
+ "tank-01036",
676
+ "tank-01039",
677
+ "tank-01042",
678
+ "tank-01045",
679
+ "tank-01048",
680
+ "tank-01054",
681
+ "tank-01057",
682
+ "tank-01066",
683
+ "tank-01069",
684
+ "tank-01075",
685
+ "tank-01084",
686
+ "tank-01087",
687
+ "tank-01090",
688
+ "tank-01096",
689
+ "tank-01105",
690
+ "tank-01108",
691
+ "tank-01111",
692
+ "tank-01117",
693
+ "tank-01120",
694
+ "tank-01126",
695
+ "tank-01135",
696
+ "tank-01138",
697
+ "tank-01141",
698
+ "tank-01144",
699
+ "tank-01147",
700
+ "tank-01150",
701
+ "tank-01153",
702
+ "tank-01159",
703
+ "tank-01162",
704
+ "tank-01165",
705
+ "tank-01168",
706
+ "tank-01174",
707
+ "tank-01177",
708
+ "tank-01180",
709
+ "tank-01186",
710
+ "tank-01195",
711
+ "thermal-00000",
712
+ "thermal-00006",
713
+ "thermal-00009",
714
+ "thermal-00012",
715
+ "thermal-00021",
716
+ "thermal-00024",
717
+ "thermal-00027",
718
+ "thermal-00033",
719
+ "thermal-00036",
720
+ "thermal-00054",
721
+ "thermal-00057",
722
+ "thermal-00060",
723
+ "thermal-00072",
724
+ "thermal-00075",
725
+ "thermal-00078",
726
+ "thermal-00081",
727
+ "thermal-00084",
728
+ "thermal-00087",
729
+ "thermal-00090",
730
+ "thermal-00096",
731
+ "thermal-00099",
732
+ "thermal-00111",
733
+ "thermal-00114",
734
+ "thermal-00120",
735
+ "thermal-00132",
736
+ "thermal-00135",
737
+ "thermal-00138",
738
+ "thermal-00141",
739
+ "thermal-00144",
740
+ "thermal-00150",
741
+ "thermal-00153",
742
+ "thermal-00156",
743
+ "thermal-00159",
744
+ "thermal-00162",
745
+ "thermal-00165",
746
+ "thermal-00168",
747
+ "thermal-00174",
748
+ "thermal-00177",
749
+ "thermal-00180",
750
+ "thermal-00183",
751
+ "thermal-00186",
752
+ "thermal-00192",
753
+ "thermal-00198",
754
+ "thermal-00201",
755
+ "thermal-00204",
756
+ "thermal-00210",
757
+ "thermal-00216",
758
+ "thermal-00219",
759
+ "thermal-00225",
760
+ "thermal-00231",
761
+ "thermal-00237",
762
+ "thermal-00240",
763
+ "thermal-00243",
764
+ "thermal-00246",
765
+ "thermal-00249",
766
+ "thermal-00252",
767
+ "thermal-00258",
768
+ "thermal-00264",
769
+ "thermal-00267",
770
+ "thermal-00273",
771
+ "thermal-00276",
772
+ "thermal-00279",
773
+ "thermal-00282",
774
+ "thermal-00285",
775
+ "thermal-00288",
776
+ "thermal-00294",
777
+ "thermal-00300",
778
+ "thermal-00303",
779
+ "thermal-00312",
780
+ "thermal-00318",
781
+ "thermal-00321",
782
+ "thermal-00324",
783
+ "thermal-00336",
784
+ "thermal-00345",
785
+ "thermal-00354",
786
+ "thermal-00357",
787
+ "thermal-00360",
788
+ "thermal-00363",
789
+ "thermal-00372",
790
+ "thermal-00378",
791
+ "thermal-00381",
792
+ "thermal-00384",
793
+ "thermal-00390",
794
+ "thermal-00393",
795
+ "thermal-00396",
796
+ "thermal-00399",
797
+ "thermal-00402",
798
+ "thermal-00405",
799
+ "thermal-00414",
800
+ "thermal-00420",
801
+ "thermal-00429",
802
+ "thermal-00432",
803
+ "thermal-00435",
804
+ "thermal-00438",
805
+ "thermal-00441",
806
+ "thermal-00444",
807
+ "thermal-00447",
808
+ "thermal-00450",
809
+ "thermal-00453",
810
+ "thermal-00456",
811
+ "thermal-00459",
812
+ "thermal-00462",
813
+ "thermal-00465",
814
+ "thermal-00468",
815
+ "thermal-00474",
816
+ "thermal-00477",
817
+ "thermal-00483",
818
+ "thermal-00486",
819
+ "thermal-00492",
820
+ "thermal-00495",
821
+ "thermal-00498",
822
+ "thermal-00504",
823
+ "thermal-00507",
824
+ "thermal-00513",
825
+ "thermal-00516",
826
+ "thermal-00519",
827
+ "thermal-00522",
828
+ "thermal-00528",
829
+ "thermal-00534",
830
+ "thermal-00537",
831
+ "thermal-00540",
832
+ "thermal-00543",
833
+ "thermal-00549",
834
+ "thermal-00552",
835
+ "thermal-00555",
836
+ "thermal-00558",
837
+ "thermal-00573",
838
+ "thermal-00576",
839
+ "thermal-00579",
840
+ "thermal-00588",
841
+ "thermal-00591",
842
+ "thermal-00594",
843
+ "thermal-00600",
844
+ "thermal-00603",
845
+ "thermal-00606",
846
+ "thermal-00609",
847
+ "thermal-00612",
848
+ "thermal-00615",
849
+ "thermal-00621",
850
+ "thermal-00627",
851
+ "thermal-00630",
852
+ "thermal-00633",
853
+ "thermal-00639",
854
+ "thermal-00642",
855
+ "thermal-00645",
856
+ "thermal-00648",
857
+ "thermal-00651",
858
+ "thermal-00657",
859
+ "thermal-00666",
860
+ "thermal-00675",
861
+ "thermal-00678",
862
+ "thermal-00681",
863
+ "thermal-00684",
864
+ "thermal-00687",
865
+ "thermal-00690",
866
+ "thermal-00693",
867
+ "thermal-00696",
868
+ "thermal-00699",
869
+ "thermal-00702",
870
+ "thermal-00705",
871
+ "thermal-00708",
872
+ "thermal-00714",
873
+ "thermal-00717",
874
+ "thermal-00723",
875
+ "thermal-00726",
876
+ "thermal-00729",
877
+ "thermal-00732",
878
+ "thermal-00735",
879
+ "thermal-00738",
880
+ "thermal-00741",
881
+ "thermal-00744",
882
+ "thermal-00747",
883
+ "thermal-00750",
884
+ "thermal-00753",
885
+ "thermal-00756",
886
+ "thermal-00759",
887
+ "thermal-00762",
888
+ "thermal-00765",
889
+ "thermal-00768",
890
+ "thermal-00771",
891
+ "thermal-00774",
892
+ "thermal-00777",
893
+ "thermal-00780",
894
+ "thermal-00783",
895
+ "thermal-00786",
896
+ "thermal-00789",
897
+ "thermal-00792",
898
+ "thermal-00795",
899
+ "thermal-00804",
900
+ "thermal-00807",
901
+ "thermal-00810",
902
+ "thermal-00813",
903
+ "thermal-00819",
904
+ "thermal-00828",
905
+ "thermal-00840",
906
+ "thermal-00843",
907
+ "thermal-00846",
908
+ "thermal-00849",
909
+ "thermal-00852",
910
+ "thermal-00855",
911
+ "thermal-00864",
912
+ "thermal-00867",
913
+ "thermal-00873",
914
+ "thermal-00876",
915
+ "thermal-00879",
916
+ "thermal-00882",
917
+ "thermal-00885",
918
+ "thermal-00894",
919
+ "thermal-00897",
920
+ "thermal-00906",
921
+ "thermal-00912",
922
+ "thermal-00915",
923
+ "thermal-00918",
924
+ "thermal-00921",
925
+ "thermal-00930",
926
+ "thermal-00933",
927
+ "thermal-00936",
928
+ "thermal-00954",
929
+ "thermal-00957",
930
+ "thermal-00963",
931
+ "thermal-00966",
932
+ "thermal-00969",
933
+ "thermal-00978",
934
+ "thermal-00981",
935
+ "thermal-00984",
936
+ "thermal-00987",
937
+ "thermal-00990",
938
+ "thermal-00993",
939
+ "thermal-00996",
940
+ "thermal-01002",
941
+ "thermal-01005",
942
+ "thermal-01008",
943
+ "thermal-01011",
944
+ "thermal-01014",
945
+ "thermal-01017",
946
+ "thermal-01020",
947
+ "thermal-01026",
948
+ "thermal-01029",
949
+ "thermal-01032",
950
+ "thermal-01035",
951
+ "thermal-01038",
952
+ "thermal-01041",
953
+ "thermal-01044",
954
+ "thermal-01047",
955
+ "thermal-01056",
956
+ "thermal-01059",
957
+ "thermal-01062",
958
+ "thermal-01065",
959
+ "thermal-01068",
960
+ "thermal-01071",
961
+ "thermal-01074",
962
+ "thermal-01080",
963
+ "thermal-01083",
964
+ "thermal-01086",
965
+ "thermal-01089",
966
+ "thermal-01095",
967
+ "thermal-01104",
968
+ "thermal-01107",
969
+ "thermal-01110",
970
+ "thermal-01113",
971
+ "thermal-01116",
972
+ "thermal-01122",
973
+ "thermal-01125",
974
+ "thermal-01128",
975
+ "thermal-01134",
976
+ "thermal-01140",
977
+ "thermal-01143",
978
+ "thermal-01146",
979
+ "thermal-01149",
980
+ "thermal-01152",
981
+ "thermal-01164",
982
+ "thermal-01167",
983
+ "thermal-01173",
984
+ "thermal-01176",
985
+ "thermal-01179",
986
+ "thermal-01185",
987
+ "thermal-01188",
988
+ "thermal-01191",
989
+ "thermal-01194",
990
+ "thermal-01197"
991
+ ],
992
+ "version": 1
993
+ }
studies/robustness-seed42-20261011/artifacts/full/transformer/seed-42/run.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/poc/data/manifest.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/citylearn_battery_common_scale-assessments.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/citylearn_battery_scale_shift-assessments.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/original_heldout-assessments.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/battery/thresholds.json ADDED
@@ -0,0 +1,344 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "tfm-retrospective-behavior-support-v1",
3
+ "policy": {
4
+ "history_steps": 24,
5
+ "anchor_index": 15,
6
+ "end_index": 23,
7
+ "horizon_minutes": 120,
8
+ "quantile": 0.99,
9
+ "quantile_method": "higher",
10
+ "min_count": 30,
11
+ "low_driver_std": 0.05
12
+ },
13
+ "training_system_ids": [
14
+ "battery-00002",
15
+ "battery-00005",
16
+ "battery-00008",
17
+ "battery-00014",
18
+ "battery-00020",
19
+ "battery-00026",
20
+ "battery-00032",
21
+ "battery-00035",
22
+ "battery-00044",
23
+ "battery-00050",
24
+ "battery-00053",
25
+ "battery-00056",
26
+ "battery-00059",
27
+ "battery-00062",
28
+ "battery-00065",
29
+ "battery-00071",
30
+ "battery-00077",
31
+ "battery-00089",
32
+ "battery-00092",
33
+ "battery-00098",
34
+ "battery-00101",
35
+ "battery-00110",
36
+ "battery-00113",
37
+ "battery-00116",
38
+ "battery-00122",
39
+ "battery-00125",
40
+ "battery-00131",
41
+ "battery-00137",
42
+ "battery-00140",
43
+ "battery-00143",
44
+ "battery-00155",
45
+ "battery-00170",
46
+ "battery-00173",
47
+ "battery-00179",
48
+ "battery-00182",
49
+ "battery-00185",
50
+ "battery-00191",
51
+ "battery-00197",
52
+ "battery-00200",
53
+ "battery-00203",
54
+ "battery-00206",
55
+ "battery-00209",
56
+ "battery-00215",
57
+ "battery-00218",
58
+ "battery-00221",
59
+ "battery-00227",
60
+ "battery-00233",
61
+ "battery-00236",
62
+ "battery-00242",
63
+ "battery-00245",
64
+ "battery-00248",
65
+ "battery-00251",
66
+ "battery-00254",
67
+ "battery-00257",
68
+ "battery-00269",
69
+ "battery-00272",
70
+ "battery-00278",
71
+ "battery-00284",
72
+ "battery-00293",
73
+ "battery-00302",
74
+ "battery-00311",
75
+ "battery-00314",
76
+ "battery-00323",
77
+ "battery-00326",
78
+ "battery-00329",
79
+ "battery-00332",
80
+ "battery-00335",
81
+ "battery-00338",
82
+ "battery-00344",
83
+ "battery-00350",
84
+ "battery-00356",
85
+ "battery-00359",
86
+ "battery-00362",
87
+ "battery-00368",
88
+ "battery-00371",
89
+ "battery-00374",
90
+ "battery-00383",
91
+ "battery-00386",
92
+ "battery-00389",
93
+ "battery-00392",
94
+ "battery-00395",
95
+ "battery-00398",
96
+ "battery-00401",
97
+ "battery-00404",
98
+ "battery-00407",
99
+ "battery-00410",
100
+ "battery-00419",
101
+ "battery-00422",
102
+ "battery-00425",
103
+ "battery-00428",
104
+ "battery-00431",
105
+ "battery-00434",
106
+ "battery-00437",
107
+ "battery-00440",
108
+ "battery-00443",
109
+ "battery-00449",
110
+ "battery-00452",
111
+ "battery-00455",
112
+ "battery-00458",
113
+ "battery-00461",
114
+ "battery-00467",
115
+ "battery-00470",
116
+ "battery-00473",
117
+ "battery-00476",
118
+ "battery-00485",
119
+ "battery-00488",
120
+ "battery-00491",
121
+ "battery-00494",
122
+ "battery-00497",
123
+ "battery-00503",
124
+ "battery-00506",
125
+ "battery-00509",
126
+ "battery-00512",
127
+ "battery-00515",
128
+ "battery-00518",
129
+ "battery-00521",
130
+ "battery-00524",
131
+ "battery-00530",
132
+ "battery-00536",
133
+ "battery-00539",
134
+ "battery-00542",
135
+ "battery-00545",
136
+ "battery-00548",
137
+ "battery-00551",
138
+ "battery-00554",
139
+ "battery-00557",
140
+ "battery-00560",
141
+ "battery-00563",
142
+ "battery-00569",
143
+ "battery-00572",
144
+ "battery-00575",
145
+ "battery-00584",
146
+ "battery-00590",
147
+ "battery-00596",
148
+ "battery-00602",
149
+ "battery-00611",
150
+ "battery-00614",
151
+ "battery-00617",
152
+ "battery-00620",
153
+ "battery-00623",
154
+ "battery-00626",
155
+ "battery-00629",
156
+ "battery-00638",
157
+ "battery-00641",
158
+ "battery-00644",
159
+ "battery-00647",
160
+ "battery-00650",
161
+ "battery-00656",
162
+ "battery-00662",
163
+ "battery-00668",
164
+ "battery-00671",
165
+ "battery-00680",
166
+ "battery-00683",
167
+ "battery-00686",
168
+ "battery-00689",
169
+ "battery-00692",
170
+ "battery-00695",
171
+ "battery-00698",
172
+ "battery-00701",
173
+ "battery-00707",
174
+ "battery-00710",
175
+ "battery-00713",
176
+ "battery-00716",
177
+ "battery-00725",
178
+ "battery-00728",
179
+ "battery-00731",
180
+ "battery-00734",
181
+ "battery-00740",
182
+ "battery-00743",
183
+ "battery-00746",
184
+ "battery-00749",
185
+ "battery-00755",
186
+ "battery-00758",
187
+ "battery-00776",
188
+ "battery-00779",
189
+ "battery-00785",
190
+ "battery-00791",
191
+ "battery-00794",
192
+ "battery-00800",
193
+ "battery-00809",
194
+ "battery-00812",
195
+ "battery-00815",
196
+ "battery-00818",
197
+ "battery-00821",
198
+ "battery-00824",
199
+ "battery-00827",
200
+ "battery-00836",
201
+ "battery-00842",
202
+ "battery-00845",
203
+ "battery-00848",
204
+ "battery-00851",
205
+ "battery-00854",
206
+ "battery-00863",
207
+ "battery-00866",
208
+ "battery-00869",
209
+ "battery-00872",
210
+ "battery-00875",
211
+ "battery-00884",
212
+ "battery-00887",
213
+ "battery-00896",
214
+ "battery-00902",
215
+ "battery-00905",
216
+ "battery-00911",
217
+ "battery-00914",
218
+ "battery-00917",
219
+ "battery-00920",
220
+ "battery-00923",
221
+ "battery-00926",
222
+ "battery-00929",
223
+ "battery-00932",
224
+ "battery-00935",
225
+ "battery-00938",
226
+ "battery-00941",
227
+ "battery-00944",
228
+ "battery-00953",
229
+ "battery-00956",
230
+ "battery-00959",
231
+ "battery-00965",
232
+ "battery-00968",
233
+ "battery-00971",
234
+ "battery-00974",
235
+ "battery-00977",
236
+ "battery-00980",
237
+ "battery-00986",
238
+ "battery-00995",
239
+ "battery-00998",
240
+ "battery-01001",
241
+ "battery-01004",
242
+ "battery-01007",
243
+ "battery-01013",
244
+ "battery-01019",
245
+ "battery-01022",
246
+ "battery-01028",
247
+ "battery-01031",
248
+ "battery-01034",
249
+ "battery-01037",
250
+ "battery-01040",
251
+ "battery-01043",
252
+ "battery-01046",
253
+ "battery-01049",
254
+ "battery-01055",
255
+ "battery-01058",
256
+ "battery-01061",
257
+ "battery-01064",
258
+ "battery-01067",
259
+ "battery-01070",
260
+ "battery-01073",
261
+ "battery-01076",
262
+ "battery-01079",
263
+ "battery-01085",
264
+ "battery-01088",
265
+ "battery-01091",
266
+ "battery-01094",
267
+ "battery-01097",
268
+ "battery-01103",
269
+ "battery-01106",
270
+ "battery-01109",
271
+ "battery-01115",
272
+ "battery-01118",
273
+ "battery-01121",
274
+ "battery-01124",
275
+ "battery-01130",
276
+ "battery-01133",
277
+ "battery-01136",
278
+ "battery-01139",
279
+ "battery-01142",
280
+ "battery-01145",
281
+ "battery-01151",
282
+ "battery-01157",
283
+ "battery-01160",
284
+ "battery-01166",
285
+ "battery-01169",
286
+ "battery-01172",
287
+ "battery-01175",
288
+ "battery-01178",
289
+ "battery-01184",
290
+ "battery-01187",
291
+ "battery-01193",
292
+ "battery-01196",
293
+ "battery-01199"
294
+ ],
295
+ "checkpoint_sha256": [
296
+ "41485d6dd0c72f09a9ca67ced83bc4a0725f9cde731276d1672902304675ebec"
297
+ ],
298
+ "normalization_sha256": "33b890560ea8c2a881a2a4e125f19e2beb7a69029ec406d4b7e6a13b9880f3e4",
299
+ "transform_id": "citylearn-soc-and-requested-power-only-v1",
300
+ "source_sha256": {
301
+ "tfm/training/train.py": "d9e58852db730ccecff009c24654e794b3be40a3d8d6985c4757774ab6e0898d",
302
+ "tfm/models/core.py": "53c6c32671006759d3a1aeab93cc2349371203414a0a1febf618e9c2b779a0c5",
303
+ "tfm/data/windows.py": "b23a0ff480d3c49b325abd266298243eae7be9c279ee91516fc4d01c5a145f12",
304
+ "tfm/data/normalization.py": "8f51104b43c2855944c550f9f8699654605196c71214e9d7746d90500a05a3a3",
305
+ "tfm/data/schema.py": "c1e09c0b273e0cb31044e5d7575b4e6387ff2a5d7fd2d550c6b23bc72ccc2078",
306
+ "tfm/data/episodes.py": "a512ba251e45017ee75d9278385bb8f3d26f5ac43bf9d994c912d8e15cead803",
307
+ "/Users/maxfarrell/repos/experimental/scripts/behavior_support.py": "fde731bd86dbd989031b2ba34d31dfa483c34b476753d09bfd5575110480b27d",
308
+ "scripts/evaluate_citylearn.py": "bc2085006b4fb12893ad5e6e839f7f47c4288f5f18badc550f35b721e0f50422",
309
+ "scripts/citylearn_validation.py": "7593a9a71f77e835b06cec23de4a4d4c169aed82c2508f777557b26e3394f2d3",
310
+ "scripts/thermal_challenges.py": "4dc1b47589232fcc2619ddc4c5a93e7cce4270cda376d29af2c236fbc67b4162"
311
+ },
312
+ "training_anchor_provenance": {
313
+ "manifest_sha256": "bfa4012aa501c8645851c8bf03095b8eacaa63da8f7ae4b2a559ac01d3cd41b7",
314
+ "window_sampling": {
315
+ "seed": 20261012,
316
+ "history_steps": 24,
317
+ "future_steps": 8,
318
+ "sampling": "uniform eligible anchors with replacement",
319
+ "anchor_sha256": "f7aae448f80997beeb5e741467375eb0627e9ee50d238b174e2d515b06f424fd",
320
+ "family_window_counts": {
321
+ "battery": 512
322
+ }
323
+ }
324
+ },
325
+ "entries": {
326
+ "[[7,0],[13,1]]|complete|7": {
327
+ "count": 385,
328
+ "threshold": 4.832884909084203
329
+ },
330
+ "[[7,0],[13,1]]|partial|7": {
331
+ "count": 110,
332
+ "threshold": 4.339740031125046
333
+ }
334
+ },
335
+ "interpretation": "Observation-only retrospective residual heuristic; no confidence probability or future coverage guarantee.",
336
+ "limitations": [
337
+ "Thresholds use model training systems and may be optimistic.",
338
+ "Overlapping sampled windows are correlated; no independent-window false-alarm guarantee.",
339
+ "No flag cannot prove a new system safe or identify hidden room size.",
340
+ "A good fit under constant drivers cannot resolve hidden action response.",
341
+ "Prefix history is shortened by 8 masked rows; this is a fixed retrospective assay, not ordinary deployment context."
342
+ ],
343
+ "sha256": "d1dade44adb8562e08c9967b86c2257d21ac5daf5aed79b427f713da2c9db0cc"
344
+ }
studies/robustness-seed42-20261011/artifacts/robustness/behavior/behavior-diagnostic.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/auditorium_3node-assessments.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/original_heldout-assessments.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/parameter_shift_2node-assessments.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/small_room_3node-assessments.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/behavior/thermal/thresholds.json ADDED
@@ -0,0 +1,376 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "tfm-retrospective-behavior-support-v1",
3
+ "policy": {
4
+ "history_steps": 24,
5
+ "anchor_index": 15,
6
+ "end_index": 23,
7
+ "horizon_minutes": 120,
8
+ "quantile": 0.99,
9
+ "quantile_method": "higher",
10
+ "min_count": 30,
11
+ "low_driver_std": 0.05
12
+ },
13
+ "training_system_ids": [
14
+ "thermal-00000",
15
+ "thermal-00006",
16
+ "thermal-00009",
17
+ "thermal-00012",
18
+ "thermal-00021",
19
+ "thermal-00024",
20
+ "thermal-00027",
21
+ "thermal-00033",
22
+ "thermal-00036",
23
+ "thermal-00054",
24
+ "thermal-00057",
25
+ "thermal-00060",
26
+ "thermal-00072",
27
+ "thermal-00075",
28
+ "thermal-00078",
29
+ "thermal-00081",
30
+ "thermal-00084",
31
+ "thermal-00087",
32
+ "thermal-00090",
33
+ "thermal-00096",
34
+ "thermal-00099",
35
+ "thermal-00111",
36
+ "thermal-00114",
37
+ "thermal-00120",
38
+ "thermal-00132",
39
+ "thermal-00135",
40
+ "thermal-00138",
41
+ "thermal-00141",
42
+ "thermal-00144",
43
+ "thermal-00150",
44
+ "thermal-00153",
45
+ "thermal-00156",
46
+ "thermal-00159",
47
+ "thermal-00162",
48
+ "thermal-00165",
49
+ "thermal-00168",
50
+ "thermal-00174",
51
+ "thermal-00177",
52
+ "thermal-00180",
53
+ "thermal-00183",
54
+ "thermal-00186",
55
+ "thermal-00192",
56
+ "thermal-00198",
57
+ "thermal-00201",
58
+ "thermal-00204",
59
+ "thermal-00210",
60
+ "thermal-00216",
61
+ "thermal-00219",
62
+ "thermal-00225",
63
+ "thermal-00231",
64
+ "thermal-00237",
65
+ "thermal-00240",
66
+ "thermal-00243",
67
+ "thermal-00246",
68
+ "thermal-00249",
69
+ "thermal-00252",
70
+ "thermal-00258",
71
+ "thermal-00264",
72
+ "thermal-00267",
73
+ "thermal-00273",
74
+ "thermal-00276",
75
+ "thermal-00279",
76
+ "thermal-00282",
77
+ "thermal-00285",
78
+ "thermal-00288",
79
+ "thermal-00294",
80
+ "thermal-00300",
81
+ "thermal-00303",
82
+ "thermal-00312",
83
+ "thermal-00318",
84
+ "thermal-00321",
85
+ "thermal-00324",
86
+ "thermal-00336",
87
+ "thermal-00345",
88
+ "thermal-00354",
89
+ "thermal-00357",
90
+ "thermal-00360",
91
+ "thermal-00363",
92
+ "thermal-00372",
93
+ "thermal-00378",
94
+ "thermal-00381",
95
+ "thermal-00384",
96
+ "thermal-00390",
97
+ "thermal-00393",
98
+ "thermal-00396",
99
+ "thermal-00399",
100
+ "thermal-00402",
101
+ "thermal-00405",
102
+ "thermal-00414",
103
+ "thermal-00420",
104
+ "thermal-00429",
105
+ "thermal-00432",
106
+ "thermal-00435",
107
+ "thermal-00438",
108
+ "thermal-00441",
109
+ "thermal-00444",
110
+ "thermal-00447",
111
+ "thermal-00450",
112
+ "thermal-00453",
113
+ "thermal-00456",
114
+ "thermal-00459",
115
+ "thermal-00462",
116
+ "thermal-00465",
117
+ "thermal-00468",
118
+ "thermal-00474",
119
+ "thermal-00477",
120
+ "thermal-00483",
121
+ "thermal-00486",
122
+ "thermal-00492",
123
+ "thermal-00495",
124
+ "thermal-00498",
125
+ "thermal-00504",
126
+ "thermal-00507",
127
+ "thermal-00513",
128
+ "thermal-00516",
129
+ "thermal-00519",
130
+ "thermal-00522",
131
+ "thermal-00528",
132
+ "thermal-00534",
133
+ "thermal-00537",
134
+ "thermal-00540",
135
+ "thermal-00543",
136
+ "thermal-00549",
137
+ "thermal-00552",
138
+ "thermal-00555",
139
+ "thermal-00558",
140
+ "thermal-00573",
141
+ "thermal-00576",
142
+ "thermal-00579",
143
+ "thermal-00588",
144
+ "thermal-00591",
145
+ "thermal-00594",
146
+ "thermal-00600",
147
+ "thermal-00603",
148
+ "thermal-00606",
149
+ "thermal-00609",
150
+ "thermal-00612",
151
+ "thermal-00615",
152
+ "thermal-00621",
153
+ "thermal-00627",
154
+ "thermal-00630",
155
+ "thermal-00633",
156
+ "thermal-00639",
157
+ "thermal-00642",
158
+ "thermal-00645",
159
+ "thermal-00648",
160
+ "thermal-00651",
161
+ "thermal-00657",
162
+ "thermal-00666",
163
+ "thermal-00675",
164
+ "thermal-00678",
165
+ "thermal-00681",
166
+ "thermal-00684",
167
+ "thermal-00687",
168
+ "thermal-00690",
169
+ "thermal-00693",
170
+ "thermal-00696",
171
+ "thermal-00699",
172
+ "thermal-00702",
173
+ "thermal-00705",
174
+ "thermal-00708",
175
+ "thermal-00714",
176
+ "thermal-00717",
177
+ "thermal-00723",
178
+ "thermal-00726",
179
+ "thermal-00729",
180
+ "thermal-00732",
181
+ "thermal-00735",
182
+ "thermal-00738",
183
+ "thermal-00741",
184
+ "thermal-00744",
185
+ "thermal-00747",
186
+ "thermal-00750",
187
+ "thermal-00753",
188
+ "thermal-00756",
189
+ "thermal-00759",
190
+ "thermal-00762",
191
+ "thermal-00765",
192
+ "thermal-00768",
193
+ "thermal-00771",
194
+ "thermal-00774",
195
+ "thermal-00777",
196
+ "thermal-00780",
197
+ "thermal-00783",
198
+ "thermal-00786",
199
+ "thermal-00789",
200
+ "thermal-00792",
201
+ "thermal-00795",
202
+ "thermal-00804",
203
+ "thermal-00807",
204
+ "thermal-00810",
205
+ "thermal-00813",
206
+ "thermal-00819",
207
+ "thermal-00828",
208
+ "thermal-00840",
209
+ "thermal-00843",
210
+ "thermal-00846",
211
+ "thermal-00849",
212
+ "thermal-00852",
213
+ "thermal-00855",
214
+ "thermal-00864",
215
+ "thermal-00867",
216
+ "thermal-00873",
217
+ "thermal-00876",
218
+ "thermal-00879",
219
+ "thermal-00882",
220
+ "thermal-00885",
221
+ "thermal-00894",
222
+ "thermal-00897",
223
+ "thermal-00906",
224
+ "thermal-00912",
225
+ "thermal-00915",
226
+ "thermal-00918",
227
+ "thermal-00921",
228
+ "thermal-00930",
229
+ "thermal-00933",
230
+ "thermal-00936",
231
+ "thermal-00954",
232
+ "thermal-00957",
233
+ "thermal-00963",
234
+ "thermal-00966",
235
+ "thermal-00969",
236
+ "thermal-00978",
237
+ "thermal-00981",
238
+ "thermal-00984",
239
+ "thermal-00987",
240
+ "thermal-00990",
241
+ "thermal-00993",
242
+ "thermal-00996",
243
+ "thermal-01002",
244
+ "thermal-01005",
245
+ "thermal-01008",
246
+ "thermal-01011",
247
+ "thermal-01014",
248
+ "thermal-01017",
249
+ "thermal-01020",
250
+ "thermal-01026",
251
+ "thermal-01029",
252
+ "thermal-01032",
253
+ "thermal-01035",
254
+ "thermal-01038",
255
+ "thermal-01041",
256
+ "thermal-01044",
257
+ "thermal-01047",
258
+ "thermal-01056",
259
+ "thermal-01059",
260
+ "thermal-01062",
261
+ "thermal-01065",
262
+ "thermal-01068",
263
+ "thermal-01071",
264
+ "thermal-01074",
265
+ "thermal-01080",
266
+ "thermal-01083",
267
+ "thermal-01086",
268
+ "thermal-01089",
269
+ "thermal-01095",
270
+ "thermal-01104",
271
+ "thermal-01107",
272
+ "thermal-01110",
273
+ "thermal-01113",
274
+ "thermal-01116",
275
+ "thermal-01122",
276
+ "thermal-01125",
277
+ "thermal-01128",
278
+ "thermal-01134",
279
+ "thermal-01140",
280
+ "thermal-01143",
281
+ "thermal-01146",
282
+ "thermal-01149",
283
+ "thermal-01152",
284
+ "thermal-01164",
285
+ "thermal-01167",
286
+ "thermal-01173",
287
+ "thermal-01176",
288
+ "thermal-01179",
289
+ "thermal-01185",
290
+ "thermal-01188",
291
+ "thermal-01191",
292
+ "thermal-01194",
293
+ "thermal-01197"
294
+ ],
295
+ "checkpoint_sha256": [
296
+ "41485d6dd0c72f09a9ca67ced83bc4a0725f9cde731276d1672902304675ebec"
297
+ ],
298
+ "normalization_sha256": "33b890560ea8c2a881a2a4e125f19e2beb7a69029ec406d4b7e6a13b9880f3e4",
299
+ "transform_id": "thermal-full-canonical-observations-v1",
300
+ "source_sha256": {
301
+ "tfm/training/train.py": "d9e58852db730ccecff009c24654e794b3be40a3d8d6985c4757774ab6e0898d",
302
+ "tfm/models/core.py": "53c6c32671006759d3a1aeab93cc2349371203414a0a1febf618e9c2b779a0c5",
303
+ "tfm/data/windows.py": "b23a0ff480d3c49b325abd266298243eae7be9c279ee91516fc4d01c5a145f12",
304
+ "tfm/data/normalization.py": "8f51104b43c2855944c550f9f8699654605196c71214e9d7746d90500a05a3a3",
305
+ "tfm/data/schema.py": "c1e09c0b273e0cb31044e5d7575b4e6387ff2a5d7fd2d550c6b23bc72ccc2078",
306
+ "tfm/data/episodes.py": "a512ba251e45017ee75d9278385bb8f3d26f5ac43bf9d994c912d8e15cead803",
307
+ "/Users/maxfarrell/repos/experimental/scripts/behavior_support.py": "fde731bd86dbd989031b2ba34d31dfa483c34b476753d09bfd5575110480b27d",
308
+ "scripts/evaluate_citylearn.py": "bc2085006b4fb12893ad5e6e839f7f47c4288f5f18badc550f35b721e0f50422",
309
+ "scripts/citylearn_validation.py": "7593a9a71f77e835b06cec23de4a4d4c169aed82c2508f777557b26e3394f2d3",
310
+ "scripts/thermal_challenges.py": "4dc1b47589232fcc2619ddc4c5a93e7cce4270cda376d29af2c236fbc67b4162"
311
+ },
312
+ "training_anchor_provenance": {
313
+ "manifest_sha256": "bfa4012aa501c8645851c8bf03095b8eacaa63da8f7ae4b2a559ac01d3cd41b7",
314
+ "window_sampling": {
315
+ "seed": 20261012,
316
+ "history_steps": 24,
317
+ "future_steps": 8,
318
+ "sampling": "uniform eligible anchors with replacement",
319
+ "anchor_sha256": "91e7d74532855b853236a07350005493cb3ea13b4d76562836b20e9cd1f5e068",
320
+ "family_window_counts": {
321
+ "thermal": 512
322
+ }
323
+ }
324
+ },
325
+ "entries": {
326
+ "[[0,0],[1,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|complete|0": {
327
+ "count": 136,
328
+ "threshold": 2.7224006872092286
329
+ },
330
+ "[[0,0],[1,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|complete|1": {
331
+ "count": 133,
332
+ "threshold": 2.291549851394941
333
+ },
334
+ "[[0,0],[1,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|complete|2": {
335
+ "count": 135,
336
+ "threshold": 2.4368125395726885
337
+ },
338
+ "[[0,0],[1,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|partial|0": {
339
+ "count": 183,
340
+ "threshold": 3.241888762365618
341
+ },
342
+ "[[0,0],[1,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|partial|1": {
343
+ "count": 191,
344
+ "threshold": 2.359288046175598
345
+ },
346
+ "[[0,0],[1,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|partial|2": {
347
+ "count": 187,
348
+ "threshold": 2.22742192742415
349
+ },
350
+ "[[0,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|partial|0": {
351
+ "count": 74,
352
+ "threshold": 1.983026587653538
353
+ },
354
+ "[[0,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|partial|2": {
355
+ "count": 70,
356
+ "threshold": 2.3795163846065046
357
+ },
358
+ "[[0,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|complete|0": {
359
+ "count": 97,
360
+ "threshold": 2.5049017350574285
361
+ },
362
+ "[[0,0],[2,0],[10,1],[14,2],[15,2],[16,2]]|complete|2": {
363
+ "count": 101,
364
+ "threshold": 2.1129659908949443
365
+ }
366
+ },
367
+ "interpretation": "Observation-only retrospective residual heuristic; no confidence probability or future coverage guarantee.",
368
+ "limitations": [
369
+ "Thresholds use model training systems and may be optimistic.",
370
+ "Overlapping sampled windows are correlated; no independent-window false-alarm guarantee.",
371
+ "No flag cannot prove a new system safe or identify hidden room size.",
372
+ "A good fit under constant drivers cannot resolve hidden action response.",
373
+ "Prefix history is shortened by 8 masked rows; this is a fixed retrospective assay, not ordinary deployment context."
374
+ ],
375
+ "sha256": "e5afaeea309a061e0ff72100aa9e2220f03ec745e339426945df83e37de71d65"
376
+ }
studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/interventions.json ADDED
The diff for this file is too large to render. See raw diff
 
studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/provenance.json ADDED
@@ -0,0 +1,1598 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "checkpoint": "/Users/maxfarrell/repos/experimental/artifacts/full/transformer/seed-42/checkpoint.pt",
3
+ "checkpoint_sha256": "41485d6dd0c72f09a9ca67ced83bc4a0725f9cde731276d1672902304675ebec",
4
+ "normalization_sha256": "33b890560ea8c2a881a2a4e125f19e2beb7a69029ec406d4b7e6a13b9880f3e4",
5
+ "manifest_sha256": "a3b9d662ff085243832ff1cc17d6cd5122e7179791f0d712069d3358ac389d9f",
6
+ "generator_sha256": "4dc1b47589232fcc2619ddc4c5a93e7cce4270cda376d29af2c236fbc67b4162",
7
+ "args": {
8
+ "manifest": "artifacts/robustness/thermal-challenges/manifest.json",
9
+ "checkpoint": "artifacts/full/transformer/seed-42/checkpoint.pt",
10
+ "output": "artifacts/robustness/challenge-interventions",
11
+ "samples_per_cohort": 16,
12
+ "seed": 20261012
13
+ },
14
+ "policy": "A is the recorded future HVAC command plan. B adds 6 electrical kW to all eight commands, clipped to public [-15,15] kW. If that leaves the entire plan unchanged, B subtracts 6 kW instead. Both branches start from the identical replayed snapshot with identical external disturbances. Hidden actuator saturation can legitimately make different requested plans physically equivalent.",
15
+ "objective": "Sum of squared indoor_temp deviation from 21 degC at 15,30,60,120 minutes; units degC^2.",
16
+ "external_real_world_validation": false,
17
+ "source_sha256": {
18
+ "/Users/maxfarrell/repos/experimental/scripts/challenge_interventions.py": "cf7f85ff76891fea7a759b17f8d38a6062cfe6e69154376f3b0fcbbb20f0443f",
19
+ "/Users/maxfarrell/repos/experimental/scripts/thermal_challenges.py": "4dc1b47589232fcc2619ddc4c5a93e7cce4270cda376d29af2c236fbc67b4162",
20
+ "tfm/data/windows.py": "b23a0ff480d3c49b325abd266298243eae7be9c279ee91516fc4d01c5a145f12",
21
+ "tfm/models/core.py": "53c6c32671006759d3a1aeab93cc2349371203414a0a1febf618e9c2b779a0c5",
22
+ "tfm/evaluation/baselines.py": "2dd709f31cbef652b252bec7e4ad63425933f7141657e73b9803f4f98eeda843",
23
+ "tfm/evaluation/counterfactual.py": "6d8c00284449997e8c338b227ebd2f4d72885c555a6d4bef0fb290742be95259"
24
+ },
25
+ "runtime": {
26
+ "torch": "2.14.1",
27
+ "numpy": "2.5.4",
28
+ "device": "cpu",
29
+ "threads": 1,
30
+ "OMP_NUM_THREADS": "1",
31
+ "MKL_NUM_THREADS": "1"
32
+ },
33
+ "anchors": [
34
+ {
35
+ "cohort": "parameter_shift_2node",
36
+ "system_id": "challenge-parameter_shift_2node-841241",
37
+ "anchor_step": 100,
38
+ "sample_index": 0,
39
+ "commands_kw": [
40
+ [
41
+ 6.314795185310229,
42
+ 6.885870066880851,
43
+ 7.182628342291165,
44
+ 7.103093519530175,
45
+ 6.663796722323511,
46
+ 0.0013888575685340114,
47
+ -0.6664787220861571,
48
+ -1.1112755175976567
49
+ ],
50
+ [
51
+ 12.314795185310228,
52
+ 12.885870066880852,
53
+ 13.182628342291165,
54
+ 13.103093519530175,
55
+ 12.66379672232351,
56
+ 6.001388857568534,
57
+ 5.333521277913843,
58
+ 4.888724482402344
59
+ ]
60
+ ],
61
+ "shared_exogenous_sha256": "52c25cd9a4238b472e5662aadc0ff6e2b5d2d0fff47acbb09a88080200e3ab9b",
62
+ "snapshot_replay_verified": true,
63
+ "observed_plan_replay_max_error": 0.0
64
+ },
65
+ {
66
+ "cohort": "parameter_shift_2node",
67
+ "system_id": "challenge-parameter_shift_2node-841244",
68
+ "anchor_step": 128,
69
+ "sample_index": 1,
70
+ "commands_kw": [
71
+ [
72
+ -1.124460767665984,
73
+ -1.127949349367997,
74
+ -0.5884360095366262,
75
+ 0.24133487840388002,
76
+ 0.9565316293474644,
77
+ 1.1964722661349916,
78
+ 0.8302643310393264,
79
+ 0.034914188744048814
80
+ ],
81
+ [
82
+ 4.875539232334016,
83
+ 4.872050650632003,
84
+ 5.411563990463374,
85
+ 6.24133487840388,
86
+ 6.956531629347465,
87
+ 7.196472266134991,
88
+ 6.830264331039326,
89
+ 6.0349141887440485
90
+ ]
91
+ ],
92
+ "shared_exogenous_sha256": "648241647546ee8893e355774a69a445827ee87234c6f8e6b2b506d200fe1f16",
93
+ "snapshot_replay_verified": true,
94
+ "observed_plan_replay_max_error": 0.0
95
+ },
96
+ {
97
+ "cohort": "parameter_shift_2node",
98
+ "system_id": "challenge-parameter_shift_2node-841250",
99
+ "anchor_step": 74,
100
+ "sample_index": 2,
101
+ "commands_kw": [
102
+ [
103
+ -0.5061041849405723,
104
+ -0.0004540226012765937,
105
+ 0.5107165437915179,
106
+ -14.07158960966246,
107
+ -13.833311814402206,
108
+ -13.828616249142225,
109
+ -14.066027025541132,
110
+ -14.503061229273346
111
+ ],
112
+ [
113
+ 5.493895815059428,
114
+ 5.999545977398723,
115
+ 6.510716543791518,
116
+ -8.07158960966246,
117
+ -7.833311814402206,
118
+ -7.828616249142225,
119
+ -8.066027025541132,
120
+ -8.503061229273346
121
+ ]
122
+ ],
123
+ "shared_exogenous_sha256": "1ccb291845f0d0d710cbc68135c0f92ffc19e5f354d27b2aa8706f9c5744e0cb",
124
+ "snapshot_replay_verified": true,
125
+ "observed_plan_replay_max_error": 0.0
126
+ },
127
+ {
128
+ "cohort": "parameter_shift_2node",
129
+ "system_id": "challenge-parameter_shift_2node-841239",
130
+ "anchor_step": 168,
131
+ "sample_index": 3,
132
+ "commands_kw": [
133
+ [
134
+ 1.1785138416924874,
135
+ 0.905733757423075,
136
+ -0.0655883053033218,
137
+ -0.9896485612111593,
138
+ -1.1395016134956146,
139
+ -0.3853401335385292,
140
+ 0.6806295727934457,
141
+ -4.800641705524654
142
+ ],
143
+ [
144
+ 7.178513841692487,
145
+ 6.905733757423075,
146
+ 5.934411694696678,
147
+ 5.010351438788841,
148
+ 4.860498386504386,
149
+ 5.614659866461471,
150
+ 6.680629572793446,
151
+ 1.1993582944753456
152
+ ]
153
+ ],
154
+ "shared_exogenous_sha256": "45b5ec47e4dfdb0b9beab7614ffdf4d23c1306d45ad3ef92e7d8984b4c204e43",
155
+ "snapshot_replay_verified": true,
156
+ "observed_plan_replay_max_error": 0.0
157
+ },
158
+ {
159
+ "cohort": "parameter_shift_2node",
160
+ "system_id": "challenge-parameter_shift_2node-841239",
161
+ "anchor_step": 93,
162
+ "sample_index": 4,
163
+ "commands_kw": [
164
+ [
165
+ -1.1017638196712802,
166
+ -1.1909993478046257,
167
+ -0.9497862806066801,
168
+ -0.43756192507966424,
169
+ 0.20509920977314797,
170
+ 6.792847547211602,
171
+ 7.148498001827496,
172
+ 7.15780781580534
173
+ ],
174
+ [
175
+ 4.89823618032872,
176
+ 4.809000652195374,
177
+ 5.050213719393319,
178
+ 5.562438074920336,
179
+ 6.205099209773148,
180
+ 12.792847547211602,
181
+ 13.148498001827496,
182
+ 13.15780781580534
183
+ ]
184
+ ],
185
+ "shared_exogenous_sha256": "f9341a408488d5002f13c6f6132bf60e99413ae951e2bb0060a77a5bb0260768",
186
+ "snapshot_replay_verified": true,
187
+ "observed_plan_replay_max_error": 0.0
188
+ },
189
+ {
190
+ "cohort": "parameter_shift_2node",
191
+ "system_id": "challenge-parameter_shift_2node-841251",
192
+ "anchor_step": 88,
193
+ "sample_index": 5,
194
+ "commands_kw": [
195
+ [
196
+ 15.0,
197
+ 14.816141306469314,
198
+ 14.26064245335104,
199
+ -1.1089877207721732,
200
+ -1.1901791646525737,
201
+ -0.953099269471377,
202
+ -0.4537512388417928,
203
+ 0.17603697936397894
204
+ ],
205
+ [
206
+ 15.0,
207
+ 15.0,
208
+ 15.0,
209
+ 4.8910122792278266,
210
+ 4.809820835347426,
211
+ 5.046900730528623,
212
+ 5.546248761158207,
213
+ 6.176036979363979
214
+ ]
215
+ ],
216
+ "shared_exogenous_sha256": "bdf29f20dcc7034df24c8a76a17ff2a1f20fc12c8098ef43503c68aab17f254b",
217
+ "snapshot_replay_verified": true,
218
+ "observed_plan_replay_max_error": 0.0
219
+ },
220
+ {
221
+ "cohort": "parameter_shift_2node",
222
+ "system_id": "challenge-parameter_shift_2node-841251",
223
+ "anchor_step": 130,
224
+ "sample_index": 6,
225
+ "commands_kw": [
226
+ [
227
+ 5.962709730752956,
228
+ 5.185481427315803,
229
+ 4.806573266944698,
230
+ -6.976456160776877,
231
+ -6.262475603142569,
232
+ -5.409493411100404,
233
+ -4.859531889971691,
234
+ -4.908587337906088
235
+ ],
236
+ [
237
+ 11.962709730752955,
238
+ 11.185481427315803,
239
+ 10.806573266944698,
240
+ -0.9764561607768769,
241
+ -0.262475603142569,
242
+ 0.5905065888995962,
243
+ 1.1404681100283094,
244
+ 1.0914126620939122
245
+ ]
246
+ ],
247
+ "shared_exogenous_sha256": "968e55fd6624ec505831d037fd70f1d2a0ae77c09c647cdd6977d38706a0e028",
248
+ "snapshot_replay_verified": true,
249
+ "observed_plan_replay_max_error": 0.0
250
+ },
251
+ {
252
+ "cohort": "parameter_shift_2node",
253
+ "system_id": "challenge-parameter_shift_2node-841245",
254
+ "anchor_step": 128,
255
+ "sample_index": 7,
256
+ "commands_kw": [
257
+ [
258
+ -15.0,
259
+ -15.0,
260
+ -15.0,
261
+ -15.0,
262
+ -15.0,
263
+ 15.0,
264
+ 15.0,
265
+ 15.0
266
+ ],
267
+ [
268
+ -9.0,
269
+ -9.0,
270
+ -9.0,
271
+ -9.0,
272
+ -9.0,
273
+ 15.0,
274
+ 15.0,
275
+ 15.0
276
+ ]
277
+ ],
278
+ "shared_exogenous_sha256": "ec3433213ec8abc0bb7e8117066a7581f08c8cac07abba0496dfb294b2bf238a",
279
+ "snapshot_replay_verified": true,
280
+ "observed_plan_replay_max_error": 0.0
281
+ },
282
+ {
283
+ "cohort": "parameter_shift_2node",
284
+ "system_id": "challenge-parameter_shift_2node-841253",
285
+ "anchor_step": 136,
286
+ "sample_index": 8,
287
+ "commands_kw": [
288
+ [
289
+ -14.445997432604097,
290
+ -15.0,
291
+ -15.0,
292
+ -15.0,
293
+ 5.311115674188667,
294
+ 6.183515169917933,
295
+ 6.957283527555702,
296
+ 7.190223497377864
297
+ ],
298
+ [
299
+ -8.445997432604097,
300
+ -9.0,
301
+ -9.0,
302
+ -9.0,
303
+ 11.311115674188667,
304
+ 12.183515169917932,
305
+ 12.957283527555703,
306
+ 13.190223497377865
307
+ ]
308
+ ],
309
+ "shared_exogenous_sha256": "04cb144f66cccddb950b0eeef2c6a6944475109067952aee3d2a00a2edcebebc",
310
+ "snapshot_replay_verified": true,
311
+ "observed_plan_replay_max_error": 0.0
312
+ },
313
+ {
314
+ "cohort": "parameter_shift_2node",
315
+ "system_id": "challenge-parameter_shift_2node-841244",
316
+ "anchor_step": 132,
317
+ "sample_index": 9,
318
+ "commands_kw": [
319
+ [
320
+ 0.9565316293474644,
321
+ 1.1964722661349916,
322
+ 0.8302643310393264,
323
+ 0.034914188744048814,
324
+ -0.7830199085716563,
325
+ -1.1920881114355302,
326
+ -0.9660117105499163,
327
+ -0.21565232292645167
328
+ ],
329
+ [
330
+ 6.956531629347465,
331
+ 7.196472266134991,
332
+ 6.830264331039326,
333
+ 6.0349141887440485,
334
+ 5.2169800914283435,
335
+ 4.80791188856447,
336
+ 5.033988289450083,
337
+ 5.784347677073549
338
+ ]
339
+ ],
340
+ "shared_exogenous_sha256": "65e769fc4edc379a1752a912cb4c02a996868bfd519b1496bcbbdd6e5b7e174a",
341
+ "snapshot_replay_verified": true,
342
+ "observed_plan_replay_max_error": 0.0
343
+ },
344
+ {
345
+ "cohort": "parameter_shift_2node",
346
+ "system_id": "challenge-parameter_shift_2node-841237",
347
+ "anchor_step": 112,
348
+ "sample_index": 10,
349
+ "commands_kw": [
350
+ [
351
+ 6.995484269523677,
352
+ 7.1993646957001305,
353
+ 6.946117907703424,
354
+ 6.323840582044115,
355
+ 5.569705513601598,
356
+ 4.982689657042318,
357
+ 4.804959569907024,
358
+ 5.118666672240532
359
+ ],
360
+ [
361
+ 12.995484269523677,
362
+ 13.19936469570013,
363
+ 12.946117907703425,
364
+ 12.323840582044115,
365
+ 11.569705513601598,
366
+ 10.982689657042318,
367
+ 10.804959569907023,
368
+ 11.118666672240533
369
+ ]
370
+ ],
371
+ "shared_exogenous_sha256": "97dfbddaa6612f071152df40a2f4bb55e60815d9f0580158afecd1fab701d8db",
372
+ "snapshot_replay_verified": true,
373
+ "observed_plan_replay_max_error": 0.0
374
+ },
375
+ {
376
+ "cohort": "parameter_shift_2node",
377
+ "system_id": "challenge-parameter_shift_2node-841248",
378
+ "anchor_step": 46,
379
+ "sample_index": 11,
380
+ "commands_kw": [
381
+ [
382
+ 6.468669452443291,
383
+ 6.1272453535769476,
384
+ 5.768937217364043,
385
+ -6.574006972893149,
386
+ -6.868120020631595,
387
+ -7.082079975519624,
388
+ -7.190330454864462,
389
+ -7.1765623366704245
390
+ ],
391
+ [
392
+ 12.46866945244329,
393
+ 12.127245353576948,
394
+ 11.768937217364044,
395
+ -0.574006972893149,
396
+ -0.8681200206315953,
397
+ -1.0820799755196244,
398
+ -1.190330454864462,
399
+ -1.1765623366704245
400
+ ]
401
+ ],
402
+ "shared_exogenous_sha256": "d6e5c7cd65a85f8c27b80937b6c23b01395d3004857596f488f03fe4cc92f78e",
403
+ "snapshot_replay_verified": true,
404
+ "observed_plan_replay_max_error": 0.0
405
+ },
406
+ {
407
+ "cohort": "parameter_shift_2node",
408
+ "system_id": "challenge-parameter_shift_2node-841247",
409
+ "anchor_step": 29,
410
+ "sample_index": 12,
411
+ "commands_kw": [
412
+ [
413
+ -14.02273470473942,
414
+ -14.189372747715375,
415
+ -14.396807611699405,
416
+ -14.637733309721725,
417
+ -14.902100861102662,
418
+ -15.0,
419
+ -0.44880926367409074,
420
+ -0.7004872796342669
421
+ ],
422
+ [
423
+ -8.02273470473942,
424
+ -8.189372747715375,
425
+ -8.396807611699405,
426
+ -8.637733309721725,
427
+ -8.902100861102662,
428
+ -9.0,
429
+ 5.55119073632591,
430
+ 5.299512720365733
431
+ ]
432
+ ],
433
+ "shared_exogenous_sha256": "7490256e5afaa747bd31bf4dc051406c34571ffd99adfae1b5affc0af6e9e673",
434
+ "snapshot_replay_verified": true,
435
+ "observed_plan_replay_max_error": 0.0
436
+ },
437
+ {
438
+ "cohort": "parameter_shift_2node",
439
+ "system_id": "challenge-parameter_shift_2node-841240",
440
+ "anchor_step": 46,
441
+ "sample_index": 13,
442
+ "commands_kw": [
443
+ [
444
+ 0.6937314633970053,
445
+ 0.9484419617829692,
446
+ 1.1233353705860014,
447
+ 1.1982257101959788,
448
+ 1.161009997834388,
449
+ 1.0098836273383827,
450
+ 0.7547221006908548,
451
+ 0.4173140122967344
452
+ ],
453
+ [
454
+ 6.693731463397006,
455
+ 6.94844196178297,
456
+ 7.123335370586002,
457
+ 7.198225710195979,
458
+ 7.1610099978343875,
459
+ 7.009883627338382,
460
+ 6.754722100690855,
461
+ 6.4173140122967345
462
+ ]
463
+ ],
464
+ "shared_exogenous_sha256": "d3982bccdd87ef2fd3162d580c966e2c095f1c895788e5f6313dca0cdae99043",
465
+ "snapshot_replay_verified": true,
466
+ "observed_plan_replay_max_error": 0.0
467
+ },
468
+ {
469
+ "cohort": "parameter_shift_2node",
470
+ "system_id": "challenge-parameter_shift_2node-841230",
471
+ "anchor_step": 71,
472
+ "sample_index": 14,
473
+ "commands_kw": [
474
+ [
475
+ -7.1240716413473235,
476
+ -7.197667326785682,
477
+ -7.060285423197824,
478
+ -6.72949998376096,
479
+ -6.260041423085827,
480
+ -5.736290969832109,
481
+ 0.7419487424379883,
482
+ 1.0783187593908918
483
+ ],
484
+ [
485
+ -1.1240716413473235,
486
+ -1.197667326785682,
487
+ -1.0602854231978238,
488
+ -0.7294999837609604,
489
+ -0.260041423085827,
490
+ 0.2637090301678908,
491
+ 6.741948742437988,
492
+ 7.078318759390892
493
+ ]
494
+ ],
495
+ "shared_exogenous_sha256": "c01d70b6b25ad3458f1dead66526a482d187462f5d1310d7daa48f3230f4a3c3",
496
+ "snapshot_replay_verified": true,
497
+ "observed_plan_replay_max_error": 0.0
498
+ },
499
+ {
500
+ "cohort": "parameter_shift_2node",
501
+ "system_id": "challenge-parameter_shift_2node-841253",
502
+ "anchor_step": 162,
503
+ "sample_index": 15,
504
+ "commands_kw": [
505
+ [
506
+ -7.194614972929072,
507
+ -6.678584932011833,
508
+ -5.66955451159669,
509
+ -4.89793971223434,
510
+ -4.937373355838005,
511
+ -5.770286452630984,
512
+ 14.220183529687512,
513
+ 13.801037531166072
514
+ ],
515
+ [
516
+ -1.194614972929072,
517
+ -0.6785849320118329,
518
+ 0.3304454884033099,
519
+ 1.10206028776566,
520
+ 1.0626266441619947,
521
+ 0.22971354736901617,
522
+ 15.0,
523
+ 15.0
524
+ ]
525
+ ],
526
+ "shared_exogenous_sha256": "374b00b7dd6d5776eb825897cf9dca928ab7bb825319250e9f96b75ca9d7d521",
527
+ "snapshot_replay_verified": true,
528
+ "observed_plan_replay_max_error": 0.0
529
+ },
530
+ {
531
+ "cohort": "small_room_3node",
532
+ "system_id": "challenge-small_room_3node-941240",
533
+ "anchor_step": 61,
534
+ "sample_index": 0,
535
+ "commands_kw": [
536
+ [
537
+ -6.143581457204094,
538
+ -5.703043819846363,
539
+ 0.7021765115637569,
540
+ 1.01303387933639,
541
+ 1.1804542316156172,
542
+ 1.1738206154142588,
543
+ 0.9875038252145056,
544
+ 0.6440501255962707
545
+ ],
546
+ [
547
+ -0.14358145720409432,
548
+ 0.2969561801536367,
549
+ 6.702176511563757,
550
+ 7.01303387933639,
551
+ 7.1804542316156175,
552
+ 7.173820615414259,
553
+ 6.987503825214506,
554
+ 6.644050125596271
555
+ ]
556
+ ],
557
+ "shared_exogenous_sha256": "c1dc9ec56047223498bec34bea86f42ee432fc0f1e37641ac6a0332ece9d8555",
558
+ "snapshot_replay_verified": true,
559
+ "observed_plan_replay_max_error": 0.0
560
+ },
561
+ {
562
+ "cohort": "small_room_3node",
563
+ "system_id": "challenge-small_room_3node-941238",
564
+ "anchor_step": 123,
565
+ "sample_index": 1,
566
+ "commands_kw": [
567
+ [
568
+ -5.171479089184098,
569
+ -5.901603846851414,
570
+ -6.680451197740407,
571
+ -1.1539652431569318,
572
+ -1.0971139713129867,
573
+ -0.5259332095968186,
574
+ 0.2984173769510247,
575
+ 0.9839363743780322
576
+ ],
577
+ [
578
+ 0.828520910815902,
579
+ 0.09839615314858641,
580
+ -0.6804511977404069,
581
+ 4.846034756843068,
582
+ 4.902886028687013,
583
+ 5.474066790403182,
584
+ 6.298417376951025,
585
+ 6.9839363743780325
586
+ ]
587
+ ],
588
+ "shared_exogenous_sha256": "db82e86f48723cedf40fc03f47f34182608c33152a77d5c05b183f4b0d05a024",
589
+ "snapshot_replay_verified": true,
590
+ "observed_plan_replay_max_error": 0.0
591
+ },
592
+ {
593
+ "cohort": "small_room_3node",
594
+ "system_id": "challenge-small_room_3node-941232",
595
+ "anchor_step": 47,
596
+ "sample_index": 2,
597
+ "commands_kw": [
598
+ [
599
+ -5.660465614600596,
600
+ -5.335497515036206,
601
+ 15.0,
602
+ 15.0,
603
+ 15.0,
604
+ 15.0,
605
+ 15.0,
606
+ 15.0
607
+ ],
608
+ [
609
+ 0.3395343853994044,
610
+ 0.6645024849637942,
611
+ 15.0,
612
+ 15.0,
613
+ 15.0,
614
+ 15.0,
615
+ 15.0,
616
+ 15.0
617
+ ]
618
+ ],
619
+ "shared_exogenous_sha256": "ee6f5139848a2c22bc722608dba191f6d753d31da46465fcfc74555851c3bf32",
620
+ "snapshot_replay_verified": true,
621
+ "observed_plan_replay_max_error": 0.0
622
+ },
623
+ {
624
+ "cohort": "small_room_3node",
625
+ "system_id": "challenge-small_room_3node-941235",
626
+ "anchor_step": 127,
627
+ "sample_index": 3,
628
+ "commands_kw": [
629
+ [
630
+ 15.0,
631
+ 15.0,
632
+ 15.0,
633
+ 15.0,
634
+ 14.263820605086341,
635
+ 13.821670445925946,
636
+ -7.03252601614092,
637
+ -6.361644199466099
638
+ ],
639
+ [
640
+ 15.0,
641
+ 15.0,
642
+ 15.0,
643
+ 15.0,
644
+ 15.0,
645
+ 15.0,
646
+ -1.0325260161409204,
647
+ -0.3616441994660988
648
+ ]
649
+ ],
650
+ "shared_exogenous_sha256": "7cb0203f7a50386256348ae28ecc250aa13d824e579ab6430aa597b67a347b40",
651
+ "snapshot_replay_verified": true,
652
+ "observed_plan_replay_max_error": 0.0
653
+ },
654
+ {
655
+ "cohort": "small_room_3node",
656
+ "system_id": "challenge-small_room_3node-941242",
657
+ "anchor_step": 127,
658
+ "sample_index": 4,
659
+ "commands_kw": [
660
+ [
661
+ 4.9073176974385895,
662
+ 4.844719421966549,
663
+ 5.330438438772936,
664
+ 6.141348911393336,
665
+ 6.887995561190814,
666
+ 7.199811361969164,
667
+ -14.087832590649285,
668
+ -14.840242373365967
669
+ ],
670
+ [
671
+ 10.90731769743859,
672
+ 10.844719421966548,
673
+ 11.330438438772937,
674
+ 12.141348911393337,
675
+ 12.887995561190813,
676
+ 13.199811361969164,
677
+ -8.087832590649285,
678
+ -8.840242373365967
679
+ ]
680
+ ],
681
+ "shared_exogenous_sha256": "8b492f41e99d51ef3250d7f09bacc11948423596ee9f8bd4b0309c92399331a4",
682
+ "snapshot_replay_verified": true,
683
+ "observed_plan_replay_max_error": 0.0
684
+ },
685
+ {
686
+ "cohort": "small_room_3node",
687
+ "system_id": "challenge-small_room_3node-941246",
688
+ "anchor_step": 82,
689
+ "sample_index": 5,
690
+ "commands_kw": [
691
+ [
692
+ -1.0085135255066169,
693
+ -1.1942745796593564,
694
+ -1.1133815843626185,
695
+ -0.7762873499899549,
696
+ -0.2542818161243725,
697
+ 0.3333329618922933,
698
+ 0.8451967486491865,
699
+ 1.1518242940088046
700
+ ],
701
+ [
702
+ 4.991486474493383,
703
+ 4.805725420340644,
704
+ 4.886618415637382,
705
+ 5.223712650010045,
706
+ 5.745718183875628,
707
+ 6.333332961892293,
708
+ 6.845196748649187,
709
+ 7.151824294008804
710
+ ]
711
+ ],
712
+ "shared_exogenous_sha256": "37596ec88d167dc596573db16bcd222c81c63f0e10c538d2a1d4fd66ce2079a5",
713
+ "snapshot_replay_verified": true,
714
+ "observed_plan_replay_max_error": 0.0
715
+ },
716
+ {
717
+ "cohort": "small_room_3node",
718
+ "system_id": "challenge-small_room_3node-941251",
719
+ "anchor_step": 54,
720
+ "sample_index": 6,
721
+ "commands_kw": [
722
+ [
723
+ 0.9037345353648802,
724
+ 1.1130498189405704,
725
+ 1.1988899175835945,
726
+ 1.145698149228389,
727
+ 0.9538582441702244,
728
+ 0.6412953593821143,
729
+ 0.24288568868273547,
730
+ -0.19258807767687627
731
+ ],
732
+ [
733
+ 6.9037345353648805,
734
+ 7.113049818940571,
735
+ 7.198889917583594,
736
+ 7.145698149228389,
737
+ 6.953858244170224,
738
+ 6.641295359382115,
739
+ 6.242885688682735,
740
+ 5.807411922323124
741
+ ]
742
+ ],
743
+ "shared_exogenous_sha256": "4c82242f007a6b07db2a17fa3e41bc5fef4c8c57a7299865bca8e466593d5a98",
744
+ "snapshot_replay_verified": true,
745
+ "observed_plan_replay_max_error": 0.0
746
+ },
747
+ {
748
+ "cohort": "small_room_3node",
749
+ "system_id": "challenge-small_room_3node-941232",
750
+ "anchor_step": 125,
751
+ "sample_index": 7,
752
+ "commands_kw": [
753
+ [
754
+ 1.0115454485592053,
755
+ 7.191087188944712,
756
+ 6.821332940322192,
757
+ 6.0645779481263125,
758
+ 5.272669575147961,
759
+ 4.8262722475967355,
760
+ 4.950001276407379,
761
+ 5.593674343181838
762
+ ],
763
+ [
764
+ 7.011545448559206,
765
+ 13.191087188944712,
766
+ 12.821332940322192,
767
+ 12.064577948126313,
768
+ 11.272669575147962,
769
+ 10.826272247596735,
770
+ 10.950001276407379,
771
+ 11.593674343181839
772
+ ]
773
+ ],
774
+ "shared_exogenous_sha256": "45a15ccc7e83f579b67eb4bbb2b529b2184ecb7815f7a5f0745fdeaf1f8e0909",
775
+ "snapshot_replay_verified": true,
776
+ "observed_plan_replay_max_error": 0.0
777
+ },
778
+ {
779
+ "cohort": "small_room_3node",
780
+ "system_id": "challenge-small_room_3node-941249",
781
+ "anchor_step": 66,
782
+ "sample_index": 8,
783
+ "commands_kw": [
784
+ [
785
+ 15.0,
786
+ 15.0,
787
+ 14.99387277549042,
788
+ 14.521552104443476,
789
+ 5.122538195838569,
790
+ 4.866980231411133,
791
+ 4.8042623512328575,
792
+ 4.952302463132314
793
+ ],
794
+ [
795
+ 15.0,
796
+ 15.0,
797
+ 15.0,
798
+ 15.0,
799
+ 11.122538195838569,
800
+ 10.866980231411134,
801
+ 10.804262351232857,
802
+ 10.952302463132314
803
+ ]
804
+ ],
805
+ "shared_exogenous_sha256": "9345c34e86a8344b726deebf749b14b28615aad9bc2cf947c3b1a25629cf7bbf",
806
+ "snapshot_replay_verified": true,
807
+ "observed_plan_replay_max_error": 0.0
808
+ },
809
+ {
810
+ "cohort": "small_room_3node",
811
+ "system_id": "challenge-small_room_3node-941248",
812
+ "anchor_step": 109,
813
+ "sample_index": 9,
814
+ "commands_kw": [
815
+ [
816
+ 5.863995401753189,
817
+ 6.571535585194884,
818
+ 7.075594392754347,
819
+ -13.815446491102351,
820
+ -14.151662199720118,
821
+ -14.814537736145118,
822
+ -15.0,
823
+ -15.0
824
+ ],
825
+ [
826
+ 11.86399540175319,
827
+ 12.571535585194884,
828
+ 13.075594392754347,
829
+ -7.815446491102351,
830
+ -8.151662199720118,
831
+ -8.814537736145118,
832
+ -9.0,
833
+ -9.0
834
+ ]
835
+ ],
836
+ "shared_exogenous_sha256": "6347053ddf17060b244c6ad456a019c8ab787232eb2ad047c5f066c1d137e473",
837
+ "snapshot_replay_verified": true,
838
+ "observed_plan_replay_max_error": 0.0
839
+ },
840
+ {
841
+ "cohort": "small_room_3node",
842
+ "system_id": "challenge-small_room_3node-941248",
843
+ "anchor_step": 128,
844
+ "sample_index": 10,
845
+ "commands_kw": [
846
+ [
847
+ -15.0,
848
+ -14.456484927143029,
849
+ -13.890450769632348,
850
+ -13.86253277309423,
851
+ -14.39694133301685,
852
+ 14.763413528463245,
853
+ 14.0391652350347,
854
+ 13.805147750035047
855
+ ],
856
+ [
857
+ -9.0,
858
+ -8.456484927143029,
859
+ -7.8904507696323485,
860
+ -7.86253277309423,
861
+ -8.39694133301685,
862
+ 15.0,
863
+ 15.0,
864
+ 15.0
865
+ ]
866
+ ],
867
+ "shared_exogenous_sha256": "900d5af2aee682aa5f5f7bfcd34df2e8f5ff0be9351fb0f40d1dac0e42f8db89",
868
+ "snapshot_replay_verified": true,
869
+ "observed_plan_replay_max_error": 0.0
870
+ },
871
+ {
872
+ "cohort": "small_room_3node",
873
+ "system_id": "challenge-small_room_3node-941239",
874
+ "anchor_step": 57,
875
+ "sample_index": 11,
876
+ "commands_kw": [
877
+ [
878
+ 4.982603168633629,
879
+ 4.826092298759373,
880
+ 4.812781656514885,
881
+ 4.950420884728985,
882
+ 5.227203310933605,
883
+ 5.611475549600046,
884
+ -5.945672747916333,
885
+ -5.504900020142093
886
+ ],
887
+ [
888
+ 10.982603168633629,
889
+ 10.826092298759374,
890
+ 10.812781656514886,
891
+ 10.950420884728985,
892
+ 11.227203310933605,
893
+ 11.611475549600046,
894
+ 0.05432725208366662,
895
+ 0.49509997985790744
896
+ ]
897
+ ],
898
+ "shared_exogenous_sha256": "3bf72f57e3509e7f0cd5322fa9d5e1e4690d5a29b8d4822a027a5a260b8c2fa9",
899
+ "snapshot_replay_verified": true,
900
+ "observed_plan_replay_max_error": 0.0
901
+ },
902
+ {
903
+ "cohort": "small_room_3node",
904
+ "system_id": "challenge-small_room_3node-941231",
905
+ "anchor_step": 63,
906
+ "sample_index": 12,
907
+ "commands_kw": [
908
+ [
909
+ 4.800000290676744,
910
+ 4.885912514471909,
911
+ 5.134919814638987,
912
+ 5.516061948849242,
913
+ 5.975881271019871,
914
+ 6.4449927933532924,
915
+ 6.848105076662049,
916
+ 1.1162146083066473
917
+ ],
918
+ [
919
+ 10.800000290676744,
920
+ 10.885912514471908,
921
+ 11.134919814638987,
922
+ 11.516061948849242,
923
+ 11.97588127101987,
924
+ 12.444992793353293,
925
+ 12.848105076662048,
926
+ 7.116214608306647
927
+ ]
928
+ ],
929
+ "shared_exogenous_sha256": "6cb61c3cec695fc28e522fc2501a65f041ece9186cc91d77c8763dd48c964f9e",
930
+ "snapshot_replay_verified": true,
931
+ "observed_plan_replay_max_error": 0.0
932
+ },
933
+ {
934
+ "cohort": "small_room_3node",
935
+ "system_id": "challenge-small_room_3node-941236",
936
+ "anchor_step": 108,
937
+ "sample_index": 13,
938
+ "commands_kw": [
939
+ [
940
+ -1.1918018327073219,
941
+ -0.9006157728027688,
942
+ -0.2838887839049982,
943
+ 0.4408239906052986,
944
+ -4.992730809857837,
945
+ -4.801521685531811,
946
+ -5.067188552059771,
947
+ -5.696805207461735
948
+ ],
949
+ [
950
+ 4.808198167292678,
951
+ 5.099384227197231,
952
+ 5.716111216095002,
953
+ 6.440823990605298,
954
+ 1.0072691901421633,
955
+ 1.198478314468189,
956
+ 0.932811447940229,
957
+ 0.30319479253826476
958
+ ]
959
+ ],
960
+ "shared_exogenous_sha256": "fb6ec01bbeba1da5b39371db250dee979d5d92fb186c919fcc1fd4e56ade922e",
961
+ "snapshot_replay_verified": true,
962
+ "observed_plan_replay_max_error": 0.0
963
+ },
964
+ {
965
+ "cohort": "small_room_3node",
966
+ "system_id": "challenge-small_room_3node-941253",
967
+ "anchor_step": 125,
968
+ "sample_index": 14,
969
+ "commands_kw": [
970
+ [
971
+ 0.9532028547242193,
972
+ 7.199173493925627,
973
+ 6.892513201502045,
974
+ 6.16588234448053,
975
+ 5.356163117343119,
976
+ 4.85165466497465,
977
+ 4.9045499690243926,
978
+ 5.499458340494377
979
+ ],
980
+ [
981
+ 6.9532028547242195,
982
+ 13.199173493925628,
983
+ 12.892513201502044,
984
+ 12.16588234448053,
985
+ 11.356163117343119,
986
+ 10.85165466497465,
987
+ 10.904549969024393,
988
+ 11.499458340494378
989
+ ]
990
+ ],
991
+ "shared_exogenous_sha256": "e84feccd03afcd9a997a16130aa27f22f1ccff544c9e025f619bf39695569cd1",
992
+ "snapshot_replay_verified": true,
993
+ "observed_plan_replay_max_error": 0.0
994
+ },
995
+ {
996
+ "cohort": "small_room_3node",
997
+ "system_id": "challenge-small_room_3node-941231",
998
+ "anchor_step": 177,
999
+ "sample_index": 15,
1000
+ "commands_kw": [
1001
+ [
1002
+ 4.809736324776544,
1003
+ 5.431732632002873,
1004
+ 6.534539141091815,
1005
+ 7.186682585974303,
1006
+ 6.822273543852635,
1007
+ -15.0,
1008
+ -15.0,
1009
+ -15.0
1010
+ ],
1011
+ [
1012
+ 10.809736324776544,
1013
+ 11.431732632002873,
1014
+ 12.534539141091816,
1015
+ 13.186682585974303,
1016
+ 12.822273543852635,
1017
+ -9.0,
1018
+ -9.0,
1019
+ -9.0
1020
+ ]
1021
+ ],
1022
+ "shared_exogenous_sha256": "3add157a42067181595ccba6bf69839733b76ecf6276abc79d3b9402db45e7b8",
1023
+ "snapshot_replay_verified": true,
1024
+ "observed_plan_replay_max_error": 0.0
1025
+ },
1026
+ {
1027
+ "cohort": "auditorium_3node",
1028
+ "system_id": "challenge-auditorium_3node-1041246",
1029
+ "anchor_step": 30,
1030
+ "sample_index": 0,
1031
+ "commands_kw": [
1032
+ [
1033
+ 0.23844687024531855,
1034
+ -0.017954768285017957,
1035
+ -0.279368245507298,
1036
+ -0.5326977983478779,
1037
+ -0.763810250088205,
1038
+ -0.9583180963912454,
1039
+ -1.1025284141765233,
1040
+ -1.1845129858758738
1041
+ ],
1042
+ [
1043
+ 6.238446870245318,
1044
+ 5.982045231714982,
1045
+ 5.720631754492702,
1046
+ 5.467302201652122,
1047
+ 5.236189749911795,
1048
+ 5.041681903608755,
1049
+ 4.897471585823476,
1050
+ 4.815487014124126
1051
+ ]
1052
+ ],
1053
+ "shared_exogenous_sha256": "4a7869bcf9345d17dafda4f5ffb1e2ad708ad9f85fd3eae482d6379df46d7a44",
1054
+ "snapshot_replay_verified": true,
1055
+ "observed_plan_replay_max_error": 0.0
1056
+ },
1057
+ {
1058
+ "cohort": "auditorium_3node",
1059
+ "system_id": "challenge-auditorium_3node-1041248",
1060
+ "anchor_step": 148,
1061
+ "sample_index": 1,
1062
+ "commands_kw": [
1063
+ [
1064
+ 13.869263390712876,
1065
+ 13.926651642076859,
1066
+ 14.648569514890436,
1067
+ 15.0,
1068
+ 15.0,
1069
+ 15.0,
1070
+ -14.822088762779329,
1071
+ -15.0
1072
+ ],
1073
+ [
1074
+ 15.0,
1075
+ 15.0,
1076
+ 15.0,
1077
+ 15.0,
1078
+ 15.0,
1079
+ 15.0,
1080
+ -8.822088762779329,
1081
+ -9.0
1082
+ ]
1083
+ ],
1084
+ "shared_exogenous_sha256": "0e16b91bb92b4f84a986f9521124163470fd0b1ceae2bed2e4538a2f8c6a51e3",
1085
+ "snapshot_replay_verified": true,
1086
+ "observed_plan_replay_max_error": 0.0
1087
+ },
1088
+ {
1089
+ "cohort": "auditorium_3node",
1090
+ "system_id": "challenge-auditorium_3node-1041244",
1091
+ "anchor_step": 63,
1092
+ "sample_index": 2,
1093
+ "commands_kw": [
1094
+ [
1095
+ -6.76972661173709,
1096
+ -6.373345158478113,
1097
+ -5.917711399418711,
1098
+ -5.468738365765424,
1099
+ -5.095596394299527,
1100
+ -4.859853282476789,
1101
+ -4.8046256343424885,
1102
+ -4.94565576387234
1103
+ ],
1104
+ [
1105
+ -0.7697266117370898,
1106
+ -0.3733451584781129,
1107
+ 0.08228860058128884,
1108
+ 0.5312616342345757,
1109
+ 0.9044036057004732,
1110
+ 1.1401467175232112,
1111
+ 1.1953743656575115,
1112
+ 1.05434423612766
1113
+ ]
1114
+ ],
1115
+ "shared_exogenous_sha256": "ba77fc6a6f4af53779fa8f3f46a25504b7fc6d3362f3702fb3dbbf3ece089e05",
1116
+ "snapshot_replay_verified": true,
1117
+ "observed_plan_replay_max_error": 0.0
1118
+ },
1119
+ {
1120
+ "cohort": "auditorium_3node",
1121
+ "system_id": "challenge-auditorium_3node-1041241",
1122
+ "anchor_step": 94,
1123
+ "sample_index": 3,
1124
+ "commands_kw": [
1125
+ [
1126
+ -1.1381749979907911,
1127
+ -0.785290904732828,
1128
+ -0.20703985281322643,
1129
+ 0.43572705702747944,
1130
+ -14.044116735516413,
1131
+ -13.805319931778117,
1132
+ -13.927846460750896,
1133
+ -14.383043475062927
1134
+ ],
1135
+ [
1136
+ 4.861825002009208,
1137
+ 5.214709095267172,
1138
+ 5.792960147186774,
1139
+ 6.43572705702748,
1140
+ -8.044116735516413,
1141
+ -7.805319931778117,
1142
+ -7.927846460750896,
1143
+ -8.383043475062927
1144
+ ]
1145
+ ],
1146
+ "shared_exogenous_sha256": "ba06284f20fcf42989885037774f5223b5426355b50f0f74448b72659f909eee",
1147
+ "snapshot_replay_verified": true,
1148
+ "observed_plan_replay_max_error": 0.0
1149
+ },
1150
+ {
1151
+ "cohort": "auditorium_3node",
1152
+ "system_id": "challenge-auditorium_3node-1041234",
1153
+ "anchor_step": 37,
1154
+ "sample_index": 4,
1155
+ "commands_kw": [
1156
+ [
1157
+ 15.0,
1158
+ 15.0,
1159
+ 15.0,
1160
+ 15.0,
1161
+ 15.0,
1162
+ 15.0,
1163
+ 15.0,
1164
+ 15.0
1165
+ ],
1166
+ [
1167
+ 9.0,
1168
+ 9.0,
1169
+ 9.0,
1170
+ 9.0,
1171
+ 9.0,
1172
+ 9.0,
1173
+ 9.0,
1174
+ 9.0
1175
+ ]
1176
+ ],
1177
+ "shared_exogenous_sha256": "1da06bac967036f636abbc8a40d899f88dfc7aff92cd5f93cbb78b4d1ec018ca",
1178
+ "snapshot_replay_verified": true,
1179
+ "observed_plan_replay_max_error": 0.0
1180
+ },
1181
+ {
1182
+ "cohort": "auditorium_3node",
1183
+ "system_id": "challenge-auditorium_3node-1041232",
1184
+ "anchor_step": 149,
1185
+ "sample_index": 5,
1186
+ "commands_kw": [
1187
+ [
1188
+ -0.2031061769312738,
1189
+ 0.7165634328653887,
1190
+ 1.1919534680953536,
1191
+ 0.9146102113749399,
1192
+ 0.0499853544446062,
1193
+ -0.8510151794636146,
1194
+ -1.198344289229705,
1195
+ -0.7529261407403106
1196
+ ],
1197
+ [
1198
+ 5.796893823068726,
1199
+ 6.716563432865389,
1200
+ 7.191953468095353,
1201
+ 6.91461021137494,
1202
+ 6.0499853544446065,
1203
+ 5.148984820536385,
1204
+ 4.801655710770295,
1205
+ 5.2470738592596895
1206
+ ]
1207
+ ],
1208
+ "shared_exogenous_sha256": "c8fa827e4de804008aa9183a23dd9f38e0247b00ca33737682a5816b520da3aa",
1209
+ "snapshot_replay_verified": true,
1210
+ "observed_plan_replay_max_error": 0.0
1211
+ },
1212
+ {
1213
+ "cohort": "auditorium_3node",
1214
+ "system_id": "challenge-auditorium_3node-1041253",
1215
+ "anchor_step": 25,
1216
+ "sample_index": 6,
1217
+ "commands_kw": [
1218
+ [
1219
+ 15.0,
1220
+ 15.0,
1221
+ 15.0,
1222
+ 6.51263062110925,
1223
+ 6.281027693670675,
1224
+ 6.031658388887724,
1225
+ 5.775001695263011,
1226
+ 5.5231935768312574
1227
+ ],
1228
+ [
1229
+ 15.0,
1230
+ 15.0,
1231
+ 15.0,
1232
+ 12.512630621109249,
1233
+ 12.281027693670675,
1234
+ 12.031658388887724,
1235
+ 11.775001695263011,
1236
+ 11.523193576831257
1237
+ ]
1238
+ ],
1239
+ "shared_exogenous_sha256": "4e86c6998da46fc6012166d823f1859729cc10ff96a161f74de5f529a07f6a9a",
1240
+ "snapshot_replay_verified": true,
1241
+ "observed_plan_replay_max_error": 0.0
1242
+ },
1243
+ {
1244
+ "cohort": "auditorium_3node",
1245
+ "system_id": "challenge-auditorium_3node-1041250",
1246
+ "anchor_step": 166,
1247
+ "sample_index": 7,
1248
+ "commands_kw": [
1249
+ [
1250
+ -0.3067844474743255,
1251
+ -1.0970372474974057,
1252
+ -15.0,
1253
+ -15.0,
1254
+ -14.202504381894386,
1255
+ -13.803034819150547,
1256
+ -14.342711096978604,
1257
+ -15.0
1258
+ ],
1259
+ [
1260
+ 5.6932155525256745,
1261
+ 4.902962752502594,
1262
+ -9.0,
1263
+ -9.0,
1264
+ -8.202504381894386,
1265
+ -7.803034819150547,
1266
+ -8.342711096978604,
1267
+ -9.0
1268
+ ]
1269
+ ],
1270
+ "shared_exogenous_sha256": "d816dcb4be93e3423651b6dfcbe00d16acd97f2b9702d2173b0462ff6fd7916e",
1271
+ "snapshot_replay_verified": true,
1272
+ "observed_plan_replay_max_error": 0.0
1273
+ },
1274
+ {
1275
+ "cohort": "auditorium_3node",
1276
+ "system_id": "challenge-auditorium_3node-1041244",
1277
+ "anchor_step": 183,
1278
+ "sample_index": 8,
1279
+ "commands_kw": [
1280
+ [
1281
+ -15.0,
1282
+ -15.0,
1283
+ -14.069618209018179,
1284
+ -13.855897368568161,
1285
+ -14.68064637446763,
1286
+ -15.0,
1287
+ 4.816264427570444,
1288
+ 5.5371597767467895
1289
+ ],
1290
+ [
1291
+ -9.0,
1292
+ -9.0,
1293
+ -8.069618209018179,
1294
+ -7.8558973685681615,
1295
+ -8.68064637446763,
1296
+ -9.0,
1297
+ 10.816264427570445,
1298
+ 11.53715977674679
1299
+ ]
1300
+ ],
1301
+ "shared_exogenous_sha256": "f2fe1555a15cea0b4e9e232468eb41d0ea9309e4069676707a3cdbbf0ac73677",
1302
+ "snapshot_replay_verified": true,
1303
+ "observed_plan_replay_max_error": 0.0
1304
+ },
1305
+ {
1306
+ "cohort": "auditorium_3node",
1307
+ "system_id": "challenge-auditorium_3node-1041244",
1308
+ "anchor_step": 72,
1309
+ "sample_index": 9,
1310
+ "commands_kw": [
1311
+ [
1312
+ -5.717129488386485,
1313
+ -6.2231357561003025,
1314
+ -6.694343389271678,
1315
+ -7.042120805389619,
1316
+ -7.1962799192625315,
1317
+ 13.879582934770792,
1318
+ 14.178040288833465,
1319
+ 14.645882937321607
1320
+ ],
1321
+ [
1322
+ 0.28287051161351506,
1323
+ -0.22313575610030245,
1324
+ -0.6943433892716779,
1325
+ -1.0421208053896187,
1326
+ -1.1962799192625315,
1327
+ 15.0,
1328
+ 15.0,
1329
+ 15.0
1330
+ ]
1331
+ ],
1332
+ "shared_exogenous_sha256": "852435701681a4e420d015c1b1881dbfa7a772067b73a264fe8ac99fbfd95fdd",
1333
+ "snapshot_replay_verified": true,
1334
+ "observed_plan_replay_max_error": 0.0
1335
+ },
1336
+ {
1337
+ "cohort": "auditorium_3node",
1338
+ "system_id": "challenge-auditorium_3node-1041238",
1339
+ "anchor_step": 72,
1340
+ "sample_index": 10,
1341
+ "commands_kw": [
1342
+ [
1343
+ 1.181118715053351,
1344
+ 1.1634710815239429,
1345
+ 0.9350669440986022,
1346
+ 0.5310427249838392,
1347
+ 0.02210785251287094,
1348
+ 5.503492996780607,
1349
+ 5.07773688246747,
1350
+ 4.834172459909491
1351
+ ],
1352
+ [
1353
+ 7.181118715053351,
1354
+ 7.163471081523943,
1355
+ 6.935066944098602,
1356
+ 6.531042724983839,
1357
+ 6.022107852512871,
1358
+ 11.503492996780608,
1359
+ 11.07773688246747,
1360
+ 10.83417245990949
1361
+ ]
1362
+ ],
1363
+ "shared_exogenous_sha256": "01aedaecbad80bd6c42ee7409054ad959953b2b2a26b6736eaae2308844858e6",
1364
+ "snapshot_replay_verified": true,
1365
+ "observed_plan_replay_max_error": 0.0
1366
+ },
1367
+ {
1368
+ "cohort": "auditorium_3node",
1369
+ "system_id": "challenge-auditorium_3node-1041239",
1370
+ "anchor_step": 146,
1371
+ "sample_index": 11,
1372
+ "commands_kw": [
1373
+ [
1374
+ -14.415009510782628,
1375
+ -15.0,
1376
+ -15.0,
1377
+ -15.0,
1378
+ -15.0,
1379
+ -14.561375046952147,
1380
+ -13.88409732409603,
1381
+ -13.91862760708669
1382
+ ],
1383
+ [
1384
+ -8.415009510782628,
1385
+ -9.0,
1386
+ -9.0,
1387
+ -9.0,
1388
+ -9.0,
1389
+ -8.561375046952147,
1390
+ -7.884097324096031,
1391
+ -7.918627607086689
1392
+ ]
1393
+ ],
1394
+ "shared_exogenous_sha256": "3dd24106bc7f00c60f05c4a3a341fa860dfe7c33520afcd7d1cc3885039ebfe9",
1395
+ "snapshot_replay_verified": true,
1396
+ "observed_plan_replay_max_error": 0.0
1397
+ },
1398
+ {
1399
+ "cohort": "auditorium_3node",
1400
+ "system_id": "challenge-auditorium_3node-1041242",
1401
+ "anchor_step": 74,
1402
+ "sample_index": 12,
1403
+ "commands_kw": [
1404
+ [
1405
+ 0.6926710853545469,
1406
+ 0.215222011235655,
1407
+ -0.3081169683506039,
1408
+ -15.0,
1409
+ -15.0,
1410
+ -15.0,
1411
+ -15.0,
1412
+ -15.0
1413
+ ],
1414
+ [
1415
+ 6.692671085354547,
1416
+ 6.215222011235655,
1417
+ 5.691883031649396,
1418
+ -9.0,
1419
+ -9.0,
1420
+ -9.0,
1421
+ -9.0,
1422
+ -9.0
1423
+ ]
1424
+ ],
1425
+ "shared_exogenous_sha256": "f03aa23e8107a3060d21831d3ec8df96aad521409b7b104a78e4a7430573df77",
1426
+ "snapshot_replay_verified": true,
1427
+ "observed_plan_replay_max_error": 0.0
1428
+ },
1429
+ {
1430
+ "cohort": "auditorium_3node",
1431
+ "system_id": "challenge-auditorium_3node-1041243",
1432
+ "anchor_step": 120,
1433
+ "sample_index": 13,
1434
+ "commands_kw": [
1435
+ [
1436
+ 0.12815319306758757,
1437
+ -0.6353904057078994,
1438
+ -1.1301827856708537,
1439
+ -1.1343905186621168,
1440
+ -0.6359902956529506,
1441
+ 0.15128710448232077,
1442
+ 6.8744294936705375,
1443
+ 7.197884507057667
1444
+ ],
1445
+ [
1446
+ 6.128153193067588,
1447
+ 5.364609594292101,
1448
+ 4.869817214329146,
1449
+ 4.865609481337883,
1450
+ 5.364009704347049,
1451
+ 6.1512871044823205,
1452
+ 12.874429493670537,
1453
+ 13.197884507057667
1454
+ ]
1455
+ ],
1456
+ "shared_exogenous_sha256": "a7172dc3071b3b865816ec66c5044c395f3abbc25f64d7cbb0f2c8eb63df1c94",
1457
+ "snapshot_replay_verified": true,
1458
+ "observed_plan_replay_max_error": 0.0
1459
+ },
1460
+ {
1461
+ "cohort": "auditorium_3node",
1462
+ "system_id": "challenge-auditorium_3node-1041230",
1463
+ "anchor_step": 172,
1464
+ "sample_index": 14,
1465
+ "commands_kw": [
1466
+ [
1467
+ -1.045594286318895,
1468
+ -0.15901493186610718,
1469
+ 0.858396344410525,
1470
+ 7.184423140341298,
1471
+ 6.542924256571777,
1472
+ 5.450656092480633,
1473
+ 4.812643651085485,
1474
+ 5.172347838617843
1475
+ ],
1476
+ [
1477
+ 4.954405713681105,
1478
+ 5.840985068133893,
1479
+ 6.858396344410525,
1480
+ 13.184423140341298,
1481
+ 12.542924256571776,
1482
+ 11.450656092480633,
1483
+ 10.812643651085484,
1484
+ 11.172347838617842
1485
+ ]
1486
+ ],
1487
+ "shared_exogenous_sha256": "d151c1e7e791d442a8f0a1a60f83778016be050ad0f18a5391d0942c551e581e",
1488
+ "snapshot_replay_verified": true,
1489
+ "observed_plan_replay_max_error": 0.0
1490
+ },
1491
+ {
1492
+ "cohort": "auditorium_3node",
1493
+ "system_id": "challenge-auditorium_3node-1041247",
1494
+ "anchor_step": 108,
1495
+ "sample_index": 15,
1496
+ "commands_kw": [
1497
+ [
1498
+ 6.4416346664701,
1499
+ 5.72863366701264,
1500
+ 5.107942237173473,
1501
+ 4.808300206910967,
1502
+ 13.948235845879188,
1503
+ 14.485096542402351,
1504
+ 15.0,
1505
+ 15.0
1506
+ ],
1507
+ [
1508
+ 12.441634666470101,
1509
+ 11.728633667012641,
1510
+ 11.107942237173473,
1511
+ 10.808300206910967,
1512
+ 15.0,
1513
+ 15.0,
1514
+ 15.0,
1515
+ 15.0
1516
+ ]
1517
+ ],
1518
+ "shared_exogenous_sha256": "a78e850d9cc0c0f0b2329129c81a5db0e8e292354bb47bdb8872a758f64b2c7b",
1519
+ "snapshot_replay_verified": true,
1520
+ "observed_plan_replay_max_error": 0.0
1521
+ }
1522
+ ],
1523
+ "episode_sha256": {
1524
+ "episodes/challenge-parameter_shift_2node-841230.npz": "6f39bab4317626cb46e49588877a361fec560a65727c5f7b227f24a396db8dbf",
1525
+ "episodes/challenge-parameter_shift_2node-841231.npz": "9748e865dd8c3511b479217e550006c51ce0775f2c86a8722d68206e50c77c15",
1526
+ "episodes/challenge-parameter_shift_2node-841232.npz": "612e3e996bd4bef2b270abe04047780a9d52eb7e663453c52d1acc62f09ab507",
1527
+ "episodes/challenge-parameter_shift_2node-841233.npz": "a6dbbde1e006cf8a63611b0e626d8880198c3cb68eb7f4cf6df356fced9fa025",
1528
+ "episodes/challenge-parameter_shift_2node-841234.npz": "35112a75b7a84d8feae255e0bdba38393852f70a379ad8b2be950c363bb54077",
1529
+ "episodes/challenge-parameter_shift_2node-841235.npz": "a55856798c69008ca186e6ecbfa72e5f1008b2313886682a0abea6b5f6f6bb04",
1530
+ "episodes/challenge-parameter_shift_2node-841236.npz": "6f1a7accdd6716b081974151d632b6d108e9965d3aefc9023e0deb4966d723d5",
1531
+ "episodes/challenge-parameter_shift_2node-841237.npz": "8800e013e1e92fff833c38ef71120f5bb6ca9e4c8e186248e741e5da1e59290d",
1532
+ "episodes/challenge-parameter_shift_2node-841238.npz": "0ccf54ae0c2fa75e4e5e5bd4f54ddba92a62984fd018c80ab5e5187b52cc4bb0",
1533
+ "episodes/challenge-parameter_shift_2node-841239.npz": "ed88464398eee594dfc1454c42f77abd14042b237295f7d721c16d59c1f99a55",
1534
+ "episodes/challenge-parameter_shift_2node-841240.npz": "6ef701a2f2fe539c0ac12ad37f2bfd3d7f5b99cd30c5b106d4fddede16db98b0",
1535
+ "episodes/challenge-parameter_shift_2node-841241.npz": "93fdd052163100a2e77a42284c7d6ac64a777622b18c88407e62e88f85daf85b",
1536
+ "episodes/challenge-parameter_shift_2node-841242.npz": "0c2bde725f7b553eee8dfd4e203bb3e72643398d80e354edef5e960c89937028",
1537
+ "episodes/challenge-parameter_shift_2node-841243.npz": "18f98668832e8ccbd1b2f779287d1395f40f8d58621cda285137666b1b93083d",
1538
+ "episodes/challenge-parameter_shift_2node-841244.npz": "2f2c54cb541044d3062422c086ec54b2061257bd6616d06f3afb01f9a773cd33",
1539
+ "episodes/challenge-parameter_shift_2node-841245.npz": "5e78f8f28c110165e230bd3ad4c1b7c2af164881fdb1f966ad95e0d6fd2b5156",
1540
+ "episodes/challenge-parameter_shift_2node-841246.npz": "ec3b33d6367463721e34cb4c57efa7bee626de9a43b5368eb1bd518e53644adf",
1541
+ "episodes/challenge-parameter_shift_2node-841247.npz": "309a99fa1882dfe77abec497c511e60280ea0deb3efa9137c28bf6b2d6c3d037",
1542
+ "episodes/challenge-parameter_shift_2node-841248.npz": "db9138d5e2893fbbb068ad7a4abf09f630ebf977f219ff86891d667b6c8d7673",
1543
+ "episodes/challenge-parameter_shift_2node-841249.npz": "55b3b2ef27c54859f216fdd0f30edb113d57dfb27a2c3e0ff919b91a72baf6a7",
1544
+ "episodes/challenge-parameter_shift_2node-841250.npz": "e82eb18a63bcecaa07655f8bfabc119eab4aee397aad3f274f1088cb2985ddae",
1545
+ "episodes/challenge-parameter_shift_2node-841251.npz": "59c8f9dab9e8b94ec8ac4f31af34755a51f140c649e907705971e7eb4843e88d",
1546
+ "episodes/challenge-parameter_shift_2node-841252.npz": "8687142c157c1973d5ba13a1871f5774591b2cbf4c4648d11eb5131da21f8191",
1547
+ "episodes/challenge-parameter_shift_2node-841253.npz": "460f8ef7608c9b3bc8ffeec3017128d256e7bd2f6b02ce642306bc55fa0e5406",
1548
+ "episodes/challenge-small_room_3node-941230.npz": "eff1fdbf357934387d9c86f61b4e448576e303382a8c5bcfd55885c688e4c89f",
1549
+ "episodes/challenge-small_room_3node-941231.npz": "7df8a10f5859612d7b948b25ee05a7e7d426e338605ec8d16f6c083b8ec98b1c",
1550
+ "episodes/challenge-small_room_3node-941232.npz": "7f0d2d0e22fea02d388a1c7309bda3a6e1b96eff4b02b81194ddf6e18c6b5ac9",
1551
+ "episodes/challenge-small_room_3node-941233.npz": "b92dc8b4fafce39c4b63b9defd136b4bd1f895c822f67255ef48eaf94a5bf4fa",
1552
+ "episodes/challenge-small_room_3node-941234.npz": "6ff72d6f58bd2ea1b0119e87eb036c56bafebb48a360a7b62e69de30820f4726",
1553
+ "episodes/challenge-small_room_3node-941235.npz": "bc62810f057c326d68b28497d618438bd3853aa1f9964dded6e538390f4ee63d",
1554
+ "episodes/challenge-small_room_3node-941236.npz": "bbff3ad44986c27ef4dc94de5bbf1f6d556cd0fea08a55ef47a6979925690f2d",
1555
+ "episodes/challenge-small_room_3node-941237.npz": "a3bf02e113176c1b9d201f643cb23e5ef7f675a5a4209672d3bf472fc4d2d535",
1556
+ "episodes/challenge-small_room_3node-941238.npz": "ecf10d4247e7ee09b9850f85e6da7f2f698241c834b6adcfbb3b38c44addaad2",
1557
+ "episodes/challenge-small_room_3node-941239.npz": "f1a5ecea1c670170ccf129a7ce960a674f4c805f49afce358c7787fb334dcecc",
1558
+ "episodes/challenge-small_room_3node-941240.npz": "08da29ee77eb6c1428cbd64e7a5dbd1d1011aba96d334acb773421b03d34af85",
1559
+ "episodes/challenge-small_room_3node-941241.npz": "2f39fbdadd72c4b54867bdb16aa5363b76c0688ded7e7d60f358c233c709ddda",
1560
+ "episodes/challenge-small_room_3node-941242.npz": "0c15d7d2963085871a778ff723df58f1dacf2f78bb1448d00019dec6768d7cba",
1561
+ "episodes/challenge-small_room_3node-941243.npz": "459cd4d44b839d99111f9181e32e472e1e4994126a890fe38018d3bb9d5b8c62",
1562
+ "episodes/challenge-small_room_3node-941244.npz": "f32b1cd4cc1f3a92c2498302a7aa1de363db2b6f95286f8285a1556fb7ac2b9e",
1563
+ "episodes/challenge-small_room_3node-941245.npz": "0a3f4c9e209134a12dd486ac9196b5037be9db9020a3ce3f9a2ec6a681e058f8",
1564
+ "episodes/challenge-small_room_3node-941246.npz": "ad81061d314250c36028184084db1b375549526389833fe254a6618a47d9c30a",
1565
+ "episodes/challenge-small_room_3node-941247.npz": "d43fc56346191c048ddd07e606cb566937cce73d964887d63d063e2e343ce45d",
1566
+ "episodes/challenge-small_room_3node-941248.npz": "8bce37f0e3bf02097cbf830d5b62520c524ca3e4e61239bad3a124dc6c0dfcf9",
1567
+ "episodes/challenge-small_room_3node-941249.npz": "c65bd39ef584f0908fb2061be0d8a4b2617dbf6b40544175218a4d08b7dbf22c",
1568
+ "episodes/challenge-small_room_3node-941250.npz": "4cc062ad3832f9c5d84ba57d33bd6820b604dabd35e5e162f7a0e8b8751edbec",
1569
+ "episodes/challenge-small_room_3node-941251.npz": "478876d37fe92ab306ef0b57c95013f1592f7b563a0c28896ad334d2b9e23b80",
1570
+ "episodes/challenge-small_room_3node-941252.npz": "ebf7c7726ba56b9eff24d17df9ad5db68a0772e14eb55f3d18d6aa3157aee7e1",
1571
+ "episodes/challenge-small_room_3node-941253.npz": "9ab95a58eaab18d39ad2bde69ddbdb48c95f65a499df19a1e6ff3dea6f33c1f4",
1572
+ "episodes/challenge-auditorium_3node-1041230.npz": "909c4df4c3e16f8c9d6927b7b538cdd0bdc3773e46b648e31ab35fe233d2ba95",
1573
+ "episodes/challenge-auditorium_3node-1041231.npz": "cb101b90a5649efc479bb5d8a812a20e814a420c12129d81b225d307b191d825",
1574
+ "episodes/challenge-auditorium_3node-1041232.npz": "797163c7811deedcbbda4f8434512b1e9712a77b9dddacd3f2d28f7e02b0449c",
1575
+ "episodes/challenge-auditorium_3node-1041233.npz": "08b48742612b07b0a97b2bad7f4c03e0745c78404808b04469b1f47e46caff8a",
1576
+ "episodes/challenge-auditorium_3node-1041234.npz": "3b1e7873e7db1b4a1191c85a82461b75040967f73962e3b05cb8d53d150a8d20",
1577
+ "episodes/challenge-auditorium_3node-1041235.npz": "d75e02840e80cc8fbfd4488662a0db5c610847f4e57aeca447714ab6b1ba3766",
1578
+ "episodes/challenge-auditorium_3node-1041236.npz": "7802684e0b5608ad658b6daafcca4aada0eb3bf68dc9c11239d9f1ebd4cc3438",
1579
+ "episodes/challenge-auditorium_3node-1041237.npz": "7c920dada0b947d5c419ec3b8bfd945e9fbbcd96100bcaf029ac303e17a85eda",
1580
+ "episodes/challenge-auditorium_3node-1041238.npz": "aa2e43363343f3f825705ddf61d0d491ee830ed87f9fefb6b360e17534468bc7",
1581
+ "episodes/challenge-auditorium_3node-1041239.npz": "a3381546d34eaba15c1556b78771ab3ddfe4701cc266e24c92c780f859ccb616",
1582
+ "episodes/challenge-auditorium_3node-1041240.npz": "7fda0071578634c230c7b0075b20a40939c688183688d3bdd4766a450b86b799",
1583
+ "episodes/challenge-auditorium_3node-1041241.npz": "bf5e5024f9d6c677ee46665af75b09ca093944396a0729814059d29bdcdc9e38",
1584
+ "episodes/challenge-auditorium_3node-1041242.npz": "a307e864df7e4a04711a150be16600647d78f4e7b7f6ad472803100652ca2620",
1585
+ "episodes/challenge-auditorium_3node-1041243.npz": "bbadc4730e9f34e2c4dfd05c1b453489a687ee4f8f8cbd6440d1f27051cd4fe8",
1586
+ "episodes/challenge-auditorium_3node-1041244.npz": "98a6a98da2590f92f5d07aa5c17f515b0d55f25286943d3798f52ce83d0022b1",
1587
+ "episodes/challenge-auditorium_3node-1041245.npz": "20c19df7e264082055d9fc64e12d7076e631e777d2d5160e05711b529318bdb6",
1588
+ "episodes/challenge-auditorium_3node-1041246.npz": "412c2843571614356c67318322f30ffabec7043fc8b01f79735930784cb141ca",
1589
+ "episodes/challenge-auditorium_3node-1041247.npz": "04cba1063d4f7ff83ad34cd4ccb7b9a49c1e9edbdf3fb9ff108fe73fe2a2100a",
1590
+ "episodes/challenge-auditorium_3node-1041248.npz": "76353c885a993fff08524ef8516367875d74d79be905f4d4e5705eb8700765f5",
1591
+ "episodes/challenge-auditorium_3node-1041249.npz": "6f1ecd89b215404fdeb2c395fcc21a374b7dcce15d46aeb09a1a8348aea451b5",
1592
+ "episodes/challenge-auditorium_3node-1041250.npz": "47ac85908002c115eaacc257c84a3dfb614a31d4c54c69238c4cde0cfefda159",
1593
+ "episodes/challenge-auditorium_3node-1041251.npz": "12b3f1d1f776e348bcc59a91b9aeef7376fe08cd53f4695efcc43ccf0d654e0e",
1594
+ "episodes/challenge-auditorium_3node-1041252.npz": "8f9e82273cf94eb7ef675fbbfdb0bf18c42dabca995c061cae02c9160c688fb6",
1595
+ "episodes/challenge-auditorium_3node-1041253.npz": "84d907e9ba3111bb87ff9bcacafac6ec24f2c822585bbf0d233bba87ebf2a318"
1596
+ },
1597
+ "anchor_sha256": "985ee5dbe2e71c284b1615ba01f748f69a0140f93a9a392588fc4dc16f20861d"
1598
+ }
studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/summary.json ADDED
@@ -0,0 +1,1147 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "status": "completed",
3
+ "external_real_world_validation": false,
4
+ "objective": "Sum of squared indoor_temp deviation from 21 degC at 15,30,60,120 minutes; units degC^2.",
5
+ "policy": "A is the recorded future HVAC command plan. B adds 6 electrical kW to all eight commands, clipped to public [-15,15] kW. If that leaves the entire plan unchanged, B subtracts 6 kW instead. Both branches start from the identical replayed snapshot with identical external disturbances. Hidden actuator saturation can legitimately make different requested plans physically equivalent.",
6
+ "provenance_sha256": "35977663cd38d3ca6dbd3edf7c0768174d6ddbf2288797dbcdea13e541de92c6",
7
+ "observed_plan_max_replay_error": 0.0,
8
+ "summary": [
9
+ {
10
+ "cohort": "auditorium_3node",
11
+ "model": "foundation_model",
12
+ "sample_count": 16,
13
+ "effects": [
14
+ {
15
+ "field": "indoor_temp",
16
+ "horizon_minutes": 15,
17
+ "action_effect_mae": 0.2542869410121623,
18
+ "action_effect_rmse": 0.33058562323808743,
19
+ "sample_count": 16
20
+ },
21
+ {
22
+ "field": "mass_temp",
23
+ "horizon_minutes": 15,
24
+ "action_effect_mae": 0.003488366993602665,
25
+ "action_effect_rmse": 0.004092668310579629,
26
+ "sample_count": 16
27
+ },
28
+ {
29
+ "field": "energy_kwh",
30
+ "horizon_minutes": 15,
31
+ "action_effect_mae": 0.2652178339305875,
32
+ "action_effect_rmse": 0.34283756095688894,
33
+ "sample_count": 16
34
+ },
35
+ {
36
+ "field": "indoor_temp",
37
+ "horizon_minutes": 30,
38
+ "action_effect_mae": 0.4237558285536963,
39
+ "action_effect_rmse": 0.5367067482674245,
40
+ "sample_count": 16
41
+ },
42
+ {
43
+ "field": "mass_temp",
44
+ "horizon_minutes": 30,
45
+ "action_effect_mae": 0.008763933395118051,
46
+ "action_effect_rmse": 0.010763674510435276,
47
+ "sample_count": 16
48
+ },
49
+ {
50
+ "field": "energy_kwh",
51
+ "horizon_minutes": 30,
52
+ "action_effect_mae": 0.6477342008495506,
53
+ "action_effect_rmse": 0.810821578023733,
54
+ "sample_count": 16
55
+ },
56
+ {
57
+ "field": "indoor_temp",
58
+ "horizon_minutes": 60,
59
+ "action_effect_mae": 0.6134296226904796,
60
+ "action_effect_rmse": 0.7758803325917524,
61
+ "sample_count": 16
62
+ },
63
+ {
64
+ "field": "mass_temp",
65
+ "horizon_minutes": 60,
66
+ "action_effect_mae": 0.031480576333465904,
67
+ "action_effect_rmse": 0.042756297075925515,
68
+ "sample_count": 16
69
+ },
70
+ {
71
+ "field": "energy_kwh",
72
+ "horizon_minutes": 60,
73
+ "action_effect_mae": 1.5161405370583796,
74
+ "action_effect_rmse": 2.0246147060158046,
75
+ "sample_count": 16
76
+ },
77
+ {
78
+ "field": "indoor_temp",
79
+ "horizon_minutes": 120,
80
+ "action_effect_mae": 0.7161370478362058,
81
+ "action_effect_rmse": 0.927898390779598,
82
+ "sample_count": 16
83
+ },
84
+ {
85
+ "field": "mass_temp",
86
+ "horizon_minutes": 120,
87
+ "action_effect_mae": 0.09261061415533123,
88
+ "action_effect_rmse": 0.11322177286892775,
89
+ "sample_count": 16
90
+ },
91
+ {
92
+ "field": "energy_kwh",
93
+ "horizon_minutes": 120,
94
+ "action_effect_mae": 3.5608205329673277,
95
+ "action_effect_rmse": 4.435303538788489,
96
+ "sample_count": 16
97
+ }
98
+ ],
99
+ "ranking_comparable_pairs": 16,
100
+ "ranking_accuracy": 1.0,
101
+ "mean_regret_degC_squared": 0.0
102
+ },
103
+ {
104
+ "cohort": "auditorium_3node",
105
+ "model": "history_linear_system_id",
106
+ "sample_count": 16,
107
+ "effects": [
108
+ {
109
+ "field": "indoor_temp",
110
+ "horizon_minutes": 15,
111
+ "action_effect_mae": 0.02455548614671188,
112
+ "action_effect_rmse": 0.032069379707972315,
113
+ "sample_count": 16
114
+ },
115
+ {
116
+ "field": "mass_temp",
117
+ "horizon_minutes": 15,
118
+ "action_effect_mae": 0.000721583647489199,
119
+ "action_effect_rmse": 0.0010191934813555776,
120
+ "sample_count": 16
121
+ },
122
+ {
123
+ "field": "energy_kwh",
124
+ "horizon_minutes": 15,
125
+ "action_effect_mae": 0.6136340470259962,
126
+ "action_effect_rmse": 0.7584465982872618,
127
+ "sample_count": 16
128
+ },
129
+ {
130
+ "field": "indoor_temp",
131
+ "horizon_minutes": 30,
132
+ "action_effect_mae": 0.04567632511762987,
133
+ "action_effect_rmse": 0.06204231183259322,
134
+ "sample_count": 16
135
+ },
136
+ {
137
+ "field": "mass_temp",
138
+ "horizon_minutes": 30,
139
+ "action_effect_mae": 0.0014630654737015636,
140
+ "action_effect_rmse": 0.0020143312815209097,
141
+ "sample_count": 16
142
+ },
143
+ {
144
+ "field": "energy_kwh",
145
+ "horizon_minutes": 30,
146
+ "action_effect_mae": 1.5412186850669096,
147
+ "action_effect_rmse": 1.9833714617648963,
148
+ "sample_count": 16
149
+ },
150
+ {
151
+ "field": "indoor_temp",
152
+ "horizon_minutes": 60,
153
+ "action_effect_mae": 0.10015042880204472,
154
+ "action_effect_rmse": 0.13433788788541173,
155
+ "sample_count": 16
156
+ },
157
+ {
158
+ "field": "mass_temp",
159
+ "horizon_minutes": 60,
160
+ "action_effect_mae": 0.0033794511976239505,
161
+ "action_effect_rmse": 0.004357821335663697,
162
+ "sample_count": 16
163
+ },
164
+ {
165
+ "field": "energy_kwh",
166
+ "horizon_minutes": 60,
167
+ "action_effect_mae": 3.8179527653290943,
168
+ "action_effect_rmse": 4.798308341207214,
169
+ "sample_count": 16
170
+ },
171
+ {
172
+ "field": "indoor_temp",
173
+ "horizon_minutes": 120,
174
+ "action_effect_mae": 0.19723939228267628,
175
+ "action_effect_rmse": 0.24580139178109733,
176
+ "sample_count": 16
177
+ },
178
+ {
179
+ "field": "mass_temp",
180
+ "horizon_minutes": 120,
181
+ "action_effect_mae": 0.008112721633385611,
182
+ "action_effect_rmse": 0.011125083765287569,
183
+ "sample_count": 16
184
+ },
185
+ {
186
+ "field": "energy_kwh",
187
+ "horizon_minutes": 120,
188
+ "action_effect_mae": 7.99387290627196,
189
+ "action_effect_rmse": 9.489395883034748,
190
+ "sample_count": 16
191
+ }
192
+ ],
193
+ "ranking_comparable_pairs": 16,
194
+ "ranking_accuracy": 0.9375,
195
+ "mean_regret_degC_squared": 0.8901179958549896
196
+ },
197
+ {
198
+ "cohort": "auditorium_3node",
199
+ "model": "persistence",
200
+ "sample_count": 16,
201
+ "effects": [
202
+ {
203
+ "field": "indoor_temp",
204
+ "horizon_minutes": 15,
205
+ "action_effect_mae": 0.04755446866276547,
206
+ "action_effect_rmse": 0.052258294079647466,
207
+ "sample_count": 16
208
+ },
209
+ {
210
+ "field": "mass_temp",
211
+ "horizon_minutes": 15,
212
+ "action_effect_mae": 8.214917146620593e-05,
213
+ "action_effect_rmse": 9.688340858845823e-05,
214
+ "sample_count": 16
215
+ },
216
+ {
217
+ "field": "energy_kwh",
218
+ "horizon_minutes": 15,
219
+ "action_effect_mae": 0.5734549882911328,
220
+ "action_effect_rmse": 0.6637778482641495,
221
+ "sample_count": 16
222
+ },
223
+ {
224
+ "field": "indoor_temp",
225
+ "horizon_minutes": 30,
226
+ "action_effect_mae": 0.12462930493172497,
227
+ "action_effect_rmse": 0.135877970931866,
228
+ "sample_count": 16
229
+ },
230
+ {
231
+ "field": "mass_temp",
232
+ "horizon_minutes": 30,
233
+ "action_effect_mae": 0.00046879179395975523,
234
+ "action_effect_rmse": 0.000551920417058589,
235
+ "sample_count": 16
236
+ },
237
+ {
238
+ "field": "energy_kwh",
239
+ "horizon_minutes": 30,
240
+ "action_effect_mae": 1.6851368221106022,
241
+ "action_effect_rmse": 1.819641134921439,
242
+ "sample_count": 16
243
+ },
244
+ {
245
+ "field": "indoor_temp",
246
+ "horizon_minutes": 60,
247
+ "action_effect_mae": 0.275309445659932,
248
+ "action_effect_rmse": 0.2958546147600714,
249
+ "sample_count": 16
250
+ },
251
+ {
252
+ "field": "mass_temp",
253
+ "horizon_minutes": 60,
254
+ "action_effect_mae": 0.002277111246946517,
255
+ "action_effect_rmse": 0.0026713334127942846,
256
+ "sample_count": 16
257
+ },
258
+ {
259
+ "field": "energy_kwh",
260
+ "horizon_minutes": 60,
261
+ "action_effect_mae": 3.7818242732765563,
262
+ "action_effect_rmse": 4.10405646642949,
263
+ "sample_count": 16
264
+ },
265
+ {
266
+ "field": "indoor_temp",
267
+ "horizon_minutes": 120,
268
+ "action_effect_mae": 0.5078931197695817,
269
+ "action_effect_rmse": 0.5285506067099681,
270
+ "sample_count": 16
271
+ },
272
+ {
273
+ "field": "mass_temp",
274
+ "horizon_minutes": 120,
275
+ "action_effect_mae": 0.009367321593782618,
276
+ "action_effect_rmse": 0.010710421002151525,
277
+ "sample_count": 16
278
+ },
279
+ {
280
+ "field": "energy_kwh",
281
+ "horizon_minutes": 120,
282
+ "action_effect_mae": 7.3838131816985175,
283
+ "action_effect_rmse": 7.978900137092953,
284
+ "sample_count": 16
285
+ }
286
+ ],
287
+ "ranking_comparable_pairs": 16,
288
+ "ranking_accuracy": 0.5,
289
+ "mean_regret_degC_squared": 7.395654559967647
290
+ },
291
+ {
292
+ "cohort": "parameter_shift_2node",
293
+ "model": "foundation_model",
294
+ "sample_count": 16,
295
+ "effects": [
296
+ {
297
+ "field": "indoor_temp",
298
+ "horizon_minutes": 15,
299
+ "action_effect_mae": 0.5906248838708554,
300
+ "action_effect_rmse": 0.8390551275651404,
301
+ "sample_count": 16
302
+ },
303
+ {
304
+ "field": "mass_temp",
305
+ "horizon_minutes": 15,
306
+ "action_effect_mae": 0.003859691347371186,
307
+ "action_effect_rmse": 0.004721373149278637,
308
+ "sample_count": 16
309
+ },
310
+ {
311
+ "field": "energy_kwh",
312
+ "horizon_minutes": 15,
313
+ "action_effect_mae": 0.6113616589639379,
314
+ "action_effect_rmse": 0.707383897346148,
315
+ "sample_count": 16
316
+ },
317
+ {
318
+ "field": "indoor_temp",
319
+ "horizon_minutes": 30,
320
+ "action_effect_mae": 0.9610313856909214,
321
+ "action_effect_rmse": 1.4695113057436924,
322
+ "sample_count": 16
323
+ },
324
+ {
325
+ "field": "mass_temp",
326
+ "horizon_minutes": 30,
327
+ "action_effect_mae": 0.011951751808714217,
328
+ "action_effect_rmse": 0.015250477099184565,
329
+ "sample_count": 16
330
+ },
331
+ {
332
+ "field": "energy_kwh",
333
+ "horizon_minutes": 30,
334
+ "action_effect_mae": 1.2855659853023607,
335
+ "action_effect_rmse": 1.484491496919845,
336
+ "sample_count": 16
337
+ },
338
+ {
339
+ "field": "indoor_temp",
340
+ "horizon_minutes": 60,
341
+ "action_effect_mae": 1.7998073549428204,
342
+ "action_effect_rmse": 2.374120410598146,
343
+ "sample_count": 16
344
+ },
345
+ {
346
+ "field": "mass_temp",
347
+ "horizon_minutes": 60,
348
+ "action_effect_mae": 0.035600025275991376,
349
+ "action_effect_rmse": 0.05381274907399123,
350
+ "sample_count": 16
351
+ },
352
+ {
353
+ "field": "energy_kwh",
354
+ "horizon_minutes": 60,
355
+ "action_effect_mae": 2.5439432162370426,
356
+ "action_effect_rmse": 2.899216326544431,
357
+ "sample_count": 16
358
+ },
359
+ {
360
+ "field": "indoor_temp",
361
+ "horizon_minutes": 120,
362
+ "action_effect_mae": 1.9916754505368175,
363
+ "action_effect_rmse": 2.950815602864714,
364
+ "sample_count": 16
365
+ },
366
+ {
367
+ "field": "mass_temp",
368
+ "horizon_minutes": 120,
369
+ "action_effect_mae": 0.1253993327000673,
370
+ "action_effect_rmse": 0.16649383273574456,
371
+ "sample_count": 16
372
+ },
373
+ {
374
+ "field": "energy_kwh",
375
+ "horizon_minutes": 120,
376
+ "action_effect_mae": 3.7776643394874094,
377
+ "action_effect_rmse": 4.546433490206043,
378
+ "sample_count": 16
379
+ }
380
+ ],
381
+ "ranking_comparable_pairs": 13,
382
+ "ranking_accuracy": 0.6923076923076923,
383
+ "mean_regret_degC_squared": 8.84957192407689
384
+ },
385
+ {
386
+ "cohort": "parameter_shift_2node",
387
+ "model": "history_linear_system_id",
388
+ "sample_count": 16,
389
+ "effects": [
390
+ {
391
+ "field": "indoor_temp",
392
+ "horizon_minutes": 15,
393
+ "action_effect_mae": 1.1433774926786884,
394
+ "action_effect_rmse": 1.5124840088622833,
395
+ "sample_count": 16
396
+ },
397
+ {
398
+ "field": "mass_temp",
399
+ "horizon_minutes": 15,
400
+ "action_effect_mae": 0.0005406143512178829,
401
+ "action_effect_rmse": 0.0006723619363045372,
402
+ "sample_count": 16
403
+ },
404
+ {
405
+ "field": "energy_kwh",
406
+ "horizon_minutes": 15,
407
+ "action_effect_mae": 0.15884217079396568,
408
+ "action_effect_rmse": 0.21446888690731306,
409
+ "sample_count": 16
410
+ },
411
+ {
412
+ "field": "indoor_temp",
413
+ "horizon_minutes": 30,
414
+ "action_effect_mae": 1.9652919392702088,
415
+ "action_effect_rmse": 2.6389189733222076,
416
+ "sample_count": 16
417
+ },
418
+ {
419
+ "field": "mass_temp",
420
+ "horizon_minutes": 30,
421
+ "action_effect_mae": 0.0016652010085149715,
422
+ "action_effect_rmse": 0.002184213681367584,
423
+ "sample_count": 16
424
+ },
425
+ {
426
+ "field": "energy_kwh",
427
+ "horizon_minutes": 30,
428
+ "action_effect_mae": 0.3317435515928031,
429
+ "action_effect_rmse": 0.4397416722226582,
430
+ "sample_count": 16
431
+ },
432
+ {
433
+ "field": "indoor_temp",
434
+ "horizon_minutes": 60,
435
+ "action_effect_mae": 3.21712000638128,
436
+ "action_effect_rmse": 3.931883638293644,
437
+ "sample_count": 16
438
+ },
439
+ {
440
+ "field": "mass_temp",
441
+ "horizon_minutes": 60,
442
+ "action_effect_mae": 0.0054118109247465185,
443
+ "action_effect_rmse": 0.007075494165032193,
444
+ "sample_count": 16
445
+ },
446
+ {
447
+ "field": "energy_kwh",
448
+ "horizon_minutes": 60,
449
+ "action_effect_mae": 0.740521003006118,
450
+ "action_effect_rmse": 0.9507302056719876,
451
+ "sample_count": 16
452
+ },
453
+ {
454
+ "field": "indoor_temp",
455
+ "horizon_minutes": 120,
456
+ "action_effect_mae": 3.4657996975548793,
457
+ "action_effect_rmse": 4.2740744343782335,
458
+ "sample_count": 16
459
+ },
460
+ {
461
+ "field": "mass_temp",
462
+ "horizon_minutes": 120,
463
+ "action_effect_mae": 0.014477995162645696,
464
+ "action_effect_rmse": 0.017891494938079934,
465
+ "sample_count": 16
466
+ },
467
+ {
468
+ "field": "energy_kwh",
469
+ "horizon_minutes": 120,
470
+ "action_effect_mae": 1.3763058666503785,
471
+ "action_effect_rmse": 1.8008052404373094,
472
+ "sample_count": 16
473
+ }
474
+ ],
475
+ "ranking_comparable_pairs": 13,
476
+ "ranking_accuracy": 0.6153846153846154,
477
+ "mean_regret_degC_squared": 26.594845533617782
478
+ },
479
+ {
480
+ "cohort": "parameter_shift_2node",
481
+ "model": "persistence",
482
+ "sample_count": 16,
483
+ "effects": [
484
+ {
485
+ "field": "indoor_temp",
486
+ "horizon_minutes": 15,
487
+ "action_effect_mae": 1.0250664211215113,
488
+ "action_effect_rmse": 1.8028350796104138,
489
+ "sample_count": 16
490
+ },
491
+ {
492
+ "field": "mass_temp",
493
+ "horizon_minutes": 15,
494
+ "action_effect_mae": 0.000412841017036536,
495
+ "action_effect_rmse": 0.0007310218720341981,
496
+ "sample_count": 16
497
+ },
498
+ {
499
+ "field": "energy_kwh",
500
+ "horizon_minutes": 15,
501
+ "action_effect_mae": 0.12816891279450138,
502
+ "action_effect_rmse": 0.20382310878561952,
503
+ "sample_count": 16
504
+ },
505
+ {
506
+ "field": "indoor_temp",
507
+ "horizon_minutes": 30,
508
+ "action_effect_mae": 1.830946447091714,
509
+ "action_effect_rmse": 3.1774373640395086,
510
+ "sample_count": 16
511
+ },
512
+ {
513
+ "field": "mass_temp",
514
+ "horizon_minutes": 30,
515
+ "action_effect_mae": 0.0015319047557005305,
516
+ "action_effect_rmse": 0.002686597583960336,
517
+ "sample_count": 16
518
+ },
519
+ {
520
+ "field": "energy_kwh",
521
+ "horizon_minutes": 30,
522
+ "action_effect_mae": 0.2676304019204412,
523
+ "action_effect_rmse": 0.41919410833848403,
524
+ "sample_count": 16
525
+ },
526
+ {
527
+ "field": "indoor_temp",
528
+ "horizon_minutes": 60,
529
+ "action_effect_mae": 3.4763366184245834,
530
+ "action_effect_rmse": 5.129950934992006,
531
+ "sample_count": 16
532
+ },
533
+ {
534
+ "field": "mass_temp",
535
+ "horizon_minutes": 60,
536
+ "action_effect_mae": 0.005696493079064391,
537
+ "action_effect_rmse": 0.009258230634837846,
538
+ "sample_count": 16
539
+ },
540
+ {
541
+ "field": "energy_kwh",
542
+ "horizon_minutes": 60,
543
+ "action_effect_mae": 0.6037065390234144,
544
+ "action_effect_rmse": 0.8874567793189667,
545
+ "sample_count": 16
546
+ },
547
+ {
548
+ "field": "indoor_temp",
549
+ "horizon_minutes": 120,
550
+ "action_effect_mae": 4.932939145105796,
551
+ "action_effect_rmse": 6.366260183841524,
552
+ "sample_count": 16
553
+ },
554
+ {
555
+ "field": "mass_temp",
556
+ "horizon_minutes": 120,
557
+ "action_effect_mae": 0.020161831187375467,
558
+ "action_effect_rmse": 0.026901814254096598,
559
+ "sample_count": 16
560
+ },
561
+ {
562
+ "field": "energy_kwh",
563
+ "horizon_minutes": 120,
564
+ "action_effect_mae": 1.2517715738053719,
565
+ "action_effect_rmse": 1.6438101625225194,
566
+ "sample_count": 16
567
+ }
568
+ ],
569
+ "ranking_comparable_pairs": 13,
570
+ "ranking_accuracy": 0.5,
571
+ "mean_regret_degC_squared": 19.35963094920246
572
+ },
573
+ {
574
+ "cohort": "small_room_3node",
575
+ "model": "foundation_model",
576
+ "sample_count": 16,
577
+ "effects": [
578
+ {
579
+ "field": "indoor_temp",
580
+ "horizon_minutes": 15,
581
+ "action_effect_mae": 0.8767140816597144,
582
+ "action_effect_rmse": 1.2602809985618095,
583
+ "sample_count": 16
584
+ },
585
+ {
586
+ "field": "mass_temp",
587
+ "horizon_minutes": 15,
588
+ "action_effect_mae": 0.012429628285375582,
589
+ "action_effect_rmse": 0.022239928030842498,
590
+ "sample_count": 16
591
+ },
592
+ {
593
+ "field": "energy_kwh",
594
+ "horizon_minutes": 15,
595
+ "action_effect_mae": 0.606961211617496,
596
+ "action_effect_rmse": 0.6859013110982052,
597
+ "sample_count": 16
598
+ },
599
+ {
600
+ "field": "indoor_temp",
601
+ "horizon_minutes": 30,
602
+ "action_effect_mae": 1.5047918345928601,
603
+ "action_effect_rmse": 2.328225337033118,
604
+ "sample_count": 16
605
+ },
606
+ {
607
+ "field": "mass_temp",
608
+ "horizon_minutes": 30,
609
+ "action_effect_mae": 0.02748426726902653,
610
+ "action_effect_rmse": 0.04441336879045282,
611
+ "sample_count": 16
612
+ },
613
+ {
614
+ "field": "energy_kwh",
615
+ "horizon_minutes": 30,
616
+ "action_effect_mae": 1.1840619787887001,
617
+ "action_effect_rmse": 1.320526632231042,
618
+ "sample_count": 16
619
+ },
620
+ {
621
+ "field": "indoor_temp",
622
+ "horizon_minutes": 60,
623
+ "action_effect_mae": 1.8662814202885802,
624
+ "action_effect_rmse": 2.7141922178285345,
625
+ "sample_count": 16
626
+ },
627
+ {
628
+ "field": "mass_temp",
629
+ "horizon_minutes": 60,
630
+ "action_effect_mae": 0.08079486736449104,
631
+ "action_effect_rmse": 0.10963668393059003,
632
+ "sample_count": 16
633
+ },
634
+ {
635
+ "field": "energy_kwh",
636
+ "horizon_minutes": 60,
637
+ "action_effect_mae": 1.9843406224552653,
638
+ "action_effect_rmse": 2.3824353488074967,
639
+ "sample_count": 16
640
+ },
641
+ {
642
+ "field": "indoor_temp",
643
+ "horizon_minutes": 120,
644
+ "action_effect_mae": 2.3435384335566027,
645
+ "action_effect_rmse": 2.7404573152779848,
646
+ "sample_count": 16
647
+ },
648
+ {
649
+ "field": "mass_temp",
650
+ "horizon_minutes": 120,
651
+ "action_effect_mae": 0.1961508381052518,
652
+ "action_effect_rmse": 0.282324832204521,
653
+ "sample_count": 16
654
+ },
655
+ {
656
+ "field": "energy_kwh",
657
+ "horizon_minutes": 120,
658
+ "action_effect_mae": 3.7296034067834807,
659
+ "action_effect_rmse": 4.626867007767064,
660
+ "sample_count": 16
661
+ }
662
+ ],
663
+ "ranking_comparable_pairs": 10,
664
+ "ranking_accuracy": 0.8,
665
+ "mean_regret_degC_squared": 2.660399445005255
666
+ },
667
+ {
668
+ "cohort": "small_room_3node",
669
+ "model": "history_linear_system_id",
670
+ "sample_count": 16,
671
+ "effects": [
672
+ {
673
+ "field": "indoor_temp",
674
+ "horizon_minutes": 15,
675
+ "action_effect_mae": 0.9402621041485266,
676
+ "action_effect_rmse": 1.5183092944905492,
677
+ "sample_count": 16
678
+ },
679
+ {
680
+ "field": "mass_temp",
681
+ "horizon_minutes": 15,
682
+ "action_effect_mae": 0.008951623758586269,
683
+ "action_effect_rmse": 0.010798569641325438,
684
+ "sample_count": 16
685
+ },
686
+ {
687
+ "field": "energy_kwh",
688
+ "horizon_minutes": 15,
689
+ "action_effect_mae": 0.03803369867779688,
690
+ "action_effect_rmse": 0.054636380217583096,
691
+ "sample_count": 16
692
+ },
693
+ {
694
+ "field": "indoor_temp",
695
+ "horizon_minutes": 30,
696
+ "action_effect_mae": 1.8556263952994758,
697
+ "action_effect_rmse": 2.844641409855803,
698
+ "sample_count": 16
699
+ },
700
+ {
701
+ "field": "mass_temp",
702
+ "horizon_minutes": 30,
703
+ "action_effect_mae": 0.029974362128682597,
704
+ "action_effect_rmse": 0.040160773554367715,
705
+ "sample_count": 16
706
+ },
707
+ {
708
+ "field": "energy_kwh",
709
+ "horizon_minutes": 30,
710
+ "action_effect_mae": 0.06384974448511777,
711
+ "action_effect_rmse": 0.09707044933169796,
712
+ "sample_count": 16
713
+ },
714
+ {
715
+ "field": "indoor_temp",
716
+ "horizon_minutes": 60,
717
+ "action_effect_mae": 2.4575200765508236,
718
+ "action_effect_rmse": 3.4916387146284578,
719
+ "sample_count": 16
720
+ },
721
+ {
722
+ "field": "mass_temp",
723
+ "horizon_minutes": 60,
724
+ "action_effect_mae": 0.09331126348105767,
725
+ "action_effect_rmse": 0.1299378526589725,
726
+ "sample_count": 16
727
+ },
728
+ {
729
+ "field": "energy_kwh",
730
+ "horizon_minutes": 60,
731
+ "action_effect_mae": 0.11890294182181271,
732
+ "action_effect_rmse": 0.1833419083808375,
733
+ "sample_count": 16
734
+ },
735
+ {
736
+ "field": "indoor_temp",
737
+ "horizon_minutes": 120,
738
+ "action_effect_mae": 2.4677421679889338,
739
+ "action_effect_rmse": 2.9696009835360484,
740
+ "sample_count": 16
741
+ },
742
+ {
743
+ "field": "mass_temp",
744
+ "horizon_minutes": 120,
745
+ "action_effect_mae": 0.21098148675686024,
746
+ "action_effect_rmse": 0.27617138088416276,
747
+ "sample_count": 16
748
+ },
749
+ {
750
+ "field": "energy_kwh",
751
+ "horizon_minutes": 120,
752
+ "action_effect_mae": 0.20393316026950947,
753
+ "action_effect_rmse": 0.27499510048490655,
754
+ "sample_count": 16
755
+ }
756
+ ],
757
+ "ranking_comparable_pairs": 10,
758
+ "ranking_accuracy": 0.8,
759
+ "mean_regret_degC_squared": 1.215336255613826
760
+ },
761
+ {
762
+ "cohort": "small_room_3node",
763
+ "model": "persistence",
764
+ "sample_count": 16,
765
+ "effects": [
766
+ {
767
+ "field": "indoor_temp",
768
+ "horizon_minutes": 15,
769
+ "action_effect_mae": 0.8087640014917343,
770
+ "action_effect_rmse": 1.6992210644787389,
771
+ "sample_count": 16
772
+ },
773
+ {
774
+ "field": "mass_temp",
775
+ "horizon_minutes": 15,
776
+ "action_effect_mae": 0.0045880184984599115,
777
+ "action_effect_rmse": 0.008937693912503103,
778
+ "sample_count": 16
779
+ },
780
+ {
781
+ "field": "energy_kwh",
782
+ "horizon_minutes": 15,
783
+ "action_effect_mae": 0.021008467119171648,
784
+ "action_effect_rmse": 0.0451326380733191,
785
+ "sample_count": 16
786
+ },
787
+ {
788
+ "field": "indoor_temp",
789
+ "horizon_minutes": 30,
790
+ "action_effect_mae": 1.5535490946615613,
791
+ "action_effect_rmse": 3.1640125374625043,
792
+ "sample_count": 16
793
+ },
794
+ {
795
+ "field": "mass_temp",
796
+ "horizon_minutes": 30,
797
+ "action_effect_mae": 0.021378155011888222,
798
+ "action_effect_rmse": 0.04152587691284955,
799
+ "sample_count": 16
800
+ },
801
+ {
802
+ "field": "energy_kwh",
803
+ "horizon_minutes": 30,
804
+ "action_effect_mae": 0.042857777090698046,
805
+ "action_effect_rmse": 0.09108964062758883,
806
+ "sample_count": 16
807
+ },
808
+ {
809
+ "field": "indoor_temp",
810
+ "horizon_minutes": 60,
811
+ "action_effect_mae": 1.8323960502994412,
812
+ "action_effect_rmse": 3.914088900253609,
813
+ "sample_count": 16
814
+ },
815
+ {
816
+ "field": "mass_temp",
817
+ "horizon_minutes": 60,
818
+ "action_effect_mae": 0.06803636544464531,
819
+ "action_effect_rmse": 0.13484085035245816,
820
+ "sample_count": 16
821
+ },
822
+ {
823
+ "field": "energy_kwh",
824
+ "horizon_minutes": 60,
825
+ "action_effect_mae": 0.08926394955617684,
826
+ "action_effect_rmse": 0.18126218024164384,
827
+ "sample_count": 16
828
+ },
829
+ {
830
+ "field": "indoor_temp",
831
+ "horizon_minutes": 120,
832
+ "action_effect_mae": 1.6474832148071799,
833
+ "action_effect_rmse": 3.107536526248188,
834
+ "sample_count": 16
835
+ },
836
+ {
837
+ "field": "mass_temp",
838
+ "horizon_minutes": 120,
839
+ "action_effect_mae": 0.1519573616030584,
840
+ "action_effect_rmse": 0.2903318155332886,
841
+ "sample_count": 16
842
+ },
843
+ {
844
+ "field": "energy_kwh",
845
+ "horizon_minutes": 120,
846
+ "action_effect_mae": 0.15616887135203578,
847
+ "action_effect_rmse": 0.3159780211252609,
848
+ "sample_count": 16
849
+ }
850
+ ],
851
+ "ranking_comparable_pairs": 10,
852
+ "ranking_accuracy": 0.5,
853
+ "mean_regret_degC_squared": 89.30202913463818
854
+ }
855
+ ],
856
+ "true_effect_summary": [
857
+ {
858
+ "cohort": "parameter_shift_2node",
859
+ "field": "indoor_temp",
860
+ "horizon_minutes": 15,
861
+ "mean_absolute_true_effect": 1.0250664211215113,
862
+ "nonzero_effect_snapshots": 8,
863
+ "snapshot_count": 16
864
+ },
865
+ {
866
+ "cohort": "parameter_shift_2node",
867
+ "field": "indoor_temp",
868
+ "horizon_minutes": 30,
869
+ "mean_absolute_true_effect": 1.830946447091714,
870
+ "nonzero_effect_snapshots": 8,
871
+ "snapshot_count": 16
872
+ },
873
+ {
874
+ "cohort": "parameter_shift_2node",
875
+ "field": "indoor_temp",
876
+ "horizon_minutes": 60,
877
+ "mean_absolute_true_effect": 3.4763366184245834,
878
+ "nonzero_effect_snapshots": 11,
879
+ "snapshot_count": 16
880
+ },
881
+ {
882
+ "cohort": "parameter_shift_2node",
883
+ "field": "indoor_temp",
884
+ "horizon_minutes": 120,
885
+ "mean_absolute_true_effect": 4.932939145105796,
886
+ "nonzero_effect_snapshots": 13,
887
+ "snapshot_count": 16
888
+ },
889
+ {
890
+ "cohort": "parameter_shift_2node",
891
+ "field": "mass_temp",
892
+ "horizon_minutes": 15,
893
+ "mean_absolute_true_effect": 0.000412841017036536,
894
+ "nonzero_effect_snapshots": 8,
895
+ "snapshot_count": 16
896
+ },
897
+ {
898
+ "cohort": "parameter_shift_2node",
899
+ "field": "mass_temp",
900
+ "horizon_minutes": 30,
901
+ "mean_absolute_true_effect": 0.0015319047557005305,
902
+ "nonzero_effect_snapshots": 8,
903
+ "snapshot_count": 16
904
+ },
905
+ {
906
+ "cohort": "parameter_shift_2node",
907
+ "field": "mass_temp",
908
+ "horizon_minutes": 60,
909
+ "mean_absolute_true_effect": 0.005696493079064391,
910
+ "nonzero_effect_snapshots": 11,
911
+ "snapshot_count": 16
912
+ },
913
+ {
914
+ "cohort": "parameter_shift_2node",
915
+ "field": "mass_temp",
916
+ "horizon_minutes": 120,
917
+ "mean_absolute_true_effect": 0.020161831187375467,
918
+ "nonzero_effect_snapshots": 13,
919
+ "snapshot_count": 16
920
+ },
921
+ {
922
+ "cohort": "parameter_shift_2node",
923
+ "field": "energy_kwh",
924
+ "horizon_minutes": 15,
925
+ "mean_absolute_true_effect": 0.12816891279450138,
926
+ "nonzero_effect_snapshots": 8,
927
+ "snapshot_count": 16
928
+ },
929
+ {
930
+ "cohort": "parameter_shift_2node",
931
+ "field": "energy_kwh",
932
+ "horizon_minutes": 30,
933
+ "mean_absolute_true_effect": 0.2676304019204412,
934
+ "nonzero_effect_snapshots": 8,
935
+ "snapshot_count": 16
936
+ },
937
+ {
938
+ "cohort": "parameter_shift_2node",
939
+ "field": "energy_kwh",
940
+ "horizon_minutes": 60,
941
+ "mean_absolute_true_effect": 0.6037065390234144,
942
+ "nonzero_effect_snapshots": 11,
943
+ "snapshot_count": 16
944
+ },
945
+ {
946
+ "cohort": "parameter_shift_2node",
947
+ "field": "energy_kwh",
948
+ "horizon_minutes": 120,
949
+ "mean_absolute_true_effect": 1.2517715738053719,
950
+ "nonzero_effect_snapshots": 13,
951
+ "snapshot_count": 16
952
+ },
953
+ {
954
+ "cohort": "small_room_3node",
955
+ "field": "indoor_temp",
956
+ "horizon_minutes": 15,
957
+ "mean_absolute_true_effect": 0.8087640014917343,
958
+ "nonzero_effect_snapshots": 7,
959
+ "snapshot_count": 16
960
+ },
961
+ {
962
+ "cohort": "small_room_3node",
963
+ "field": "indoor_temp",
964
+ "horizon_minutes": 30,
965
+ "mean_absolute_true_effect": 1.5535490946615613,
966
+ "nonzero_effect_snapshots": 7,
967
+ "snapshot_count": 16
968
+ },
969
+ {
970
+ "cohort": "small_room_3node",
971
+ "field": "indoor_temp",
972
+ "horizon_minutes": 60,
973
+ "mean_absolute_true_effect": 1.8323960502994412,
974
+ "nonzero_effect_snapshots": 7,
975
+ "snapshot_count": 16
976
+ },
977
+ {
978
+ "cohort": "small_room_3node",
979
+ "field": "indoor_temp",
980
+ "horizon_minutes": 120,
981
+ "mean_absolute_true_effect": 1.6474832148071799,
982
+ "nonzero_effect_snapshots": 10,
983
+ "snapshot_count": 16
984
+ },
985
+ {
986
+ "cohort": "small_room_3node",
987
+ "field": "mass_temp",
988
+ "horizon_minutes": 15,
989
+ "mean_absolute_true_effect": 0.0045880184984599115,
990
+ "nonzero_effect_snapshots": 7,
991
+ "snapshot_count": 16
992
+ },
993
+ {
994
+ "cohort": "small_room_3node",
995
+ "field": "mass_temp",
996
+ "horizon_minutes": 30,
997
+ "mean_absolute_true_effect": 0.021378155011888222,
998
+ "nonzero_effect_snapshots": 7,
999
+ "snapshot_count": 16
1000
+ },
1001
+ {
1002
+ "cohort": "small_room_3node",
1003
+ "field": "mass_temp",
1004
+ "horizon_minutes": 60,
1005
+ "mean_absolute_true_effect": 0.06803636544464531,
1006
+ "nonzero_effect_snapshots": 7,
1007
+ "snapshot_count": 16
1008
+ },
1009
+ {
1010
+ "cohort": "small_room_3node",
1011
+ "field": "mass_temp",
1012
+ "horizon_minutes": 120,
1013
+ "mean_absolute_true_effect": 0.1519573616030584,
1014
+ "nonzero_effect_snapshots": 10,
1015
+ "snapshot_count": 16
1016
+ },
1017
+ {
1018
+ "cohort": "small_room_3node",
1019
+ "field": "energy_kwh",
1020
+ "horizon_minutes": 15,
1021
+ "mean_absolute_true_effect": 0.021008467119171648,
1022
+ "nonzero_effect_snapshots": 7,
1023
+ "snapshot_count": 16
1024
+ },
1025
+ {
1026
+ "cohort": "small_room_3node",
1027
+ "field": "energy_kwh",
1028
+ "horizon_minutes": 30,
1029
+ "mean_absolute_true_effect": 0.042857777090698046,
1030
+ "nonzero_effect_snapshots": 7,
1031
+ "snapshot_count": 16
1032
+ },
1033
+ {
1034
+ "cohort": "small_room_3node",
1035
+ "field": "energy_kwh",
1036
+ "horizon_minutes": 60,
1037
+ "mean_absolute_true_effect": 0.08926394955617684,
1038
+ "nonzero_effect_snapshots": 7,
1039
+ "snapshot_count": 16
1040
+ },
1041
+ {
1042
+ "cohort": "small_room_3node",
1043
+ "field": "energy_kwh",
1044
+ "horizon_minutes": 120,
1045
+ "mean_absolute_true_effect": 0.15616887135203578,
1046
+ "nonzero_effect_snapshots": 10,
1047
+ "snapshot_count": 16
1048
+ },
1049
+ {
1050
+ "cohort": "auditorium_3node",
1051
+ "field": "indoor_temp",
1052
+ "horizon_minutes": 15,
1053
+ "mean_absolute_true_effect": 0.04755446866276547,
1054
+ "nonzero_effect_snapshots": 15,
1055
+ "snapshot_count": 16
1056
+ },
1057
+ {
1058
+ "cohort": "auditorium_3node",
1059
+ "field": "indoor_temp",
1060
+ "horizon_minutes": 30,
1061
+ "mean_absolute_true_effect": 0.12462930493172497,
1062
+ "nonzero_effect_snapshots": 15,
1063
+ "snapshot_count": 16
1064
+ },
1065
+ {
1066
+ "cohort": "auditorium_3node",
1067
+ "field": "indoor_temp",
1068
+ "horizon_minutes": 60,
1069
+ "mean_absolute_true_effect": 0.275309445659932,
1070
+ "nonzero_effect_snapshots": 16,
1071
+ "snapshot_count": 16
1072
+ },
1073
+ {
1074
+ "cohort": "auditorium_3node",
1075
+ "field": "indoor_temp",
1076
+ "horizon_minutes": 120,
1077
+ "mean_absolute_true_effect": 0.5078931197695817,
1078
+ "nonzero_effect_snapshots": 16,
1079
+ "snapshot_count": 16
1080
+ },
1081
+ {
1082
+ "cohort": "auditorium_3node",
1083
+ "field": "mass_temp",
1084
+ "horizon_minutes": 15,
1085
+ "mean_absolute_true_effect": 8.214917146620593e-05,
1086
+ "nonzero_effect_snapshots": 15,
1087
+ "snapshot_count": 16
1088
+ },
1089
+ {
1090
+ "cohort": "auditorium_3node",
1091
+ "field": "mass_temp",
1092
+ "horizon_minutes": 30,
1093
+ "mean_absolute_true_effect": 0.00046879179395975523,
1094
+ "nonzero_effect_snapshots": 15,
1095
+ "snapshot_count": 16
1096
+ },
1097
+ {
1098
+ "cohort": "auditorium_3node",
1099
+ "field": "mass_temp",
1100
+ "horizon_minutes": 60,
1101
+ "mean_absolute_true_effect": 0.002277111246946517,
1102
+ "nonzero_effect_snapshots": 16,
1103
+ "snapshot_count": 16
1104
+ },
1105
+ {
1106
+ "cohort": "auditorium_3node",
1107
+ "field": "mass_temp",
1108
+ "horizon_minutes": 120,
1109
+ "mean_absolute_true_effect": 0.009367321593782618,
1110
+ "nonzero_effect_snapshots": 16,
1111
+ "snapshot_count": 16
1112
+ },
1113
+ {
1114
+ "cohort": "auditorium_3node",
1115
+ "field": "energy_kwh",
1116
+ "horizon_minutes": 15,
1117
+ "mean_absolute_true_effect": 0.5734549882911328,
1118
+ "nonzero_effect_snapshots": 15,
1119
+ "snapshot_count": 16
1120
+ },
1121
+ {
1122
+ "cohort": "auditorium_3node",
1123
+ "field": "energy_kwh",
1124
+ "horizon_minutes": 30,
1125
+ "mean_absolute_true_effect": 1.6851368221106022,
1126
+ "nonzero_effect_snapshots": 15,
1127
+ "snapshot_count": 16
1128
+ },
1129
+ {
1130
+ "cohort": "auditorium_3node",
1131
+ "field": "energy_kwh",
1132
+ "horizon_minutes": 60,
1133
+ "mean_absolute_true_effect": 3.7818242732765563,
1134
+ "nonzero_effect_snapshots": 16,
1135
+ "snapshot_count": 16
1136
+ },
1137
+ {
1138
+ "cohort": "auditorium_3node",
1139
+ "field": "energy_kwh",
1140
+ "horizon_minutes": 120,
1141
+ "mean_absolute_true_effect": 7.3838131816985175,
1142
+ "nonzero_effect_snapshots": 16,
1143
+ "snapshot_count": 16
1144
+ }
1145
+ ],
1146
+ "limitation": "Independently implemented synthetic equations, not external real-world validation. Only two candidate plans and 16 snapshots per cohort by default; saturation can remove the actual action effect. Ranking/regret applies solely to the declared indoor-temperature objective; no energy/safety/controller claim."
1147
+ }
studies/robustness-seed42-20261011/artifacts/robustness/challenge-interventions/verification.json ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "status": "verified",
3
+ "observed_plan_max_replay_error": 0.0,
4
+ "outputs_sha256": {
5
+ "interventions.json": "c558198983e314b8d9fb3b860c9031dabdc91797a2806349bb66b3d19433a7b0",
6
+ "provenance.json": "35977663cd38d3ca6dbd3edf7c0768174d6ddbf2288797dbcdea13e541de92c6",
7
+ "summary.json": "1580aacc75ecafabd59a2990eaf69d7964a6323bdd16989a79dc56c72c71a452"
8
+ },
9
+ "verified_bindings": [
10
+ "checkpoint",
11
+ "normalization",
12
+ "manifest",
13
+ "generator",
14
+ "source_files",
15
+ "test_episode_files",
16
+ "sampled_anchor_records",
17
+ "provenance"
18
+ ]
19
+ }
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/README.md ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # CityLearn third-party battery device validation
2
+
3
+ These episodes execute the actual unmodified `citylearn.energy_model.Battery` from PyPI CityLearn 3.0.2. This is third-party synthetic device physics validation, not real-world, building, or full CityLearn control-environment validation. Only native SOC is available as a state. Temperature, voltage, and ambient temperature are omitted, not fabricated.
4
+
5
+ The command schedule is fixed before any transitions and is requested electrical kW within canonical +/-20kW. Each command is converted to kWh using 900/3600 hours and passed to native Battery.charge with time_step_ratio=1. Native SOC/power limits, efficiency curves, depth of discharge, degradation, and standby losses execute unchanged. The native call order advances time (losses), then charges. Realized energy/power is stored separately in native-audit; it never enters history/future action tensors. There is no reinterpretation of a CityLearn environment action fraction or thermostat setpoint.
6
+
7
+ Load with `scripts.citylearn_validation.load_citylearn_windows(manifest, saved_training_normalization, cohort=None)`. It uses the unchanged WindowDataset and never imports CityLearn, refits normalization, or reads native-audit. This tests SOC generalization while exposing only history SOC and planned electrical commands.
8
+
9
+ Generate: `PYTHONPATH=/private/tmp/tfm-citylearn-runtime OMP_NUM_THREADS=1 OPENBLAS_NUM_THREADS=1 .venv/bin/python -m scripts.citylearn_validation`. The temporary runtime contains CityLearn and only its device-path import dependencies, including NumPy 1.26.4 to honor CityLearn's NumPy<2 declaration. No second torch, OpenStudio, Gymnasium, DOE data, or torchvision was installed. The active .venv and lockfile are untouched. Source hashes, installed versions, system seeds, parameter draws, canonical and audit hashes are in manifest.json.
10
+
11
+ Official API documentation: https://www.citylearn.net/api/citylearn.energy_model.html
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "version": "citylearn-device-validation-1.0",
3
+ "systems_per_cohort": 24,
4
+ "steps": 192,
5
+ "seed": 183127,
6
+ "seconds_per_time_step": 900,
7
+ "time_step_ratio": 1.0
8
+ }
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283127.npz ADDED
Binary file (6.85 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283128.npz ADDED
Binary file (7.42 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283129.npz ADDED
Binary file (7.64 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283130.npz ADDED
Binary file (7.25 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283131.npz ADDED
Binary file (7.37 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283132.npz ADDED
Binary file (7.31 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283133.npz ADDED
Binary file (7.29 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283134.npz ADDED
Binary file (6.92 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283135.npz ADDED
Binary file (7.4 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283136.npz ADDED
Binary file (7.46 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283137.npz ADDED
Binary file (7.26 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283138.npz ADDED
Binary file (7.16 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283139.npz ADDED
Binary file (7.54 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283140.npz ADDED
Binary file (7.53 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283141.npz ADDED
Binary file (7.15 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283142.npz ADDED
Binary file (7.26 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283143.npz ADDED
Binary file (7.45 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283144.npz ADDED
Binary file (7.06 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283145.npz ADDED
Binary file (7.17 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283146.npz ADDED
Binary file (7.22 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283147.npz ADDED
Binary file (7.2 kB). View file
 
studies/robustness-seed42-20261011/artifacts/robustness/citylearn/episodes/citylearn-device-citylearn_battery_common_scale-283148.npz ADDED
Binary file (7.35 kB). View file