Point evaluation at the reproduction guide, with a short main-branch variant.

README.md

@@ -9,69 +9,13 @@ tags:
   - opfdata
 ---
 
-Reproduction guide: [GENCO §5.2](https://github.com/gridfm/gridfm-paper-genco/blob/main/repro_instructions/5.2_OPF_on_opfdata.md).
-
 GENCO optimal-power-flow checkpoints on OPFData ([paper](https://arxiv.org/abs/2608.09921)): IEEE 14, 30, 57, and 118, and GOC 500 and 2000, seeds 42, 3, and 17.
 
-## Evaluate
-
-Use graphkit branch [genco-paper-repro](https://github.com/gridfm/gridfm-graphkit/tree/genco-paper-repro). Graphkit requires Python 3.10, 3.11, or 3.12. The paper numbers come from this branch. [Evaluate on main](#evaluate-on-main) is the same checkpoints on current `main`.
-
-```bash
-git clone -b genco-paper-repro https://github.com/gridfm/gridfm-graphkit.git
-cd gridfm-graphkit
-pip install -e .
-pip install huggingface_hub
-TORCH_CUDA_VERSION=$(python -c "import torch; print(torch.__version__ + ('+cpu' if torch.version.cuda is None else ''))")
-pip install torch-scatter -f https://data.pyg.org/whl/torch-${TORCH_CUDA_VERSION}.html
-export MLFLOW_ALLOW_FILE_STORE=true
-```
-
-Run the commands below from that repo root. Graphkit loads `{data_path}/{network}/raw/*.parquet`. Configs are in [`scripts/opfdata/configs`](https://github.com/gridfm/gridfm-graphkit/tree/genco-paper-repro/scripts/opfdata/configs). Copy `splits/` to `scripts/opfdata/splits/` before evaluating. Each checkpoint folder has `best_model_state_dict.pt` and `normalizer_stats.pt`.
-
-| Grid | Dataset | `network` folder |
-|---|---|---|
-| IEEE 14 | [gridfm/opfdata_case14_ieee](https://huggingface.co/datasets/gridfm/opfdata_case14_ieee) | `case14_ieee` |
-| IEEE 30 | [gridfm/opfdata_case30_ieee](https://huggingface.co/datasets/gridfm/opfdata_case30_ieee) | `case30_ieee` |
-| IEEE 57 | [gridfm/opfdata_case57_ieee](https://huggingface.co/datasets/gridfm/opfdata_case57_ieee) | `case57_ieee` |
-| IEEE 118 | [gridfm/opfdata_case118_ieee](https://huggingface.co/datasets/gridfm/opfdata_case118_ieee) | `case118_ieee` |
-| GOC 500 | [gridfm/opfdata_case500_goc](https://huggingface.co/datasets/gridfm/opfdata_case500_goc) | `case500_goc` |
-| GOC 2000 | [gridfm/opfdata_case2000_goc](https://huggingface.co/datasets/gridfm/opfdata_case2000_goc) | `case2000_goc` |
-
-```bash
-mkdir -p data/case118_ieee/raw scripts/opfdata/splits
-hf download gridfm/opfdata_case118_ieee --repo-type dataset --local-dir data/case118_ieee/raw
-hf download gridfm/genco-opfdata --include "case118_ieee/seed42/**" --include "splits/**" --local-dir genco-opfdata
-cp genco-opfdata/splits/*.pt scripts/opfdata/splits/
-
-gridfm_graphkit evaluate \
-  --config scripts/opfdata/configs/HGNSQ_penalty_11_OPFData_case118_default.yaml \
-  --data_path data \
-  --model_path genco-opfdata/case118_ieee/seed42/best_model_state_dict.pt \
-  --normalizer_stats genco-opfdata/case118_ieee/seed42/normalizer_stats.pt \
-  --batch_size 512
-```
-
-Repeat for the other grids and seeds. Download each dataset into `data/<network>/raw`. The first `evaluate` writes one graph file per scenario before testing.
-
-## Evaluate on main
+Evaluate on the paper branch by following [GENCO §5.2](https://github.com/gridfm/gridfm-paper-genco/blob/main/repro_instructions/5.2_OPF_on_opfdata.md). That guide uses graphkit [genco-paper-repro](https://github.com/gridfm/gridfm-graphkit/tree/genco-paper-repro) and is how the paper numbers were produced.
 
-The same checkpoints run on current [main](https://github.com/gridfm/gridfm-graphkit/tree/main). This was checked at commit `f104900`. `main` does not ship these YAML files, and it rejects them as config version 0. Use the YAML downloaded with the checkpoint, and pass `--config_conversion auto_inline`. That upgrades the config in memory and leaves the file unchanged. The config still reads splits from `scripts/opfdata/splits/` relative to the repository root.
+Or evaluate the same checkpoints on graphkit [main](https://github.com/gridfm/gridfm-graphkit/tree/main). `main` is under development, so the same numbers are not guaranteed. They matched the paper-branch result for IEEE 14, seed 42, at commit [`f104900`](https://github.com/gridfm/gridfm-graphkit/commit/f104900245cba26d1380037eea562cf633a97484) (1 October 2026). Clone `main` instead of `genco-paper-repro`, follow the rest of the install and the downloads in the guide, then run:
 
 ```bash
-git clone https://github.com/gridfm/gridfm-graphkit.git
-cd gridfm-graphkit
-pip install -e .
-pip install huggingface_hub
-TORCH_CUDA_VERSION=$(python -c "import torch; print(torch.__version__ + ('+cpu' if torch.version.cuda is None else ''))")
-pip install torch-scatter -f https://data.pyg.org/whl/torch-${TORCH_CUDA_VERSION}.html
-export MLFLOW_ALLOW_FILE_STORE=true
-
-mkdir -p data/case118_ieee/raw scripts/opfdata/splits
-hf download gridfm/opfdata_case118_ieee --repo-type dataset --local-dir data/case118_ieee/raw
-hf download gridfm/genco-opfdata --include "case118_ieee/seed42/**" --include "splits/**" --local-dir genco-opfdata
-cp genco-opfdata/splits/*.pt scripts/opfdata/splits/
-
 gridfm_graphkit evaluate \
   --config_conversion auto_inline \
   --config genco-opfdata/case118_ieee/seed42/HGNSQ_penalty_11_OPFData_case118_default.yaml \
@@ -81,18 +25,4 @@ gridfm_graphkit evaluate \
   --batch_size 512
 ```
 
-Repeat for the other grids and seeds. On IEEE 14, seed 42, this matched the reproduction-branch evaluation.
-
-## Files
-
-```
-{case14_ieee,case30_ieee,case57_ieee,case118_ieee,case500_goc,case2000_goc}/seed{42,3,17}/
-  best_model_state_dict.pt
-  normalizer_stats.pt
-  metrics.csv
-  HGNSQ_penalty_11_OPFData_<case>_<default|3|17>.yaml
-splits/
-  train.pt  val.pt  test.pt  shuffled_indices.pt
-mlflow/train/
-mlflow/eval/
-```
+`main` does not ship the paper YAML and rejects it as config version 0. `--config_conversion auto_inline` upgrades that file in memory. The YAML is the one downloaded with the checkpoint. Repeat for the other grids and seeds.