junaid-simamdigital commited on
Commit
5c8dbf5
·
verified ·
1 Parent(s): 4fb7c31

research: align paper outline with evaluation tools

Browse files
Files changed (1) hide show
  1. PAPER_OUTLINE.md +10 -0
PAPER_OUTLINE.md CHANGED
@@ -21,6 +21,10 @@ generated geometry, uncertainty, and lighting evidence separate?
21
  - Uncertainty, projection-coverage, and reprojection diagnostics.
22
  - Depth-normal photometric light hypothesis and shareable reveal artifacts.
23
  - Manifest claims contract, artifact hashes, and run summarization.
 
 
 
 
24
 
25
  ## Preliminary reproducibility evidence
26
 
@@ -68,6 +72,12 @@ points labeled observed that are supported by an input view. Report failure
68
  cases separately for reflective, textureless, transparent, and highly
69
  occluded objects. Do not call relative-depth outputs metric reconstruction.
70
 
 
 
 
 
 
 
71
  ## Honest success criterion
72
 
73
  The method is successful only if held-out-view metrics and provenance-aware
 
21
  - Uncertainty, projection-coverage, and reprojection diagnostics.
22
  - Depth-normal photometric light hypothesis and shareable reveal artifacts.
23
  - Manifest claims contract, artifact hashes, and run summarization.
24
+ - Reproducible depth evaluation for paired arrays and JSONL datasets, with raw
25
+ versus median-scaled reporting.
26
+ - Reproducible point-cloud/Gaussian evaluation using symmetric Chamfer,
27
+ precision, recall, and F-score, plus calibrated-capture manifest validation.
28
 
29
  ## Preliminary reproducibility evidence
30
 
 
72
  cases separately for reflective, textureless, transparent, and highly
73
  occluded objects. Do not call relative-depth outputs metric reconstruction.
74
 
75
+ Before scoring, validate the capture manifest with
76
+ `validate_capture_manifest.py`; then use `evaluate_depth_dataset.py` and
77
+ `evaluate_pointcloud_dataset.py` to retain per-sample failures and aggregate
78
+ metrics. The current synthetic geometry benchmark is a contract test for
79
+ projection/fusion determinism, not a learned-model quality result.
80
+
81
  ## Honest success criterion
82
 
83
  The method is successful only if held-out-view metrics and provenance-aware