Spaces:
Running on Zero
Running on Zero
research: align paper outline with evaluation tools
Browse files- PAPER_OUTLINE.md +10 -0
PAPER_OUTLINE.md
CHANGED
|
@@ -21,6 +21,10 @@ generated geometry, uncertainty, and lighting evidence separate?
|
|
| 21 |
- Uncertainty, projection-coverage, and reprojection diagnostics.
|
| 22 |
- Depth-normal photometric light hypothesis and shareable reveal artifacts.
|
| 23 |
- Manifest claims contract, artifact hashes, and run summarization.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
|
| 25 |
## Preliminary reproducibility evidence
|
| 26 |
|
|
@@ -68,6 +72,12 @@ points labeled observed that are supported by an input view. Report failure
|
|
| 68 |
cases separately for reflective, textureless, transparent, and highly
|
| 69 |
occluded objects. Do not call relative-depth outputs metric reconstruction.
|
| 70 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
## Honest success criterion
|
| 72 |
|
| 73 |
The method is successful only if held-out-view metrics and provenance-aware
|
|
|
|
| 21 |
- Uncertainty, projection-coverage, and reprojection diagnostics.
|
| 22 |
- Depth-normal photometric light hypothesis and shareable reveal artifacts.
|
| 23 |
- Manifest claims contract, artifact hashes, and run summarization.
|
| 24 |
+
- Reproducible depth evaluation for paired arrays and JSONL datasets, with raw
|
| 25 |
+
versus median-scaled reporting.
|
| 26 |
+
- Reproducible point-cloud/Gaussian evaluation using symmetric Chamfer,
|
| 27 |
+
precision, recall, and F-score, plus calibrated-capture manifest validation.
|
| 28 |
|
| 29 |
## Preliminary reproducibility evidence
|
| 30 |
|
|
|
|
| 72 |
cases separately for reflective, textureless, transparent, and highly
|
| 73 |
occluded objects. Do not call relative-depth outputs metric reconstruction.
|
| 74 |
|
| 75 |
+
Before scoring, validate the capture manifest with
|
| 76 |
+
`validate_capture_manifest.py`; then use `evaluate_depth_dataset.py` and
|
| 77 |
+
`evaluate_pointcloud_dataset.py` to retain per-sample failures and aggregate
|
| 78 |
+
metrics. The current synthetic geometry benchmark is a contract test for
|
| 79 |
+
projection/fusion determinism, not a learned-model quality result.
|
| 80 |
+
|
| 81 |
## Honest success criterion
|
| 82 |
|
| 83 |
The method is successful only if held-out-view metrics and provenance-aware
|