Spaces:
Running on Zero
Running on Zero
File size: 1,639 Bytes
7591a5b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 | # Benchmark Dataset Directory
This directory provides an isolated, standardized benchmark harness for testing deepfake detectors.
## Directory Structure
```text
benchmark/
βββ README.md
βββ metadata.json
βββ images/
β βββ real/ # Ground-truth photographic images
β βββ ai_generated/ # Ground-truth synthetically generated images
β βββ manipulated/ # Ground-truth edited/spliced images
β βββ corrupted/ # Corrupted or malformed files for rejection testing
βββ results/ # Benchmark execution outputs (JSON and CSV)
```
## Input Availability & Addition Protocol
In accordance with strict repository isolation rules:
- No files were copied from local workspaces or external paths outside this Space repository.
- No ground-truth labels were fabricated.
### How to Manually Add Benchmark Images
1. Place natural photographs into `benchmark/images/real/`.
2. Place AI-generated images (e.g., from Diffusion, GAN, or Flow-Matching models) into `benchmark/images/ai_generated/`.
3. Place edited or composite images into `benchmark/images/manipulated/`.
4. Place truncated or corrupted test files into `benchmark/images/corrupted/`.
5. Update `benchmark/metadata.json` with the filename, category, and verified ground-truth origin. If ground truth cannot be verified with documentary proof, mark `ground_truth: "UNKNOWN"`.
## Non-Authenticity Disclaimer
This benchmark framework is an operational diagnostic tool. Successful execution does not imply detector accuracy, and consensus across models does not verify photographic authenticity.
|