Spaces:
Running on Zero
Running on Zero
File size: 4,199 Bytes
7591a5b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 | # Requirements Specification for Future Secondary Detector Integration
**Target Space**: [`https://huggingface.co/spaces/Thiru1122/Multimodel_setup`](https://huggingface.co/spaces/Thiru1122/Multimodel_setup)
**Purpose**: Defines the mandatory technical specifications and artifacts required before any secondary detector (e.g. ViT, RAID, or other architecture) can be integrated into the multi-model benchmark framework.
---
## Required Specification Checklist
To prevent integration failures, unverified assumptions, or runtime crashes, any candidate detector proposed for integration must provide complete, verified answers to the following 14 requirements:
### 1. Repository & Code Source
- Exact public GitHub or Hugging Face repository URL.
- Specific commit SHA or release tag to pin for reproducibility.
### 2. Software & Model License
- Formal license type (e.g., MIT, Apache 2.0, Non-Commercial CC-BY-NC).
- Confirmation of compatibility with Hugging Face Spaces hosting.
### 3. Model Architecture & Backbone
- Base neural network architecture (e.g., `google/vit-base-patch16-224`, `timm/vit_large_patch14_224`, `ResNet50`).
- Any custom classification neck, pooling layer, or multi-scale projection heads.
### 4. Checkpoint Location & Integrity
- Accessible public download URL or Hugging Face model hub identifier (`repo_id`).
- SHA256 checksum of the weight file.
- Exact filename and format (e.g., `pytorch_model.bin`, `model.safetensors`, `model.pth`).
- Confirmation whether the checkpoint contains the full model or classification head only.
### 5. Input Modality
- Explicit confirmation that the model evaluates single static images (or frame sequences).
### 6. Input Dimensions & Aspect Ratio
- Target tensor resolution (e.g., $224 \times 224$, $384 \times 384$, or variable).
- Aspect ratio handling (e.g., isotropic scaling with padding vs. anisotropic bicubic resize vs. center cropping).
### 7. Preprocessing Transform Pipeline
- Exact color space (RGB, BGR, or Grayscale).
- Resizing interpolation mode (Bilinear, Bicubic, Lanczos).
- Cropping strategy (Center crop, random crop, or no crop).
- Tensor scaling (range `[0.0, 1.0]` vs. `[-1.0, 1.0]` vs. `[0, 255]`).
- Exact channel mean and standard deviation vectors for normalization.
### 8. Output Format & Tensor Shape
- Number of output logits:
- Binary single scalar logit (`[batch, 1]`), OR
- Two-class logits (`[batch, 2]` for `[real_logit, fake_logit]`), OR
- Softmax probability distribution.
### 9. Label Mapping
- Explicit class indexing:
- Which index/sign corresponds to **REAL** (e.g., index `0` or negative logit).
- Which index/sign corresponds to **FAKE** (e.g., index `1` or positive logit).
### 10. Operational Decision Threshold
- Author-defined threshold value (e.g., $0.50$, $0.65$, or logit $0.00$).
- Calibration details (whether Platt scaling or temperature scaling is required).
### 11. Confidence Calculation Formula
- Mathematical formula used to compute user-facing confidence percentage from logits/probabilities.
### 12. Device & Memory Footprint
- Peak GPU VRAM required during batch=1 inference.
- Host system RAM required to load weights into memory.
- Compatibility with Hugging Face ZeroGPU (`zero-a10g`) and PyTorch CPU execution.
### 13. Inference Function & Entry Point
- Python function signature for single-image execution (e.g., `predict(image: PIL.Image) -> float`).
- Whether model loading can be decoupled and executed lazily once at startup.
### 14. Dependency Requirements & Conflicts
- Required Python library versions (`transformers`, `timm`, `torchvision`, etc.).
- Confirmation of no conflicting dependencies with existing UniversalFakeDetect requirements.
---
## 15. Labeled Benchmark Evaluation Data
Before performing comparative benchmarking, a curated set of test images with documentary proof of ground-truth origin must be supplied:
- Verified natural photographs (diverse camera sensors, lighting, and subjects).
- Verified legacy GAN synthetic images (ProGAN, StyleGAN2/3).
- Verified modern diffusion synthetic images (Google Imagen, Stable Diffusion XL, Midjourney v6, Flux).
- Localized image manipulations (splicing, inpainting).
|