Publish DeepVerify V1 Model Bundle
Browse files- README.md +34 -0
- frequency/metadata.json +22 -0
- frequency/model_best.pth +3 -0
- manifest.json +21 -0
- spatial/metadata.json +22 -0
- spatial/model_best.pth +3 -0
README.md
ADDED
|
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- deepfake-detection
|
| 4 |
+
- computer-vision
|
| 5 |
+
- efficientnet
|
| 6 |
+
- forensics
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# DeepVerify V1 Models
|
| 10 |
+
|
| 11 |
+
DeepVerify is an AI-generated/manipulated media detection project.
|
| 12 |
+
This repository contains the V1 production model bundle, utilizing a 60/40 spatial-frequency probability ensemble.
|
| 13 |
+
|
| 14 |
+
## Models Included
|
| 15 |
+
|
| 16 |
+
1. **Spatial Model (EXP-001)**
|
| 17 |
+
- Architecture: EfficientNet-B0
|
| 18 |
+
- Representation: Spatial RGB
|
| 19 |
+
- Weight: 60% of ensemble
|
| 20 |
+
|
| 21 |
+
2. **Frequency Model (EXP-002)**
|
| 22 |
+
- Architecture: EfficientNet-B0
|
| 23 |
+
- Representation: Frequency-domain log-magnitude FFT
|
| 24 |
+
- Weight: 40% of ensemble
|
| 25 |
+
|
| 26 |
+
## Input & Output
|
| 27 |
+
- **Expected Input**: 224x224 RGB image
|
| 28 |
+
- **Output Interpretation**: Both models predict `P(REAL)`. The final ensemble score is `0.60 * Spatial_P(REAL) + 0.40 * Frequency_P(REAL)`. A score `>= 0.5` is considered `LIKELY_AUTHENTIC`, while `< 0.5` is considered `LIKELY_AI_GENERATED`.
|
| 29 |
+
|
| 30 |
+
## Limitations
|
| 31 |
+
- **Dataset Limitations**: Trained exclusively on the 140k Real and Fake Faces v1.0 benchmark. Does not guarantee out-of-distribution generalization to all generative models or non-face semantics.
|
| 32 |
+
- **Model Limitations**: This model is **not** a universal deepfake detector. It is highly specific to the domain it was trained on.
|
| 33 |
+
- **Confidence**: The probability score is a statistical confidence metric, **not** absolute ground truth.
|
| 34 |
+
- **Explainability**: Spatial Grad-CAM visual evidence indicates regions of model activation/saliency. It is **not** causal proof of manipulation.
|
frequency/metadata.json
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"experiment_id": "EXP-002",
|
| 3 |
+
"run_id": "run_20261008_080128_559d2631",
|
| 4 |
+
"architecture": "EfficientNet-B0",
|
| 5 |
+
"pretrained_initialization": "ImageNet",
|
| 6 |
+
"input_size": [
|
| 7 |
+
3,
|
| 8 |
+
224,
|
| 9 |
+
224
|
| 10 |
+
],
|
| 11 |
+
"preprocessing_representation": "Frequency-domain log-magnitude FFT",
|
| 12 |
+
"class_convention": "0=REAL, 1=FAKE",
|
| 13 |
+
"probability_convention": "P(REAL)",
|
| 14 |
+
"dataset_version": "140k-real-and-fake-faces-v1.0",
|
| 15 |
+
"checkpoint_filename": "model_best.pth",
|
| 16 |
+
"sha256": "507f9d6cf9aadc633d336f236df140555f4847fdc29697a8fc576a3fe3aa4c52",
|
| 17 |
+
"relevant_metrics": {
|
| 18 |
+
"test_accuracy": "81.73%",
|
| 19 |
+
"test_roc_auc": "0.9014"
|
| 20 |
+
},
|
| 21 |
+
"known_limitations": "Trained on 140k face benchmark. Not a universal deepfake detector."
|
| 22 |
+
}
|
frequency/model_best.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:507f9d6cf9aadc633d336f236df140555f4847fdc29697a8fc576a3fe3aa4c52
|
| 3 |
+
size 48606264
|
manifest.json
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model_bundle_version": "v1.0.0",
|
| 3 |
+
"ensemble_weights": {
|
| 4 |
+
"spatial": 0.6,
|
| 5 |
+
"frequency": 0.4
|
| 6 |
+
},
|
| 7 |
+
"models": {
|
| 8 |
+
"spatial": {
|
| 9 |
+
"experiment_id": "EXP-001",
|
| 10 |
+
"run_id": "run_20261007_141902_9e04eeda",
|
| 11 |
+
"checkpoint_filename": "spatial/model_best.pth",
|
| 12 |
+
"sha256": "b05a302c9283783fdc7352abe967baa4e4ab278028a2ba08cf40bd290e521d03"
|
| 13 |
+
},
|
| 14 |
+
"frequency": {
|
| 15 |
+
"experiment_id": "EXP-002",
|
| 16 |
+
"run_id": "run_20261008_080128_559d2631",
|
| 17 |
+
"checkpoint_filename": "frequency/model_best.pth",
|
| 18 |
+
"sha256": "507f9d6cf9aadc633d336f236df140555f4847fdc29697a8fc576a3fe3aa4c52"
|
| 19 |
+
}
|
| 20 |
+
}
|
| 21 |
+
}
|
spatial/metadata.json
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"experiment_id": "EXP-001",
|
| 3 |
+
"run_id": "run_20261007_141902_9e04eeda",
|
| 4 |
+
"architecture": "EfficientNet-B0",
|
| 5 |
+
"pretrained_initialization": "ImageNet",
|
| 6 |
+
"input_size": [
|
| 7 |
+
3,
|
| 8 |
+
224,
|
| 9 |
+
224
|
| 10 |
+
],
|
| 11 |
+
"preprocessing_representation": "Spatial RGB",
|
| 12 |
+
"class_convention": "0=REAL, 1=FAKE",
|
| 13 |
+
"probability_convention": "P(REAL)",
|
| 14 |
+
"dataset_version": "140k-real-and-fake-faces-v1.0",
|
| 15 |
+
"checkpoint_filename": "model_best.pth",
|
| 16 |
+
"sha256": "b05a302c9283783fdc7352abe967baa4e4ab278028a2ba08cf40bd290e521d03",
|
| 17 |
+
"relevant_metrics": {
|
| 18 |
+
"test_accuracy": "99.895%",
|
| 19 |
+
"test_roc_auc": "0.999995"
|
| 20 |
+
},
|
| 21 |
+
"known_limitations": "Trained on 140k face benchmark. Not a universal deepfake detector."
|
| 22 |
+
}
|
spatial/model_best.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b05a302c9283783fdc7352abe967baa4e4ab278028a2ba08cf40bd290e521d03
|
| 3 |
+
size 48606264
|