TwinD / README.md
yermandy's picture
Update README.md
b87d624 verified
|
Raw History Blame Contribute Delete
4.23 kB
---
license: cc-by-nc-4.0
pipeline_tag: image-classification
tags:
- decision-model
base_model:
- timm/PE-Core-L-14-336
- facebook/PE-Core-L14-336
---
# TwinD: Generalizing Deepfake Detection from Blending to Entire Face Synthesis
This repository contains the TwinD model presented in [TwinD: Generalizing Deepfake Detection from Blending to Entire Face Synthesis](https://huggingface.co/papers/2611.25935).
[![arXiv Badge](https://img.shields.io/badge/arXiv-B31B1B?logo=arxiv&logoColor=FFF)](https://arxiv.org/abs/2611.25935)
[![GitHub Badge](https://img.shields.io/badge/GitHub-181717?logo=github&logoColor=fff)](https://github.com/yermandy/TwinD)
![Overview of TwinD: reconstruction and blob twins of a real frame, training pairs of a fake and its real frame, and the mean AUROC on EFS and blending datasets](https://huggingface.co/yermandy/TwinD/resolve/main/fig/overview.png)
Video-level AUROC (%) of SOTA methods on 19 datasets sorted by their macro-average (Avg). Above the dataset names are
their release years. † A temporal model, which takes several frames as input in a single forward pass.
| | Blending | | | | | | | | | | Blending + EFS | | | | EFS | | | | | |
| :-- | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: | --: |
| | 2019 | 2020 | 2020 | 2021 | 2021 | 2022 | 2024 | 2024 | 2024 | 2025 | 2025 | 2025 | 2025 | 2026 | 2026 | 2026 | 2026 | 2026 | 2026 | |
| | DFD | FSh | CDFv2 | FFIW | FAVC | DFDM | PGF | IDF | DSv1 | HiDF | CDFv3 | DSv2 | RF | HF | THB | OF | DFAV | MV | DF26 | **Avg** |
| *AIGC detectors* | | | | | | | | | | | | | | | | | | | | |
| Effort-SDv1.4 | 51.5 | 58.9 | 48.8 | 56.5 | 55.4 | 55.3 | 38.4 | 63.7 | 31.6 | 55.0 | 63.5 | 51.5 | 79.4 | 75.8 | 79.6 | 77.3 | 48.9 | 38.6 | 62.3 | 57.5 |
| DGS-Net | 58.4 | 71.9 | 55.4 | 73.6 | 45.1 | 72.8 | 49.4 | 38.1 | 41.5 | 47.8 | 71.9 | 41.7 | 56.8 | 66.2 | 66.0 | 49.0 | 68.5 | 69.8 | 75.0 | 58.9 |
| LTD-UFD | 83.3 | 77.2 | 57.2 | 72.6 | 61.9 | 52.1 | 60.4 | 50.9 | 47.2 | 64.6 | 66.2 | 38.7 | 64.1 | 53.2 | 75.9 | 30.8 | 75.1 | 55.9 | 87.6 | 61.8 |
| AlignedFor. | 55.0 | 62.9 | 61.0 | 78.3 | 93.2 | 65.5 | 56.8 | 93.7 | 43.0 | 47.8 | 28.6 | 74.8 | 68.8 | 90.3 | 93.5 | 56.9 | 83.6 | 40.0 | 67.8 | 66.4 |
| DDA | 64.4 | 53.2 | 55.5 | 57.5 | 73.8 | 51.6 | 60.2 | 70.2 | 71.2 | 66.8 | 60.4 | 84.2 | 75.4 | 97.0 | 85.3 | 36.5 | 93.5 | 71.2 | 75.1 | 68.6 |
| B-Free | 69.4 | 69.6 | 57.1 | 58.1 | 79.9 | 74.6 | 78.5 | 75.8 | 82.0 | 69.4 | 59.5 | 82.7 | 77.2 | **98.5** | 86.2 | 48.6 | 91.6 | 74.8 | 68.0 | 73.8 |
| *Facial deepfake detectors* | | | | | | | | | | | | | | | | | | | | |
| SBI | 90.2 | 77.2 | 87.5 | 90.9 | 98.7 | 99.8 | 75.0 | 98.4 | 63.1 | 82.1 | 59.9 | 59.2 | 62.1 | 61.4 | 71.2 | 75.9 | 57.8 | 43.3 | 60.1 | 74.4 |
| FSFM | 90.8 | 72.2 | 90.5 | 78.4 | 90.9 | 96.8 | 85.8 | 82.5 | 83.5 | 91.9 | 79.6 | 69.0 | 66.2 | 72.1 | 47.4 | 49.5 | 74.2 | 62.7 | 52.6 | 75.6 |
| ForAda | 98.1 | 81.3 | 95.5 | 92.8 | 93.1 | 97.3 | 87.3 | 90.7 | 83.0 | 91.6 | 75.6 | 73.3 | 69.5 | 57.5 | 60.2 | 65.1 | 73.1 | 65.7 | 56.5 | 79.3 |
| Effort | 96.6 | 91.3 | 93.4 | 95.1 | 92.4 | 98.1 | 86.8 | 96.0 | 83.2 | 90.9 | 78.7 | 65.3 | 64.8 | 62.6 | 73.1 | 75.4 | 72.5 | 57.1 | 44.0 | 79.9 |
| DFD-FCG† | 94.7 | 91.8 | 94.0 | 94.0 | 90.6 | 99.6 | 78.5 | 92.8 | 82.7 | 94.6 | **93.1** | 78.5 | 64.5 | 65.6 | 75.3 | 76.0 | 65.2 | 65.4 | 53.0 | 81.6 |
| VLAForge | 98.1 | 92.9 | 95.0 | 96.8 | 94.5 | 99.5 | 89.7 | 97.6 | 87.0 | 93.9 | 72.4 | 70.0 | 69.0 | 57.9 | 77.2 | 71.7 | 74.0 | 62.8 | 54.3 | 81.8 |
| FS-VFM | 97.8 | 80.7 | 94.4 | 92.0 | 97.4 | 98.4 | 90.8 | 94.7 | 92.3 | 97.3 | 85.0 | 79.5 | 74.6 | 77.7 | 61.9 | 67.3 | 81.7 | 60.1 | 57.7 | 83.2 |
| DFD-HR | 98.7 | 92.9 | 94.2 | 98.0 | 98.7 | 99.7 | 94.6 | 98.7 | 90.7 | 96.3 | 81.6 | 83.2 | 67.5 | 59.6 | 81.2 | 74.8 | 86.3 | 80.8 | 63.4 | 86.4 |
| GenD-PE | 98.6 | 88.3 | 95.9 | 95.4 | 97.5 | 98.8 | 94.3 | 98.0 | 89.8 | 93.7 | 89.9 | 78.5 | 76.6 | 75.3 | 83.7 | 72.3 | 85.1 | 79.8 | 69.7 | 87.4 |
| **TwinD** | **98.9** | **96.8** | **97.1** | **98.9** | **99.9** | **99.9** | **97.3** | **99.5** | **93.5** | **98.7** | 90.4 | **92.1** | **92.3** | 96.1 | **98.5** | **94.9** | **93.7** | **95.0** | **95.8** | **96.3** |