LianJC commited on
Commit
623e09f
·
verified ·
1 Parent(s): 26ebbc3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: bsd-3-clause
3
+ library_name: pytorch
4
+ pipeline_tag: image-classification
5
+ tags:
6
+ - facial-forgery-detection
7
+ - multi-label-classification
8
+ - vit
9
+ - deepfake
10
+ - acl-2026
11
+ ---
12
+
13
+ # Face-ViT: Multi-Label Facial Forgery Region Classifier
14
+
15
+ ## 📖 Model Description
16
+ This is the **Face-ViT** auxiliary perception module proposed in the ACL 2026 paper:
17
+ *"Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baseline"*.
18
+
19
+ Face-ViT is a multi-label classifier based on the **ViT-H/14** architecture. It is specifically trained to recognize 21 different types of facial manipulations (e.g., eye modification, skin smoothing, mouth tampering). In the DFF framework, it provides fine-grained visual cues that guide the large language model to generate accurate forensic explanations.
20
+
21
+ ## 🛠️ Model Details
22
+ - **Architecture**: ViT-H/14 with an additional CNN branch and max-pooling for multi-label support.
23
+ - **Input Size**: 224x224 RGB images.
24
+ - **Number of Classes**: 21 (Facial attributes/manipulation types).
25
+ - **Training Objective**: Joint loss including BCE, Focal, Dice, and Jaccard loss.
26
+
27
+ ## 🚀 Links
28
+ - **Official Code**: [Generating-Attribution-Reports](https://github.com/JingchunLian/Generating-Attribution-Reports)
29
+ - **Main Framework (DFF)**: [LianJC/DFF-InstructBLIP-Detection](https://huggingface.co/LianJC/DFF-InstructBLIP-Detection)
30
+ - **Dataset (MMTT)**: [LianJC/MMTT-Dataset](https://huggingface.co/datasets/LianJC/MMTT-Dataset)
31
+
32
+ ## 📜 Citation
33
+ If you find this model useful, please cite:
34
+ ```bibtex
35
+ @inproceedings{lian2026generating,
36
+ title={Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baseline},
37
+ author={Lian, Jingchun and others},
38
+ booktitle={Proceedings of ACL},
39
+ year={2026},
40
+ note={To appear}
41
+ }