sdzt commited on
Commit
43c0e77
·
verified ·
1 Parent(s): 28b66c3

Add model card

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen2.5-VL-7B-Instruct
4
+ pipeline_tag: video-text-to-text
5
+ library_name: transformers
6
+ tags:
7
+ - temporal-forgery-localization
8
+ - video-forensics
9
+ - grpo
10
+ ---
11
+
12
+ # ForgeLoc-R1 checkpoints
13
+
14
+ Qwen2.5-VL-7B-Instruct fine-tuned with GRPO to localize the manipulated segments of a video.
15
+ Every folder holds a full checkpoint in Hugging Face format.
16
+
17
+ | Folder | Model | Training data | Test mIoU (%) |
18
+ |---|---|---|---|
19
+ | `af` | ForgeLoc-R1 | ActivityForensics | 64.27 |
20
+ | `ddl` | ForgeLoc-R1 | DDL | 53.03 |
21
+ | `baselines/af_grpo` | GRPO | ActivityForensics | 51.28 |
22
+ | `baselines/af_video-r1` | Video-R1 | ActivityForensics | 54.29 |
23
+ | `baselines/af_tempsamp-r1` | TempSamp-R1 | ActivityForensics | 59.93 |
24
+ | `baselines/ddl_grpo` | GRPO | DDL | 31.89 |
25
+ | `baselines/ddl_video-r1` | Video-R1 | DDL | 33.25 |
26
+ | `baselines/ddl_tempsamp-r1` | TempSamp-R1 | DDL | 50.92 |
27
+ | `ablations/af_noanchor` | without anchor injection | ActivityForensics | 58.61 |
28
+ | `ablations/af_noprune` | without advantage pruning | ActivityForensics | 62.05 |
29
+ | `ablations/af_noos` | without count balancing (m=1) | ActivityForensics | 59.53 |
30
+ | `ablations/af_notransform` | without the asymmetric advantage transform | ActivityForensics | 62.90 |
31
+ | `ablations/af_bestoverlap` | set term replaced by the best-overlap soft F1 | ActivityForensics | 65.35 |
32
+ | `ablations/af_g16` | G'=16 | ActivityForensics | 63.53 |
33
+ | `ablations/af_eps0.01` | Sinkhorn coefficient 0.01 | ActivityForensics | 63.49 |
34
+ | `ablations/af_seed7` | ForgeLoc-R1, seed 7 | ActivityForensics | 63.27 |
35
+ | `ablations/ddl_noos` | without count balancing (m=1) | DDL | 50.17 |
36
+
37
+ mIoU is measured on the test splits: 1,565 ActivityForensics videos and 1,500 DDL videos.
38
+
39
+ ```python
40
+ from transformers import AutoProcessor, Qwen2_5_VLForConditionalGeneration
41
+
42
+ model = Qwen2_5_VLForConditionalGeneration.from_pretrained(
43
+ "sdzt/ForgeLoc-R1", subfolder="af", torch_dtype="bfloat16", device_map="auto"
44
+ )
45
+ processor = AutoProcessor.from_pretrained("sdzt/ForgeLoc-R1", subfolder="af")
46
+ ```