heygen-zujin commited on
Commit
07badfe
·
1 Parent(s): a49ab67

Release cross-scene benchmark data (benchmark_data.json); update README

Browse files
Files changed (2) hide show
  1. README.md +12 -6
  2. benchmark_data.json +0 -0
README.md CHANGED
@@ -82,17 +82,23 @@ Qualitative results and comparisons against baselines are on the
82
  [project page](https://gseancdat.github.io/projects/TAVR.html).
83
 
84
  On the cross-scene benchmark, TAVR yields the best identity similarity and an overall quality
85
- score of 16.42 against 14.13 for the next best method. The benchmark data is not part of this
86
- release.
 
 
 
 
 
 
 
 
 
87
 
88
  ## Release Progress
89
 
90
  - [x] Model weights
91
  - [x] Inference code
92
- - [ ] Evaluation code
93
- - [ ] Cross-scene benchmark data
94
-
95
- 🚧 The remaining items are being prepared for release.
96
 
97
  ## Citation
98
 
 
82
  [project page](https://gseancdat.github.io/projects/TAVR.html).
83
 
84
  On the cross-scene benchmark, TAVR yields the best identity similarity and an overall quality
85
+ score of 16.42 against 14.13 for the next best method.
86
+
87
+ ### Cross-scene benchmark data
88
+
89
+ `benchmark_data.json` lists the 158 reference/target pairs of the cross-scene benchmark. The clips
90
+ come from the public [TalkVid](https://github.com/FreedomIntelligence/TalkVid) dataset. Each sample has:
91
+
92
+ | field | content |
93
+ |---|---|
94
+ | `reference`, `target` | `video_id`, `video_url`, `start_time` / `end_time` (seconds), `start_frame` / `end_frame` at the source `fps`, `width`, `height` |
95
+ | `target_caption` | scene caption used as the text prompt |
96
 
97
  ## Release Progress
98
 
99
  - [x] Model weights
100
  - [x] Inference code
101
+ - [x] Cross-scene benchmark data
 
 
 
102
 
103
  ## Citation
104
 
benchmark_data.json ADDED
The diff for this file is too large to render. See raw diff