KBlueLeaf commited on
Commit
24879fd
·
verified ·
1 Parent(s): dd4e57f

Model card: possible downstream uses

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -72,6 +72,22 @@ Frozen attentive probe, mean top-1 over 3 seeds (TT-VidT evaluation protocol, 8
72
  | paper TT3D (full-linear resample, 407.8M) | 24.8 | 35.4 | 86.6 | 72.9 | 25.9 |
73
  | this checkpoint (structured resample, 195.5M) | 25.2 | 36.1 | 86.0 | 72.9 | 25.4 |
74
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
  ## License
76
 
77
  Apache-2.0. The spatial path is initialised from DINOv3, which has its own license.
 
72
  | paper TT3D (full-linear resample, 407.8M) | 24.8 | 35.4 | 86.6 | 72.9 | 25.9 |
73
  | this checkpoint (structured resample, 195.5M) | 25.2 | 36.1 | 86.0 | 72.9 | 25.4 |
74
 
75
+ ## Possible downstream uses
76
+
77
+ The encoder gives a compact sequence of per-frame motion tokens alongside the
78
+ DINOv3 appearance features. Some directions we think are worth trying:
79
+
80
+ - **From image models to video models**: pair an existing image model with the
81
+ motion token sequence to get a video model for understanding in the broad
82
+ sense: classification, retrieval, captioning, question answering, or any
83
+ other task.
84
+ - **Generation and motion transfer**: use the motion tokens as a conditioning
85
+ signal for video generation, or take them from one clip and apply them to
86
+ another subject or scene.
87
+
88
+ Further exploration and feedback are very welcome, and so are attempts at larger
89
+ scale (bigger backbones, more data, longer training).
90
+
91
  ## License
92
 
93
  Apache-2.0. The spatial path is initialised from DINOv3, which has its own license.