Neelesh-Babu commited on
Commit
702e9f4
·
verified ·
1 Parent(s): 93ea668

Publish VideoMAE Base ONNX - CC BY-NC 4.0

Browse files
Files changed (4) hide show
  1. LICENSE +400 -0
  2. README.md +176 -0
  3. config.yaml +126 -0
  4. model.onnx +3 -0
LICENSE ADDED
@@ -0,0 +1,400 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ Attribution-NonCommercial 4.0 International
3
+
4
+ =======================================================================
5
+
6
+ Creative Commons Corporation ("Creative Commons") is not a law firm and
7
+ does not provide legal services or legal advice. Distribution of
8
+ Creative Commons public licenses does not create a lawyer-client or
9
+ other relationship. Creative Commons makes its licenses and related
10
+ information available on an "as-is" basis. Creative Commons gives no
11
+ warranties regarding its licenses, any material licensed under their
12
+ terms and conditions, or any related information. Creative Commons
13
+ disclaims all liability for damages resulting from their use to the
14
+ fullest extent possible.
15
+
16
+ Using Creative Commons Public Licenses
17
+
18
+ Creative Commons public licenses provide a standard set of terms and
19
+ conditions that creators and other rights holders may use to share
20
+ original works of authorship and other material subject to copyright
21
+ and certain other rights specified in the public license below. The
22
+ following considerations are for informational purposes only, are not
23
+ exhaustive, and do not form part of our licenses.
24
+
25
+ Considerations for licensors: Our public licenses are
26
+ intended for use by those authorized to give the public
27
+ permission to use material in ways otherwise restricted by
28
+ copyright and certain other rights. Our licenses are
29
+ irrevocable. Licensors should read and understand the terms
30
+ and conditions of the license they choose before applying it.
31
+ Licensors should also secure all rights necessary before
32
+ applying our licenses so that the public can reuse the
33
+ material as expected. Licensors should clearly mark any
34
+ material not subject to the license. This includes other CC-
35
+ licensed material, or material used under an exception or
36
+ limitation to copyright. More considerations for licensors:
37
+ wiki.creativecommons.org/Considerations_for_licensors
38
+
39
+ Considerations for the public: By using one of our public
40
+ licenses, a licensor grants the public permission to use the
41
+ licensed material under specified terms and conditions. If
42
+ the licensor's permission is not necessary for any reason--for
43
+ example, because of any applicable exception or limitation to
44
+ copyright--then that use is not regulated by the license. Our
45
+ licenses grant only permissions under copyright and certain
46
+ other rights that a licensor has authority to grant. Use of
47
+ the licensed material may still be restricted for other
48
+ reasons, including because others have copyright or other
49
+ rights in the material. A licensor may make special requests,
50
+ such as asking that all changes be marked or described.
51
+ Although not required by our licenses, you are encouraged to
52
+ respect those requests where reasonable. More_considerations
53
+ for the public:
54
+ wiki.creativecommons.org/Considerations_for_licensees
55
+
56
+ =======================================================================
57
+
58
+ Creative Commons Attribution-NonCommercial 4.0 International Public
59
+ License
60
+
61
+ By exercising the Licensed Rights (defined below), You accept and agree
62
+ to be bound by the terms and conditions of this Creative Commons
63
+ Attribution-NonCommercial 4.0 International Public License ("Public
64
+ License"). To the extent this Public License may be interpreted as a
65
+ contract, You are granted the Licensed Rights in consideration of Your
66
+ acceptance of these terms and conditions, and the Licensor grants You
67
+ such rights in consideration of benefits the Licensor receives from
68
+ making the Licensed Material available under these terms and
69
+ conditions.
70
+
71
+ Section 1 -- Definitions.
72
+
73
+ a. Adapted Material means material subject to Copyright and Similar
74
+ Rights that is derived from or based upon the Licensed Material
75
+ and in which the Licensed Material is translated, altered,
76
+ arranged, transformed, or otherwise modified in a manner requiring
77
+ permission under the Copyright and Similar Rights held by the
78
+ Licensor. For purposes of this Public License, where the Licensed
79
+ Material is a musical work, performance, or sound recording,
80
+ Adapted Material is always produced where the Licensed Material is
81
+ synched in timed relation with a moving image.
82
+
83
+ b. Adapter's License means the license You apply to Your Copyright
84
+ and Similar Rights in Your contributions to Adapted Material in
85
+ accordance with the terms and conditions of this Public License.
86
+
87
+ c. Copyright and Similar Rights means copyright and/or similar rights
88
+ closely related to copyright including, without limitation,
89
+ performance, broadcast, sound recording, and Sui Generis Database
90
+ Rights, without regard to how the rights are labeled or
91
+ categorized. For purposes of this Public License, the rights
92
+ specified in Section 2(b)(1)-(2) are not Copyright and Similar
93
+ Rights.
94
+ d. Effective Technological Measures means those measures that, in the
95
+ absence of proper authority, may not be circumvented under laws
96
+ fulfilling obligations under Article 11 of the WIPO Copyright
97
+ Treaty adopted on December 20, 1996, and/or similar international
98
+ agreements.
99
+
100
+ e. Exceptions and Limitations means fair use, fair dealing, and/or
101
+ any other exception or limitation to Copyright and Similar Rights
102
+ that applies to Your use of the Licensed Material.
103
+
104
+ f. Licensed Material means the artistic or literary work, database,
105
+ or other material to which the Licensor applied this Public
106
+ License.
107
+
108
+ g. Licensed Rights means the rights granted to You subject to the
109
+ terms and conditions of this Public License, which are limited to
110
+ all Copyright and Similar Rights that apply to Your use of the
111
+ Licensed Material and that the Licensor has authority to license.
112
+
113
+ h. Licensor means the individual(s) or entity(ies) granting rights
114
+ under this Public License.
115
+
116
+ i. NonCommercial means not primarily intended for or directed towards
117
+ commercial advantage or monetary compensation. For purposes of
118
+ this Public License, the exchange of the Licensed Material for
119
+ other material subject to Copyright and Similar Rights by digital
120
+ file-sharing or similar means is NonCommercial provided there is
121
+ no payment of monetary compensation in connection with the
122
+ exchange.
123
+
124
+ j. Share means to provide material to the public by any means or
125
+ process that requires permission under the Licensed Rights, such
126
+ as reproduction, public display, public performance, distribution,
127
+ dissemination, communication, or importation, and to make material
128
+ available to the public including in ways that members of the
129
+ public may access the material from a place and at a time
130
+ individually chosen by them.
131
+
132
+ k. Sui Generis Database Rights means rights other than copyright
133
+ resulting from Directive 96/9/EC of the European Parliament and of
134
+ the Council of 11 March 1996 on the legal protection of databases,
135
+ as amended and/or succeeded, as well as other essentially
136
+ equivalent rights anywhere in the world.
137
+
138
+ l. You means the individual or entity exercising the Licensed Rights
139
+ under this Public License. Your has a corresponding meaning.
140
+
141
+ Section 2 -- Scope.
142
+
143
+ a. License grant.
144
+
145
+ 1. Subject to the terms and conditions of this Public License,
146
+ the Licensor hereby grants You a worldwide, royalty-free,
147
+ non-sublicensable, non-exclusive, irrevocable license to
148
+ exercise the Licensed Rights in the Licensed Material to:
149
+
150
+ a. reproduce and Share the Licensed Material, in whole or
151
+ in part, for NonCommercial purposes only; and
152
+
153
+ b. produce, reproduce, and Share Adapted Material for
154
+ NonCommercial purposes only.
155
+
156
+ 2. Exceptions and Limitations. For the avoidance of doubt, where
157
+ Exceptions and Limitations apply to Your use, this Public
158
+ License does not apply, and You do not need to comply with
159
+ its terms and conditions.
160
+
161
+ 3. Term. The term of this Public License is specified in Section
162
+ 6(a).
163
+
164
+ 4. Media and formats; technical modifications allowed. The
165
+ Licensor authorizes You to exercise the Licensed Rights in
166
+ all media and formats whether now known or hereafter created,
167
+ and to make technical modifications necessary to do so. The
168
+ Licensor waives and/or agrees not to assert any right or
169
+ authority to forbid You from making technical modifications
170
+ necessary to exercise the Licensed Rights, including
171
+ technical modifications necessary to circumvent Effective
172
+ Technological Measures. For purposes of this Public License,
173
+ simply making modifications authorized by this Section 2(a)
174
+ (4) never produces Adapted Material.
175
+
176
+ 5. Downstream recipients.
177
+
178
+ a. Offer from the Licensor -- Licensed Material. Every
179
+ recipient of the Licensed Material automatically
180
+ receives an offer from the Licensor to exercise the
181
+ Licensed Rights under the terms and conditions of this
182
+ Public License.
183
+
184
+ b. No downstream restrictions. You may not offer or impose
185
+ any additional or different terms or conditions on, or
186
+ apply any Effective Technological Measures to, the
187
+ Licensed Material if doing so restricts exercise of the
188
+ Licensed Rights by any recipient of the Licensed
189
+ Material.
190
+
191
+ 6. No endorsement. Nothing in this Public License constitutes or
192
+ may be construed as permission to assert or imply that You
193
+ are, or that Your use of the Licensed Material is, connected
194
+ with, or sponsored, endorsed, or granted official status by,
195
+ the Licensor or others designated to receive attribution as
196
+ provided in Section 3(a)(1)(A)(i).
197
+
198
+ b. Other rights.
199
+
200
+ 1. Moral rights, such as the right of integrity, are not
201
+ licensed under this Public License, nor are publicity,
202
+ privacy, and/or other similar personality rights; however, to
203
+ the extent possible, the Licensor waives and/or agrees not to
204
+ assert any such rights held by the Licensor to the limited
205
+ extent necessary to allow You to exercise the Licensed
206
+ Rights, but not otherwise.
207
+
208
+ 2. Patent and trademark rights are not licensed under this
209
+ Public License.
210
+
211
+ 3. To the extent possible, the Licensor waives any right to
212
+ collect royalties from You for the exercise of the Licensed
213
+ Rights, whether directly or through a collecting society
214
+ under any voluntary or waivable statutory or compulsory
215
+ licensing scheme. In all other cases the Licensor expressly
216
+ reserves any right to collect such royalties, including when
217
+ the Licensed Material is used other than for NonCommercial
218
+ purposes.
219
+
220
+ Section 3 -- License Conditions.
221
+
222
+ Your exercise of the Licensed Rights is expressly made subject to the
223
+ following conditions.
224
+
225
+ a. Attribution.
226
+
227
+ 1. If You Share the Licensed Material (including in modified
228
+ form), You must:
229
+
230
+ a. retain the following if it is supplied by the Licensor
231
+ with the Licensed Material:
232
+
233
+ i. identification of the creator(s) of the Licensed
234
+ Material and any others designated to receive
235
+ attribution, in any reasonable manner requested by
236
+ the Licensor (including by pseudonym if
237
+ designated);
238
+
239
+ ii. a copyright notice;
240
+
241
+ iii. a notice that refers to this Public License;
242
+
243
+ iv. a notice that refers to the disclaimer of
244
+ warranties;
245
+
246
+ v. a URI or hyperlink to the Licensed Material to the
247
+ extent reasonably practicable;
248
+
249
+ b. indicate if You modified the Licensed Material and
250
+ retain an indication of any previous modifications; and
251
+
252
+ c. indicate the Licensed Material is licensed under this
253
+ Public License, and include the text of, or the URI or
254
+ hyperlink to, this Public License.
255
+
256
+ 2. You may satisfy the conditions in Section 3(a)(1) in any
257
+ reasonable manner based on the medium, means, and context in
258
+ which You Share the Licensed Material. For example, it may be
259
+ reasonable to satisfy the conditions by providing a URI or
260
+ hyperlink to a resource that includes the required
261
+ information.
262
+
263
+ 3. If requested by the Licensor, You must remove any of the
264
+ information required by Section 3(a)(1)(A) to the extent
265
+ reasonably practicable.
266
+
267
+ 4. If You Share Adapted Material You produce, the Adapter's
268
+ License You apply must not prevent recipients of the Adapted
269
+ Material from complying with this Public License.
270
+
271
+ Section 4 -- Sui Generis Database Rights.
272
+
273
+ Where the Licensed Rights include Sui Generis Database Rights that
274
+ apply to Your use of the Licensed Material:
275
+
276
+ a. for the avoidance of doubt, Section 2(a)(1) grants You the right
277
+ to extract, reuse, reproduce, and Share all or a substantial
278
+ portion of the contents of the database for NonCommercial purposes
279
+ only;
280
+
281
+ b. if You include all or a substantial portion of the database
282
+ contents in a database in which You have Sui Generis Database
283
+ Rights, then the database in which You have Sui Generis Database
284
+ Rights (but not its individual contents) is Adapted Material; and
285
+
286
+ c. You must comply with the conditions in Section 3(a) if You Share
287
+ all or a substantial portion of the contents of the database.
288
+
289
+ For the avoidance of doubt, this Section 4 supplements and does not
290
+ replace Your obligations under this Public License where the Licensed
291
+ Rights include other Copyright and Similar Rights.
292
+
293
+ Section 5 -- Disclaimer of Warranties and Limitation of Liability.
294
+
295
+ a. UNLESS OTHERWISE SEPARATELY UNDERTAKEN BY THE LICENSOR, TO THE
296
+ EXTENT POSSIBLE, THE LICENSOR OFFERS THE LICENSED MATERIAL AS-IS
297
+ AND AS-AVAILABLE, AND MAKES NO REPRESENTATIONS OR WARRANTIES OF
298
+ ANY KIND CONCERNING THE LICENSED MATERIAL, WHETHER EXPRESS,
299
+ IMPLIED, STATUTORY, OR OTHER. THIS INCLUDES, WITHOUT LIMITATION,
300
+ WARRANTIES OF TITLE, MERCHANTABILITY, FITNESS FOR A PARTICULAR
301
+ PURPOSE, NON-INFRINGEMENT, ABSENCE OF LATENT OR OTHER DEFECTS,
302
+ ACCURACY, OR THE PRESENCE OR ABSENCE OF ERRORS, WHETHER OR NOT
303
+ KNOWN OR DISCOVERABLE. WHERE DISCLAIMERS OF WARRANTIES ARE NOT
304
+ ALLOWED IN FULL OR IN PART, THIS DISCLAIMER MAY NOT APPLY TO YOU.
305
+
306
+ b. TO THE EXTENT POSSIBLE, IN NO EVENT WILL THE LICENSOR BE LIABLE
307
+ TO YOU ON ANY LEGAL THEORY (INCLUDING, WITHOUT LIMITATION,
308
+ NEGLIGENCE) OR OTHERWISE FOR ANY DIRECT, SPECIAL, INDIRECT,
309
+ INCIDENTAL, CONSEQUENTIAL, PUNITIVE, EXEMPLARY, OR OTHER LOSSES,
310
+ COSTS, EXPENSES, OR DAMAGES ARISING OUT OF THIS PUBLIC LICENSE OR
311
+ USE OF THE LICENSED MATERIAL, EVEN IF THE LICENSOR HAS BEEN
312
+ ADVISED OF THE POSSIBILITY OF SUCH LOSSES, COSTS, EXPENSES, OR
313
+ DAMAGES. WHERE A LIMITATION OF LIABILITY IS NOT ALLOWED IN FULL OR
314
+ IN PART, THIS LIMITATION MAY NOT APPLY TO YOU.
315
+
316
+ c. The disclaimer of warranties and limitation of liability provided
317
+ above shall be interpreted in a manner that, to the extent
318
+ possible, most closely approximates an absolute disclaimer and
319
+ waiver of all liability.
320
+
321
+ Section 6 -- Term and Termination.
322
+
323
+ a. This Public License applies for the term of the Copyright and
324
+ Similar Rights licensed here. However, if You fail to comply with
325
+ this Public License, then Your rights under this Public License
326
+ terminate automatically.
327
+
328
+ b. Where Your right to use the Licensed Material has terminated under
329
+ Section 6(a), it reinstates:
330
+
331
+ 1. automatically as of the date the violation is cured, provided
332
+ it is cured within 30 days of Your discovery of the
333
+ violation; or
334
+
335
+ 2. upon express reinstatement by the Licensor.
336
+
337
+ For the avoidance of doubt, this Section 6(b) does not affect any
338
+ right the Licensor may have to seek remedies for Your violations
339
+ of this Public License.
340
+
341
+ c. For the avoidance of doubt, the Licensor may also offer the
342
+ Licensed Material under separate terms or conditions or stop
343
+ distributing the Licensed Material at any time; however, doing so
344
+ will not terminate this Public License.
345
+
346
+ d. Sections 1, 5, 6, 7, and 8 survive termination of this Public
347
+ License.
348
+
349
+ Section 7 -- Other Terms and Conditions.
350
+
351
+ a. The Licensor shall not be bound by any additional or different
352
+ terms or conditions communicated by You unless expressly agreed.
353
+
354
+ b. Any arrangements, understandings, or agreements regarding the
355
+ Licensed Material not stated herein are separate from and
356
+ independent of the terms and conditions of this Public License.
357
+
358
+ Section 8 -- Interpretation.
359
+
360
+ a. For the avoidance of doubt, this Public License does not, and
361
+ shall not be interpreted to, reduce, limit, restrict, or impose
362
+ conditions on any use of the Licensed Material that could lawfully
363
+ be made without permission under this Public License.
364
+
365
+ b. To the extent possible, if any provision of this Public License is
366
+ deemed unenforceable, it shall be automatically reformed to the
367
+ minimum extent necessary to make it enforceable. If the provision
368
+ cannot be reformed, it shall be severed from this Public License
369
+ without affecting the enforceability of the remaining terms and
370
+ conditions.
371
+
372
+ c. No term or condition of this Public License will be waived and no
373
+ failure to comply consented to unless expressly agreed to by the
374
+ Licensor.
375
+
376
+ d. Nothing in this Public License constitutes or may be interpreted
377
+ as a limitation upon, or waiver of, any privileges and immunities
378
+ that apply to the Licensor or You, including from the legal
379
+ processes of any jurisdiction or authority.
380
+
381
+ =======================================================================
382
+
383
+ Creative Commons is not a party to its public
384
+ licenses. Notwithstanding, Creative Commons may elect to apply one of
385
+ its public licenses to material it publishes and in those instances
386
+ will be considered the “Licensor.” The text of the Creative Commons
387
+ public licenses is dedicated to the public domain under the CC0 Public
388
+ Domain Dedication. Except for the limited purpose of indicating that
389
+ material is shared under a Creative Commons public license or as
390
+ otherwise permitted by the Creative Commons policies published at
391
+ creativecommons.org/policies, Creative Commons does not authorize the
392
+ use of the trademark "Creative Commons" or any other trademark or logo
393
+ of Creative Commons without its prior written consent including,
394
+ without limitation, in connection with any unauthorized modifications
395
+ to any of its public licenses or any other arrangements,
396
+ understandings, or agreements concerning use of licensed material. For
397
+ the avoidance of doubt, this paragraph does not form part of the
398
+ public licenses.
399
+
400
+ Creative Commons may be contacted at creativecommons.org.
README.md ADDED
@@ -0,0 +1,176 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ base_model: MCG-NJU/videomae-base
4
+ pipeline_tag: feature-extraction
5
+ tags:
6
+ - eidora
7
+ - eidora-model-zoo
8
+ - onnx
9
+ - onnxruntime
10
+ - embeddings
11
+ - video
12
+ - videomae
13
+ - non-commercial
14
+ ---
15
+
16
+ # VideoMAE_Base_K400
17
+
18
+ VideoMAE Base is a self-supervised video transformer pretrained on Kinetics-400. This EIDORA package converts the pretrained encoder into a 768-dimensional normalized clip embedding.
19
+
20
+ ## Source and provenance
21
+
22
+ - Base model/checkpoint: `MCG-NJU/videomae-base`
23
+ - Source: https://huggingface.co/MCG-NJU/videomae-base
24
+ - Original model: VideoMAE Base
25
+ - Architecture paper: https://proceedings.neurips.cc/paper_files/paper/2022/hash/416f9cb3276121c42eebb86352a4354a-Abstract-Conference.html
26
+ - Training data: Kinetics-400, self-supervised pretraining for 1600 epochs
27
+
28
+ ## EIDORA package
29
+
30
+ - Package schema: `3` (Desktop preparation implementation `1`)
31
+ - Declared providers: `CPUExecutionProvider`
32
+ - Provider declarations require certification in validation-report.json before publication.
33
+ - Preparation runs in EIDORA; exposed defaults are recommended, alternatives are not equivalent-quality claims.
34
+ - Modality: `video`
35
+ - Embedding dimensions: `768`
36
+ - Normalized: `true`
37
+ - Similarity: `cosine`
38
+
39
+ ## Preparation
40
+
41
+ ```yaml
42
+ width: 224
43
+ height: 224
44
+ layout: BTCHW
45
+ resize: short_edge_crop
46
+ interpolation: bilinear
47
+ rescale: 0.00392156862745098
48
+ mean:
49
+ - 0.0
50
+ - 0.0
51
+ - 0.0
52
+ std:
53
+ - 1.0
54
+ - 1.0
55
+ - 1.0
56
+ alpha_background:
57
+ - 0
58
+ - 0
59
+ - 0
60
+ short_edge: 224
61
+ frame_count: 16
62
+ duration_seconds: 2.0
63
+ excerpt: beginning
64
+ parameters:
65
+ resize:
66
+ default: short_edge_crop
67
+ choices:
68
+ - stretch
69
+ - fill_crop
70
+ - fit_pad
71
+ - short_edge_crop
72
+ interpolation:
73
+ default: bilinear
74
+ choices:
75
+ - nearest
76
+ - bilinear
77
+ - bicubic
78
+ - lanczos
79
+ crop_position:
80
+ default: center
81
+ short_edge:
82
+ default: 224
83
+ minimum: 224
84
+ maximum: 2048
85
+ excerpt:
86
+ default: beginning
87
+ start_seconds:
88
+ default: 0.0
89
+ maximum: 604800
90
+ duration_seconds:
91
+ default: 2.0
92
+ minimum: 0.1
93
+ maximum: 60
94
+ ```
95
+
96
+ ## Intended use
97
+
98
+ - Clip-level video similarity and retrieval.
99
+ - Clustering video clips using both spatial and temporal visual information.
100
+ - Comparing motion-aware video representations with frame-based image embeddings.
101
+ - Exploratory analysis of video collections where text alignment is not required.
102
+
103
+ ## Limitations
104
+
105
+ This checkpoint was pretrained on Kinetics-400 and therefore reflects the visual and action distribution of that dataset. It has no audio or language alignment. EIDORA converts the encoder output into one 768-dimensional embedding by mean-pooling the final spatiotemporal tokens and applying L2 normalization. The ONNX model accepts exactly 16 RGB frames at 224 x 224; decoding, temporal frame selection, resizing, cropping, and rescaling are performed outside the graph. The upstream checkpoint is licensed CC-BY-NC-4.0, so its non-commercial restriction must be considered before redistribution or use.
106
+
107
+ ## License and attribution
108
+
109
+ Based on the VideoMAE Base checkpoint released by MCG-NJU. The upstream checkpoint is licensed under CC-BY-NC-4.0.
110
+
111
+ ## Citation
112
+
113
+ ```bibtex
114
+ @inproceedings{tong2022videomae,
115
+ title={VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training},
116
+ author={Tong, Zhan and Song, Yibing and Wang, Jue and Wang, Limin},
117
+ booktitle={Advances in Neural Information Processing Systems},
118
+ volume={35},
119
+ pages={10078--10093},
120
+ year={2022},
121
+ doi={10.52202/068431-0732}
122
+ }
123
+ ```
124
+
125
+
126
+ ## Available EIDORA input modes
127
+
128
+ **This package supports video only.**
129
+
130
+ It accepts a 16-frame video clip and generates one normalized,
131
+ 768-dimensional embedding.
132
+
133
+ It does not process audio, accept text queries, perform video
134
+ captioning, or provide a shared text-video embedding space.
135
+
136
+ There is currently no separately validated image-only,
137
+ text-only, or multimodal variant of this VideoMAE checkpoint
138
+ in EIDORA.
139
+
140
+ ## EIDORA adaptation
141
+
142
+ The original VideoMAE pretrained encoder is retained.
143
+ EIDORA obtains clip-level embeddings by averaging the final
144
+ spatiotemporal token representations and applying L2
145
+ normalization.
146
+
147
+ These embeddings are intended for exploratory video similarity,
148
+ retrieval and clustering.
149
+
150
+ ## License and attribution
151
+
152
+ **License: CC BY-NC 4.0 — non-commercial use only.**
153
+
154
+ Original checkpoint:
155
+ https://huggingface.co/MCG-NJU/videomae-base
156
+
157
+ Original project:
158
+ https://github.com/MCG-NJU/VideoMAE
159
+
160
+ This ONNX conversion does not remove the original checkpoint's
161
+ non-commercial restrictions.
162
+
163
+ See the LICENSE file included in this repository.
164
+
165
+ VideoMAE:
166
+ Tong et al., *VideoMAE: Masked Autoencoders are Data-Efficient
167
+ Learners for Self-Supervised Video Pre-Training*, NeurIPS 2022.
168
+
169
+ ## Validation and distribution
170
+
171
+ The ONNX model was validated against the original PyTorch
172
+ encoder and the EIDORA schema-v3 runtime.
173
+
174
+ Real-video validation evidence is retained in the EIDORA
175
+ development package. Validation media and diagnostic tensors
176
+ are not included in this public inference distribution.
config.yaml ADDED
@@ -0,0 +1,126 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 3
2
+ id: EIDORA/VideoMAE_Base_K400
3
+ name: VideoMAE_Base_K400
4
+ version: 0.1.0
5
+ modality: video
6
+ license: cc-by-nc-4.0
7
+ bibtex: "@inproceedings{tong2022videomae,\n title={VideoMAE: Masked Autoencoders\
8
+ \ are Data-Efficient Learners for Self-Supervised Video Pre-Training},\n author={Tong,\
9
+ \ Zhan and Song, Yibing and Wang, Jue and Wang, Limin},\n booktitle={Advances in\
10
+ \ Neural Information Processing Systems},\n volume={35},\n pages={10078--10093},\n\
11
+ \ year={2022},\n doi={10.52202/068431-0732}\n}"
12
+ compatibility:
13
+ min_eidora_version: 0.1.0
14
+ artifacts:
15
+ - path: model.onnx
16
+ sha256: 7107a1ae23a38882335ee7cb75caa0009a6ea786ea5304b46ce6aff72cb1f17e
17
+ role: graph
18
+ runtime:
19
+ graph: model.onnx
20
+ inputs:
21
+ - name: pixel_values
22
+ source: frames
23
+ dtype: float32
24
+ shape:
25
+ - batch
26
+ - 16
27
+ - 3
28
+ - 224
29
+ - 224
30
+ output:
31
+ name: embedding
32
+ dtype: float32
33
+ shape:
34
+ - batch
35
+ - 768
36
+ execution_providers:
37
+ - CPUExecutionProvider
38
+ preparation:
39
+ width: 224
40
+ height: 224
41
+ layout: BTCHW
42
+ resize: short_edge_crop
43
+ interpolation: bilinear
44
+ rescale: 0.00392156862745098
45
+ mean:
46
+ - 0.0
47
+ - 0.0
48
+ - 0.0
49
+ std:
50
+ - 1.0
51
+ - 1.0
52
+ - 1.0
53
+ alpha_background:
54
+ - 0
55
+ - 0
56
+ - 0
57
+ short_edge: 224
58
+ frame_count: 16
59
+ duration_seconds: 2.0
60
+ excerpt: beginning
61
+ parameters:
62
+ resize:
63
+ default: short_edge_crop
64
+ choices:
65
+ - stretch
66
+ - fill_crop
67
+ - fit_pad
68
+ - short_edge_crop
69
+ interpolation:
70
+ default: bilinear
71
+ choices:
72
+ - nearest
73
+ - bilinear
74
+ - bicubic
75
+ - lanczos
76
+ crop_position:
77
+ default: center
78
+ short_edge:
79
+ default: 224
80
+ minimum: 224
81
+ maximum: 2048
82
+ excerpt:
83
+ default: beginning
84
+ start_seconds:
85
+ default: 0.0
86
+ maximum: 604800
87
+ duration_seconds:
88
+ default: 2.0
89
+ minimum: 0.1
90
+ maximum: 60
91
+ embedding:
92
+ dimensions: 768
93
+ normalized: true
94
+ similarity: cosine
95
+ metadata:
96
+ summary: VideoMAE Base video embeddings for clip-level visual similarity, retrieval,
97
+ clustering, and temporal representation analysis.
98
+ trained_on: Kinetics-400, self-supervised pretraining for 1600 epochs
99
+ feature_type: embedding
100
+ pooling: mean of final-layer VideoMAE spatiotemporal tokens
101
+ group:
102
+ id: video
103
+ label: Video Models
104
+ order: 30
105
+ provenance:
106
+ base_model: MCG-NJU/videomae-base
107
+ source_repository: https://huggingface.co/MCG-NJU/videomae-base
108
+ original_name: VideoMAE Base
109
+ original_model_url: https://github.com/MCG-NJU/VideoMAE
110
+ paper_title: 'VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised
111
+ Video Pre-Training'
112
+ paper_url: https://proceedings.neurips.cc/paper_files/paper/2022/hash/416f9cb3276121c42eebb86352a4354a-Abstract-Conference.html
113
+ training_data: Kinetics-400, self-supervised pretraining for 1600 epochs
114
+ upstream_license: CC-BY-NC-4.0
115
+ authors:
116
+ - Zhan Tong
117
+ - Yibing Song
118
+ - Jue Wang
119
+ - Limin Wang
120
+ source_model: MCG-NJU/videomae-base
121
+ source_revision: dc740ceda42fce44faed2ea03c6d447db72f6af9
122
+ source_weights_sha256: bc053ca2840a038b1068269a4eec06ca569689e9a1ed9376a5b2b8a111be5290
123
+ transformers_version: 4.57.1
124
+ exported_opset: 17
125
+ export_date: '2026-10-26'
126
+ exporter_version: eidora-onnx 1.0.0
model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7107a1ae23a38882335ee7cb75caa0009a6ea786ea5304b46ce6aff72cb1f17e
3
+ size 349969601