imbcmdth commited on
Commit
649f3c9
·
verified ·
1 Parent(s): 7e08dc1

Add model card

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - onnx
5
+ - video-classification
6
+ - clip
7
+ base_model: microsoft/xclip-base-patch16-kinetics-600
8
+ ---
9
+
10
+ # xclip-onnx
11
+
12
+ Two ONNX graphs exported from
13
+ [microsoft/xclip-base-patch16-kinetics-600](https://huggingface.co/microsoft/xclip-base-patch16-kinetics-600)
14
+ (MIT license, code and weights) at revision
15
+ `e4921c41fc296102aae210d43d4127c5e3e51928`, for use through `wasi:nn`
16
+ where no PyTorch runtime is available. Used by
17
+ [`ffrwd/describe`](https://github.com/imbcmdth/ffrwd-package-describe).
18
+
19
+ There is no official or community ONNX export of X-CLIP; these are
20
+ produced by `scripts/export_xclip.py` in that repository, opset 17, no
21
+ dynamic axes, and validated against the PyTorch model on export (max
22
+ absolute diff ~1e-6, float32 rounding noise).
23
+
24
+ ## Files
25
+
26
+ | file | tower | input | output |
27
+ | --- | --- | --- | --- |
28
+ | `video_tower.onnx` | `get_video_features` | `pixel_values` `[1, 8, 3, 224, 224]` fp32 | `video_embeds` `[1, 512]` |
29
+ | `text_tower.onnx` | `get_text_features` | `input_ids`, `attention_mask`, both `[1, 77]` i64 | `text_embeds` `[1, 512]` |
30
+
31
+ Both towers' output is the model's `pooler_output` field, which
32
+ X-CLIP overwrites with the projected embedding (not the tower's own
33
+ pooled hidden state) - the field the export script pulls explicitly.
34
+
35
+ ## License
36
+
37
+ MIT, following the source model.