msluszniak commited on
Commit
5e542db
·
verified ·
1 Parent(s): 0a39ace

Apply the model card standard

Browse files
Files changed (1) hide show
  1. README.md +46 -31
README.md CHANGED
@@ -4,39 +4,54 @@ pipeline_tag: image-feature-extraction
4
  library_name: executorch
5
  ---
6
 
7
- # Introduction
8
-
9
- This repository hosts the image encoder of
10
- [clip-vit-base-patch32](https://huggingface.co/openai/clip-vit-base-patch32)
11
- model for the [React Native
12
- ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It
13
- includes the model exported for xnnpack in `.pte` format, ready for use in the
14
- **ExecuTorch** runtime.
15
-
16
- If you'd like to run these models in your own ExecuTorch runtime, refer to the
17
- [official documentation](https://pytorch.org/executorch/stable/index.html) for
18
- setup instructions.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
  ## Compatibility
21
 
22
- If you intend to use this model outside of React Native ExecuTorch, make sure
23
- your runtime is compatible with the **ExecuTorch** version used to export the
24
- `.pte` files. For more details, see the compatibility note in the [ExecuTorch
25
- GitHub
26
- repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4).
27
- If you work with React Native ExecuTorch, the constants from the library will
28
- guarantee compatibility with runtime used behind the scenes.
29
-
30
- These models were exported using **ExecuTorch** version 1.1.0 and **no forward
31
- compatibility** is guaranteed. Older versions of the runtime may not work with
32
- these files.
33
-
34
- ### Repository Structure
35
-
36
- The repository is organized into directories:
37
-
38
- - `xnnpack`
39
 
40
- Each directory contains models exported for the respective backend.
 
 
41
 
42
- - The `.pte` file should be passed to the `modelSource` parameter.
 
 
 
4
  library_name: executorch
5
  ---
6
 
7
+ # clip-vit-base-patch32
8
+
9
+ This repository hosts the **clip-vit-base-patch32** models exported for the
10
+ [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch)
11
+ library as ExecuTorch `.pte` programs, ready to run on device.
12
+
13
+ Upstream model: [clip-vit-base-patch32](https://huggingface.co/openai/clip-vit-base-patch32)
14
+
15
+ ## Variants
16
+
17
+ | Path | Component | Backend | Precision |
18
+ | --- | --- | --- | --- |
19
+ | `coreml/clip_vit_base_patch32_image_coreml_fp16.pte` | image | coreml | fp16 |
20
+ | `coreml/clip_vit_base_patch32_text_coreml_fp16.pte` | text | coreml | fp16 |
21
+ | `mlx/clip_vit_base_patch32_image_mlx_int8.pte` | - | mlx | int8 |
22
+ | `vulkan/clip_vit_base_patch32_image_vulkan_fp16.pte` | image | vulkan | fp16 |
23
+ | `vulkan/clip_vit_base_patch32_text_vulkan_fp16.pte` | text | vulkan | fp16 |
24
+ | `xnnpack/clip_vit_base_patch32_image_xnnpack_fp32.pte` | image | xnnpack | fp32 |
25
+ | `xnnpack/clip_vit_base_patch32_text_xnnpack_fp32.pte` | text | xnnpack | fp32 |
26
+
27
+ ## Repository structure
28
+
29
+ ```
30
+ config.json 43 B
31
+ coreml/clip_vit_base_patch32_image_coreml_fp16.pte 168 MB
32
+ coreml/clip_vit_base_patch32_text_coreml_fp16.pte 122 MB
33
+ coreml/config.json 1.7 kB
34
+ mlx/clip_vit_base_patch32_image_mlx_int8.pte 93.7 MB
35
+ mlx/config.json 840 B
36
+ tokenizer.json 2.1 MB
37
+ vulkan/clip_vit_base_patch32_image_vulkan_fp16.pte 168 MB
38
+ vulkan/clip_vit_base_patch32_text_vulkan_fp16.pte 121 MB
39
+ vulkan/config.json 1.7 kB
40
+ xnnpack/clip_vit_base_patch32_image_xnnpack_fp32.pte 335 MB
41
+ xnnpack/clip_vit_base_patch32_text_xnnpack_fp32.pte 242 MB
42
+ xnnpack/config.json 1.6 kB
43
+ ```
44
 
45
  ## Compatibility
46
 
47
+ These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch
48
+ gives no forward compatibility guarantee, so an older runtime may fail to load
49
+ them.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
 
51
+ To use them in React Native ExecuTorch, pass the model constant shipped in the
52
+ library's model registry to the corresponding task pipeline. See the
53
+ [documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/loading-models).
54
 
55
+ To load these files in your own ExecuTorch runtime, read the
56
+ [compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md)
57
+ first.