msluszniak commited on
Commit
27eddbb
·
verified ·
1 Parent(s): 138d871

Apply the model card standard

Browse files
Files changed (1) hide show
  1. README.md +34 -10
README.md CHANGED
@@ -4,21 +4,45 @@ pipeline_tag: sentence-similarity
4
  library_name: executorch
5
  ---
6
 
7
- # Introduction
8
 
9
- This repository hosts the [multi-qa-mpnet-base-dot-v1](https://huggingface.co/sentence-transformers/multi-qa-mpnet-base-dot-v1/tree/main) models for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes the model exported for xnnpack in `.pte` format, ready for use in the **ExecuTorch** runtime.
 
 
10
 
11
- If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
12
 
13
- ## Compatibility
 
 
 
 
 
 
14
 
15
- If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.
16
 
17
- These models were exported using `v0.6.0` version and **no forward compatibility** is guaranteed. Older versions of the runtime may not work with these files.
 
 
 
 
 
 
 
 
 
 
 
18
 
19
- ### Repository Structure
 
 
20
 
21
- All files are located in the root directory.
 
 
22
 
23
- - The `.pte` file should be as the `modelSource` argument.
24
- - The tokenizer is provided as `tokenizer.json` in the root directory.
 
 
4
  library_name: executorch
5
  ---
6
 
7
+ # multi-qa-mpnet-base-dot-v1
8
 
9
+ This repository hosts the **multi-qa-mpnet-base-dot-v1** models exported for the
10
+ [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch)
11
+ library as ExecuTorch `.pte` programs, ready to run on device.
12
 
13
+ Upstream model: [multi-qa-mpnet-base-dot-v1](https://huggingface.co/sentence-transformers/multi-qa-mpnet-base-dot-v1/tree/main)
14
 
15
+ ## Variants
16
+
17
+ | Path | Backend | Precision |
18
+ | --- | --- | --- |
19
+ | `vulkan/multi_qa_mpnet_base_dot_v1_vulkan_fp16.pte` | vulkan | fp16 |
20
+ | `vulkan/multi_qa_mpnet_base_dot_v1_vulkan_int8.pte` | vulkan | int8 |
21
+ | `xnnpack/multi_qa_mpnet_base_dot_v1_xnnpack_fp32.pte` | xnnpack | fp32 |
22
 
23
+ ## Repository structure
24
 
25
+ ```
26
+ config.json 48 B
27
+ tokenizer.json 694 kB
28
+ tokenizer_config.json 363 B
29
+ vulkan/config.json 1.6 kB
30
+ vulkan/multi_qa_mpnet_base_dot_v1_vulkan_fp16.pte 208 MB
31
+ vulkan/multi_qa_mpnet_base_dot_v1_vulkan_int8.pte 127 MB
32
+ xnnpack/config.json 951 B
33
+ xnnpack/multi_qa_mpnet_base_dot_v1_xnnpack_fp32.pte 416 MB
34
+ ```
35
+
36
+ ## Compatibility
37
 
38
+ These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch
39
+ gives no forward compatibility guarantee, so an older runtime may fail to load
40
+ them.
41
 
42
+ To use them in React Native ExecuTorch, pass the model constant shipped in the
43
+ library's model registry to the corresponding task pipeline. See the
44
+ [documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/loading-models).
45
 
46
+ To load these files in your own ExecuTorch runtime, read the
47
+ [compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md)
48
+ first.