msluszniak commited on
Commit
2ed5c92
·
verified ·
1 Parent(s): fa72381

Apply the model card standard

Browse files
Files changed (1) hide show
  1. README.md +47 -15
README.md CHANGED
@@ -6,27 +6,59 @@ tags:
6
  library_name: executorch
7
  ---
8
 
9
- # Introduction
10
 
11
- This repository hosts the **Qwen 3** models for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes **unquantized** and **quantized** versions of the Qwen model in `.pte` format, ready for use in the **ExecuTorch** runtime.
 
 
12
 
13
- If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
14
 
15
- ## Compatibility
16
-
17
- If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.
 
 
 
 
 
 
 
 
18
 
19
- These models were exported using `v0.6.0` version and **no forward compatibility** is guaranteed. Older versions of the runtime may not work with these files.
20
 
21
- ### Repository Structure
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
 
23
- The repository is organized into three main directories:
24
 
25
- - `qwen-3-0.6B`
26
- - `qwen-3-1.7B`
27
- - `qwen-3-4B`
28
 
29
- Each directory contains different versions of the model, including **quantized**, and the **original** models.
 
 
30
 
31
- - The `.pte` file should be passed to the `modelSource` parameter.
32
- - The tokenizer for the models is available within the repo root, under `tokenizer.json` and `tokenizer_config.json`
 
 
6
  library_name: executorch
7
  ---
8
 
9
+ # qwen-3
10
 
11
+ This repository hosts the **qwen-3** models exported for the
12
+ [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch)
13
+ library as ExecuTorch `.pte` programs, ready to run on device.
14
 
15
+ ## Variants
16
 
17
+ | Path | Backend | Precision |
18
+ | --- | --- | --- |
19
+ | `0_6b/mlx/qwen_3_0_6b_mlx_int4.pte` | mlx | 4w |
20
+ | `0_6b/xnnpack/qwen_3_0_6b_xnnpack_bf16.pte` | xnnpack | bf16 |
21
+ | `0_6b/xnnpack/qwen_3_0_6b_xnnpack_8da4w.pte` | xnnpack | 8da4w |
22
+ | `1_7b/mlx/qwen_3_1_7b_mlx_int4.pte` | mlx | 4w |
23
+ | `1_7b/xnnpack/qwen_3_1_7b_xnnpack_bf16.pte` | xnnpack | bf16 |
24
+ | `1_7b/xnnpack/qwen_3_1_7b_xnnpack_8da4w.pte` | xnnpack | 8da4w |
25
+ | `4b/mlx/qwen_3_4b_mlx_int4.pte` | mlx | 4w |
26
+ | `4b/xnnpack/qwen_3_4b_xnnpack_bf16.pte` | xnnpack | bf16 |
27
+ | `4b/xnnpack/qwen_3_4b_xnnpack_8da4w.pte` | xnnpack | 8da4w |
28
 
29
+ ## Repository structure
30
 
31
+ ```
32
+ 0_6b/mlx/config.json 1.3 kB
33
+ 0_6b/mlx/qwen_3_0_6b_mlx_int4.pte 599 MB
34
+ 0_6b/xnnpack/config.json 2.3 kB
35
+ 0_6b/xnnpack/qwen_3_0_6b_xnnpack_8da4w.pte 482 MB
36
+ 0_6b/xnnpack/qwen_3_0_6b_xnnpack_bf16.pte 1.1 GB
37
+ 1_7b/mlx/config.json 1.3 kB
38
+ 1_7b/mlx/qwen_3_1_7b_mlx_int4.pte 1.4 GB
39
+ 1_7b/xnnpack/config.json 2.3 kB
40
+ 1_7b/xnnpack/qwen_3_1_7b_xnnpack_8da4w.pte 1.2 GB
41
+ 1_7b/xnnpack/qwen_3_1_7b_xnnpack_bf16.pte 3.2 GB
42
+ 4b/mlx/config.json 1.3 kB
43
+ 4b/mlx/qwen_3_4b_mlx_int4.pte 2.7 GB
44
+ 4b/xnnpack/config.json 2.3 kB
45
+ 4b/xnnpack/qwen_3_4b_xnnpack_8da4w.pte 2.5 GB
46
+ 4b/xnnpack/qwen_3_4b_xnnpack_bf16.pte 7.5 GB
47
+ config.json 28 B
48
+ tokenizer.json 10.9 MB
49
+ tokenizer_config.json 7.8 kB
50
+ ```
51
 
52
+ ## Compatibility
53
 
54
+ These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch
55
+ gives no forward compatibility guarantee, so an older runtime may fail to load
56
+ them.
57
 
58
+ To use them in React Native ExecuTorch, pass the model constant shipped in the
59
+ library's model registry to the corresponding task pipeline. See the
60
+ [documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/loading-models).
61
 
62
+ To load these files in your own ExecuTorch runtime, read the
63
+ [compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md)
64
+ first.