msluszniak commited on
Commit
7224aca
·
verified ·
1 Parent(s): c6ffc31

Apply the model card standard

Browse files
Files changed (1) hide show
  1. README.md +31 -14
README.md CHANGED
@@ -6,26 +6,43 @@ tags:
6
  library_name: executorch
7
  ---
8
 
9
- # Introduction
10
 
11
- This repository hosts the **Phi 4 Mini** models for the [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) library. It includes **unquantized** and **quantized** versions of the Phi model in `.pte` format, ready for use in the **ExecuTorch** runtime.
 
 
12
 
13
- If you'd like to run these models in your own ExecuTorch runtime, refer to the [official documentation](https://pytorch.org/executorch/stable/index.html) for setup instructions.
14
 
15
- ## Compatibility
16
-
17
- If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the **ExecuTorch** version used to export the `.pte` files. For more details, see the compatibility note in the [ExecuTorch GitHub repository](https://github.com/pytorch/executorch/blob/11d1742fdeddcf05bc30a6cfac321d2a2e3b6768/runtime/COMPATIBILITY.md?plain=1#L4). If you work with React Native ExecuTorch, the constants from the library will guarantee compatibility with runtime used behind the scenes.
 
 
18
 
19
- These models were exported using `v0.6.0` version and **no forward compatibility** is guaranteed. Older versions of the runtime may not work with these files.
20
 
21
- ### Repository Structure
 
 
 
 
 
 
 
 
 
22
 
23
- The repository is organized into two main directory:
24
 
25
- - `original`
26
- - `quantized`
 
27
 
28
- The directory contains original version of model.
 
 
29
 
30
- - The `.pte` file should be passed to the `modelSource` parameter.
31
- - The tokenizer for the models is available within the repo root, under `tokenizer.json` and `tokenizer_config.json`
 
 
6
  library_name: executorch
7
  ---
8
 
9
+ # phi-4-mini
10
 
11
+ This repository hosts the **phi-4-mini** models exported for the
12
+ [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch)
13
+ library as ExecuTorch `.pte` programs, ready to run on device.
14
 
15
+ ## Variants
16
 
17
+ | Path | Backend | Precision |
18
+ | --- | --- | --- |
19
+ | `mlx/phi_4_mini_mlx_int4.pte` | mlx | 4w |
20
+ | `xnnpack/phi_4_mini_xnnpack_bf16.pte` | xnnpack | bf16 |
21
+ | `xnnpack/phi_4_mini_xnnpack_8da4w.pte` | xnnpack | 8da4w |
22
 
23
+ ## Repository structure
24
 
25
+ ```
26
+ config.json 32 B
27
+ mlx/config.json 1.3 kB
28
+ mlx/phi_4_mini_mlx_int4.pte 3.0 GB
29
+ tokenizer.json 14.8 MB
30
+ tokenizer_config.json 2.9 kB
31
+ xnnpack/config.json 2.3 kB
32
+ xnnpack/phi_4_mini_xnnpack_8da4w.pte 2.6 GB
33
+ xnnpack/phi_4_mini_xnnpack_bf16.pte 7.1 GB
34
+ ```
35
 
36
+ ## Compatibility
37
 
38
+ These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch
39
+ gives no forward compatibility guarantee, so an older runtime may fail to load
40
+ them.
41
 
42
+ To use them in React Native ExecuTorch, pass the model constant shipped in the
43
+ library's model registry to the corresponding task pipeline. See the
44
+ [documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/loading-models).
45
 
46
+ To load these files in your own ExecuTorch runtime, read the
47
+ [compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md)
48
+ first.