| --- |
| license: cc-by-nc-4.0 |
| pipeline_tag: text-generation |
| tags: |
| - executorch |
| library_name: executorch |
| --- |
| |
| # hammer-2.1 |
|
|
| This repository hosts the **hammer-2.1** models exported for the |
| [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch) |
| library as ExecuTorch `.pte` programs, ready to run on device. |
|
|
| ## Variants |
|
|
| | Path | Backend | Precision | Context length | |
| | --- | --- | --- | --- | |
| | `0_5b/mlx/hammer_2_1_0_5b_mlx_int4.pte` | mlx | int4 | 16,384 | |
| | `0_5b/xnnpack/hammer_2_1_0_5b_xnnpack_8da4w.pte` | xnnpack | 8da4w | 16,384 | |
| | `1_5b/mlx/hammer_2_1_1_5b_mlx_int4.pte` | mlx | int4 | 16,384 | |
| | `1_5b/xnnpack/hammer_2_1_1_5b_xnnpack_8da4w.pte` | xnnpack | 8da4w | 16,384 | |
| | `3b/mlx/hammer_2_1_3b_mlx_int4.pte` | mlx | int4 | 8,192 | |
| | `3b/xnnpack/hammer_2_1_3b_xnnpack_8da4w.pte` | xnnpack | 8da4w | 8,192 | |
|
|
|
|
|
|
| ## Repository structure |
|
|
| ``` |
| 0_5b/mlx/config.json 1.3 KiB |
| 0_5b/mlx/hammer_2_1_0_5b_mlx_int4.pte 510 MiB |
| 0_5b/xnnpack/config.json 1.3 KiB |
| 0_5b/xnnpack/hammer_2_1_0_5b_xnnpack_8da4w.pte 412 MiB |
| 1_5b/mlx/config.json 1.3 KiB |
| 1_5b/mlx/hammer_2_1_1_5b_mlx_int4.pte 1.2 GiB |
| 1_5b/xnnpack/config.json 1.3 KiB |
| 1_5b/xnnpack/hammer_2_1_1_5b_xnnpack_8da4w.pte 1.1 GiB |
| 3b/mlx/config.json 1.3 KiB |
| 3b/mlx/hammer_2_1_3b_mlx_int4.pte 2.1 GiB |
| 3b/xnnpack/config.json 1.3 KiB |
| 3b/xnnpack/hammer_2_1_3b_xnnpack_8da4w.pte 1.9 GiB |
| config.json 32 B |
| tokenizer.json 10.9 MiB |
| tokenizer_config.json 7.0 KiB |
| ``` |
|
|
| ## Compatibility |
|
|
| These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch |
| gives no forward compatibility guarantee, so an older runtime may fail to load |
| them. |
|
|
| To use them in React Native ExecuTorch, pass the model constant shipped in the |
| library's model registry to the corresponding task pipeline. See the |
| [documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/downloading-models). |
|
|
| To load these files in your own ExecuTorch runtime, read the |
| [compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md) |
| first. |
|
|
