Add eurollm exports
Browse files- .gitattributes +2 -35
- 1_7b/mlx/config.json +0 -0
- 1_7b/mlx/eurollm_1_7b_mlx_int8.pte +3 -0
- 1_7b/tokenizer.json +0 -0
- 1_7b/tokenizer_config.json +0 -0
- 1_7b/vulkan/config.json +0 -0
- 1_7b/vulkan/eurollm_1_7b_vulkan_int8.pte +3 -0
- 1_7b/xnnpack/config.json +0 -0
- 1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte +3 -0
- README.md +61 -0
- config.json +0 -0
.gitattributes
CHANGED
|
@@ -1,35 +1,2 @@
|
|
| 1 |
-
*.
|
| 2 |
-
*.
|
| 3 |
-
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
-
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
-
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
-
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
-
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
-
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
-
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
-
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
-
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
-
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
-
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
-
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
-
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
-
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
-
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
-
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
-
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
-
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
-
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
-
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
-
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
-
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
-
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
-
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
-
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
-
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
-
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
-
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
-
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
-
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
-
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
-
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
-
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
| 1 |
+
*.pte filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.json -filter -diff -merge text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1_7b/mlx/config.json
ADDED
|
Binary file (1.47 kB). View file
|
|
|
1_7b/mlx/eurollm_1_7b_mlx_int8.pte
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:74253d5871aaf79d505dc63cf3b27027a66f234d21d75e90c770224050bb5b3c
|
| 3 |
+
size 1708930048
|
1_7b/tokenizer.json
ADDED
|
Binary file (8.22 MB). View file
|
|
|
1_7b/tokenizer_config.json
ADDED
|
Binary file (47.4 kB). View file
|
|
|
1_7b/vulkan/config.json
ADDED
|
Binary file (1.47 kB). View file
|
|
|
1_7b/vulkan/eurollm_1_7b_vulkan_int8.pte
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d5661739af034088ec8b27c9af8de6de9d8bb3a85e0c3ffdb0a743bb38df5ea7
|
| 3 |
+
size 1760632576
|
1_7b/xnnpack/config.json
ADDED
|
Binary file (1.47 kB). View file
|
|
|
1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:024c204b0356cb801a11f2f3bd29ff0c2738e8572fb42a9229bc537e1f397061
|
| 3 |
+
size 1662633088
|
README.md
ADDED
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: translation
|
| 4 |
+
library_name: executorch
|
| 5 |
+
base_model: utter-project/EuroLLM-1.7B-Instruct
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# eurollm
|
| 9 |
+
|
| 10 |
+
This repository hosts the **eurollm** models exported for the
|
| 11 |
+
[React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch)
|
| 12 |
+
library as ExecuTorch `.pte` programs, ready to run on device.
|
| 13 |
+
|
| 14 |
+
Upstream model: [utter-project/EuroLLM-1.7B-Instruct](https://huggingface.co/utter-project/EuroLLM-1.7B-Instruct)
|
| 15 |
+
|
| 16 |
+
## Variants
|
| 17 |
+
|
| 18 |
+
| Path | Backend | Precision |
|
| 19 |
+
| --- | --- | --- |
|
| 20 |
+
| `1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte` | xnnpack | 8da8w |
|
| 21 |
+
| `1_7b/mlx/eurollm_1_7b_mlx_int8.pte` | mlx | int8 |
|
| 22 |
+
| `1_7b/vulkan/eurollm_1_7b_vulkan_int8.pte` | vulkan | int8 |
|
| 23 |
+
|
| 24 |
+
## Repository structure
|
| 25 |
+
|
| 26 |
+
```
|
| 27 |
+
1_7b/mlx/config.json 1.5 kB
|
| 28 |
+
1_7b/mlx/eurollm_1_7b_mlx_int8.pte 1.7 GB
|
| 29 |
+
1_7b/tokenizer.json 8.2 MB
|
| 30 |
+
1_7b/tokenizer_config.json 47.4 kB
|
| 31 |
+
1_7b/vulkan/config.json 1.5 kB
|
| 32 |
+
1_7b/vulkan/eurollm_1_7b_vulkan_int8.pte 1.8 GB
|
| 33 |
+
1_7b/xnnpack/config.json 1.5 kB
|
| 34 |
+
1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte 1.7 GB
|
| 35 |
+
config.json 29 B
|
| 36 |
+
```
|
| 37 |
+
|
| 38 |
+
## Compatibility
|
| 39 |
+
|
| 40 |
+
These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch
|
| 41 |
+
gives no forward compatibility guarantee, so an older runtime may fail to load
|
| 42 |
+
them.
|
| 43 |
+
|
| 44 |
+
To use them in React Native ExecuTorch, pass the model constant shipped in the
|
| 45 |
+
library's model registry to the corresponding task pipeline. See the
|
| 46 |
+
[documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/downloading-models).
|
| 47 |
+
|
| 48 |
+
To load these files in your own ExecuTorch runtime, read the
|
| 49 |
+
[compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md)
|
| 50 |
+
first.
|
| 51 |
+
|
| 52 |
+
## Export notes
|
| 53 |
+
|
| 54 |
+
Weights are 8-bit: 4-bit (8da4w) lost 6-9 BLEU on WMT13 en->de and often failed
|
| 55 |
+
to stop. XNNPACK uses dynamic int8 activations with per-channel int8 weights;
|
| 56 |
+
MLX and Vulkan use int8 weight-only. For translation, prompt it as the model
|
| 57 |
+
card does, without a BOS token:
|
| 58 |
+
|
| 59 |
+
```
|
| 60 |
+
<|im_start|>system\n<|im_end|>\n<|im_start|>user\nTranslate the following English source text to German:\nEnglish: {text} \nGerman: <|im_end|>\n<|im_start|>assistant\n
|
| 61 |
+
```
|
config.json
ADDED
|
Binary file (29 Bytes). View file
|
|
|