msluszniak commited on
Commit
a3ab009
·
verified ·
1 Parent(s): 164f5c5

Add eurollm exports

Browse files
.gitattributes CHANGED
@@ -1,35 +1,2 @@
1
- *.7z filter=lfs diff=lfs merge=lfs -text
2
- *.arrow filter=lfs diff=lfs merge=lfs -text
3
- *.bin filter=lfs diff=lfs merge=lfs -text
4
- *.bz2 filter=lfs diff=lfs merge=lfs -text
5
- *.ckpt filter=lfs diff=lfs merge=lfs -text
6
- *.ftz filter=lfs diff=lfs merge=lfs -text
7
- *.gz filter=lfs diff=lfs merge=lfs -text
8
- *.h5 filter=lfs diff=lfs merge=lfs -text
9
- *.joblib filter=lfs diff=lfs merge=lfs -text
10
- *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
- *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
- *.model filter=lfs diff=lfs merge=lfs -text
13
- *.msgpack filter=lfs diff=lfs merge=lfs -text
14
- *.npy filter=lfs diff=lfs merge=lfs -text
15
- *.npz filter=lfs diff=lfs merge=lfs -text
16
- *.onnx filter=lfs diff=lfs merge=lfs -text
17
- *.ot filter=lfs diff=lfs merge=lfs -text
18
- *.parquet filter=lfs diff=lfs merge=lfs -text
19
- *.pb filter=lfs diff=lfs merge=lfs -text
20
- *.pickle filter=lfs diff=lfs merge=lfs -text
21
- *.pkl filter=lfs diff=lfs merge=lfs -text
22
- *.pt filter=lfs diff=lfs merge=lfs -text
23
- *.pth filter=lfs diff=lfs merge=lfs -text
24
- *.rar filter=lfs diff=lfs merge=lfs -text
25
- *.safetensors filter=lfs diff=lfs merge=lfs -text
26
- saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
- *.tar.* filter=lfs diff=lfs merge=lfs -text
28
- *.tar filter=lfs diff=lfs merge=lfs -text
29
- *.tflite filter=lfs diff=lfs merge=lfs -text
30
- *.tgz filter=lfs diff=lfs merge=lfs -text
31
- *.wasm filter=lfs diff=lfs merge=lfs -text
32
- *.xz filter=lfs diff=lfs merge=lfs -text
33
- *.zip filter=lfs diff=lfs merge=lfs -text
34
- *.zst filter=lfs diff=lfs merge=lfs -text
35
- *tfevents* filter=lfs diff=lfs merge=lfs -text
 
1
+ *.pte filter=lfs diff=lfs merge=lfs -text
2
+ *.json -filter -diff -merge text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1_7b/mlx/config.json ADDED
Binary file (1.47 kB). View file
 
1_7b/mlx/eurollm_1_7b_mlx_int8.pte ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74253d5871aaf79d505dc63cf3b27027a66f234d21d75e90c770224050bb5b3c
3
+ size 1708930048
1_7b/tokenizer.json ADDED
Binary file (8.22 MB). View file
 
1_7b/tokenizer_config.json ADDED
Binary file (47.4 kB). View file
 
1_7b/vulkan/config.json ADDED
Binary file (1.47 kB). View file
 
1_7b/vulkan/eurollm_1_7b_vulkan_int8.pte ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5661739af034088ec8b27c9af8de6de9d8bb3a85e0c3ffdb0a743bb38df5ea7
3
+ size 1760632576
1_7b/xnnpack/config.json ADDED
Binary file (1.47 kB). View file
 
1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:024c204b0356cb801a11f2f3bd29ff0c2738e8572fb42a9229bc537e1f397061
3
+ size 1662633088
README.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: translation
4
+ library_name: executorch
5
+ base_model: utter-project/EuroLLM-1.7B-Instruct
6
+ ---
7
+
8
+ # eurollm
9
+
10
+ This repository hosts the **eurollm** models exported for the
11
+ [React Native ExecuTorch](https://www.npmjs.com/package/react-native-executorch)
12
+ library as ExecuTorch `.pte` programs, ready to run on device.
13
+
14
+ Upstream model: [utter-project/EuroLLM-1.7B-Instruct](https://huggingface.co/utter-project/EuroLLM-1.7B-Instruct)
15
+
16
+ ## Variants
17
+
18
+ | Path | Backend | Precision |
19
+ | --- | --- | --- |
20
+ | `1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte` | xnnpack | 8da8w |
21
+ | `1_7b/mlx/eurollm_1_7b_mlx_int8.pte` | mlx | int8 |
22
+ | `1_7b/vulkan/eurollm_1_7b_vulkan_int8.pte` | vulkan | int8 |
23
+
24
+ ## Repository structure
25
+
26
+ ```
27
+ 1_7b/mlx/config.json 1.5 kB
28
+ 1_7b/mlx/eurollm_1_7b_mlx_int8.pte 1.7 GB
29
+ 1_7b/tokenizer.json 8.2 MB
30
+ 1_7b/tokenizer_config.json 47.4 kB
31
+ 1_7b/vulkan/config.json 1.5 kB
32
+ 1_7b/vulkan/eurollm_1_7b_vulkan_int8.pte 1.8 GB
33
+ 1_7b/xnnpack/config.json 1.5 kB
34
+ 1_7b/xnnpack/eurollm_1_7b_xnnpack_8da8w.pte 1.7 GB
35
+ config.json 29 B
36
+ ```
37
+
38
+ ## Compatibility
39
+
40
+ These files are published for the **ExecuTorch v1.4.1** runtime. ExecuTorch
41
+ gives no forward compatibility guarantee, so an older runtime may fail to load
42
+ them.
43
+
44
+ To use them in React Native ExecuTorch, pass the model constant shipped in the
45
+ library's model registry to the corresponding task pipeline. See the
46
+ [documentation](https://docs.swmansion.com/react-native-executorch/docs/fundamentals/downloading-models).
47
+
48
+ To load these files in your own ExecuTorch runtime, read the
49
+ [compatibility note](https://github.com/pytorch/executorch/blob/main/runtime/COMPATIBILITY.md)
50
+ first.
51
+
52
+ ## Export notes
53
+
54
+ Weights are 8-bit: 4-bit (8da4w) lost 6-9 BLEU on WMT13 en->de and often failed
55
+ to stop. XNNPACK uses dynamic int8 activations with per-channel int8 weights;
56
+ MLX and Vulkan use int8 weight-only. For translation, prompt it as the model
57
+ card does, without a BOS token:
58
+
59
+ ```
60
+ <|im_start|>system\n<|im_end|>\n<|im_start|>user\nTranslate the following English source text to German:\nEnglish: {text} \nGerman: <|im_end|>\n<|im_start|>assistant\n
61
+ ```
config.json ADDED
Binary file (29 Bytes). View file