Add ExecuTorch WebGPU program for llama-3.2-1b-instruct
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ tags:
|
|
| 20 |
This repository contains an [ExecuTorch](https://github.com/pytorch/executorch) conversion of
|
| 21 |
[meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) for the ExecuTorch **WebGPU** backend, so the model runs entirely in a web browser on
|
| 22 |
the visitor's GPU. It powers the corresponding demo in the
|
| 23 |
-
|
| 24 |
|
| 25 |
- **Base model:** [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct)
|
| 26 |
- **Format:** ExecuTorch `.pte` programs delegated to the WebGPU backend
|
|
@@ -44,14 +44,13 @@ Full checksums are in `manifest.json`. The playground verifies them after downlo
|
|
| 44 |
|
| 45 |
These programs need the ExecuTorch WebGPU runtime compiled to WebAssembly
|
| 46 |
([backends/webgpu](https://github.com/pytorch/executorch/tree/main/backends/webgpu)). The easiest way to
|
| 47 |
-
try the model is the
|
| 48 |
-
files once, caches them in the browser, and runs everything locally.
|
| 49 |
|
| 50 |
## Provenance
|
| 51 |
|
| 52 |
-
- Converted from the upstream checkpoint
|
| 53 |
-
-
|
| 54 |
-
- Export recipe: _to be published with the ExecuTorch release that ships the WebGPU runtime_.
|
| 55 |
|
| 56 |
## License
|
| 57 |
|
|
|
|
| 20 |
This repository contains an [ExecuTorch](https://github.com/pytorch/executorch) conversion of
|
| 21 |
[meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) for the ExecuTorch **WebGPU** backend, so the model runs entirely in a web browser on
|
| 22 |
the visitor's GPU. It powers the corresponding demo in the
|
| 23 |
+
ExecuTorch WebGPU Playground (launching soon on [executorch.ai](https://executorch.ai)).
|
| 24 |
|
| 25 |
- **Base model:** [meta-llama/Llama-3.2-1B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct)
|
| 26 |
- **Format:** ExecuTorch `.pte` programs delegated to the WebGPU backend
|
|
|
|
| 44 |
|
| 45 |
These programs need the ExecuTorch WebGPU runtime compiled to WebAssembly
|
| 46 |
([backends/webgpu](https://github.com/pytorch/executorch/tree/main/backends/webgpu)). The easiest way to
|
| 47 |
+
try the model is the ExecuTorch WebGPU Playground (launching soon on [executorch.ai](https://executorch.ai)),
|
| 48 |
+
which downloads these files once, caches them in the browser, and runs everything locally.
|
| 49 |
|
| 50 |
## Provenance
|
| 51 |
|
| 52 |
+
- Converted from the upstream checkpoint by the ExecuTorch team with the WebGPU export path.
|
| 53 |
+
- A reproducible export recipe will be published alongside the open-source ExecuTorch WebGPU runtime.
|
|
|
|
| 54 |
|
| 55 |
## License
|
| 56 |
|