Add ExecuTorch WebGPU program for qwen2.5-0.5b-instruct
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ tags:
|
|
| 16 |
This repository contains an [ExecuTorch](https://github.com/pytorch/executorch) conversion of
|
| 17 |
[Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) for the ExecuTorch **WebGPU** backend, so the model runs entirely in a web browser on
|
| 18 |
the visitor's GPU. It powers the corresponding demo in the
|
| 19 |
-
|
| 20 |
|
| 21 |
- **Base model:** [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct)
|
| 22 |
- **Format:** ExecuTorch `.pte` programs delegated to the WebGPU backend
|
|
@@ -41,8 +41,8 @@ Full checksums are in `manifest.json`. The playground verifies them after downlo
|
|
| 41 |
|
| 42 |
These programs need the ExecuTorch WebGPU runtime compiled to WebAssembly
|
| 43 |
([backends/webgpu](https://github.com/pytorch/executorch/tree/main/backends/webgpu)). The easiest way to
|
| 44 |
-
try the model is the
|
| 45 |
-
files once, caches them in the browser, and runs everything locally.
|
| 46 |
|
| 47 |
## Provenance
|
| 48 |
|
|
|
|
| 16 |
This repository contains an [ExecuTorch](https://github.com/pytorch/executorch) conversion of
|
| 17 |
[Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) for the ExecuTorch **WebGPU** backend, so the model runs entirely in a web browser on
|
| 18 |
the visitor's GPU. It powers the corresponding demo in the
|
| 19 |
+
ExecuTorch WebGPU Playground (launching soon on [executorch.ai](https://executorch.ai)).
|
| 20 |
|
| 21 |
- **Base model:** [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct)
|
| 22 |
- **Format:** ExecuTorch `.pte` programs delegated to the WebGPU backend
|
|
|
|
| 41 |
|
| 42 |
These programs need the ExecuTorch WebGPU runtime compiled to WebAssembly
|
| 43 |
([backends/webgpu](https://github.com/pytorch/executorch/tree/main/backends/webgpu)). The easiest way to
|
| 44 |
+
try the model is the ExecuTorch WebGPU Playground (launching soon on [executorch.ai](https://executorch.ai)),
|
| 45 |
+
which downloads these files once, caches them in the browser, and runs everything locally.
|
| 46 |
|
| 47 |
## Provenance
|
| 48 |
|