CUDA Granite worker for Windows x64, built from 67c9498
Browse files- NOTICE.md +94 -0
- README.md +75 -0
- granite-worker-cuda-windows-x64.zip +3 -0
NOTICE.md
ADDED
|
@@ -0,0 +1,94 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Third-party notices
|
| 2 |
+
|
| 3 |
+
`granite-worker.exe` is a compiled binary containing the components below.
|
| 4 |
+
Their notices are reproduced verbatim, as their licences require.
|
| 5 |
+
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
## llama.cpp / ggml
|
| 9 |
+
|
| 10 |
+
```
|
| 11 |
+
MIT License
|
| 12 |
+
|
| 13 |
+
Copyright (c) 2023-2026 The ggml authors
|
| 14 |
+
|
| 15 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 16 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 17 |
+
in the Software without restriction, including without limitation the rights
|
| 18 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 19 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 20 |
+
furnished to do so, subject to the following conditions:
|
| 21 |
+
|
| 22 |
+
The above copyright notice and this permission notice shall be included in all
|
| 23 |
+
copies or substantial portions of the Software.
|
| 24 |
+
|
| 25 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 26 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 27 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 28 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 29 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 30 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
| 31 |
+
SOFTWARE.
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
---
|
| 35 |
+
|
| 36 |
+
## nlohmann/json (vendored by llama.cpp)
|
| 37 |
+
|
| 38 |
+
```
|
| 39 |
+
MIT License
|
| 40 |
+
|
| 41 |
+
Copyright (c) 2013-2025 Niels Lohmann
|
| 42 |
+
|
| 43 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 44 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 45 |
+
in the Software without restriction, including without limitation the rights
|
| 46 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 47 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 48 |
+
furnished to do so, subject to the following conditions:
|
| 49 |
+
|
| 50 |
+
The above copyright notice and this permission notice shall be included in all
|
| 51 |
+
copies or substantial portions of the Software.
|
| 52 |
+
|
| 53 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 54 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 55 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 56 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 57 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 58 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
| 59 |
+
SOFTWARE.
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
---
|
| 63 |
+
|
| 64 |
+
## llama-cpp-rs (Rust bindings)
|
| 65 |
+
|
| 66 |
+
Dual-licensed MIT or Apache-2.0. The MIT terms:
|
| 67 |
+
|
| 68 |
+
```
|
| 69 |
+
Copyright (c) Dial AI
|
| 70 |
+
|
| 71 |
+
Permission is hereby granted, free of charge, to any
|
| 72 |
+
person obtaining a copy of this software and associated
|
| 73 |
+
documentation files (the "Software"), to deal in the
|
| 74 |
+
Software without restriction, including without
|
| 75 |
+
limitation the rights to use, copy, modify, merge,
|
| 76 |
+
publish, distribute, sublicense, and/or sell copies of
|
| 77 |
+
the Software, and to permit persons to whom the Software
|
| 78 |
+
is furnished to do so, subject to the following
|
| 79 |
+
conditions:
|
| 80 |
+
|
| 81 |
+
The above copyright notice and this permission notice
|
| 82 |
+
shall be included in all copies or substantial portions
|
| 83 |
+
of the Software.
|
| 84 |
+
|
| 85 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF
|
| 86 |
+
ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED
|
| 87 |
+
TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A
|
| 88 |
+
PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT
|
| 89 |
+
SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
|
| 90 |
+
CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
|
| 91 |
+
OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR
|
| 92 |
+
IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
|
| 93 |
+
DEALINGS IN THE SOFTWARE.
|
| 94 |
+
```
|
README.md
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- not-a-model
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
# SpeakEasy Mini — CUDA runtime worker (Windows x64)
|
| 8 |
+
|
| 9 |
+
**This repository contains no model.** It carries one compiled Windows
|
| 10 |
+
executable: the CUDA-enabled build of SpeakEasy Mini's Granite Speech inference
|
| 11 |
+
worker. The model it runs is
|
| 12 |
+
[ibm-granite/granite-speech-4.1-2b-GGUF](https://huggingface.co/ibm-granite/granite-speech-4.1-2b-GGUF),
|
| 13 |
+
which lives elsewhere and is fetched separately.
|
| 14 |
+
|
| 15 |
+
SpeakEasy Mini is a local-only Windows dictation app. All inference runs on the
|
| 16 |
+
machine; nothing is sent anywhere. Its installer fetches this archive only when
|
| 17 |
+
the user chooses the graphics-card configuration on a machine with a supported
|
| 18 |
+
NVIDIA card, and verifies it against the digests below before it is used.
|
| 19 |
+
|
| 20 |
+
## What is in here
|
| 21 |
+
|
| 22 |
+
| | |
|
| 23 |
+
| --- | --- |
|
| 24 |
+
| `granite-worker-cuda-windows-x64.zip` | 42,162,465 bytes, SHA-256 `03b7c33f83674edfa64549e43a5f87e3393e03100db44027b10940b5deb28147` |
|
| 25 |
+
| contents | `granite-worker.exe`, 57,052,672 bytes, SHA-256 `1d4a3ad57e72acaaa55a507f88733ac18f77909349c4bf7c7bc017269499170a` |
|
| 26 |
+
|
| 27 |
+
The archive has no wrapping directory. The digests above are pinned in the
|
| 28 |
+
application's own trusted manifest and re-checked on the user's machine after
|
| 29 |
+
download and again before the worker is run, so a corrupted or truncated
|
| 30 |
+
transfer is refused rather than executed.
|
| 31 |
+
|
| 32 |
+
## Runtime requirements
|
| 33 |
+
|
| 34 |
+
The executable is a **CUDA build** and does not fall back to the processor. It
|
| 35 |
+
needs, beside it in its own directory:
|
| 36 |
+
|
| 37 |
+
- `cublas64_13.dll` and `cublasLt64_13.dll` — from NVIDIA's CUDA 13.x
|
| 38 |
+
redistributables. `cuBLAS` is an import of the image; `cuBLASLt` is loaded by
|
| 39 |
+
`cuBLAS` at the first matrix multiplication, so a copy missing only that one
|
| 40 |
+
starts, loads the weights, and fails roughly half a minute later.
|
| 41 |
+
- an NVIDIA driver providing `nvcuda.dll`.
|
| 42 |
+
|
| 43 |
+
The CUDA runtime itself is statically linked, so `cudart64_13.dll` is not
|
| 44 |
+
loaded. SpeakEasy Mini's installer fetches the two libraries above from NVIDIA's
|
| 45 |
+
own distribution servers rather than from here.
|
| 46 |
+
|
| 47 |
+
## Build provenance
|
| 48 |
+
|
| 49 |
+
- Source: [`kwp490/speakeasy-granite-rust-mini`](https://github.com/kwp490/speakeasy-granite-rust-mini)
|
| 50 |
+
at commit `67c94987d26983767ef1ceb05f7f62fdbd902858`
|
| 51 |
+
- Built with `cargo build --release -p speakeasy-granite-worker --features cuda`
|
| 52 |
+
on Windows, MSVC toolchain, against CUDA Toolkit 13.3
|
| 53 |
+
- Verified on an NVIDIA RTX 4070 Laptop GPU: transcribed the project's fixture
|
| 54 |
+
clip in 361.2 ms resident, byte-identical to the processor build's transcript,
|
| 55 |
+
with NVML confirming the worker's own process holding a CUDA context
|
| 56 |
+
|
| 57 |
+
MSVC embeds a timestamp and a PDB path, so this build is not bit-reproducible. A
|
| 58 |
+
rebuild from the same commit will produce a different SHA-256. The digests above
|
| 59 |
+
identify these bytes, which are the ones that were tested.
|
| 60 |
+
|
| 61 |
+
## Licences
|
| 62 |
+
|
| 63 |
+
See [`NOTICE.md`](NOTICE.md) for the full notices. In summary, this executable
|
| 64 |
+
contains:
|
| 65 |
+
|
| 66 |
+
- **llama.cpp / ggml** — MIT, Copyright (c) 2023-2026 The ggml authors
|
| 67 |
+
- **nlohmann/json** and **cpp-httplib** — MIT, as vendored by llama.cpp
|
| 68 |
+
- **llama-cpp-rs** bindings — MIT or Apache-2.0, Copyright (c) Dial AI
|
| 69 |
+
- **NVIDIA CUDA runtime**, statically linked — governed by the
|
| 70 |
+
[NVIDIA CUDA Toolkit EULA](https://docs.nvidia.com/cuda/eula/index.html)
|
| 71 |
+
- SpeakEasy Mini's own code — see the source repository
|
| 72 |
+
|
| 73 |
+
The `mit` tag in this page's metadata describes the project's own code and its
|
| 74 |
+
MIT-licensed dependencies. It does not extend to the statically linked NVIDIA
|
| 75 |
+
components, which remain subject to NVIDIA's own terms.
|
granite-worker-cuda-windows-x64.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:03b7c33f83674edfa64549e43a5f87e3393e03100db44027b10940b5deb28147
|
| 3 |
+
size 42162465
|