orangeblue39 commited on
Commit
18ec2c4
·
verified ·
1 Parent(s): 1656192

CUDA Granite worker for Windows x64, built from 67c9498

Browse files
Files changed (3) hide show
  1. NOTICE.md +94 -0
  2. README.md +75 -0
  3. granite-worker-cuda-windows-x64.zip +3 -0
NOTICE.md ADDED
@@ -0,0 +1,94 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Third-party notices
2
+
3
+ `granite-worker.exe` is a compiled binary containing the components below.
4
+ Their notices are reproduced verbatim, as their licences require.
5
+
6
+ ---
7
+
8
+ ## llama.cpp / ggml
9
+
10
+ ```
11
+ MIT License
12
+
13
+ Copyright (c) 2023-2026 The ggml authors
14
+
15
+ Permission is hereby granted, free of charge, to any person obtaining a copy
16
+ of this software and associated documentation files (the "Software"), to deal
17
+ in the Software without restriction, including without limitation the rights
18
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
19
+ copies of the Software, and to permit persons to whom the Software is
20
+ furnished to do so, subject to the following conditions:
21
+
22
+ The above copyright notice and this permission notice shall be included in all
23
+ copies or substantial portions of the Software.
24
+
25
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
26
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
27
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
28
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
29
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
30
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
31
+ SOFTWARE.
32
+ ```
33
+
34
+ ---
35
+
36
+ ## nlohmann/json (vendored by llama.cpp)
37
+
38
+ ```
39
+ MIT License
40
+
41
+ Copyright (c) 2013-2025 Niels Lohmann
42
+
43
+ Permission is hereby granted, free of charge, to any person obtaining a copy
44
+ of this software and associated documentation files (the "Software"), to deal
45
+ in the Software without restriction, including without limitation the rights
46
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
47
+ copies of the Software, and to permit persons to whom the Software is
48
+ furnished to do so, subject to the following conditions:
49
+
50
+ The above copyright notice and this permission notice shall be included in all
51
+ copies or substantial portions of the Software.
52
+
53
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
54
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
55
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
56
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
57
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
58
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
59
+ SOFTWARE.
60
+ ```
61
+
62
+ ---
63
+
64
+ ## llama-cpp-rs (Rust bindings)
65
+
66
+ Dual-licensed MIT or Apache-2.0. The MIT terms:
67
+
68
+ ```
69
+ Copyright (c) Dial AI
70
+
71
+ Permission is hereby granted, free of charge, to any
72
+ person obtaining a copy of this software and associated
73
+ documentation files (the "Software"), to deal in the
74
+ Software without restriction, including without
75
+ limitation the rights to use, copy, modify, merge,
76
+ publish, distribute, sublicense, and/or sell copies of
77
+ the Software, and to permit persons to whom the Software
78
+ is furnished to do so, subject to the following
79
+ conditions:
80
+
81
+ The above copyright notice and this permission notice
82
+ shall be included in all copies or substantial portions
83
+ of the Software.
84
+
85
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF
86
+ ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED
87
+ TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A
88
+ PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT
89
+ SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
90
+ CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION
91
+ OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR
92
+ IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER
93
+ DEALINGS IN THE SOFTWARE.
94
+ ```
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - not-a-model
5
+ ---
6
+
7
+ # SpeakEasy Mini — CUDA runtime worker (Windows x64)
8
+
9
+ **This repository contains no model.** It carries one compiled Windows
10
+ executable: the CUDA-enabled build of SpeakEasy Mini's Granite Speech inference
11
+ worker. The model it runs is
12
+ [ibm-granite/granite-speech-4.1-2b-GGUF](https://huggingface.co/ibm-granite/granite-speech-4.1-2b-GGUF),
13
+ which lives elsewhere and is fetched separately.
14
+
15
+ SpeakEasy Mini is a local-only Windows dictation app. All inference runs on the
16
+ machine; nothing is sent anywhere. Its installer fetches this archive only when
17
+ the user chooses the graphics-card configuration on a machine with a supported
18
+ NVIDIA card, and verifies it against the digests below before it is used.
19
+
20
+ ## What is in here
21
+
22
+ | | |
23
+ | --- | --- |
24
+ | `granite-worker-cuda-windows-x64.zip` | 42,162,465 bytes, SHA-256 `03b7c33f83674edfa64549e43a5f87e3393e03100db44027b10940b5deb28147` |
25
+ | contents | `granite-worker.exe`, 57,052,672 bytes, SHA-256 `1d4a3ad57e72acaaa55a507f88733ac18f77909349c4bf7c7bc017269499170a` |
26
+
27
+ The archive has no wrapping directory. The digests above are pinned in the
28
+ application's own trusted manifest and re-checked on the user's machine after
29
+ download and again before the worker is run, so a corrupted or truncated
30
+ transfer is refused rather than executed.
31
+
32
+ ## Runtime requirements
33
+
34
+ The executable is a **CUDA build** and does not fall back to the processor. It
35
+ needs, beside it in its own directory:
36
+
37
+ - `cublas64_13.dll` and `cublasLt64_13.dll` — from NVIDIA's CUDA 13.x
38
+ redistributables. `cuBLAS` is an import of the image; `cuBLASLt` is loaded by
39
+ `cuBLAS` at the first matrix multiplication, so a copy missing only that one
40
+ starts, loads the weights, and fails roughly half a minute later.
41
+ - an NVIDIA driver providing `nvcuda.dll`.
42
+
43
+ The CUDA runtime itself is statically linked, so `cudart64_13.dll` is not
44
+ loaded. SpeakEasy Mini's installer fetches the two libraries above from NVIDIA's
45
+ own distribution servers rather than from here.
46
+
47
+ ## Build provenance
48
+
49
+ - Source: [`kwp490/speakeasy-granite-rust-mini`](https://github.com/kwp490/speakeasy-granite-rust-mini)
50
+ at commit `67c94987d26983767ef1ceb05f7f62fdbd902858`
51
+ - Built with `cargo build --release -p speakeasy-granite-worker --features cuda`
52
+ on Windows, MSVC toolchain, against CUDA Toolkit 13.3
53
+ - Verified on an NVIDIA RTX 4070 Laptop GPU: transcribed the project's fixture
54
+ clip in 361.2 ms resident, byte-identical to the processor build's transcript,
55
+ with NVML confirming the worker's own process holding a CUDA context
56
+
57
+ MSVC embeds a timestamp and a PDB path, so this build is not bit-reproducible. A
58
+ rebuild from the same commit will produce a different SHA-256. The digests above
59
+ identify these bytes, which are the ones that were tested.
60
+
61
+ ## Licences
62
+
63
+ See [`NOTICE.md`](NOTICE.md) for the full notices. In summary, this executable
64
+ contains:
65
+
66
+ - **llama.cpp / ggml** — MIT, Copyright (c) 2023-2026 The ggml authors
67
+ - **nlohmann/json** and **cpp-httplib** — MIT, as vendored by llama.cpp
68
+ - **llama-cpp-rs** bindings — MIT or Apache-2.0, Copyright (c) Dial AI
69
+ - **NVIDIA CUDA runtime**, statically linked — governed by the
70
+ [NVIDIA CUDA Toolkit EULA](https://docs.nvidia.com/cuda/eula/index.html)
71
+ - SpeakEasy Mini's own code — see the source repository
72
+
73
+ The `mit` tag in this page's metadata describes the project's own code and its
74
+ MIT-licensed dependencies. It does not extend to the statically linked NVIDIA
75
+ components, which remain subject to NVIDIA's own terms.
granite-worker-cuda-windows-x64.zip ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03b7c33f83674edfa64549e43a5f87e3393e03100db44027b10940b5deb28147
3
+ size 42162465