File size: 3,523 Bytes
18ec2c4 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 | ---
license: mit
tags:
- not-a-model
---
# SpeakEasy Mini — CUDA runtime worker (Windows x64)
**This repository contains no model.** It carries one compiled Windows
executable: the CUDA-enabled build of SpeakEasy Mini's Granite Speech inference
worker. The model it runs is
[ibm-granite/granite-speech-4.1-2b-GGUF](https://huggingface.co/ibm-granite/granite-speech-4.1-2b-GGUF),
which lives elsewhere and is fetched separately.
SpeakEasy Mini is a local-only Windows dictation app. All inference runs on the
machine; nothing is sent anywhere. Its installer fetches this archive only when
the user chooses the graphics-card configuration on a machine with a supported
NVIDIA card, and verifies it against the digests below before it is used.
## What is in here
| | |
| --- | --- |
| `granite-worker-cuda-windows-x64.zip` | 42,162,465 bytes, SHA-256 `03b7c33f83674edfa64549e43a5f87e3393e03100db44027b10940b5deb28147` |
| contents | `granite-worker.exe`, 57,052,672 bytes, SHA-256 `1d4a3ad57e72acaaa55a507f88733ac18f77909349c4bf7c7bc017269499170a` |
The archive has no wrapping directory. The digests above are pinned in the
application's own trusted manifest and re-checked on the user's machine after
download and again before the worker is run, so a corrupted or truncated
transfer is refused rather than executed.
## Runtime requirements
The executable is a **CUDA build** and does not fall back to the processor. It
needs, beside it in its own directory:
- `cublas64_13.dll` and `cublasLt64_13.dll` — from NVIDIA's CUDA 13.x
redistributables. `cuBLAS` is an import of the image; `cuBLASLt` is loaded by
`cuBLAS` at the first matrix multiplication, so a copy missing only that one
starts, loads the weights, and fails roughly half a minute later.
- an NVIDIA driver providing `nvcuda.dll`.
The CUDA runtime itself is statically linked, so `cudart64_13.dll` is not
loaded. SpeakEasy Mini's installer fetches the two libraries above from NVIDIA's
own distribution servers rather than from here.
## Build provenance
- Source: [`kwp490/speakeasy-granite-rust-mini`](https://github.com/kwp490/speakeasy-granite-rust-mini)
at commit `67c94987d26983767ef1ceb05f7f62fdbd902858`
- Built with `cargo build --release -p speakeasy-granite-worker --features cuda`
on Windows, MSVC toolchain, against CUDA Toolkit 13.3
- Verified on an NVIDIA RTX 4070 Laptop GPU: transcribed the project's fixture
clip in 361.2 ms resident, byte-identical to the processor build's transcript,
with NVML confirming the worker's own process holding a CUDA context
MSVC embeds a timestamp and a PDB path, so this build is not bit-reproducible. A
rebuild from the same commit will produce a different SHA-256. The digests above
identify these bytes, which are the ones that were tested.
## Licences
See [`NOTICE.md`](NOTICE.md) for the full notices. In summary, this executable
contains:
- **llama.cpp / ggml** — MIT, Copyright (c) 2023-2026 The ggml authors
- **nlohmann/json** and **cpp-httplib** — MIT, as vendored by llama.cpp
- **llama-cpp-rs** bindings — MIT or Apache-2.0, Copyright (c) Dial AI
- **NVIDIA CUDA runtime**, statically linked — governed by the
[NVIDIA CUDA Toolkit EULA](https://docs.nvidia.com/cuda/eula/index.html)
- SpeakEasy Mini's own code — see the source repository
The `mit` tag in this page's metadata describes the project's own code and its
MIT-licensed dependencies. It does not extend to the statically linked NVIDIA
components, which remain subject to NVIDIA's own terms.
|