Document observed specialization and cached preparation
Browse files- README.md +22 -7
- SHA256.json +2 -2
README.md
CHANGED
|
@@ -41,15 +41,16 @@ The scalar FP32 decoder returns a global token ID.
|
|
| 41 |
|
| 42 |
M3 MacBook Air (16 GB), macOS 27 build 26A428. Medians after warmup;
|
| 43 |
frontend, encoder and decoding are included, while preparation, file I/O and
|
| 44 |
-
chunk planning are excluded. The
|
|
|
|
| 45 |
The quality short-clip test intentionally uses the unmodified five-minute shape.
|
| 46 |
|
| 47 |
| Bundle | Audio duration | Transcription | Audio / elapsed |
|
| 48 |
| --- | ---: | ---: | ---: |
|
| 49 |
-
| fast | 20
|
| 50 |
-
| fast |
|
| 51 |
-
| quality | 20
|
| 52 |
-
| quality |
|
| 53 |
|
| 54 |
Whisper-normalized WER against the supplied long-recording reference:
|
| 55 |
|
|
@@ -64,8 +65,22 @@ The reported full-recording runs retain all audio, with 74 fast chunks or four
|
|
| 64 |
quality chunks. These are distinct contexts and execution policies, not a
|
| 65 |
controlled kernel-only comparison.
|
| 66 |
|
| 67 |
-
|
| 68 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 69 |
are omitted because no significant load-time benefit has been demonstrated.
|
| 70 |
Authoring debug locations were removed while preserving graph signatures and
|
| 71 |
operation counts. `SHA256.json` lists distributed payload checksums.
|
|
|
|
| 41 |
|
| 42 |
M3 MacBook Air (16 GB), macOS 27 build 26A428. Medians after warmup;
|
| 43 |
frontend, encoder and decoding are included, while preparation, file I/O and
|
| 44 |
+
chunk planning are excluded. The audio is JFK's **“We choose to go to the Moon”**
|
| 45 |
+
speech: a **20-second excerpt** and the **18-minute 15-second recording**.
|
| 46 |
The quality short-clip test intentionally uses the unmodified five-minute shape.
|
| 47 |
|
| 48 |
| Bundle | Audio duration | Transcription | Audio / elapsed |
|
| 49 |
| --- | ---: | ---: | ---: |
|
| 50 |
+
| fast | 20 seconds | 0.150 s | 133.4× |
|
| 51 |
+
| fast | 18 min 15 s | 1.876 s | 584.0× |
|
| 52 |
+
| quality | 20 seconds | 1.336 s | 15.0× |
|
| 53 |
+
| quality | 18 min 15 s | 7.044 s | 155.5× |
|
| 54 |
|
| 55 |
Whisper-normalized WER against the supplied long-recording reference:
|
| 56 |
|
|
|
|
| 65 |
quality chunks. These are distinct contexts and execution policies, not a
|
| 66 |
controlled kernel-only comparison.
|
| 67 |
|
| 68 |
+
## Device specialization and loading
|
| 69 |
+
|
| 70 |
+
Source `.aimodel` files specialize on the device. On the same Mac, preparation
|
| 71 |
+
of these published source assets took:
|
| 72 |
+
|
| 73 |
+
| Bundle | First observed preparation with specialization | Subsequent cached preparation |
|
| 74 |
+
| --- | ---: | ---: |
|
| 75 |
+
| fast | 33 s | 0.060 s |
|
| 76 |
+
| quality | 10 min 7 s | 0.037 s |
|
| 77 |
+
|
| 78 |
+
Preparation includes model loading and compilation requested by Core AI, and
|
| 79 |
+
excludes warmup and transcription. These are observed cache histories, not
|
| 80 |
+
guaranteed fresh-install times: the underlying ANE cache state is not fully
|
| 81 |
+
observable, and OS/device/application changes can require specialization again.
|
| 82 |
+
|
| 83 |
+
AoT compiled artifacts
|
| 84 |
are omitted because no significant load-time benefit has been demonstrated.
|
| 85 |
Authoring debug locations were removed while preserving graph signatures and
|
| 86 |
operation counts. `SHA256.json` lists distributed payload checksums.
|
SHA256.json
CHANGED
|
@@ -11,8 +11,8 @@
|
|
| 11 |
},
|
| 12 |
{
|
| 13 |
"path": "README.md",
|
| 14 |
-
"bytes":
|
| 15 |
-
"sha256": "
|
| 16 |
},
|
| 17 |
{
|
| 18 |
"path": "fast/LICENSE",
|
|
|
|
| 11 |
},
|
| 12 |
{
|
| 13 |
"path": "README.md",
|
| 14 |
+
"bytes": 4129,
|
| 15 |
+
"sha256": "e49a5b9f1ea0fa4d4fa8a369f6f9b732da44aae3733b55ea19b696fc384911dc"
|
| 16 |
},
|
| 17 |
{
|
| 18 |
"path": "fast/LICENSE",
|