coder543 commited on
Commit
3f3de01
·
verified ·
1 Parent(s): b4c15d3

Document observed specialization and cached preparation

Browse files
Files changed (2) hide show
  1. README.md +22 -7
  2. SHA256.json +2 -2
README.md CHANGED
@@ -41,15 +41,16 @@ The scalar FP32 decoder returns a global token ID.
41
 
42
  M3 MacBook Air (16 GB), macOS 27 build 26A428. Medians after warmup;
43
  frontend, encoder and decoding are included, while preparation, file I/O and
44
- chunk planning are excluded. The long JFK clip is 1,095.320125 seconds (18:15).
 
45
  The quality short-clip test intentionally uses the unmodified five-minute shape.
46
 
47
  | Bundle | Audio duration | Transcription | Audio / elapsed |
48
  | --- | ---: | ---: | ---: |
49
- | fast | 20.000 s | 0.150 s | 133.4× |
50
- | fast | 1095.320 s | 1.876 s | 584.0× |
51
- | quality | 20.000 s | 1.336 s | 15.0× |
52
- | quality | 1095.320 s | 7.044 s | 155.5× |
53
 
54
  Whisper-normalized WER against the supplied long-recording reference:
55
 
@@ -64,8 +65,22 @@ The reported full-recording runs retain all audio, with 74 fast chunks or four
64
  quality chunks. These are distinct contexts and execution policies, not a
65
  controlled kernel-only comparison.
66
 
67
- Source `.aimodel` files specialize on the device. First-use preparation can
68
- take several minutes; it is not included in the table. AoT compiled artifacts
 
 
 
 
 
 
 
 
 
 
 
 
 
 
69
  are omitted because no significant load-time benefit has been demonstrated.
70
  Authoring debug locations were removed while preserving graph signatures and
71
  operation counts. `SHA256.json` lists distributed payload checksums.
 
41
 
42
  M3 MacBook Air (16 GB), macOS 27 build 26A428. Medians after warmup;
43
  frontend, encoder and decoding are included, while preparation, file I/O and
44
+ chunk planning are excluded. The audio is JFK's **“We choose to go to the Moon”**
45
+ speech: a **20-second excerpt** and the **18-minute 15-second recording**.
46
  The quality short-clip test intentionally uses the unmodified five-minute shape.
47
 
48
  | Bundle | Audio duration | Transcription | Audio / elapsed |
49
  | --- | ---: | ---: | ---: |
50
+ | fast | 20 seconds | 0.150 s | 133.4× |
51
+ | fast | 18 min 15 s | 1.876 s | 584.0× |
52
+ | quality | 20 seconds | 1.336 s | 15.0× |
53
+ | quality | 18 min 15 s | 7.044 s | 155.5× |
54
 
55
  Whisper-normalized WER against the supplied long-recording reference:
56
 
 
65
  quality chunks. These are distinct contexts and execution policies, not a
66
  controlled kernel-only comparison.
67
 
68
+ ## Device specialization and loading
69
+
70
+ Source `.aimodel` files specialize on the device. On the same Mac, preparation
71
+ of these published source assets took:
72
+
73
+ | Bundle | First observed preparation with specialization | Subsequent cached preparation |
74
+ | --- | ---: | ---: |
75
+ | fast | 33 s | 0.060 s |
76
+ | quality | 10 min 7 s | 0.037 s |
77
+
78
+ Preparation includes model loading and compilation requested by Core AI, and
79
+ excludes warmup and transcription. These are observed cache histories, not
80
+ guaranteed fresh-install times: the underlying ANE cache state is not fully
81
+ observable, and OS/device/application changes can require specialization again.
82
+
83
+ AoT compiled artifacts
84
  are omitted because no significant load-time benefit has been demonstrated.
85
  Authoring debug locations were removed while preserving graph signatures and
86
  operation counts. `SHA256.json` lists distributed payload checksums.
SHA256.json CHANGED
@@ -11,8 +11,8 @@
11
  },
12
  {
13
  "path": "README.md",
14
- "bytes": 3531,
15
- "sha256": "d328e50a52bbbac7430e9cba2fd63c257a24fdf9c53af559e387b4c8cdf386c7"
16
  },
17
  {
18
  "path": "fast/LICENSE",
 
11
  },
12
  {
13
  "path": "README.md",
14
+ "bytes": 4129,
15
+ "sha256": "e49a5b9f1ea0fa4d4fa8a369f6f9b732da44aae3733b55ea19b696fc384911dc"
16
  },
17
  {
18
  "path": "fast/LICENSE",