Card: link the sample app (CoreAISearchiOS) and record the iPhone 18 Pro JIT run of 2026-10-09 (bit-identical to the 17 Pro h18p index)
Browse files
README.md
CHANGED
|
@@ -26,6 +26,8 @@ This model has no row on [DeviceMark](https://devicemark.github.io/), the on-dev
|
|
| 26 |
|
| 27 |
Zoo card, recipe and gate transcript: [coreai-model-zoo/models/granite-embedding-97m](https://github.com/john-rocky/coreai-model-zoo/blob/main/models/granite-embedding-97m/README.md).
|
| 28 |
|
|
|
|
|
|
|
| 29 |
IBM's 97M-parameter **multilingual text embedder** — a ModernBERT encoder, 384-d CLS-pooled
|
| 30 |
unit vectors, Japanese and English among its languages — as a static `.aimodel` for macOS 27
|
| 31 |
and iOS 27, with bundles compiled ahead of time for the iPhone 17 Pro beside it.
|
|
@@ -121,7 +123,11 @@ per graph
|
|
| 121 |
|
| 122 |
The iPhone gate above (the iPhone 17 Pro rows) ran the `h18p` export, now in `ios-h18p/`. The JIT IR in
|
| 123 |
`ios/` was only loaded and called once on the iPhone 18 Pro. That call returned a 384-value float32
|
| 124 |
-
embedding with no non-finite values
|
|
|
|
|
|
|
|
|
|
|
|
|
| 125 |
|
| 126 |
The fixed grid computes every position, so pick the smallest grid that covers the text: S=128
|
| 127 |
for queries and short notes, S=512 for passages. **fp32 is the default.** w8 is a storage
|
|
|
|
| 26 |
|
| 27 |
Zoo card, recipe and gate transcript: [coreai-model-zoo/models/granite-embedding-97m](https://github.com/john-rocky/coreai-model-zoo/blob/main/models/granite-embedding-97m/README.md).
|
| 28 |
|
| 29 |
+
Sample app: [CoreAISearchiOS](https://github.com/john-rocky/coreai-samples/tree/main/CoreAISearchiOS) downloads `ios/fp32-s128` from this repo and searches your own notes by meaning, 16.5 ms per query on an iPhone 18 Pro (iOS 27.2, 2026-10-09).
|
| 30 |
+
|
| 31 |
IBM's 97M-parameter **multilingual text embedder** — a ModernBERT encoder, 384-d CLS-pooled
|
| 32 |
unit vectors, Japanese and English among its languages — as a static `.aimodel` for macOS 27
|
| 33 |
and iOS 27, with bundles compiled ahead of time for the iPhone 17 Pro beside it.
|
|
|
|
| 123 |
|
| 124 |
The iPhone gate above (the iPhone 17 Pro rows) ran the `h18p` export, now in `ios-h18p/`. The JIT IR in
|
| 125 |
`ios/` was only loaded and called once on the iPhone 18 Pro. That call returned a 384-value float32
|
| 126 |
+
embedding with no non-finite values. On 2026-10-09 the sample app above embedded 9,859 sentences on an
|
| 127 |
+
iPhone 18 Pro (iOS 27.2, 24B5099f) with `ios/fp32-s128`, GPU preferred: the 9,859 × 384 float32 matrix has the
|
| 128 |
+
same SHA-256 as the one the `h18p` bundle produced on the iPhone 17 Pro on 2026-09-20 (bit-identical), so the
|
| 129 |
+
five example queries return the same top 5 with the same scores. First load 0.44 s, first call 612 ms, load
|
| 130 |
+
after a relaunch 0.054 s, 4.91 ms per sentence over the 9,859, one run.
|
| 131 |
|
| 132 |
The fixed grid computes every position, so pick the smallest grid that covers the text: S=128
|
| 133 |
for queries and short notes, S=512 for passages. **fp32 is the default.** w8 is a storage
|