LFM2.5-VL-3B -> Core AI: fp16 SigLIP2-NaFlex tower + int8lin/int4lin decoders + text core; fp32 ladder cos 1.000000, suite 7/9 = fp16 baseline
Browse files
README.md
CHANGED
|
@@ -50,12 +50,17 @@ greedy decoding turns any near-tie into a different tail, and the fp16 bundle it
|
|
| 50 |
— int8lin and int4lin both reproduce that 7/9. The divergences are wording: *"sleeping
|
| 51 |
peacefully on a bright pink couch"* → *"sleeping on a pink couch"*.
|
| 52 |
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 59 |
|
| 60 |
## Run it
|
| 61 |
|
|
|
|
| 50 |
— int8lin and int4lin both reproduce that 7/9. The divergences are wording: *"sleeping
|
| 51 |
peacefully on a bright pink couch"* → *"sleeping on a pink couch"*.
|
| 52 |
|
| 53 |
+
### iPhone 17 Pro — `ios-h18p/lfm2_5_vl_3b_decode_int4lin` + the fp16 tower
|
| 54 |
+
|
| 55 |
+
**27.5 prefill / 19.3–22.8 decode tok/s**, nat 16/16 and image oracle 24/24, clean at a
|
| 56 |
+
1024-token generation. int8lin does **not** load on iOS (its AOT `resources.bin` is 3.13 GiB);
|
| 57 |
+
int4lin's is 2.03 GiB and does — which is worth stating because the note this port was written
|
| 58 |
+
against put the load wall at 2 GiB, and 2.03 GiB was written up as expected-to-fail before a
|
| 59 |
+
phone was asked. It loaded. Use int8lin on a Mac and int4lin on a phone; on this model int4
|
| 60 |
+
costs nothing (7/9 on the suite, the same cases as fp16).
|
| 61 |
+
|
| 62 |
+
On device the description matches fp32's picture and diverges at the same near-tie the Mac
|
| 63 |
+
bundles take ("sleeping peacefully" → "sleeping"), then onto an equally accurate branch.
|
| 64 |
|
| 65 |
## Run it
|
| 66 |
|