Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -27,8 +27,14 @@ Both graphs also ship in fp16, and both hold their accuracy there:
|
|
| 27 |
|
| 28 |
Every file takes and returns fp32 tensors, so precision is a file swap — the fp16
|
| 29 |
pair is 68.2 MB against 133.9 MB. Hiera is attention-heavy, which is why fp16 halves
|
| 30 |
-
it cleanly
|
| 31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
|
| 33 |
If size is the binding constraint, look at
|
| 34 |
[EdgeTAM](https://huggingface.co/mlboydaisuke/EdgeTAM-ExecuTorch) — same output
|
|
@@ -59,13 +65,3 @@ torch.export → to_edge_transform_and_lower(XnnpackPartitioner) → .pte, with:
|
|
| 59 |
- identity `repeat_interleave(1, dim)` calls stripped (delegate mis-sizes their
|
| 60 |
decomposition)
|
| 61 |
- constant `dense_prompt_embeddings` (no-mask embedding) baked as a buffer
|
| 62 |
-
|
| 63 |
-
<!-- funnel:v1 -->
|
| 64 |
-
|
| 65 |
-
---
|
| 66 |
-
|
| 67 |
-
**More models in this format:** [ExecuTorch Model Zoo](https://huggingface.co/collections/mlboydaisuke/executorch-model-zoo-6a7ff328390b63075ffeae5e) — 31 models, each with the recipe that produced it.
|
| 68 |
-
|
| 69 |
-
**Want a different model on-device?** [Open a request](https://github.com/john-rocky/on-device-requests) — free, open weights only; the export and its measured numbers get published publicly.
|
| 70 |
-
|
| 71 |
-
<!-- /funnel:v1 -->
|
|
|
|
| 27 |
|
| 28 |
Every file takes and returns fp32 tensors, so precision is a file swap — the fp16
|
| 29 |
pair is 68.2 MB against 133.9 MB. Hiera is attention-heavy, which is why fp16 halves
|
| 30 |
+
it cleanly.
|
| 31 |
+
|
| 32 |
+
Dynamic int8 is measured and not published. It does shrink the encoder — 109.2 MB
|
| 33 |
+
to 29.1 MB at worst-output correlation 0.9958 — but the number that decides is what
|
| 34 |
+
the decoder makes of it. Feeding the int8 encoder's embeddings to the same fp32
|
| 35 |
+
decoder, over 42 clicks the fp32 build answered, the worst decoded mask comes back
|
| 36 |
+
at **0.9375 IoU** against the fp32 encoder's mask (median 0.9956), under the 0.95
|
| 37 |
+
bar every mask on this shelf has to clear.
|
| 38 |
|
| 39 |
If size is the binding constraint, look at
|
| 40 |
[EdgeTAM](https://huggingface.co/mlboydaisuke/EdgeTAM-ExecuTorch) — same output
|
|
|
|
| 65 |
- identity `repeat_interleave(1, dim)` calls stripped (delegate mis-sizes their
|
| 66 |
decomposition)
|
| 67 |
- constant `dense_prompt_embeddings` (no-mask embedding) baked as a buffer
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|