mlboydaisuke commited on
Commit
d3ac8b9
·
verified ·
1 Parent(s): 466b581

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +8 -12
README.md CHANGED
@@ -27,8 +27,14 @@ Both graphs also ship in fp16, and both hold their accuracy there:
27
 
28
  Every file takes and returns fp32 tensors, so precision is a file swap — the fp16
29
  pair is 68.2 MB against 133.9 MB. Hiera is attention-heavy, which is why fp16 halves
30
- it cleanly; dynamic int8 was measured too and is not published, since it leaves the
31
- convolutional parts in fp32 and came out at the full 109.2 MB for the encoder.
 
 
 
 
 
 
32
 
33
  If size is the binding constraint, look at
34
  [EdgeTAM](https://huggingface.co/mlboydaisuke/EdgeTAM-ExecuTorch) — same output
@@ -59,13 +65,3 @@ torch.export → to_edge_transform_and_lower(XnnpackPartitioner) → .pte, with:
59
  - identity `repeat_interleave(1, dim)` calls stripped (delegate mis-sizes their
60
  decomposition)
61
  - constant `dense_prompt_embeddings` (no-mask embedding) baked as a buffer
62
-
63
- <!-- funnel:v1 -->
64
-
65
- ---
66
-
67
- **More models in this format:** [ExecuTorch Model Zoo](https://huggingface.co/collections/mlboydaisuke/executorch-model-zoo-6a7ff328390b63075ffeae5e) — 31 models, each with the recipe that produced it.
68
-
69
- **Want a different model on-device?** [Open a request](https://github.com/john-rocky/on-device-requests) — free, open weights only; the export and its measured numbers get published publicly.
70
-
71
- <!-- /funnel:v1 -->
 
27
 
28
  Every file takes and returns fp32 tensors, so precision is a file swap — the fp16
29
  pair is 68.2 MB against 133.9 MB. Hiera is attention-heavy, which is why fp16 halves
30
+ it cleanly.
31
+
32
+ Dynamic int8 is measured and not published. It does shrink the encoder — 109.2 MB
33
+ to 29.1 MB at worst-output correlation 0.9958 — but the number that decides is what
34
+ the decoder makes of it. Feeding the int8 encoder's embeddings to the same fp32
35
+ decoder, over 42 clicks the fp32 build answered, the worst decoded mask comes back
36
+ at **0.9375 IoU** against the fp32 encoder's mask (median 0.9956), under the 0.95
37
+ bar every mask on this shelf has to clear.
38
 
39
  If size is the binding constraint, look at
40
  [EdgeTAM](https://huggingface.co/mlboydaisuke/EdgeTAM-ExecuTorch) — same output
 
65
  - identity `repeat_interleave(1, dim)` calls stripped (delegate mis-sizes their
66
  decomposition)
67
  - constant `dense_prompt_embeddings` (no-mask embedding) baked as a buffer