EfficientSAM3 EV-M, ONNX export for PIXL

This repository holds PIXL's ONNX export of EfficientSAM3 EV-M (SimonZeng7108/efficientsam3): an EfficientViT image encoder and a MobileCLIP-S0 text encoder, distilled from Meta's SAM 3, with SAM 3's decoder. It is split into three graphs, run by the PIXL engine's segment_concept (@xuckless/pixl-engine).

  • The weights are distilled from SAM 3 and are under the SAM License (LICENSE). Your use is bound by that agreement, trade controls included.
  • EfficientSAM3's code is Apache-2.0 (LICENSE-code).

This is not an official Meta or EfficientSAM3 release.

Files

File Bytes SHA-256
efficientsam3_ev_m_image_encoder.onnx 85,436,582 2ed08306579138120dbf9f1110fd31784d1c20fe1b67fa2187a0a2a6d7c82729
efficientsam3_ev_m_text_encoder.onnx 169,171,689 3065ea6116f21f6e22bc70a0c041e5da9ae05fdec7b48df953394f5657609590
efficientsam3_ev_m_decoder.onnx 129,858,624 16accc22a07ee99c73ef8a14e286ec567f94c116e0d8efa1a3a6c0bc9a2596a8

The text encoder takes 16 tokens. The decoder has 8 exemplar slots and a mask.

How it was made

  • Source: Simon7108528/EfficientSAM3 at 85b05896928f974e308f889d7ccb2eefc069de98, efficientsam3_ft/efficientsam3_efficientvit.pt (sha256 086b04b2e7da7cc98aa4621b70c7291608aa9d187357b98d03bd4d6533ed5a17). The checkpoint loads with 0 missing and 0 unexpected keys.
  • Export: tests/models/export/export_sam3.py --variant efficientsam3-ev-m in xuckless/pixl-engine, run with torch 2.14.0+cpu, onnx 1.23.0 and onnxruntime 1.30.0. It is byte-reproducible.
  • Checked against PyTorch:
    • image encoder within 2.1e-5;
    • text encoder within 2.8e-6;
    • decoder within 5.0e-3.

Note: in PIXL's own checks on real photographs it agrees with SAM 3 on clear nouns, but it answers confidently wrong on vague phrases where SAM 3 returns nothing. PIXL offers SAM 3 as the phrase model, and this one as the lighter alternative.

Attribution

SAM 3 © Meta Platforms, Inc., under the SAM License. EfficientSAM3 by Simon Zeng et al. (Apache-2.0 code). Exported by PIXL (xuckless).

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for xuckless/pixl-efficientsam3-onnx

Quantized
(1)
this model