--- license: apache-2.0 tags: - kornia - image-segmentation - segment-anything --- # kornia/sam Pretrained weights for **Segment Anything (SAM)**, used by `kornia.models.sam.Sam`. SAM predicts object masks from point, box or mask prompts. It pairs a ViT image encoder with a lightweight prompt encoder and mask decoder. **Original repo:** [facebookresearch/segment-anything](https://github.com/facebookresearch/segment-anything) ## Weights | File | Image encoder | |------|---------------| | `sam_vit_b_01ec64.safetensors` | ViT-B | | `sam_vit_l_0b3195.safetensors` | ViT-L | | `sam_vit_h_4b8939.safetensors` | ViT-H | ## Provenance Each file holds the tensors of the upstream checkpoint with the same stem, unchanged: the same keys, dtypes, shapes and bits. The kornia maintainers converted them (converter revision `0c3db846b2`). They checked that a model loaded from either file has a bitwise-identical `state_dict()` and gives bitwise-identical image-encoder outputs. | File | Upstream source | Source sha256 | sha256 | |------|-----------------|---------------|--------| | `sam_vit_b_01ec64.safetensors` | [`sam_vit_b_01ec64.pth`](https://dl.fbaipublicfiles.com/segment_anything/sam_vit_b_01ec64.pth) | `ec2df62732614e57411cdcf32a23ffdf28910380d03139ee0f4fcbe91eb8c912` | `fbf4c1ad844a2e9b867d89dc04a61f3ece19c57ebb7d8fcb6da92062a291d839` | | `sam_vit_l_0b3195.safetensors` | [`sam_vit_l_0b3195.pth`](https://dl.fbaipublicfiles.com/segment_anything/sam_vit_l_0b3195.pth) | `3adcc4315b642a4d2101128f611684e8734c41232a17c648ed1693702a49a622` | `8e087bc0db5cfac2676ae69bb1b846fa1f6cc193fc0beb6be8fb14fc7406be41` | | `sam_vit_h_4b8939.safetensors` | [`sam_vit_h_4b8939.pth`](https://dl.fbaipublicfiles.com/segment_anything/sam_vit_h_4b8939.pth) | `a7bf3b02f3ebf1267aba913ff637d9a2d5c33d3173bb679e46d9f338c26f262e` | `1424ffbab6fa8218aeae5abb931549dcd2d68725220ed14a5d1b579aa503c3e7` | The upstream ViT-B and ViT-L checkpoints store `mask_decoder.iou_token.weight` and `mask_decoder.mask_tokens.weight` as views of one shared storage. The safetensors format forbids shared storage, so each is stored as its own copy with identical values; loading a model copies them into separate parameters either way. ## License Apache-2.0. The upstream README states that "The model is licensed under the Apache 2.0 license". See [`LICENSE`](LICENSE), copied from facebookresearch/segment-anything. The SA-1B dataset has its own licence, which does not apply to these weights. ## Citation ```bibtex @article{kirillov2023segany, title = {Segment Anything}, author = {Kirillov, Alexander and Mintun, Eric and Ravi, Nikhila and Mao, Hanzi and Rolland, Chloe and Gustafson, Laura and Xiao, Tete and Whitehead, Spencer and Berg, Alexander C. and Lo, Wan-Yen and Doll{\'a}r, Piotr and Girshick, Ross}, journal = {arXiv:2304.02643}, year = {2023} } ```