Hugging Face's logo

qualcomm
/
FastSam-X

Image Segmentation
PyTorch
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
619afa1
·
verified ·
1 Parent(s): 308612c

v0.64.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.64.0 for changelog.

Files changed (1) hide show
  1. README.md +52 -50
README.md CHANGED
@@ -14,18 +14,18 @@ pipeline_tag: image-segmentation
14
  The Fast Segment Anything Model (FastSAM) is a novel, real-time CNN-based solution for the Segment Anything task. This task is designed to segment any object within an image based on various possible user interaction prompts. The model performs competitively despite significantly reduced computation, making it a practical choice for a variety of vision tasks.
15
 
16
  This is based on the implementation of FastSam-X found [here](https://github.com/CASIA-LMC-Lab/FastSAM).
17
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/fastsam_x) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
21
  ## Getting Started
22
  Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
23
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/fastsam_x) Python library to compile and export the model with your own:
24
  - Custom weights (e.g., fine-tuned checkpoints)
25
  - Custom input shapes
26
  - Target device and runtime configurations
27
 
28
- See our repository for [FastSam-X on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/fastsam_x) for usage instructions.
29
 
30
 
31
  ## Model Details
@@ -83,55 +83,57 @@ See our repository for [FastSam-X on GitHub](https://github.com/qualcomm/ai-hub-
83
  | FastSam-X | ONNX | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-7790 | 89.626 ms | 9 - 483 MB | NPU
84
  | FastSam-X | ONNX | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-8750 | 30.062 ms | 6 - 439 MB | NPU
85
  | FastSam-X | ONNX | w8a16_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 89.626 ms | 9 - 483 MB | NPU
86
- | FastSam-X | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 17.634 ms | 5 - 218 MB | NPU
87
- | FastSam-X | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 24.957 ms | 5 - 209 MB | NPU
88
- | FastSam-X | QNN_DLC | float | Snapdragon® X2 Elite | 23.236 ms | 5 - 5 MB | NPU
89
- | FastSam-X | QNN_DLC | float | Snapdragon® X Elite | 43.784 ms | 5 - 5 MB | NPU
90
- | FastSam-X | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 32.599 ms | 5 - 294 MB | NPU
91
- | FastSam-X | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 82.024 ms | 4 - 376 MB | NPU
92
- | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 80.207 ms | 5 - 17 MB | NPU
93
- | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 42.426 ms | 5 - 7 MB | NPU
94
- | FastSam-X | QNN_DLC | float | Qualcomm® QCS8450 | 82.024 ms | 4 - 376 MB | NPU
95
- | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 69.026 ms | 7 - 18 MB | NPU
96
- | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 43.784 ms | 5 - 5 MB | NPU
97
- | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 24.957 ms | 5 - 209 MB | NPU
98
- | FastSam-X | QNN_DLC | float | Qualcomm® SA8295P | 76.323 ms | 0 - 287 MB | NPU
99
- | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 11.81 ms | 2 - 321 MB | NPU
100
- | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 17.068 ms | 2 - 317 MB | NPU
101
- | FastSam-X | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 13.927 ms | 2 - 2 MB | NPU
102
- | FastSam-X | QNN_DLC | w8a16 | Snapdragon® X Elite | 30.528 ms | 2 - 2 MB | NPU
103
- | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 20.45 ms | 2 - 407 MB | NPU
104
- | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 41.166 ms | 2 - 405 MB | NPU
105
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 147.106 ms | 2 - 9 MB | NPU
106
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 28.913 ms | 2 - 10 MB | NPU
107
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 29.842 ms | 2 - 5 MB | NPU
108
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8775P | 26.699 ms | 1 - 307 MB | NPU
109
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8650P | 26.699 ms | 1 - 307 MB | NPU
110
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8255P | 26.699 ms | 1 - 307 MB | NPU
111
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 41.166 ms | 2 - 405 MB | NPU
112
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 27.2 ms | 1 - 7 MB | NPU
113
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 30.528 ms | 2 - 2 MB | NPU
114
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 618.255 ms | 3 - 459 MB | NPU
115
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 54.139 ms | 2 - 393 MB | NPU
116
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 17.068 ms | 2 - 317 MB | NPU
117
- | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8295P | 44.427 ms | 0 - 307 MB | NPU
118
- | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 54.139 ms | 2 - 393 MB | NPU
119
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 19.383 ms | 2 - 416 MB | NPU
120
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 8 Elite For Galaxy Mobile | 28.926 ms | 0 - 406 MB | NPU
121
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® X2 Elite | 24.374 ms | 2 - 2 MB | NPU
122
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® X Elite | 47.905 ms | 2 - 2 MB | NPU
123
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 34.155 ms | 2 - 500 MB | NPU
124
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ IQ-8275 | 47.992 ms | 2 - 10 MB | NPU
125
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 48.048 ms | 3 - 4 MB | NPU
126
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® SA8775P | 43.823 ms | 1 - 399 MB | NPU
 
 
127
  | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® SA8650P | 43.823 ms | 1 - 399 MB | NPU
128
  | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® SA8255P | 43.823 ms | 1 - 399 MB | NPU
129
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ IQ-9075 | 44.064 ms | 4 - 11 MB | NPU
130
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ IQ-X7181 | 47.905 ms | 2 - 2 MB | NPU
131
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-6690 | 1041.133 ms | 3 - 532 MB | NPU
132
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-7790 | 83.179 ms | 2 - 449 MB | NPU
133
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-8750 | 28.926 ms | 0 - 406 MB | NPU
134
- | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 83.179 ms | 2 - 449 MB | NPU
135
  | FastSam-X | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 17.031 ms | 0 - 256 MB | NPU
136
  | FastSam-X | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 24.645 ms | 6 - 251 MB | NPU
137
  | FastSam-X | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 32.194 ms | 3 - 412 MB | NPU
 
14
  The Fast Segment Anything Model (FastSAM) is a novel, real-time CNN-based solution for the Segment Anything task. This task is designed to segment any object within an image based on various possible user interaction prompts. The model performs competitively despite significantly reduced computation, making it a practical choice for a variety of vision tasks.
15
 
16
  This is based on the implementation of FastSam-X found [here](https://github.com/CASIA-LMC-Lab/FastSAM).
17
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.64.0/src/qai_hub_models/models/fastsam_x) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
21
  ## Getting Started
22
  Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
23
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.64.0/src/qai_hub_models/models/fastsam_x) Python library to compile and export the model with your own:
24
  - Custom weights (e.g., fine-tuned checkpoints)
25
  - Custom input shapes
26
  - Target device and runtime configurations
27
 
28
+ See our repository for [FastSam-X on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.64.0/src/qai_hub_models/models/fastsam_x) for usage instructions.
29
 
30
 
31
  ## Model Details
 
83
  | FastSam-X | ONNX | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-7790 | 89.626 ms | 9 - 483 MB | NPU
84
  | FastSam-X | ONNX | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-8750 | 30.062 ms | 6 - 439 MB | NPU
85
  | FastSam-X | ONNX | w8a16_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 89.626 ms | 9 - 483 MB | NPU
86
+ | FastSam-X | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 17.657 ms | 5 - 217 MB | NPU
87
+ | FastSam-X | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 25.008 ms | 0 - 203 MB | NPU
88
+ | FastSam-X | QNN_DLC | float | Snapdragon® X2 Elite | 23.284 ms | 5 - 5 MB | NPU
89
+ | FastSam-X | QNN_DLC | float | Snapdragon® X Elite | 44.028 ms | 5 - 5 MB | NPU
90
+ | FastSam-X | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 32.45 ms | 5 - 293 MB | NPU
91
+ | FastSam-X | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 79.823 ms | 1 - 374 MB | NPU
92
+ | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 79.839 ms | 5 - 17 MB | NPU
93
+ | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 42.046 ms | 5 - 7 MB | NPU
94
+ | FastSam-X | QNN_DLC | float | Qualcomm® SA8775P | 68.089 ms | 0 - 205 MB | NPU
95
+ | FastSam-X | QNN_DLC | float | Qualcomm® SA8650P | 68.089 ms | 0 - 205 MB | NPU
96
+ | FastSam-X | QNN_DLC | float | Qualcomm® SA8255P | 68.089 ms | 0 - 205 MB | NPU
97
+ | FastSam-X | QNN_DLC | float | Qualcomm® QCS8450 | 79.823 ms | 1 - 374 MB | NPU
98
+ | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 68.704 ms | 5 - 16 MB | NPU
99
+ | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 44.028 ms | 5 - 5 MB | NPU
100
+ | FastSam-X | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 25.008 ms | 0 - 203 MB | NPU
101
+ | FastSam-X | QNN_DLC | float | Qualcomm® SA8295P | 76.375 ms | 0 - 287 MB | NPU
102
+ | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 11.935 ms | 2 - 321 MB | NPU
103
+ | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 17.012 ms | 0 - 315 MB | NPU
104
+ | FastSam-X | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 13.954 ms | 2 - 2 MB | NPU
105
+ | FastSam-X | QNN_DLC | w8a16 | Snapdragon® X Elite | 30.433 ms | 2 - 2 MB | NPU
106
+ | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 20.609 ms | 2 - 407 MB | NPU
107
+ | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 41.05 ms | 2 - 406 MB | NPU
108
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 147.853 ms | 2 - 9 MB | NPU
109
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 29.049 ms | 1 - 8 MB | NPU
110
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 29.439 ms | 2 - 4 MB | NPU
111
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8775P | 26.694 ms | 1 - 307 MB | NPU
112
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8650P | 26.694 ms | 1 - 307 MB | NPU
113
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8255P | 26.694 ms | 1 - 307 MB | NPU
114
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 41.05 ms | 2 - 406 MB | NPU
115
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 27.04 ms | 1 - 8 MB | NPU
116
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 30.433 ms | 2 - 2 MB | NPU
117
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 600.542 ms | 2 - 460 MB | NPU
118
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 53.713 ms | 2 - 394 MB | NPU
119
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 17.012 ms | 0 - 315 MB | NPU
120
+ | FastSam-X | QNN_DLC | w8a16 | Qualcomm® SA8295P | 44.459 ms | 0 - 308 MB | NPU
121
+ | FastSam-X | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 53.713 ms | 2 - 394 MB | NPU
122
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 19.21 ms | 2 - 414 MB | NPU
123
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 8 Elite For Galaxy Mobile | 28.741 ms | 0 - 407 MB | NPU
124
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® X2 Elite | 24.45 ms | 2 - 2 MB | NPU
125
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® X Elite | 47.723 ms | 2 - 2 MB | NPU
126
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 34.243 ms | 2 - 501 MB | NPU
127
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ IQ-8275 | 47.998 ms | 2 - 10 MB | NPU
128
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 46.76 ms | 2 - 7 MB | NPU
129
  | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® SA8650P | 43.823 ms | 1 - 399 MB | NPU
130
  | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® SA8255P | 43.823 ms | 1 - 399 MB | NPU
131
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ IQ-9075 | 43.674 ms | 4 - 11 MB | NPU
132
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ IQ-X7181 | 47.723 ms | 2 - 2 MB | NPU
133
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-6690 | 1033.378 ms | 3 - 532 MB | NPU
134
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-7790 | 83.484 ms | 2 - 448 MB | NPU
135
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Qualcomm® Dragonwing™ Q-8750 | 28.741 ms | 0 - 407 MB | NPU
136
+ | FastSam-X | QNN_DLC | w8a16_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 83.484 ms | 2 - 448 MB | NPU
137
  | FastSam-X | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 17.031 ms | 0 - 256 MB | NPU
138
  | FastSam-X | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 24.645 ms | 6 - 251 MB | NPU
139
  | FastSam-X | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 32.194 ms | 3 - 412 MB | NPU