File size: 29,763 Bytes
ae79e10
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c54d79e
ae79e10
 
 
 
 
 
 
 
 
 
 
 
c54d79e
 
 
 
 
 
ae79e10
 
 
 
 
 
c54d79e
ae79e10
 
 
 
 
 
c54d79e
ae79e10
 
 
 
 
 
 
 
c48af34
 
9331153
 
 
 
ae79e10
 
 
 
c54d79e
 
 
 
 
 
 
 
 
 
4e707df
c54d79e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4e707df
c54d79e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4e707df
c54d79e
 
 
 
 
 
4e707df
c54d79e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ae79e10
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
---
library_name: pytorch
license: other
tags:
- foundation
- android
pipeline_tag: image-segmentation

---

![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/edgetam/web-assets/model_demo.png)

# EdgeTAM: Optimized for Qualcomm Devices

EdgeTAM is a lightweight and efficient version of SAM 2, optimized for on-device tracking and segmenting any object in videos and low memory usage by using a novel 2D Spatial Perceiver and RepViT backbone.

This is based on the implementation of EdgeTAM found [here](https://github.com/facebookresearch/EdgeTAM).
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/edgetam) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).

Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.

## Getting Started
There are two ways to deploy this model on your device:

### Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/edgetam/releases/v0.59.0/edgetam-onnx-float.zip)
| ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/edgetam/releases/v0.59.0/edgetam-onnx-w8a8.zip)
| QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/edgetam/releases/v0.59.0/edgetam-qnn_dlc-float.zip)
| QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/edgetam/releases/v0.59.0/edgetam-qnn_dlc-w8a8.zip)
| TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/edgetam/releases/v0.59.0/edgetam-tflite-float.zip)
| TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/edgetam/releases/v0.59.0/edgetam-tflite-w8a8.zip)

For more device-specific assets and performance metrics, visit **[EdgeTAM on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/edgetam)**.


### Option 2: Export with Custom Configurations

Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/edgetam) Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for [EdgeTAM on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/edgetam) for usage instructions.

## Model Details

**Model Type:** Model_use_case.semantic_segmentation

**Model Stats:**
- Model checkpoint: edgetam.pt
- Input resolution (Encoder): 1024x1024
- Number of parameters (encoder): 8.3M
- Model size (encoder) (float): 33 MB
- Number of parameters (memory_encoder): 1.2M
- Model size (memory_encoder) (float): 4.6 MB
- Number of parameters (video_decoder): 6.22M
- Model size (video_decoder) (float): 23.7 MB

## Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
|---|---|---|---|---|---|---
| encoder | ONNX | float | Snapdragon® X2 Elite | 8.833 ms | 70 - 70 MB | NPU
| encoder | ONNX | float | Snapdragon® X Elite | 17.873 ms | 70 - 70 MB | NPU
| encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 14.067 ms | 47 - 394 MB | NPU
| encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 91.154 ms | 3 - 414 MB | NPU
| encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 18.011 ms | 48 - 50 MB | NPU
| encoder | ONNX | float | Qualcomm® QCS8450 | 91.154 ms | 3 - 414 MB | NPU
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 23.122 ms | 12 - 15 MB | NPU
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 17.873 ms | 70 - 70 MB | NPU
| encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 9.541 ms | 44 - 357 MB | NPU
| encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 9.541 ms | 44 - 357 MB | NPU
| encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.981 ms | 44 - 381 MB | NPU
| encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.144 ms | 18 - 18 MB | NPU
| encoder | ONNX | w8a8 | Snapdragon® X Elite | 8.268 ms | 18 - 18 MB | NPU
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.368 ms | 14 - 309 MB | NPU
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2242.426 ms | 4 - 323 MB | NPU
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4475.73 ms | 3 - 6 MB | NPU
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.941 ms | 10 - 16 MB | NPU
| encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 2242.426 ms | 4 - 323 MB | NPU
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 8.411 ms | 13 - 16 MB | NPU
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 8.268 ms | 18 - 18 MB | NPU
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.485 ms | 12 - 272 MB | NPU
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.485 ms | 12 - 272 MB | NPU
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.037 ms | 1 - 279 MB | NPU
| encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.373 ms | 12 - 12 MB | NPU
| encoder | QNN_DLC | float | Snapdragon® X Elite | 23.494 ms | 12 - 12 MB | NPU
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 16.934 ms | 6 - 343 MB | NPU
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 99.518 ms | 12 - 422 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 68.706 ms | 17 - 277 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 23.012 ms | 12 - 14 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® SA8775P | 27.492 ms | 0 - 258 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® SA8650P | 27.492 ms | 0 - 258 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® SA8255P | 27.492 ms | 0 - 258 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® QCS8450 | 99.518 ms | 12 - 422 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 28.948 ms | 12 - 46 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 23.494 ms | 12 - 12 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 11.663 ms | 11 - 288 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® SA7255P | 68.706 ms | 17 - 277 MB | NPU
| encoder | QNN_DLC | float | Qualcomm® SA8295P | 53.547 ms | 0 - 335 MB | NPU
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 11.663 ms | 11 - 288 MB | NPU
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.951 ms | 12 - 314 MB | NPU
| encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 4.293 ms | 3 - 3 MB | NPU
| encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 11.677 ms | 3 - 3 MB | NPU
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.34 ms | 3 - 302 MB | NPU
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2266.154 ms | 3 - 325 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4540.687 ms | 3 - 12 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 20.15 ms | 3 - 260 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.89 ms | 3 - 5 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 11.599 ms | 3 - 259 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 11.599 ms | 3 - 259 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 11.599 ms | 3 - 259 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2266.154 ms | 3 - 325 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 13.72 ms | 0 - 10 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 11.677 ms | 3 - 3 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 54.705 ms | 5 - 238 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 11.474 ms | 3 - 264 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.523 ms | 3 - 251 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 20.15 ms | 3 - 260 MB | NPU
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2125.515 ms | 1 - 280 MB | NPU
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 4.523 ms | 3 - 251 MB | NPU
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.779 ms | 3 - 269 MB | NPU
| encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 11.474 ms | 3 - 264 MB | NPU
| encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 16.656 ms | 20 - 371 MB | NPU
| encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 100.989 ms | 0 - 418 MB | NPU
| encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 68.748 ms | 20 - 285 MB | NPU
| encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 23.003 ms | 20 - 39 MB | NPU
| encoder | TFLITE | float | Qualcomm® SA8775P | 27.589 ms | 20 - 285 MB | NPU
| encoder | TFLITE | float | Qualcomm® SA8650P | 27.589 ms | 20 - 285 MB | NPU
| encoder | TFLITE | float | Qualcomm® SA8255P | 27.589 ms | 20 - 285 MB | NPU
| encoder | TFLITE | float | Qualcomm® QCS8450 | 100.989 ms | 0 - 418 MB | NPU
| encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 28.764 ms | 0 - 46 MB | NPU
| encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 11.636 ms | 19 - 306 MB | NPU
| encoder | TFLITE | float | Qualcomm® SA7255P | 68.748 ms | 20 - 285 MB | NPU
| encoder | TFLITE | float | Qualcomm® SA8295P | 53.506 ms | 20 - 365 MB | NPU
| encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 11.636 ms | 19 - 306 MB | NPU
| encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.952 ms | 20 - 321 MB | NPU
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.799 ms | 3 - 301 MB | NPU
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2252.678 ms | 2 - 327 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4541.95 ms | 0 - 24 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 13.689 ms | 5 - 260 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.068 ms | 5 - 7 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 7.833 ms | 5 - 260 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® SA8650P | 7.833 ms | 5 - 260 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® SA8255P | 7.833 ms | 5 - 260 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 2252.678 ms | 2 - 327 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 7.529 ms | 2 - 19 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 68.192 ms | 5 - 235 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 8.209 ms | 5 - 260 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 2.964 ms | 4 - 249 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 13.689 ms | 5 - 260 MB | NPU
| encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 2095.818 ms | 1 - 281 MB | NPU
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 2.964 ms | 4 - 249 MB | NPU
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.66 ms | 0 - 262 MB | NPU
| encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 8.209 ms | 5 - 260 MB | NPU
| memory_encoder | ONNX | float | Snapdragon® X2 Elite | 10.393 ms | 8 - 8 MB | NPU
| memory_encoder | ONNX | float | Snapdragon® X Elite | 24.795 ms | 8 - 8 MB | NPU
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 19.513 ms | 8 - 447 MB | NPU
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 39.947 ms | 8 - 334 MB | NPU
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 24.898 ms | 8 - 333 MB | NPU
| memory_encoder | ONNX | float | Qualcomm® QCS8450 | 39.947 ms | 8 - 334 MB | NPU
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 35.317 ms | 8 - 11 MB | NPU
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 24.795 ms | 8 - 8 MB | NPU
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 10.737 ms | 2 - 285 MB | NPU
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 10.737 ms | 2 - 285 MB | NPU
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.758 ms | 2 - 296 MB | NPU
| memory_encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.054 ms | 2 - 2 MB | NPU
| memory_encoder | ONNX | w8a8 | Snapdragon® X Elite | 6.028 ms | 2 - 2 MB | NPU
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 3.887 ms | 2 - 217 MB | NPU
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 11.375 ms | 2 - 344 MB | NPU
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 37.721 ms | 2 - 5 MB | NPU
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.803 ms | 1 - 114 MB | NPU
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 11.375 ms | 2 - 344 MB | NPU
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 6.252 ms | 2 - 5 MB | NPU
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 6.028 ms | 2 - 2 MB | NPU
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.212 ms | 1 - 296 MB | NPU
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.212 ms | 1 - 296 MB | NPU
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.691 ms | 0 - 298 MB | NPU
| memory_encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.191 ms | 8 - 8 MB | NPU
| memory_encoder | QNN_DLC | float | Snapdragon® X Elite | 19.855 ms | 8 - 8 MB | NPU
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 13.454 ms | 2 - 531 MB | NPU
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 29.498 ms | 4 - 404 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 44.849 ms | 0 - 316 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 18.732 ms | 8 - 11 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® SA8775P | 20.808 ms | 0 - 357 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® SA8650P | 20.808 ms | 0 - 357 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® SA8255P | 20.808 ms | 0 - 357 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8450 | 29.498 ms | 4 - 404 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 20.881 ms | 8 - 18 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 19.855 ms | 8 - 8 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 10.58 ms | 4 - 323 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® SA7255P | 44.849 ms | 0 - 316 MB | NPU
| memory_encoder | QNN_DLC | float | Qualcomm® SA8295P | 23.474 ms | 0 - 366 MB | NPU
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 10.58 ms | 4 - 323 MB | NPU
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.221 ms | 4 - 315 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 3.08 ms | 2 - 2 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 6.697 ms | 2 - 2 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.071 ms | 0 - 236 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 7.907 ms | 0 - 198 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 37.0 ms | 1 - 5 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 11.38 ms | 2 - 168 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 6.038 ms | 2 - 4 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 6.696 ms | 2 - 169 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 6.696 ms | 2 - 169 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 6.696 ms | 2 - 169 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 7.907 ms | 0 - 198 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 6.439 ms | 1 - 4 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 6.697 ms | 2 - 2 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 47.682 ms | 2 - 324 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 7.471 ms | 1 - 312 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.061 ms | 1 - 173 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 11.38 ms | 2 - 168 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 7.897 ms | 2 - 183 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 3.061 ms | 1 - 173 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.598 ms | 1 - 189 MB | NPU
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 7.471 ms | 1 - 312 MB | NPU
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 19.592 ms | 0 - 364 MB | NPU
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 37.949 ms | 0 - 321 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 53.245 ms | 0 - 310 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 24.823 ms | 0 - 3 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® SA8775P | 28.711 ms | 0 - 311 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® SA8650P | 28.711 ms | 0 - 311 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® SA8255P | 28.711 ms | 0 - 311 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® QCS8450 | 37.949 ms | 0 - 321 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 29.135 ms | 0 - 16 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 16.048 ms | 0 - 319 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® SA7255P | 53.245 ms | 0 - 310 MB | NPU
| memory_encoder | TFLITE | float | Qualcomm® SA8295P | 33.501 ms | 0 - 289 MB | NPU
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 16.048 ms | 0 - 319 MB | NPU
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.939 ms | 0 - 305 MB | NPU
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 6.281 ms | 0 - 254 MB | NPU
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 13.376 ms | 1 - 252 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 113.201 ms | 10 - 52 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 17.743 ms | 1 - 228 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.824 ms | 1 - 4 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 10.102 ms | 1 - 228 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8650P | 10.102 ms | 1 - 228 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8255P | 10.102 ms | 1 - 228 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 13.376 ms | 1 - 252 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.589 ms | 1 - 9 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 70.994 ms | 10 - 236 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 32.376 ms | 10 - 196 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.657 ms | 0 - 237 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 17.743 ms | 1 - 228 MB | NPU
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 12.332 ms | 1 - 231 MB | NPU
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 4.657 ms | 0 - 237 MB | NPU
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.031 ms | 1 - 241 MB | NPU
| memory_encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 32.376 ms | 10 - 196 MB | NPU
| video_decoder | ONNX | float | Snapdragon® X2 Elite | 3.361 ms | 16 - 16 MB | NPU
| video_decoder | ONNX | float | Snapdragon® X Elite | 7.135 ms | 16 - 16 MB | NPU
| video_decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.062 ms | 17 - 278 MB | NPU
| video_decoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 15.432 ms | 17 - 268 MB | NPU
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.253 ms | 16 - 20 MB | NPU
| video_decoder | ONNX | float | Qualcomm® QCS8450 | 15.432 ms | 17 - 268 MB | NPU
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 8.283 ms | 16 - 19 MB | NPU
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 7.135 ms | 16 - 16 MB | NPU
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 3.987 ms | 3 - 218 MB | NPU
| video_decoder | ONNX | float | Snapdragon® 8 Elite Mobile | 3.987 ms | 3 - 218 MB | NPU
| video_decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.473 ms | 3 - 225 MB | NPU
| video_decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 1.627 ms | 4 - 4 MB | NPU
| video_decoder | ONNX | w8a8 | Snapdragon® X Elite | 3.603 ms | 4 - 4 MB | NPU
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 2.291 ms | 4 - 221 MB | NPU
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 4.29 ms | 4 - 171 MB | NPU
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 14.04 ms | 4 - 7 MB | NPU
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 3.409 ms | 2 - 163 MB | NPU
| video_decoder | ONNX | w8a8 | Qualcomm® QCS8450 | 4.29 ms | 4 - 171 MB | NPU
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 4.565 ms | 4 - 7 MB | NPU
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.603 ms | 4 - 4 MB | NPU
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.844 ms | 0 - 134 MB | NPU
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.844 ms | 0 - 134 MB | NPU
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.544 ms | 1 - 163 MB | NPU
| video_decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.406 ms | 16 - 16 MB | NPU
| video_decoder | QNN_DLC | float | Snapdragon® X Elite | 6.073 ms | 16 - 16 MB | NPU
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 4.107 ms | 3 - 249 MB | NPU
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 9.23 ms | 4 - 229 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 13.563 ms | 16 - 239 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.898 ms | 10 - 13 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® SA8775P | 7.17 ms | 16 - 236 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® SA8650P | 7.17 ms | 16 - 236 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® SA8255P | 7.17 ms | 16 - 236 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® QCS8450 | 9.23 ms | 4 - 229 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 6.957 ms | 16 - 34 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 6.073 ms | 16 - 16 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.174 ms | 4 - 219 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® SA7255P | 13.563 ms | 16 - 239 MB | NPU
| video_decoder | QNN_DLC | float | Qualcomm® SA8295P | 8.879 ms | 0 - 200 MB | NPU
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.174 ms | 4 - 219 MB | NPU
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.815 ms | 4 - 201 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.79 ms | 4 - 4 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 3.349 ms | 4 - 4 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.912 ms | 0 - 115 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.441 ms | 0 - 118 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 11.418 ms | 1 - 7 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 5.447 ms | 4 - 92 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.895 ms | 4 - 120 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 3.538 ms | 4 - 94 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 3.538 ms | 4 - 94 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 3.538 ms | 4 - 94 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 3.441 ms | 0 - 118 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 3.362 ms | 1 - 7 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.349 ms | 4 - 4 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.874 ms | 9 - 286 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.459 ms | 4 - 217 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.514 ms | 1 - 94 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 5.447 ms | 4 - 92 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 4.039 ms | 4 - 110 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.514 ms | 1 - 94 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.322 ms | 1 - 114 MB | NPU
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.459 ms | 4 - 217 MB | NPU
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 4.041 ms | 0 - 247 MB | NPU
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 9.392 ms | 0 - 229 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 13.405 ms | 0 - 216 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.865 ms | 0 - 3 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® SA8775P | 7.224 ms | 0 - 222 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® SA8650P | 7.224 ms | 0 - 222 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® SA8255P | 7.224 ms | 0 - 222 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® QCS8450 | 9.392 ms | 0 - 229 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 6.944 ms | 0 - 31 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 3.196 ms | 0 - 215 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® SA7255P | 13.405 ms | 0 - 216 MB | NPU
| video_decoder | TFLITE | float | Qualcomm® SA8295P | 8.747 ms | 0 - 238 MB | NPU
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 3.196 ms | 0 - 215 MB | NPU
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.838 ms | 0 - 191 MB | NPU
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.902 ms | 0 - 250 MB | NPU
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 9.803 ms | 0 - 246 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 40.448 ms | 12 - 59 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 15.367 ms | 0 - 215 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.546 ms | 0 - 28 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8775P | 9.778 ms | 0 - 219 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8650P | 9.778 ms | 0 - 219 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8255P | 9.778 ms | 0 - 219 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 9.803 ms | 0 - 246 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.467 ms | 0 - 14 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 35.113 ms | 12 - 213 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 15.327 ms | 12 - 204 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.877 ms | 0 - 248 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 15.367 ms | 0 - 215 MB | NPU
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 9.27 ms | 0 - 222 MB | NPU
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 3.877 ms | 0 - 248 MB | NPU
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.381 ms | 0 - 250 MB | NPU
| video_decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 15.327 ms | 12 - 204 MB | NPU

## License
* The license for the original implementation of EdgeTAM can be found
  [here](https://github.com/facebookresearch/EdgeTAM/blob/main/LICENSE).

## References
* [EdgeTAM: On-Device Track Anything Model](https://arxiv.org/abs/2501.07256)
* [Source Model Implementation](https://github.com/facebookresearch/EdgeTAM)

## Community
* Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
* For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).