EdgeTAM: Optimized for Qualcomm Devices
EdgeTAM is a lightweight and efficient version of SAM 2, optimized for on-device tracking and segmenting any object in videos and low memory usage by using a novel 2D Spatial Perceiver and RepViT backbone.
This is based on the implementation of EdgeTAM found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
There are two ways to deploy this model on your device:
Option 1: Download Pre-Exported Models
Below are pre-exported model assets ready for deployment.
| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | Download |
| ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | Download |
| QNN_DLC | float | Universal | QAIRT 2.45 | Download |
| QNN_DLC | w8a8 | Universal | QAIRT 2.45 | Download |
| TFLITE | float | Universal | QAIRT 2.45 | Download |
| TFLITE | w8a8 | Universal | QAIRT 2.45 | Download |
For more device-specific assets and performance metrics, visit EdgeTAM on Qualcomm® AI Hub.
Option 2: Export with Custom Configurations
Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
This option is ideal if you need to customize the model beyond the default configuration provided here.
See our repository for EdgeTAM on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.semantic_segmentation
Model Stats:
- Model checkpoint: edgetam.pt
- Input resolution (Encoder): 1024x1024
- Number of parameters (encoder): 8.3M
- Model size (encoder) (float): 33 MB
- Number of parameters (memory_encoder): 1.2M
- Model size (memory_encoder) (float): 4.6 MB
- Number of parameters (video_decoder): 6.22M
- Model size (video_decoder) (float): 23.7 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| encoder | ONNX | float | Snapdragon® X2 Elite | 8.853 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Snapdragon® X Elite | 17.997 ms | 70 - 70 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 14.055 ms | 56 - 405 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 91.226 ms | 1 - 414 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 17.989 ms | 41 - 63 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS8450 | 91.226 ms | 1 - 414 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 23.303 ms | 12 - 15 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.981 ms | 44 - 381 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 9.52 ms | 44 - 358 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 9.52 ms | 44 - 358 MB | NPU |
| encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 17.997 ms | 70 - 70 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.149 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X Elite | 8.196 ms | 18 - 18 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.395 ms | 14 - 312 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2290.981 ms | 9 - 326 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4489.323 ms | 3 - 6 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.851 ms | 10 - 17 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 2290.981 ms | 9 - 326 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.467 ms | 12 - 273 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 10.584 ms | 15 - 275 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.052 ms | 2 - 283 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 10.474 ms | 14 - 17 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 50.656 ms | 5 - 259 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 10.584 ms | 15 - 275 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.467 ms | 12 - 273 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 8.196 ms | 18 - 18 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.156 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X Elite | 23.558 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 16.832 ms | 12 - 349 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 99.616 ms | 12 - 420 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8275 | 68.709 ms | 0 - 260 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 22.885 ms | 12 - 15 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8775P | 27.475 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8650P | 27.475 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8255P | 27.475 ms | 0 - 258 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8450 | 99.616 ms | 12 - 420 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 28.311 ms | 14 - 48 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.96 ms | 11 - 311 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA7255P | 68.709 ms | 0 - 260 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 11.691 ms | 12 - 288 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8295P | 53.585 ms | 0 - 336 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 11.691 ms | 12 - 288 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 23.558 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 4.333 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 11.643 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.353 ms | 3 - 301 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2262.225 ms | 3 - 326 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4486.468 ms | 3 - 12 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 20.142 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.881 ms | 3 - 158 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 11.569 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 11.569 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 11.569 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2262.225 ms | 3 - 326 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 4.528 ms | 3 - 251 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 11.425 ms | 3 - 263 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.772 ms | 3 - 269 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 11.379 ms | 2 - 12 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 82.972 ms | 5 - 237 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 20.142 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2118.682 ms | 1 - 281 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 11.425 ms | 3 - 263 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.528 ms | 3 - 251 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 11.643 ms | 3 - 3 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 16.626 ms | 18 - 373 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 100.048 ms | 0 - 419 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8275 | 68.77 ms | 7 - 272 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 23.593 ms | 20 - 22 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8775P | 27.58 ms | 20 - 284 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8650P | 27.58 ms | 20 - 284 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8255P | 27.58 ms | 20 - 284 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8450 | 100.048 ms | 0 - 419 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 28.044 ms | 0 - 46 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.953 ms | 20 - 327 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA7255P | 68.77 ms | 7 - 272 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 11.596 ms | 18 - 304 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8295P | 53.563 ms | 20 - 362 MB | NPU |
| encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 11.596 ms | 18 - 304 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.8 ms | 3 - 302 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2264.609 ms | 2 - 327 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4521.946 ms | 5 - 28 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8275 | 13.727 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.015 ms | 5 - 8 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 7.821 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8650P | 7.821 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8255P | 7.821 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 2264.609 ms | 2 - 327 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 2.963 ms | 5 - 249 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 8.175 ms | 2 - 257 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.651 ms | 0 - 262 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.577 ms | 5 - 21 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 75.354 ms | 5 - 235 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 13.727 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 2123.549 ms | 0 - 280 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 8.175 ms | 2 - 257 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 2.963 ms | 5 - 249 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X2 Elite | 10.431 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X Elite | 24.76 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 19.732 ms | 8 - 450 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 40.174 ms | 8 - 332 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 24.879 ms | 8 - 11 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS8450 | 40.174 ms | 8 - 332 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 29.32 ms | 8 - 11 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.769 ms | 2 - 294 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 10.762 ms | 0 - 285 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 10.762 ms | 0 - 285 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 24.76 ms | 8 - 8 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.04 ms | 2 - 2 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X Elite | 6.044 ms | 1 - 1 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 3.893 ms | 2 - 217 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 11.305 ms | 2 - 344 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 37.167 ms | 2 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.71 ms | 1 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 11.305 ms | 2 - 344 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.241 ms | 2 - 297 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 7.0 ms | 2 - 283 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.691 ms | 0 - 298 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 6.238 ms | 2 - 5 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 33.573 ms | 0 - 325 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 7.0 ms | 2 - 283 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.241 ms | 2 - 297 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 6.044 ms | 1 - 1 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.196 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X Elite | 19.737 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 13.404 ms | 0 - 528 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 29.309 ms | 4 - 403 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8275 | 44.894 ms | 0 - 316 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 18.779 ms | 8 - 10 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8775P | 20.804 ms | 0 - 357 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8650P | 20.804 ms | 0 - 357 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8255P | 20.804 ms | 0 - 357 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8450 | 29.309 ms | 4 - 403 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 21.227 ms | 8 - 18 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.228 ms | 4 - 314 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA7255P | 44.894 ms | 0 - 316 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 10.594 ms | 4 - 324 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8295P | 23.527 ms | 0 - 366 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 10.594 ms | 4 - 324 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 19.737 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 3.093 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 6.731 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.102 ms | 0 - 236 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 7.884 ms | 0 - 200 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 36.561 ms | 1 - 5 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 11.39 ms | 2 - 167 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 6.066 ms | 2 - 39 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 6.7 ms | 2 - 168 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 6.7 ms | 2 - 168 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 6.7 ms | 2 - 168 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 7.884 ms | 0 - 200 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 3.075 ms | 1 - 173 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 7.441 ms | 2 - 314 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.6 ms | 1 - 188 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 6.429 ms | 3 - 7 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 50.933 ms | 2 - 324 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 11.39 ms | 2 - 167 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 7.925 ms | 2 - 182 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 7.441 ms | 2 - 314 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.075 ms | 1 - 173 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 6.731 ms | 2 - 2 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 19.27 ms | 0 - 485 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 37.995 ms | 0 - 328 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8275 | 52.98 ms | 0 - 316 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 24.693 ms | 0 - 3 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8775P | 28.718 ms | 0 - 323 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8650P | 28.718 ms | 0 - 323 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8255P | 28.718 ms | 0 - 323 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8450 | 37.995 ms | 0 - 328 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 29.777 ms | 0 - 16 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.874 ms | 0 - 314 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA7255P | 52.98 ms | 0 - 316 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 13.663 ms | 0 - 332 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8295P | 30.082 ms | 0 - 286 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 13.663 ms | 0 - 332 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 6.294 ms | 1 - 259 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 13.376 ms | 1 - 252 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 108.781 ms | 10 - 52 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8275 | 17.715 ms | 1 - 228 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.833 ms | 1 - 3 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 10.055 ms | 1 - 229 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8650P | 10.055 ms | 1 - 229 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8255P | 10.055 ms | 1 - 229 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 13.376 ms | 1 - 252 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 4.651 ms | 1 - 221 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 32.373 ms | 10 - 195 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.031 ms | 1 - 239 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.604 ms | 0 - 9 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 70.336 ms | 10 - 237 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 17.715 ms | 1 - 228 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 12.401 ms | 1 - 231 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 32.373 ms | 10 - 195 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 4.651 ms | 1 - 221 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X2 Elite | 3.427 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X Elite | 7.186 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.072 ms | 17 - 279 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 15.511 ms | 17 - 269 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.245 ms | 16 - 20 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS8450 | 15.511 ms | 17 - 269 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 8.27 ms | 16 - 19 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.475 ms | 2 - 223 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite Mobile | 3.995 ms | 3 - 219 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 3.995 ms | 3 - 219 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 7.186 ms | 16 - 16 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 1.638 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X Elite | 3.598 ms | 4 - 4 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 2.279 ms | 4 - 174 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 4.314 ms | 4 - 170 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 14.559 ms | 4 - 7 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 3.386 ms | 2 - 9 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS8450 | 4.314 ms | 4 - 170 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.849 ms | 0 - 131 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 4.146 ms | 4 - 309 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.518 ms | 0 - 160 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 3.952 ms | 4 - 7 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 20.916 ms | 4 - 261 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 4.146 ms | 4 - 309 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.849 ms | 0 - 131 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.598 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.29 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X Elite | 6.145 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 4.076 ms | 4 - 252 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 9.186 ms | 16 - 243 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8275 | 13.528 ms | 16 - 238 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 5.851 ms | 16 - 18 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8775P | 7.133 ms | 16 - 237 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8650P | 7.133 ms | 16 - 237 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8255P | 7.133 ms | 16 - 237 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8450 | 9.186 ms | 16 - 243 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 6.954 ms | 16 - 34 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.823 ms | 4 - 203 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA7255P | 13.528 ms | 16 - 238 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.171 ms | 4 - 219 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8295P | 8.831 ms | 0 - 200 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.171 ms | 4 - 219 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 6.145 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.778 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 3.298 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.917 ms | 0 - 116 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.428 ms | 0 - 118 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 11.629 ms | 3 - 9 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 5.466 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.915 ms | 4 - 6 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 3.557 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8650P | 3.557 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8255P | 3.557 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 3.428 ms | 0 - 118 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.522 ms | 1 - 94 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.492 ms | 4 - 218 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.322 ms | 1 - 115 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 3.414 ms | 1 - 6 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 13.503 ms | 4 - 280 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 5.466 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 4.041 ms | 4 - 95 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.492 ms | 4 - 218 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.522 ms | 1 - 94 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 3.298 ms | 4 - 4 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 4.014 ms | 0 - 248 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 9.378 ms | 0 - 230 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8275 | 13.387 ms | 0 - 216 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 6.025 ms | 0 - 30 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8775P | 7.188 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8650P | 7.188 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8255P | 7.188 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8450 | 9.378 ms | 0 - 230 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 6.939 ms | 0 - 31 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.859 ms | 0 - 192 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA7255P | 13.387 ms | 0 - 216 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 3.21 ms | 0 - 213 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8295P | 8.73 ms | 0 - 239 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 3.21 ms | 0 - 213 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.916 ms | 0 - 252 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 9.776 ms | 0 - 250 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 37.331 ms | 12 - 59 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8275 | 15.35 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.549 ms | 0 - 22 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8775P | 9.754 ms | 0 - 218 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8650P | 9.754 ms | 0 - 218 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8255P | 9.754 ms | 0 - 218 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 9.776 ms | 0 - 250 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 3.907 ms | 0 - 244 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 15.068 ms | 12 - 204 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.376 ms | 0 - 251 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.445 ms | 0 - 14 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 35.192 ms | 12 - 212 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 15.35 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 9.293 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 15.068 ms | 12 - 204 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 3.907 ms | 0 - 244 MB | NPU |
License
- The license for the original implementation of EdgeTAM can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
