MediaPipe-Selfie-Segmentation: Optimized for Qualcomm Devices
Light-weight model that segments a person from the background in square or landscape selfie and video conference imagery.
This is based on the implementation of MediaPipe-Selfie-Segmentation found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
There are two ways to deploy this model on your device:
Option 1: Download Pre-Exported Models
Below are pre-exported model assets ready for deployment.
| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | Download |
| ONNX | w8a16 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | Download |
| ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | Download |
| QNN_DLC | float | Universal | QAIRT 2.45 | Download |
| QNN_DLC | w8a16 | Universal | QAIRT 2.45 | Download |
| QNN_DLC | w8a8 | Universal | QAIRT 2.45 | Download |
| TFLITE | float | Universal | QAIRT 2.45 | Download |
| TFLITE | w8a8 | Universal | QAIRT 2.45 | Download |
For more device-specific assets and performance metrics, visit MediaPipe-Selfie-Segmentation on Qualcomm® AI Hub.
Option 2: Export with Custom Configurations
Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
This option is ideal if you need to customize the model beyond the default configuration provided here.
See our repository for MediaPipe-Selfie-Segmentation on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.semantic_segmentation
Model Stats:
- Model checkpoint: Square
- Input resolution (Square): 256x256
- Input resolution (Landscape): 144x256
- Number of output classes: 6
- Number of parameters: 106K
- Model size (float): 447 KB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| MediaPipe-Selfie-Segmentation | ONNX | float | Snapdragon® X2 Elite | 0.379 ms | 2 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Snapdragon® X Elite | 0.801 ms | 2 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 0.516 ms | 0 - 38 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 1.094 ms | 1 - 44 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.788 ms | 1 - 3 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Qualcomm® QCS8450 | 1.094 ms | 1 - 44 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 0.974 ms | 1 - 4 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 0.801 ms | 2 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.408 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Snapdragon® 8 Elite Mobile | 0.408 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.376 ms | 0 - 27 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Snapdragon® X2 Elite | 0.411 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Snapdragon® X Elite | 0.851 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 0.542 ms | 0 - 43 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 1.039 ms | 0 - 46 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 2.798 ms | 1 - 3 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.827 ms | 0 - 3 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Qualcomm® QCS8450 | 1.039 ms | 0 - 46 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 0.962 ms | 0 - 3 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 0.851 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 0.445 ms | 0 - 33 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 0.445 ms | 0 - 33 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 0.387 ms | 0 - 34 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Snapdragon® X2 Elite | 0.178 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Snapdragon® X Elite | 0.356 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.248 ms | 0 - 40 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 0.452 ms | 0 - 44 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 1.017 ms | 0 - 3 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.364 ms | 0 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Qualcomm® QCS8450 | 0.452 ms | 0 - 44 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 0.537 ms | 0 - 3 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 0.356 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.203 ms | 0 - 33 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 0.203 ms | 0 - 33 MB | NPU |
| MediaPipe-Selfie-Segmentation | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.193 ms | 0 - 30 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Snapdragon® X2 Elite | 0.453 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Snapdragon® X Elite | 0.8 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.455 ms | 0 - 36 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 0.931 ms | 0 - 38 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 1.778 ms | 1 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.68 ms | 1 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® SA8775P | 0.966 ms | 1 - 28 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® SA8650P | 0.966 ms | 1 - 28 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® SA8255P | 0.966 ms | 1 - 28 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® QCS8450 | 0.931 ms | 0 - 38 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 0.843 ms | 3 - 5 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 0.8 ms | 1 - 1 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.359 ms | 1 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® SA7255P | 1.778 ms | 1 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Qualcomm® SA8295P | 1.297 ms | 0 - 24 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 0.359 ms | 1 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.322 ms | 1 - 28 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 0.38 ms | 0 - 0 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Snapdragon® X Elite | 0.728 ms | 0 - 0 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 0.425 ms | 0 - 35 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 0.76 ms | 0 - 42 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 2.557 ms | 0 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8275 | 1.333 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.604 ms | 1 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® SA8775P | 0.816 ms | 0 - 29 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® SA8650P | 0.816 ms | 0 - 29 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® SA8255P | 0.816 ms | 0 - 29 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 0.76 ms | 0 - 42 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 0.734 ms | 2 - 5 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 0.728 ms | 0 - 0 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 2.072 ms | 0 - 139 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 0.61 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 0.328 ms | 0 - 32 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® SA7255P | 1.333 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Qualcomm® SA8295P | 1.068 ms | 0 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 0.328 ms | 0 - 32 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 0.266 ms | 0 - 30 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 0.61 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.24 ms | 0 - 0 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Snapdragon® X Elite | 0.364 ms | 0 - 0 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.184 ms | 0 - 32 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 0.336 ms | 0 - 37 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 0.787 ms | 2 - 4 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 0.678 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.259 ms | 0 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® SA8775P | 0.433 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® SA8650P | 0.433 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® SA8255P | 0.433 ms | 0 - 26 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 0.336 ms | 0 - 37 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 0.347 ms | 2 - 4 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 0.364 ms | 0 - 0 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 0.85 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 0.251 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.146 ms | 0 - 27 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® SA7255P | 0.678 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Qualcomm® SA8295P | 0.608 ms | 0 - 22 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 0.146 ms | 0 - 27 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.135 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 0.251 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.459 ms | 0 - 36 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 0.938 ms | 0 - 43 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 1.79 ms | 0 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.691 ms | 0 - 34 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® SA8775P | 0.985 ms | 0 - 27 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® SA8650P | 0.985 ms | 0 - 27 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® SA8255P | 0.985 ms | 0 - 27 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® QCS8450 | 0.938 ms | 0 - 43 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.058 ms | 0 - 4 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.366 ms | 0 - 30 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® SA7255P | 1.79 ms | 0 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Qualcomm® SA8295P | 1.273 ms | 0 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Snapdragon® 8 Elite Mobile | 0.366 ms | 0 - 30 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.331 ms | 0 - 28 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.186 ms | 0 - 31 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 0.348 ms | 0 - 37 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 0.74 ms | 0 - 3 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 0.719 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 0.261 ms | 0 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® SA8775P | 0.459 ms | 0 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® SA8650P | 0.459 ms | 0 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® SA8255P | 0.459 ms | 0 - 25 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® QCS8450 | 0.348 ms | 0 - 37 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 0.383 ms | 0 - 2 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 0.842 ms | 0 - 21 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 0.257 ms | 0 - 22 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.151 ms | 0 - 22 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® SA7255P | 0.719 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Qualcomm® SA8295P | 0.637 ms | 0 - 21 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 0.151 ms | 0 - 22 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.142 ms | 0 - 23 MB | NPU |
| MediaPipe-Selfie-Segmentation | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 0.257 ms | 0 - 22 MB | NPU |
License
- The license for the original implementation of MediaPipe-Selfie-Segmentation can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
