Image Segmentation
PyTorch
android

FastSam-X: Optimized for Qualcomm Devices

The Fast Segment Anything Model (FastSAM) is a novel, real-time CNN-based solution for the Segment Anything task. This task is designed to segment any object within an image based on various possible user interaction prompts. The model performs competitively despite significantly reduced computation, making it a practical choice for a variety of vision tasks.

This is based on the implementation of FastSam-X found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for FastSam-X on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.semantic_segmentation

Model Stats:

  • Inference latency: RealTime
  • Input resolution: 640x640
  • Model checkpoint: fastsam-x.pt
  • Model size (float): 276 MB
  • Number of parameters: 72.2M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
FastSam-X ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 18.493 ms 13 - 253 MB NPU
FastSam-X ONNX float Snapdragon® 8 Elite For Galaxy Mobile 26.058 ms 13 - 235 MB NPU
FastSam-X ONNX float Snapdragon® X2 Elite 23.662 ms 17 - 17 MB NPU
FastSam-X ONNX float Snapdragon® X Elite 44.703 ms 140 - 140 MB NPU
FastSam-X ONNX float Snapdragon® 8 Gen 3 Mobile 33.662 ms 17 - 323 MB NPU
FastSam-X ONNX float Snapdragon® 8 Gen 1 Mobile 87.074 ms 17 - 408 MB NPU
FastSam-X ONNX float Qualcomm® Dragonwing™ IQ-8275 81.853 ms 5 - 14 MB NPU
FastSam-X ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 44.315 ms 0 - 612 MB NPU
FastSam-X ONNX float Qualcomm® QCS8450 87.074 ms 17 - 408 MB NPU
FastSam-X ONNX float Qualcomm® Dragonwing™ IQ-9075 70.394 ms 12 - 20 MB NPU
FastSam-X ONNX float Qualcomm® Dragonwing™ IQ-X7181 44.703 ms 140 - 140 MB NPU
FastSam-X ONNX float Qualcomm® Dragonwing™ Q-8750 26.058 ms 13 - 235 MB NPU
FastSam-X ONNX w8a16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 13.599 ms 6 - 358 MB NPU
FastSam-X ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 19.247 ms 6 - 348 MB NPU
FastSam-X ONNX w8a16 Snapdragon® X2 Elite 14.729 ms 9 - 9 MB NPU
FastSam-X ONNX w8a16 Snapdragon® X Elite 31.022 ms 71 - 71 MB NPU
FastSam-X ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 21.375 ms 2 - 438 MB NPU
FastSam-X ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 45.905 ms 0 - 439 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 152.763 ms 6 - 12 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 30.06 ms 6 - 12 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 30.863 ms 0 - 80 MB NPU
FastSam-X ONNX w8a16 Qualcomm® QCS8450 45.905 ms 0 - 439 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 29.836 ms 6 - 12 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 31.022 ms 71 - 71 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 600.685 ms 0 - 486 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 55.911 ms 8 - 423 MB NPU
FastSam-X ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 19.247 ms 6 - 348 MB NPU
FastSam-X ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 55.911 ms 8 - 423 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 20.026 ms 7 - 446 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Snapdragon® 8 Elite For Galaxy Mobile 30.062 ms 6 - 439 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Snapdragon® X2 Elite 25.069 ms 9 - 9 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Snapdragon® X Elite 49.056 ms 132 - 132 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Snapdragon® 8 Gen 3 Mobile 35.43 ms 0 - 525 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Qualcomm® Dragonwing™ IQ-8275 49.133 ms 6 - 12 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 48.331 ms 0 - 699 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Qualcomm® Dragonwing™ IQ-9075 45.91 ms 6 - 12 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Qualcomm® Dragonwing™ IQ-X7181 49.056 ms 132 - 132 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Qualcomm® Dragonwing™ Q-6690 1008.939 ms 0 - 575 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Qualcomm® Dragonwing™ Q-7790 89.626 ms 9 - 483 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Qualcomm® Dragonwing™ Q-8750 30.062 ms 6 - 439 MB NPU
FastSam-X ONNX w8a16_mixed_int16 Snapdragon® 7 Gen 4 Mobile 89.626 ms 9 - 483 MB NPU
FastSam-X QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 17.634 ms 5 - 218 MB NPU
FastSam-X QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 24.957 ms 5 - 209 MB NPU
FastSam-X QNN_DLC float Snapdragon® X2 Elite 23.236 ms 5 - 5 MB NPU
FastSam-X QNN_DLC float Snapdragon® X Elite 43.784 ms 5 - 5 MB NPU
FastSam-X QNN_DLC float Snapdragon® 8 Gen 3 Mobile 32.599 ms 5 - 294 MB NPU
FastSam-X QNN_DLC float Snapdragon® 8 Gen 1 Mobile 82.024 ms 4 - 376 MB NPU
FastSam-X QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 80.207 ms 5 - 17 MB NPU
FastSam-X QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 42.426 ms 5 - 7 MB NPU
FastSam-X QNN_DLC float Qualcomm® QCS8450 82.024 ms 4 - 376 MB NPU
FastSam-X QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 69.026 ms 7 - 18 MB NPU
FastSam-X QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 43.784 ms 5 - 5 MB NPU
FastSam-X QNN_DLC float Qualcomm® Dragonwing™ Q-8750 24.957 ms 5 - 209 MB NPU
FastSam-X QNN_DLC float Qualcomm® SA8295P 76.323 ms 0 - 287 MB NPU
FastSam-X QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 11.81 ms 2 - 321 MB NPU
FastSam-X QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 17.068 ms 2 - 317 MB NPU
FastSam-X QNN_DLC w8a16 Snapdragon® X2 Elite 13.927 ms 2 - 2 MB NPU
FastSam-X QNN_DLC w8a16 Snapdragon® X Elite 30.528 ms 2 - 2 MB NPU
FastSam-X QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 20.45 ms 2 - 407 MB NPU
FastSam-X QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 41.166 ms 2 - 405 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 147.106 ms 2 - 9 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 28.913 ms 2 - 10 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 29.842 ms 2 - 5 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® SA8775P 26.699 ms 1 - 307 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® SA8650P 26.699 ms 1 - 307 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® SA8255P 26.699 ms 1 - 307 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® QCS8450 41.166 ms 2 - 405 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 27.2 ms 1 - 7 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 30.528 ms 2 - 2 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 618.255 ms 3 - 459 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 54.139 ms 2 - 393 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 17.068 ms 2 - 317 MB NPU
FastSam-X QNN_DLC w8a16 Qualcomm® SA8295P 44.427 ms 0 - 307 MB NPU
FastSam-X QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 54.139 ms 2 - 393 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 19.383 ms 2 - 416 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Snapdragon® 8 Elite For Galaxy Mobile 28.926 ms 0 - 406 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Snapdragon® X2 Elite 24.374 ms 2 - 2 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Snapdragon® X Elite 47.905 ms 2 - 2 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Snapdragon® 8 Gen 3 Mobile 34.155 ms 2 - 500 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® Dragonwing™ IQ-8275 47.992 ms 2 - 10 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 48.048 ms 3 - 4 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® SA8775P 43.823 ms 1 - 399 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® SA8650P 43.823 ms 1 - 399 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® SA8255P 43.823 ms 1 - 399 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® Dragonwing™ IQ-9075 44.064 ms 4 - 11 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® Dragonwing™ IQ-X7181 47.905 ms 2 - 2 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® Dragonwing™ Q-6690 1041.133 ms 3 - 532 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® Dragonwing™ Q-7790 83.179 ms 2 - 449 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Qualcomm® Dragonwing™ Q-8750 28.926 ms 0 - 406 MB NPU
FastSam-X QNN_DLC w8a16_mixed_int16 Snapdragon® 7 Gen 4 Mobile 83.179 ms 2 - 449 MB NPU
FastSam-X TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 17.031 ms 0 - 256 MB NPU
FastSam-X TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 24.645 ms 6 - 251 MB NPU
FastSam-X TFLITE float Snapdragon® 8 Gen 3 Mobile 32.194 ms 3 - 412 MB NPU
FastSam-X TFLITE float Snapdragon® 8 Gen 1 Mobile 84.318 ms 0 - 492 MB NPU
FastSam-X TFLITE float Qualcomm® Dragonwing™ IQ-8275 79.849 ms 4 - 159 MB NPU
FastSam-X TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 42.51 ms 4 - 8 MB NPU
FastSam-X TFLITE float Qualcomm® SA8775P 67.463 ms 5 - 249 MB NPU
FastSam-X TFLITE float Qualcomm® SA8650P 67.463 ms 5 - 249 MB NPU
FastSam-X TFLITE float Qualcomm® SA8255P 67.463 ms 5 - 249 MB NPU
FastSam-X TFLITE float Qualcomm® QCS8450 84.318 ms 0 - 492 MB NPU
FastSam-X TFLITE float Qualcomm® Dragonwing™ IQ-9075 68.058 ms 4 - 158 MB NPU
FastSam-X TFLITE float Qualcomm® Dragonwing™ Q-8750 24.645 ms 6 - 251 MB NPU
FastSam-X TFLITE float Qualcomm® SA7255P 278.858 ms 5 - 249 MB NPU
FastSam-X TFLITE float Qualcomm® SA8295P 75.585 ms 5 - 324 MB NPU

License

  • The license for the original implementation of FastSam-X can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/FastSam-X