Parakeet-TDT-0.6B-v3: Optimized for Qualcomm Devices

Parakeet-TDT-0.6B-v3 is a 600M-parameter ASR model by NVIDIA using TDT architecture with a FastConformer encoder and 2-layer LSTM predictor, split into Encoder, Decoder, and Joint components for efficient on-device inference across English and 25 European languages.

This is based on the implementation of Parakeet-TDT-0.6B-v3 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Deploying Parakeet-TDT-0.6B-v3 on-device

This model is compatible with the Qualcomm Voice AI SDK. Download the SDK from the Qualcomm Package Manager to deploy this model on-device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.51, ONNX Runtime 1.30.0 Download
ONNX mixed_with_float Universal QAIRT 2.51, ONNX Runtime 1.30.0 Download
QNN_DLC float Universal QAIRT 2.51 Download
QNN_DLC mixed_with_float Universal QAIRT 2.51 Download

For more device-specific assets and performance metrics, visit Parakeet-TDT-0.6B-v3 on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for Parakeet-TDT-0.6B-v3 on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.speech_recognition

Model Stats:

  • Input resolution: 128 mel bins x variable time (16kHz mono audio)
  • Model checkpoint: nvidia/parakeet-tdt-0.6b-v3
  • Model size (decoder) (float): 47 MB
  • Model size (encoder) (float): 2270 MB
  • Model size (joint) (float): 20 MB
  • Number of parameters (decoder): 12.2M
  • Number of parameters (encoder): 609.5M
  • Number of parameters (joint): 5.3M
  • Supported languages: English + 25 European languages
  • TDT durations: 5 (0,1,2,3,4 frames)
  • Total parameters: 627.0M
  • Vocabulary size: 8193 (8192 BPE + 1 blank)
  • WER (LibriSpeech test-clean): 1.93%
  • WER (LibriSpeech test-other): 3.59%

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
decoder ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.234 ms 0 - 32 MB NPU
decoder ONNX float Snapdragon® 8 Elite For Galaxy Mobile 0.25 ms 0 - 28 MB NPU
decoder ONNX float Snapdragon® X2 Elite 0.203 ms 1 - 1 MB NPU
decoder ONNX float Snapdragon® X Elite 0.275 ms 23 - 23 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-8275 0.382 ms 0 - 4 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-9075 0.337 ms 0 - 3 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 0.275 ms 23 - 23 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ Q-8750 0.25 ms 0 - 28 MB NPU
decoder ONNX float Snapdragon® 8 Elite Extreme Gen 6 Mobile 0.221 ms 0 - 31 MB NPU
decoder ONNX float Snapdragon® 8 Elite Gen 6 Mobile 0.218 ms 0 - 29 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.16 ms 0 - 33 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.167 ms 0 - 33 MB NPU
decoder ONNX mixed_with_float Snapdragon® X2 Elite 0.109 ms 1 - 1 MB NPU
decoder ONNX mixed_with_float Snapdragon® X Elite 0.182 ms 12 - 12 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 0.238 ms 0 - 4 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 0.232 ms 0 - 3 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 0.182 ms 12 - 12 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 0.167 ms 0 - 33 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite Extreme Gen 6 Mobile 0.145 ms 0 - 34 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 6 Mobile 0.143 ms 0 - 34 MB NPU
decoder QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.237 ms 0 - 31 MB NPU
decoder QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 0.24 ms 0 - 29 MB NPU
decoder QNN_DLC float Snapdragon® X2 Elite 0.244 ms 0 - 0 MB NPU
decoder QNN_DLC float Snapdragon® X Elite 0.366 ms 0 - 0 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 0.381 ms 0 - 3 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 0.328 ms 0 - 2 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 0.366 ms 0 - 0 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 0.24 ms 0 - 29 MB NPU
decoder QNN_DLC float Qualcomm® SA8295P 0.541 ms 0 - 22 MB NPU
decoder QNN_DLC float Snapdragon® 8 Elite Gen 6 Mobile 0.215 ms 0 - 30 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.153 ms 0 - 33 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.157 ms 0 - 37 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® X2 Elite 0.203 ms 0 - 0 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® X Elite 0.274 ms 0 - 0 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 0.221 ms 0 - 3 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 0.217 ms 2 - 4 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 0.274 ms 0 - 0 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 0.157 ms 0 - 37 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® SA8295P 0.396 ms 0 - 31 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Extreme Gen 6 Mobile 0.136 ms 0 - 34 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 6 Mobile 0.142 ms 0 - 33 MB NPU
encoder ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 33.968 ms 2 - 1169 MB NPU
encoder ONNX float Snapdragon® 8 Elite For Galaxy Mobile 40.387 ms 2 - 1150 MB NPU
encoder ONNX float Snapdragon® X2 Elite 32.496 ms 2 - 2 MB NPU
encoder ONNX float Snapdragon® X Elite 74.201 ms 1151 - 1151 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-8275 90.898 ms 1 - 6 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-9075 88.167 ms 1 - 5 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 74.201 ms 1151 - 1151 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ Q-8750 40.387 ms 2 - 1150 MB NPU
encoder ONNX float Snapdragon® 8 Elite Extreme Gen 6 Mobile 30.268 ms 2 - 1143 MB NPU
encoder ONNX float Snapdragon® 8 Elite Gen 6 Mobile 34.065 ms 2 - 1126 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 32.237 ms 2 - 1170 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 40.514 ms 2 - 1157 MB NPU
encoder ONNX mixed_with_float Snapdragon® X2 Elite 45.611 ms 2 - 2 MB NPU
encoder ONNX mixed_with_float Snapdragon® X Elite 74.151 ms 1151 - 1151 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 90.429 ms 1 - 6 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 89.042 ms 1 - 5 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 74.151 ms 1151 - 1151 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 40.514 ms 2 - 1157 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite Extreme Gen 6 Mobile 30.262 ms 2 - 1143 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 6 Mobile 34.157 ms 2 - 1120 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 33.178 ms 1 - 1109 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 39.424 ms 1 - 1104 MB NPU
encoder QNN_DLC float Snapdragon® X2 Elite 33.255 ms 1 - 1 MB NPU
encoder QNN_DLC float Snapdragon® X Elite 75.71 ms 1 - 1 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 92.075 ms 1 - 5 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 88.874 ms 1 - 4 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 75.71 ms 1 - 1 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 39.424 ms 1 - 1104 MB NPU
encoder QNN_DLC float Qualcomm® SA8295P 97.114 ms 0 - 1164 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite Gen 6 Mobile 33.951 ms 1 - 1104 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 32.372 ms 1 - 1109 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 39.973 ms 1 - 1105 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® X2 Elite 33.563 ms 1 - 1 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® X Elite 74.607 ms 1 - 1 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 91.207 ms 1 - 5 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 89.822 ms 1 - 4 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 74.607 ms 1 - 1 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 39.973 ms 1 - 1105 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® SA8295P 97.14 ms 1 - 1165 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Extreme Gen 6 Mobile 29.415 ms 1 - 1093 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 6 Mobile 33.933 ms 1 - 1104 MB NPU
joint ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.202 ms 0 - 44 MB NPU
joint ONNX float Snapdragon® 8 Elite For Galaxy Mobile 0.207 ms 0 - 43 MB NPU
joint ONNX float Snapdragon® X2 Elite 0.145 ms 1 - 1 MB NPU
joint ONNX float Snapdragon® X Elite 0.227 ms 10 - 10 MB NPU
joint ONNX float Qualcomm® Dragonwing™ IQ-8275 0.317 ms 0 - 4 MB NPU
joint ONNX float Qualcomm® Dragonwing™ IQ-9075 0.286 ms 0 - 4 MB NPU
joint ONNX float Qualcomm® Dragonwing™ IQ-X7181 0.227 ms 10 - 10 MB NPU
joint ONNX float Qualcomm® Dragonwing™ Q-8750 0.207 ms 0 - 43 MB NPU
joint ONNX float Snapdragon® 8 Elite Extreme Gen 6 Mobile 0.19 ms 0 - 44 MB NPU
joint ONNX float Snapdragon® 8 Elite Gen 6 Mobile 0.172 ms 0 - 44 MB NPU
joint ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.121 ms 0 - 30 MB NPU
joint ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.124 ms 0 - 32 MB NPU
joint ONNX mixed_with_float Snapdragon® X2 Elite 0.082 ms 1 - 1 MB NPU
joint ONNX mixed_with_float Snapdragon® X Elite 0.129 ms 0 - 0 MB NPU
joint ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 0.268 ms 0 - 4 MB NPU
joint ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 0.201 ms 0 - 4 MB NPU
joint ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 0.129 ms 0 - 0 MB NPU
joint ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 0.124 ms 0 - 32 MB NPU
joint ONNX mixed_with_float Snapdragon® 8 Elite Extreme Gen 6 Mobile 0.111 ms 0 - 28 MB NPU
joint ONNX mixed_with_float Snapdragon® 8 Elite Gen 6 Mobile 0.115 ms 0 - 28 MB NPU
joint QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.211 ms 0 - 45 MB NPU
joint QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 0.218 ms 0 - 47 MB NPU
joint QNN_DLC float Snapdragon® X2 Elite 0.257 ms 0 - 0 MB NPU
joint QNN_DLC float Snapdragon® X Elite 0.342 ms 1 - 1 MB NPU
joint QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 0.293 ms 0 - 3 MB NPU
joint QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 0.281 ms 0 - 2 MB NPU
joint QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 0.342 ms 1 - 1 MB NPU
joint QNN_DLC float Qualcomm® Dragonwing™ Q-8750 0.218 ms 0 - 47 MB NPU
joint QNN_DLC float Qualcomm® SA8295P 0.448 ms 0 - 20 MB NPU
joint QNN_DLC float Snapdragon® 8 Elite Gen 6 Mobile 0.176 ms 0 - 44 MB NPU
joint QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 0.121 ms 0 - 28 MB NPU
joint QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.125 ms 0 - 32 MB NPU
joint QNN_DLC mixed_with_float Snapdragon® X2 Elite 0.176 ms 0 - 0 MB NPU
joint QNN_DLC mixed_with_float Snapdragon® X Elite 0.228 ms 1 - 1 MB NPU
joint QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 0.216 ms 0 - 3 MB NPU
joint QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 0.162 ms 0 - 2 MB NPU
joint QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 0.228 ms 1 - 1 MB NPU
joint QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 0.125 ms 0 - 32 MB NPU
joint QNN_DLC mixed_with_float Qualcomm® SA8295P 0.335 ms 0 - 27 MB NPU
joint QNN_DLC mixed_with_float Snapdragon® 8 Elite Extreme Gen 6 Mobile 0.115 ms 0 - 29 MB NPU
joint QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 6 Mobile 0.114 ms 0 - 29 MB NPU

License

  • The license for the original implementation of Parakeet-TDT-0.6B-v3 can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/Parakeet-TDT-0.6B-v3