Exporting 🤗 Transformers models to ONNX
🤗 Transformers provides a transformers.onnx package that enables you to
convert model checkpoints to an ONNX graph by leveraging configuration objects.
See the guide on exporting 🤗 Transformers models for more details.
ONNX Configurations
We provide three abstract classes that you should inherit from, depending on the type of model architecture you wish to export:
- Encoder-based models inherit from [
~onnx.config.OnnxConfig] - Decoder-based models inherit from [
~onnx.config.OnnxConfigWithPast] - Encoder-decoder models inherit from [
~onnx.config.OnnxSeq2SeqConfigWithPast]
OnnxConfig
[[autodoc]] onnx.config.OnnxConfig
OnnxConfigWithPast
[[autodoc]] onnx.config.OnnxConfigWithPast
OnnxSeq2SeqConfigWithPast
[[autodoc]] onnx.config.OnnxSeq2SeqConfigWithPast
ONNX Features
Each ONNX configuration is associated with a set of features that enable you to export models for different types of topologies or tasks.
FeaturesManager
[[autodoc]] onnx.features.FeaturesManager