Commit History
-
Add exported onnx model 'model_qint8_avx512_vnni.onnx'
Verified signatureHello! *This pull request has been automatically generated from the [`export_dynamic_quantized_onnx_model`](https://sbert.net/docs/package_reference/util.html#sentence_transformers.backend.export_dynamic_quantized_onnx_model) function from the Sentence Transformers library.* ## Config ```python QuantizationConfig( is_static=False, format=<QuantFormat.QOperator: 0>, mode=<QuantizationMode.IntegerOps: 0>, activations_dtype=<QuantType.QUInt8: 1>, activations_symmetric=False, weights_dtype=<QuantType.QInt8: 0>, weights_symmetric=True, per_channel=True, reduce_range=False, nodes_to_quantize=[], nodes_to_exclude=[], operators_to_quantize=['Conv', 'MatMul', 'Attention', 'LSTM', 'Gather', 'Transpose', 'EmbedLayerNormalization'], qdq_add_pair_to_weight=False, qdq_dedicated_pair=False, qdq_op_type_per_channel_support_to_axis={'MatMul': 1} ) ``` ## Tip: Consider testing this pull request before merging by loading the model from this PR with the `revision` argument: ```pyth…10a40f0
-
Adding ONNX file of this model (#11)
- Adding ONNX file of this model (3a233be0ddddb328f8b63b9f9b65b3969ba2f504) Co-authored-by: Nayan Shah <nayan06@users.noreply.huggingface.co>1c644c9
