Commit History
-
Add exported onnx model 'model_quint8_avx2.onnx'
Verified signatureHello! *This pull request has been automatically generated from the [`export_dynamic_quantized_onnx_model`](https://sbert.net/docs/package_reference/util.html#sentence_transformers.backend.export_dynamic_quantized_onnx_model) function from the Sentence Transformers library.* ## Config ```python QuantizationConfig( is_static=False, format=<QuantFormat.QOperator: 0>, mode=<QuantizationMode.IntegerOps: 0>, activations_dtype=<QuantType.QUInt8: 1>, activations_symmetric=False, weights_dtype=<QuantType.QUInt8: 1>, weights_symmetric=True, per_channel=True, reduce_range=False, nodes_to_quantize=[], nodes_to_exclude=[], operators_to_quantize=['Conv', 'MatMul', 'Attention', 'LSTM', 'Gather', 'Transpose', 'EmbedLayerNormalization'], qdq_add_pair_to_weight=False, qdq_dedicated_pair=False, qdq_op_type_per_channel_support_to_axis={'MatMul': 1} ) ``` ## Tip: Consider testing this pull request before merging by loading the model from this PR with the `revision` argument: ```pyt…699f490
-
Adding `safetensors` variant of this model (#8)
- Adding `safetensors` variant of this model (a8ac50516d12b468a8ec7ccd06a2ad64d8e0e69a) Co-authored-by: Metal Whale <metalwhale@users.noreply.huggingface.co>c3e8ac8
-
Update README.md (#7)
- Update README.md (32cfcafcfdd5c16479bf9995da7e3db3d209630c) Co-authored-by: namespace-Pt <namespace-Pt@users.noreply.huggingface.co>b635676 -
Update README.md (#6)
- Update README.md (1661329696483c2d43fae5f241c862deaa8b9dc6) Co-authored-by: namespace-Pt <namespace-Pt@users.noreply.huggingface.co>31a500a
-
Update README.md (#4)
- Update README.md (c5a80429b472525af5f9bd6a5ff4f10ff4cf63b1) Co-authored-by: namespace-Pt <namespace-Pt@users.noreply.huggingface.co>f20d0dd
-
update
46636b5
-
upload
01fe9c0 -
initial commit
59ebfa5