Commit History
-
Add exported onnx model 'model_qint8_avx512_vnni.onnx'
Verified signatureHello! *This pull request has been automatically generated from the [`export_dynamic_quantized_onnx_model`](https://sbert.net/docs/package_reference/util.html#sentence_transformers.backend.export_dynamic_quantized_onnx_model) function from the Sentence Transformers library.* ## Config ```python QuantizationConfig( is_static=False, format=<QuantFormat.QOperator: 0>, mode=<QuantizationMode.IntegerOps: 0>, activations_dtype=<QuantType.QUInt8: 1>, activations_symmetric=False, weights_dtype=<QuantType.QInt8: 0>, weights_symmetric=True, per_channel=True, reduce_range=False, nodes_to_quantize=[], nodes_to_exclude=[], operators_to_quantize=['Conv', 'MatMul', 'Attention', 'LSTM', 'Gather', 'Transpose', 'EmbedLayerNormalization'], qdq_add_pair_to_weight=False, qdq_dedicated_pair=False, qdq_op_type_per_channel_support_to_axis={'MatMul': 1} ) ``` ## Tip: Consider testing this pull request before merging by loading the model from this PR with the `revision` argument: ```pyth…a53d981
-
Update README.md
Verified signature7292217 -
add model weights & configs
Verified signature971dfab -
add ruMTEB metrics
Verified signature720a8a7 -
Update config_sentence_transformers.json
Verified signature5cc05c6
-
Update README.md
Verified signaturea6c7e2d -
Update README.md
Verified signature5861f85
-
Update README.md
Verified signature091e8de -
Update README.md
Verified signaturec24672d -
Update README.md
Verified signaturee1e6966 -
Upload img.jpg
Verified signatureeda83c3 -
Update README.md
Verified signature7980dfb -
Create README.md
Verified signature36d796b -
Add prompts to config
Verified signature537c839 -
initial commit
Verified signature7894c28