Commit History
-
Add/update the quantized ONNX model files and README.md for Transformers.js v3
Verified signature## Applied Quantizations ### ✅ Based on `decoder_model.onnx` *with* slimming ↳ ✅ `int8`: `decoder_model_int8.onnx` (added) ↳ ✅ `uint8`: `decoder_model_uint8.onnx` (added) ↳ ✅ `q4`: `decoder_model_q4.onnx` (added) ↳ ✅ `q4f16`: `decoder_model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `decoder_model_bnb4.onnx` (added) ### ✅ Based on `decoder_model.onnx` *with* slimming ↳ ✅ `int8`: `decoder_model_int8.onnx` (added) ↳ ✅ `uint8`: `decoder_model_uint8.onnx` (added) ↳ ✅ `q4`: `decoder_model_q4.onnx` (added) ↳ ✅ `q4f16`: `decoder_model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `decoder_model_bnb4.onnx` (added) ### ✅ Based on `decoder_with_past_model.onnx` *with* slimming ↳ ✅ `fp16`: `decoder_with_past_model_fp16.onnx` (added) ↳ ✅ `int8`: `decoder_with_past_model_int8.onnx` (added) ↳ ✅ `uint8`: `decoder_with_past_model_uint8.onnx` (added) ↳ ✅ `q4`: `decoder_with_past_model_q4.onnx` (added) ↳ ✅ `q4f16`: `decoder_with_past_model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `decoder_with_past_model_bnb4.onnx` (added) ### ✅ …bed8038
-
Upload folder using huggingface_hub
Verified signature282efc0
-
Upload fp16 ONNX weights
Verified signature48ea906
-
Upload folder using huggingface_hub
b645993 -
Upload folder using huggingface_hub
1c7ebbb -
Upload folder using huggingface_hub
247a083
-
Upload folder using huggingface_hub
141c21d