Commit History
-
Re-quantize with float16 for T4 GPU compatibility
Verified signaturec68d969 -
Remove model.safetensors - use pytorch_model.bin with INT8 weights
Verified signature29acac0 -
Add back TorchAO INT8 quantization_config for proper loading
Verified signature1209faf -
Remove quantization_config to avoid BitsAndBytes imports
Verified signaturec7f451a -
Upload folder using huggingface_hub
Verified signaturee020402 -
Upload README.md with huggingface_hub
Verified signature8eada2c -
Upload folder using huggingface_hub
Verified signature8bf2e5c -
initial commit
Verified signature4f8176a