Commit History

  1. Re-quantize with float16 for T4 GPU compatibility

    Verified signature
    c68d969
  2. Remove model.safetensors - use pytorch_model.bin with INT8 weights

    Verified signature
    29acac0
  3. Add back TorchAO INT8 quantization_config for proper loading

    Verified signature
    1209faf
  4. Remove quantization_config to avoid BitsAndBytes imports

    Verified signature
    c7f451a
  5. Upload folder using huggingface_hub

    Verified signature
    e020402
  6. Upload README.md with huggingface_hub

    Verified signature
    8eada2c
  7. Upload folder using huggingface_hub

    Verified signature
    8bf2e5c
  8. initial commit

    Verified signature
    4f8176a