sdxl-quant-int8 / math_model.py

Commit History

  1. Update quant params structure (#2)⁠

    Verified signature
    6b62ce4

  1. Remove potential overflow / saturation error.

    161df88
  2. Added comments - highlight possible overflow situation

    3f5851c
  3. Updated math model to target int8 x int8 kernels.

    4024f9d

  1. Updated QOp model to fuse SmoothQuant scales with input quantization

    dca9b6e

  1. Fix: set `keepdim=True`

    9ab1060
  2. [math_model/test] Added "QOp" implementation and basic tests.

    eb5a5f6

  1. Upload math_model.py with huggingface_hub

    Verified signature
    049c65f
  2. Upload math_model.py with huggingface_hub

    Verified signature
    d5dfd96