Add direct native int8 convrot quantization of v1 test
#1
by LokkenJP - opened
This PR adds a direct native int8 convrot quantization of v1 test.
Labeled HQ due to selective protection of edges in source bf16 precision (blocks 0,1,47-49), preserving all other tensors in their original source precision.
The smaller activation aware quantizations for lower memory requirements and lower-end GPUs with improved quality will come next.
Actual VRAM usage depends on the workflow and other loaded models.
A full model card and standalone releases will follow only once gating for S3 is lifted.
TenStrip changed pull request status to merged