MarshallHD's picture
NVFP4 W4A4 quantization of zerank-2-reranker (selective: transformer linear layers only)
442517e verified