leoncca/Qwen3.5-122B-A10B-Heretic-Selective-AWQ
Image-Text-to-Text • 125B • Updated • 17
Models built for and runtime-validated on NVIDIA Tesla V100/SM70, with frozen recipes, checksums, benchmarks, and explicit quality limits.
Note Activation-aware selective AWQ W4A16; validated on 4x V100 32GB TP4 with no CPU weight offload.
Note Selective AWQ W4A16 for 4x V100 32GB TP4. Quantization/runtime validated; known Laguna-family output-quality caveats remain, and this artifact does not claim to fix them.