8-bit LLM.int8 decoder-only quant of ekacare/parrotlet-a-2.5-pro (encoder+projector fp16, patched loader)
9ff1e13 verified | { | |
| "base": "ekacare/parrotlet-a-2.5-pro", | |
| "quant": "decoder-only BNB 8-bit LLM.int8 (threshold 6.0), compute fp16 (T4)", | |
| "encoder": "fp16", | |
| "projector": "fp16" | |
| } |