axteam/GLM-OCR-FP8-dynamic
Image-Text-to-Text • 1B • Updated • 19 • 1
Quantized OCR / document VLMs (GLM-OCR, PaddleOCR-VL) — compressed-tensors + GGUF for vLLM / llama.cpp. By axteam.
Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM-servable
Note GGUF Q8_0 / Q4_K_M (text backbone) for llama.cpp
Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM-servable
Note GGUF Q8_0 / Q4_K_M (text backbone) for llama.cpp