File size: 741 Bytes
33333e8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | ---
library_name: transformers
tags:
- vision-language
- document-understanding
- boundingdocs
- bitsandbytes
- 8-bit
---
# CompressingVLM/glm-ocr-boundingdocs-ft-bnb-int8
Source model: `/content/dce_checkpoints/gaycor/base_glm_ocr_unquantized`
Quantization: bitsandbytes 8-bit.
Model kind: `gaycor_tit GLM-OCR LoRA fine-tuned checkpoint-8000`
This repository stores a PEFT adapter plus quantization metadata. Load the base model with the included BitsAndBytesConfig and then apply the adapter.
The accompanying notebooks evaluate with the same branch metrics used before quantization:
ANLS, spatial precision/recall/F1, `ANLS * Spatial F1`, and bbox coverage. For the Qwen distilled model they also report value exact/contains match.
|