coco1-ocr / README.md
Shamika2004's picture
Upload README.md with huggingface_hub
601874e verified
|
Raw History Blame Contribute Delete
1.61 kB
metadata
base_model: Qwen/Qwen3-VL-4B-Instruct
library_name: gguf
pipeline_tag: image-text-to-text
tags:
  - gguf
  - qwen3-vl
  - ocr
  - table-recognition
  - llama.cpp

coco1-ocr (GGUF)

Fine-tuned from Qwen/Qwen3-VL-4B-Instruct (LoRA, merged) for document understanding: table-to-HTML, checkbox/option transcription, handwritten line transcription, digit recognition, and layout detection.

Files

File Purpose
coco1-ocr-Q8_0.gguf Language model (Q8_0)
mmproj-coco1-ocr-f16.gguf Vision projector (F16), required for image input

Usage (llama.cpp)

llama-mtmd-cli -m coco1-ocr-Q8_0.gguf --mmproj mmproj-coco1-ocr-f16.gguf \
  --image table.png \
  -p "Convert the table in the image to HTML. Use only <table>, <tr> and <td>, with rowspan/colspan attributes for merged cells. Keep empty cells as <td></td>."

Prompts used in training

  • table: Convert the table in the image to HTML. Use only , and .
  • check_text: Transcribe the options shown. Put ☑ before the option that is marked or selected and ☐ before every other option.
  • hw_line: Transcribe the handwritten text.
  • digit: What digit is shown? Answer with the digit only.
  • layout: List every layout element with its category and bounding box [x0,y0,x1,y1] in 0-1000 relative coordinates, from top to bottom.
  • Notes

    Converted to GGUF from the merged fine-tuned weights. Use the same prompts as above for best results.

    , with rowspan/colspan attributes for merged cells. Keep empty cells as