docs: sync with latest GitHub (OpenBMB links, examples, KIE, seal/chart prompts)
Browse files- .gitattributes +1 -0
- README.md +31 -9
- assets/minicpm-ocr-chinese-cases.png +3 -0
.gitattributes
CHANGED
|
@@ -42,3 +42,4 @@ assets/minicpm-english-examples-3-column.gif filter=lfs diff=lfs merge=lfs -text
|
|
| 42 |
assets/minicpm-ocr-english-cases.png filter=lfs diff=lfs merge=lfs -text
|
| 43 |
assets/ocr-benchmarks.png filter=lfs diff=lfs merge=lfs -text
|
| 44 |
assets/throughput-comparison.png filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 42 |
assets/minicpm-ocr-english-cases.png filter=lfs diff=lfs merge=lfs -text
|
| 43 |
assets/ocr-benchmarks.png filter=lfs diff=lfs merge=lfs -text
|
| 44 |
assets/throughput-comparison.png filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
assets/minicpm-ocr-chinese-cases.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -84,23 +84,27 @@ Real throughput also depends on page content, backend, concurrency, and hardware
|
|
| 84 |
|
| 85 |
## Examples
|
| 86 |
|
| 87 |
-
|
| 88 |
-
|
|
|
|
|
|
|
|
|
|
| 89 |
|
| 90 |
**Chinese documents**
|
| 91 |
|
| 92 |
-
<p align="center"><img src="./assets/minicpm-chinese-examples-3-column.gif" alt="Chinese document
|
| 93 |
|
| 94 |
-
|
| 95 |
|
| 96 |
-
|
| 97 |
|
| 98 |
-
|
|
|
|
|
|
|
| 99 |
|
| 100 |
-
|
| 101 |
-
information extraction — originals next to parse results.
|
| 102 |
|
| 103 |
-
<p align="center"><img src="./assets/minicpm-ocr-
|
| 104 |
|
| 105 |
## Model architecture
|
| 106 |
|
|
@@ -165,9 +169,27 @@ The prompt selects the task and must match the region you cropped:
|
|
| 165 |
| Table | `Table Recognition:` | HTML (via SDK post-processing) |
|
| 166 |
| Formula | `Formula Recognition:` | LaTeX |
|
| 167 |
| Inline formula | `Text Recognition:` | LaTeX |
|
|
|
|
|
|
|
| 168 |
|
| 169 |
If `finish_reason` is `length`, the output was truncated — raise the token budget.
|
| 170 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 171 |
### Agent skill
|
| 172 |
|
| 173 |
Have a coding agent follow the skill to set up the environment, download the model, and parse
|
|
|
|
| 84 |
|
| 85 |
## Examples
|
| 86 |
|
| 87 |
+
Left to right: original document, detected layout, and rendered Markdown.
|
| 88 |
+
|
| 89 |
+
**English documents**
|
| 90 |
+
|
| 91 |
+
<p align="center"><img src="./assets/minicpm-english-examples-3-column.gif" alt="English document animation: original, detected layout, and rendered Markdown." width="100%"></p>
|
| 92 |
|
| 93 |
**Chinese documents**
|
| 94 |
|
| 95 |
+
<p align="center"><img src="./assets/minicpm-chinese-examples-3-column.gif" alt="Chinese document animation: original, detected layout, and rendered Markdown." width="100%"></p>
|
| 96 |
|
| 97 |
+
### More examples
|
| 98 |
|
| 99 |
+
Original documents and parsed results, side by side.
|
| 100 |
|
| 101 |
+
**English documents**
|
| 102 |
+
|
| 103 |
+
<p align="center"><img src="./assets/minicpm-ocr-english-cases.png" alt="English examples comparing inputs and results: handwriting, historical and scanned documents, newspapers, financial statements, and key information extraction." width="100%"></p>
|
| 104 |
|
| 105 |
+
**Chinese documents**
|
|
|
|
| 106 |
|
| 107 |
+
<p align="center"><img src="./assets/minicpm-ocr-chinese-cases.png" alt="Chinese examples comparing inputs and results: handwritten notes, complex formulas, newspapers, financial statements, stamped documents, illustrations, and key information extraction." width="100%"></p>
|
| 108 |
|
| 109 |
## Model architecture
|
| 110 |
|
|
|
|
| 169 |
| Table | `Table Recognition:` | HTML (via SDK post-processing) |
|
| 170 |
| Formula | `Formula Recognition:` | LaTeX |
|
| 171 |
| Inline formula | `Text Recognition:` | LaTeX |
|
| 172 |
+
| Seal | `Seal Recognition:` | seal text |
|
| 173 |
+
| Chart | `Chart to Table:` | table |
|
| 174 |
|
| 175 |
If `finish_reason` is `length`, the output was truncated — raise the token budget.
|
| 176 |
|
| 177 |
+
### Key information extraction (KIE)
|
| 178 |
+
|
| 179 |
+
MiniCPM-OCR 1.0 can pull specified fields straight out of an image — for example the store name
|
| 180 |
+
and amount on a receipt. Send the image with a field-extraction prompt and ask for a JSON object;
|
| 181 |
+
you do not need to produce page Markdown first.
|
| 182 |
+
|
| 183 |
+
Use the [image recognition API example](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/vllm_deploy_en.md#22-image-recognition) and
|
| 184 |
+
replace `Text Recognition:` with:
|
| 185 |
+
|
| 186 |
+
```text
|
| 187 |
+
Extract the "store_name", "amount". Format the output as a JSON object with keys: "store_name", "amount". If an item is not in the image, use "###".
|
| 188 |
+
```
|
| 189 |
+
|
| 190 |
+
Replace both field lists with your own field names (Chinese or English). The response is
|
| 191 |
+
model-generated text: parse the JSON and check fields and values before using it downstream.
|
| 192 |
+
|
| 193 |
### Agent skill
|
| 194 |
|
| 195 |
Have a coding agent follow the skill to set up the environment, download the model, and parse
|
assets/minicpm-ocr-chinese-cases.png
ADDED
|
Git LFS Details
|