tc-mb commited on
Commit
2db951b
·
verified ·
1 Parent(s): a6d9cc2

docs: sync with latest GitHub (OpenBMB links, examples, KIE, seal/chart prompts)

Browse files
.gitattributes CHANGED
@@ -42,3 +42,4 @@ assets/minicpm-english-examples-3-column.gif filter=lfs diff=lfs merge=lfs -text
42
  assets/minicpm-ocr-english-cases.png filter=lfs diff=lfs merge=lfs -text
43
  assets/ocr-benchmarks.png filter=lfs diff=lfs merge=lfs -text
44
  assets/throughput-comparison.png filter=lfs diff=lfs merge=lfs -text
 
 
42
  assets/minicpm-ocr-english-cases.png filter=lfs diff=lfs merge=lfs -text
43
  assets/ocr-benchmarks.png filter=lfs diff=lfs merge=lfs -text
44
  assets/throughput-comparison.png filter=lfs diff=lfs merge=lfs -text
45
+ assets/minicpm-ocr-chinese-cases.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -84,23 +84,27 @@ Real throughput also depends on page content, backend, concurrency, and hardware
84
 
85
  ## Examples
86
 
87
- The animations show the original page, the detected layout boxes, and the rendered Markdown.
88
- Click an image to open it at full resolution.
 
 
 
89
 
90
  **Chinese documents**
91
 
92
- <p align="center"><img src="./assets/minicpm-chinese-examples-3-column.gif" alt="Chinese document parsing: original page, detected layout boxes, and rendered Markdown." width="100%"></p>
93
 
94
- **English documents**
95
 
96
- <p align="center"><img src="./assets/minicpm-english-examples-3-column.gif" alt="English document parsing: original page, detected layout boxes, and rendered Markdown." width="100%"></p>
97
 
98
- ### Static examples
 
 
99
 
100
- Handwritten notes, historical documents, scans, newspapers, financial statements, and key
101
- information extraction — originals next to parse results.
102
 
103
- <p align="center"><img src="./assets/minicpm-ocr-english-cases.png" alt="MiniCPM-OCR 1.0 English examples: original inputs and parsing results for handwritten notes, historical documents, scanned documents, newspapers, financial statements, and key information extraction." width="100%"></p>
104
 
105
  ## Model architecture
106
 
@@ -165,9 +169,27 @@ The prompt selects the task and must match the region you cropped:
165
  | Table | `Table Recognition:` | HTML (via SDK post-processing) |
166
  | Formula | `Formula Recognition:` | LaTeX |
167
  | Inline formula | `Text Recognition:` | LaTeX |
 
 
168
 
169
  If `finish_reason` is `length`, the output was truncated — raise the token budget.
170
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
171
  ### Agent skill
172
 
173
  Have a coding agent follow the skill to set up the environment, download the model, and parse
 
84
 
85
  ## Examples
86
 
87
+ Left to right: original document, detected layout, and rendered Markdown.
88
+
89
+ **English documents**
90
+
91
+ <p align="center"><img src="./assets/minicpm-english-examples-3-column.gif" alt="English document animation: original, detected layout, and rendered Markdown." width="100%"></p>
92
 
93
  **Chinese documents**
94
 
95
+ <p align="center"><img src="./assets/minicpm-chinese-examples-3-column.gif" alt="Chinese document animation: original, detected layout, and rendered Markdown." width="100%"></p>
96
 
97
+ ### More examples
98
 
99
+ Original documents and parsed results, side by side.
100
 
101
+ **English documents**
102
+
103
+ <p align="center"><img src="./assets/minicpm-ocr-english-cases.png" alt="English examples comparing inputs and results: handwriting, historical and scanned documents, newspapers, financial statements, and key information extraction." width="100%"></p>
104
 
105
+ **Chinese documents**
 
106
 
107
+ <p align="center"><img src="./assets/minicpm-ocr-chinese-cases.png" alt="Chinese examples comparing inputs and results: handwritten notes, complex formulas, newspapers, financial statements, stamped documents, illustrations, and key information extraction." width="100%"></p>
108
 
109
  ## Model architecture
110
 
 
169
  | Table | `Table Recognition:` | HTML (via SDK post-processing) |
170
  | Formula | `Formula Recognition:` | LaTeX |
171
  | Inline formula | `Text Recognition:` | LaTeX |
172
+ | Seal | `Seal Recognition:` | seal text |
173
+ | Chart | `Chart to Table:` | table |
174
 
175
  If `finish_reason` is `length`, the output was truncated — raise the token budget.
176
 
177
+ ### Key information extraction (KIE)
178
+
179
+ MiniCPM-OCR 1.0 can pull specified fields straight out of an image — for example the store name
180
+ and amount on a receipt. Send the image with a field-extraction prompt and ask for a JSON object;
181
+ you do not need to produce page Markdown first.
182
+
183
+ Use the [image recognition API example](https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/vllm_deploy_en.md#22-image-recognition) and
184
+ replace `Text Recognition:` with:
185
+
186
+ ```text
187
+ Extract the "store_name", "amount". Format the output as a JSON object with keys: "store_name", "amount". If an item is not in the image, use "###".
188
+ ```
189
+
190
+ Replace both field lists with your own field names (Chinese or English). The response is
191
+ model-generated text: parse the JSON and check fields and values before using it downstream.
192
+
193
  ### Agent skill
194
 
195
  Have a coding agent follow the skill to set up the environment, download the model, and parse
assets/minicpm-ocr-chinese-cases.png ADDED

Git LFS Details

  • SHA256: f79b6250007298a575a8a74189686854888f3953822cc52d360aa32961525040
  • Pointer size: 133 Bytes
  • Size of remote file: 14.1 MB