Image-Text-to-Text
MiniCPM-OCR
Safetensors
English
Chinese
minicpm_ocr
ocr
document-parsing
multimodal
vision-language
table-recognition
formula-recognition
conversational
Eval Results
Instructions to use openbmb/MiniCPM-OCR-1.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MiniCPM-OCR
How to use openbmb/MiniCPM-OCR-1.0 with MiniCPM-OCR:
pip install "minicpm-ocr[all]" huggingface_hub # Deploy openbmb/MiniCPM-OCR-1.0 as a recognition service before running the Python example: # https://github.com/OpenBMB/MiniCPM-OCR/blob/main/docs/vllm_deploy_en.md # vLLM: load the model above; use --port 8080, # --served-model-name minicpm-ocr and --max-model-len 40960. # Layout detection uses cuda:0; recognition runs on the deployed service.
from importlib.resources import files from pathlib import Path from minicpmvocr import load_config, pipelined_run from huggingface_hub import snapshot_download layout_model = snapshot_download("PaddlePaddle/PP-DocLayoutV3") cfg = load_config( str(files("minicpmvocr").joinpath("configs/minicpmvocr.yaml")), overrides={ "input": {"file_path": str(Path("demo.png").resolve())}, "engine": { "type": "vllm", "server_url": "http://127.0.0.1:8080", "model_name": "minicpm-ocr", "max_model_len": 40960, }, "layout": {"model_dir": layout_model, "device": "cuda:0"}, # Render PDFs in-process so this example also works without a main guard. "pipeline": {"overlap_layout": True, "render_workers": 1}, }, ) pipelined_run(cfg) - Notebooks
- Google Colab
- Kaggle
Add Real5-OmniDocBench evaluation results for MiniCPM-OCR-1.0
Browse files# Real5-OmniDocBench evaluation results for MiniCPM-OCR-1.0
This PR adds the evaluation file for MiniCPM-OCR-1.0 under the Hugging Face
evaluation-results workflow.
This is based on the new evaluation results feature: https://huggingface.co/docs/hub/eval-results.
## Dataset
- [PaddlePaddle/Real5-OmniDocBench](https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench)
## File
- `.eval_results/real5_omnidocbench.yaml`
## Tasks
- overall
- scanning
- warping
- screen_photography
- illumination
- skew
.eval_results/real5_omnidocbench.yaml
ADDED
|
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: PaddlePaddle/Real5-OmniDocBench
|
| 3 |
+
task_id: overall
|
| 4 |
+
value: 93.75
|
| 5 |
+
source:
|
| 6 |
+
url: https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench
|
| 7 |
+
name: Real5-OmniDocBench Leaderboard
|
| 8 |
+
user: PaddlePaddle
|
| 9 |
+
- dataset:
|
| 10 |
+
id: PaddlePaddle/Real5-OmniDocBench
|
| 11 |
+
task_id: scanning
|
| 12 |
+
value: 94.45
|
| 13 |
+
source:
|
| 14 |
+
url: https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench
|
| 15 |
+
name: Real5-OmniDocBench Leaderboard
|
| 16 |
+
user: PaddlePaddle
|
| 17 |
+
- dataset:
|
| 18 |
+
id: PaddlePaddle/Real5-OmniDocBench
|
| 19 |
+
task_id: warping
|
| 20 |
+
value: 93.54
|
| 21 |
+
source:
|
| 22 |
+
url: https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench
|
| 23 |
+
name: Real5-OmniDocBench Leaderboard
|
| 24 |
+
user: PaddlePaddle
|
| 25 |
+
- dataset:
|
| 26 |
+
id: PaddlePaddle/Real5-OmniDocBench
|
| 27 |
+
task_id: screen_photography
|
| 28 |
+
value: 93.74
|
| 29 |
+
source:
|
| 30 |
+
url: https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench
|
| 31 |
+
name: Real5-OmniDocBench Leaderboard
|
| 32 |
+
user: PaddlePaddle
|
| 33 |
+
- dataset:
|
| 34 |
+
id: PaddlePaddle/Real5-OmniDocBench
|
| 35 |
+
task_id: illumination
|
| 36 |
+
value: 93.74
|
| 37 |
+
source:
|
| 38 |
+
url: https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench
|
| 39 |
+
name: Real5-OmniDocBench Leaderboard
|
| 40 |
+
user: PaddlePaddle
|
| 41 |
+
- dataset:
|
| 42 |
+
id: PaddlePaddle/Real5-OmniDocBench
|
| 43 |
+
task_id: skew
|
| 44 |
+
value: 93.28
|
| 45 |
+
source:
|
| 46 |
+
url: https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench
|
| 47 |
+
name: Real5-OmniDocBench Leaderboard
|
| 48 |
+
user: PaddlePaddle
|