jasperdew commited on
Commit
3d59764
·
verified ·
1 Parent(s): ba5bacb

Rewrite opendataloader-bench claim: ranks above published leaderboard

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -17,15 +17,15 @@ tags:
17
 
18
  PDFluent, the document engine you can run anywhere.
19
 
20
- PDFluent gives you PDF parsing and extraction that runs inside your app, on your machine. It is for developers building RAG, agents and document automation. Turn PDFs into Markdown for your RAG pipeline, redact content or fill XFA forms. PDFluent SDK 1.3.0 scores the highest overall on opendataloader-bench of the engines on its public leaderboard*.
21
 
22
- \* Measured with the benchmark's own harness and evaluator on its 200 documents, PDFluent SDK 1.3.0, `quality="auto"` with `keep_furniture=True`, on Linux (CPU only), 29 October 2026: 0.9168 overall against 0.907 for opendataloader [hybrid], 0.885 for nutrient and 0.882 for docling. Competitor figures are taken from the benchmark's public README (read 2 November 2026), not re-run by us (our own re-run of opendataloader [hybrid] on 28 October 2026 gave 0.9068). PDFluent is not on that leaderboard; the results are submitted in a pull request: https://github.com/opendataloader-project/opendataloader-bench/pull/37. Development was optimised for this benchmark among its targets. The scores are measured on the benchmark's own 200 documents. The 19-measure result on our own held-out half and the separate checks are on pdfluent.com/benchmarks. The scores come from a release candidate wheel of 1.3.0 that reported version 1.2.0. Speed is not published. The run keeps page headers and footers, because the benchmark's ground truth counts them as content. The difference is one run without a confidence interval. Run from the PyPI 1.3.0 wheel on Apple M1 Pro, macOS 26.5 (2 November 2026), the same benchmark gives 0.9154 overall.
23
 
24
  ## Why PDFluent
25
 
26
- ### Highest overall score
27
 
28
- PDFluent SDK 1.3.0 has the highest overall score on opendataloader-bench, achieving top marks for reading order and headings while placing second on table structure.
29
 
30
  ### Highest average, 19 measures
31
 
 
17
 
18
  PDFluent, the document engine you can run anywhere.
19
 
20
+ PDFluent gives you PDF parsing and extraction that runs inside your app, on your machine. It is for developers building RAG, agents and document automation. Turn PDFs into Markdown for your RAG pipeline, redact content or fill XFA forms. PDFluent 1.3.0 ranks above every engine on the published opendataloader-bench leaderboard (as of 3 November 2026)*.
21
 
22
+ \*Overall score 0.9168 (quality="auto", keep_furniture=True, Linux) against the engines listed in the benchmark README on 3 November 2026; submitted as pull request #37 (https://github.com/opendataloader-project/opendataloader-bench/pull/37). Other engines have submissions open that are not yet on the leaderboard.
23
 
24
  ## Why PDFluent
25
 
26
+ ### Leaderboard position
27
 
28
+ PDFluent 1.3.0 ranks above every engine on the published opendataloader-bench leaderboard (as of 3 November 2026)*.
29
 
30
  ### Highest average, 19 measures
31