Image-to-Text
Transformers
Safetensors
qwen3_5
image-text-to-text
ocr
table-recognition
document-understanding
Instructions to use lschiemanowski/tablereader-lightonocr-v0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lschiemanowski/tablereader-lightonocr-v0 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("image-to-text", model="lschiemanowski/tablereader-lightonocr-v0")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("lschiemanowski/tablereader-lightonocr-v0") model = AutoModelForMultimodalLM.from_pretrained("lschiemanowski/tablereader-lightonocr-v0", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Model card wording
Browse files
README.md
CHANGED
|
@@ -37,7 +37,7 @@ disabled, temperature 0, up to 16,000 new tokens.
|
|
| 37 |
|
| 38 |
LoRA (rank 16, alpha 32) on every language-model projection, the vision encoder frozen; 3 epochs at learning
|
| 39 |
rate 1e-4 on 995 table crops from 107 publication series (UK public-sector reports, US federal and historical
|
| 40 |
-
statistics, German budget annexes and others),
|
| 41 |
transcriptions that parse into tables without blocking issues; they were not reviewed by a person. The training
|
| 42 |
crops include some that the [scannedtables](https://huggingface.co/datasets/lschiemanowski/scannedtables)
|
| 43 |
dataset holds back for rights or privacy reasons. The adapter is merged into the bf16 weights.
|
|
@@ -47,12 +47,12 @@ dataset holds back for rights or privacy reasons. The adapter is merged into the
|
|
| 47 |
1,006 validation crops from series not seen in training, scored as the share of printed values whose row path,
|
| 48 |
column path and text match the reference transcription exactly (metric `records-1`):
|
| 49 |
|
| 50 |
-
| All |
|
| 51 |
| ---: | ---: | ---: |
|
| 52 |
| 0.797 | 0.835 | 0.511 |
|
| 53 |
|
| 54 |
72% of crops are read without a difference. The model does not yet answer `NOT_A_TABLE` for crops without a
|
| 55 |
-
table, and scans read much worse than
|
| 56 |
transcriptions did not improve these scores.
|
| 57 |
|
| 58 |
## License
|
|
|
|
| 37 |
|
| 38 |
LoRA (rank 16, alpha 32) on every language-model projection, the vision encoder frozen; 3 epochs at learning
|
| 39 |
rate 1e-4 on 995 table crops from 107 publication series (UK public-sector reports, US federal and historical
|
| 40 |
+
statistics, German budget annexes and others), digital and scanned. The targets are GPT-6.1 Terra
|
| 41 |
transcriptions that parse into tables without blocking issues; they were not reviewed by a person. The training
|
| 42 |
crops include some that the [scannedtables](https://huggingface.co/datasets/lschiemanowski/scannedtables)
|
| 43 |
dataset holds back for rights or privacy reasons. The adapter is merged into the bf16 weights.
|
|
|
|
| 47 |
1,006 validation crops from series not seen in training, scored as the share of printed values whose row path,
|
| 48 |
column path and text match the reference transcription exactly (metric `records-1`):
|
| 49 |
|
| 50 |
+
| All | Digital PDFs | Scans |
|
| 51 |
| ---: | ---: | ---: |
|
| 52 |
| 0.797 | 0.835 | 0.511 |
|
| 53 |
|
| 54 |
72% of crops are read without a difference. The model does not yet answer `NOT_A_TABLE` for crops without a
|
| 55 |
+
table, and scans read much worse than digital PDFs. A self-training round on 7,698 of its own
|
| 56 |
transcriptions did not improve these scores.
|
| 57 |
|
| 58 |
## License
|