lschiemanowski commited on
Commit
9c06f0f
·
verified ·
1 Parent(s): 7cfeac5

Model card wording

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -37,7 +37,7 @@ disabled, temperature 0, up to 16,000 new tokens.
37
 
38
  LoRA (rank 16, alpha 32) on every language-model projection, the vision encoder frozen; 3 epochs at learning
39
  rate 1e-4 on 995 table crops from 107 publication series (UK public-sector reports, US federal and historical
40
- statistics, German budget annexes and others), scanned and born-digital. The targets are GPT-6.1 Terra
41
  transcriptions that parse into tables without blocking issues; they were not reviewed by a person. The training
42
  crops include some that the [scannedtables](https://huggingface.co/datasets/lschiemanowski/scannedtables)
43
  dataset holds back for rights or privacy reasons. The adapter is merged into the bf16 weights.
@@ -47,12 +47,12 @@ dataset holds back for rights or privacy reasons. The adapter is merged into the
47
  1,006 validation crops from series not seen in training, scored as the share of printed values whose row path,
48
  column path and text match the reference transcription exactly (metric `records-1`):
49
 
50
- | All | Born-digital | Scanned |
51
  | ---: | ---: | ---: |
52
  | 0.797 | 0.835 | 0.511 |
53
 
54
  72% of crops are read without a difference. The model does not yet answer `NOT_A_TABLE` for crops without a
55
- table, and scans read much worse than born-digital pages. A self-training round on 7,698 of its own
56
  transcriptions did not improve these scores.
57
 
58
  ## License
 
37
 
38
  LoRA (rank 16, alpha 32) on every language-model projection, the vision encoder frozen; 3 epochs at learning
39
  rate 1e-4 on 995 table crops from 107 publication series (UK public-sector reports, US federal and historical
40
+ statistics, German budget annexes and others), digital and scanned. The targets are GPT-6.1 Terra
41
  transcriptions that parse into tables without blocking issues; they were not reviewed by a person. The training
42
  crops include some that the [scannedtables](https://huggingface.co/datasets/lschiemanowski/scannedtables)
43
  dataset holds back for rights or privacy reasons. The adapter is merged into the bf16 weights.
 
47
  1,006 validation crops from series not seen in training, scored as the share of printed values whose row path,
48
  column path and text match the reference transcription exactly (metric `records-1`):
49
 
50
+ | All | Digital PDFs | Scans |
51
  | ---: | ---: | ---: |
52
  | 0.797 | 0.835 | 0.511 |
53
 
54
  72% of crops are read without a difference. The model does not yet answer `NOT_A_TABLE` for crops without a
55
+ table, and scans read much worse than digital PDFs. A self-training round on 7,698 of its own
56
  transcriptions did not improve these scores.
57
 
58
  ## License