Papers
arxiv:2505.11599

Can LLMs Credibly Transform the Creation of Panel Data from Diverse Historical Tables?

Published on Jul 1
Authors:
,
,

Abstract

Multimodal LLMs offer the potential for a watershed change for the digitization of historical tables by enabling low-cost processing that is centered on domain expertise rather than technical skill. We develop and rigorously assess an LLM-based pipeline on a new panel of historical county-level vehicle registration tables from early 20th-century U.S. state reports. Using human-transcribed gold standard data for evaluation, the pipeline achieves an exact cell match rate of 95.4% at approximately 50 times less expense than traditional outsourcing. The pipeline performs well at extracting table structure, where it reduces critical parsing errors from 61.4% to 0.35%; in numerical transcription, where it exactly matches 96.7% of linked cells and achieves a mean absolute percentage error of 0.7%. The pipeline performs on par with human-based category alignment. We also assess pipeline performance in situ with two case studies that analyze the growth and persistence of historical vehicle adoption using common regression models. The significance and sign of effects are identical whether using LLM or gold standard data for all eight models tested, and the coefficient of interest is statistically indistinguishable in six of eight models.

Community

Sign up or log in to comment

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2505.11599 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2505.11599 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2505.11599 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.