Spaces:
Running
Running
Commit History
19 days ago
-
feat(data): append newly ingested papers to the metadata sidecar
siddhm11 +1: Claude Opus 5.5Rebuilding the sidecar re-reads 1.8M Turso rows; after an ingest only the rows above the previous highest rowid are new. append_to_sidecar.py adds them to papers, paper_categories and the external-content FTS5 index in one transaction, indexing each under the rowid SQLite assigned. Existing papers are skipped, never replaced, since INSERT OR REPLACE would renumber them and desynchronise the index. --verify runs quick_check, the FTS5 integrity check, and checks that every paper has category rows. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>12eb9f4