modelguard-observatory / DATA_PROVENANCE.md
Hugdrigo's picture
Upload 28 files
85920d3 verified
|
Raw History Blame Contribute Delete
1.22 kB
# Data provenance and lineage
- Source project: ModelOps Research Lab v2.0 by Rodrigo Pantoja.
- Source dataset: Academic Rhetorical Intent Mini v1.1, synthetic-curated, CC BY 4.0.
- Task: English, Spanish and Portuguese academic rhetorical-intent classification into six classes: background, objective, method, result, limitation, implication.
- Original split sizes: 842 train; 130 controlled IID test; 54 novel-pattern challenge; 1,026 records in total.
- Monitoring artifact: `evaluation_snapshots.json` with 736 rows = 4 model methods × (130 + 54).
- Input artifacts: `train.json`, `iid_test.json`, `challenge.json`, and `source_modelops_engine.js` carried forward unchanged from the earlier ModelOps work.
- Rebuild command: `node build_artifacts.js`; no external data or network required.
- Integrity checks: unique split/model/id keys, source-split ID separation, consistent sample IDs for each method; SHA-256 digests in `benchmark_manifest.json`.
Do not describe the two splits as monthly checkpoints or claim to be streaming production logs. The samples are deliberately small and synthetic-curated. Any external dataset must supply its own provenance, annotation quality assessment and usage permissions.