Data Attribution

EleutherAI 's Collections

Evals

Deep Ignorance

Pythia Scaling Suite

PolyPythias

Data Attribution

Quirky Models and Datasets

Pile-T5

Quirky Math (archive)

Pile-T5 T5x Checkpoints

Sparse Autoencoders

updated 8 days ago

Leave-1%-out retrained models, per-query loss changes, and datasets for computing LDS.

Upvote

EleutherAI/LDS-retrain-bank-adamw-N4k-bs256

Viewer • Updated about 1 month ago • 2k • 723
EleutherAI/LDS-retrain-bank-adamw-N8k-bs256

Viewer • Updated about 1 month ago • 4.64k • 327
EleutherAI/LDS-retrain-bank-muon-N8k-bs256

Viewer • Updated about 1 month ago • 2k • 308
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256

Viewer • Updated about 1 month ago • 3.2k • 629
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.25

Viewer • Updated about 1 month ago • 2.9k • 608
EleutherAI/LDS-retrain-bank-muon-N4k-bs256

Viewer • Updated about 1 month ago • 2k • 298
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-ep4

Viewer • Updated 29 days ago • 4k • 473
EleutherAI/LDS-retrain-bank-adamw-N32k-bs256

Viewer • Updated 29 days ago • 4k • 451
EleutherAI/LDS-retrain-bank-muon-N16k-bs16

Viewer • Updated 29 days ago • 4k • 755
EleutherAI/LDS-retrain-bank-muon-N32k-bs256

Viewer • Updated 29 days ago • 4k • 624
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-gpt2-medium

Viewer • Updated 29 days ago • 4k • 447
EleutherAI/bergson-smollm2-lds-chunks

Viewer • Updated Jul 17 • 60.1k • 57
EleutherAI/bergson-smollm2-scaling

Viewer • Updated Aug 20 • 512k • 58
EleutherAI/LDS-retrain-bank-adamw-N16k-bs128

Viewer • Updated Aug 24 • 2k • 30
EleutherAI/LDS-retrain-bank-adamw-N16k-bs16

Viewer • Updated Aug 24 • 2k • 73
EleutherAI/LDS-retrain-bank-adamw-N16k-bs32

Viewer • Updated Aug 23 • 2k • 27
EleutherAI/LDS-retrain-bank-adamw-N16k-bs512

Viewer • Updated Aug 24 • 2k • 227
EleutherAI/LDS-retrain-bank-adamw-N16k-bs64

Viewer • Updated Aug 22 • 2k • 255
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-clip1.0

Viewer • Updated Aug 24 • 2.9k • 127
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-scale0.5

Viewer • Updated Aug 24 • 2.9k • 11
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.0

Viewer • Updated Aug 24 • 2.9k • 53
EleutherAI/LDS-retrain-bank-adamw-N16k-bs256-wd0.1

Viewer • Updated Aug 24 • 2.9k • 72
EleutherAI/LDS-retrain-bank-muon-N16k-bs128

Viewer • Updated Aug 22 • 2k • 644
EleutherAI/LDS-retrain-bank-muon-N16k-bs32

Viewer • Updated Aug 23 • 4k • 52
EleutherAI/LDS-retrain-bank-muon-N16k-bs64

Viewer • Updated Aug 24 • 2k • 17
EleutherAI/LDS-retrain-bank-muon-N16k-bs256

Viewer • Updated Aug 24 • 5.64k • 533
EleutherAI/LDS-retrain-bank-adamw-N64k-bs256

Viewer • Updated 26 days ago • 4.18k • 276
EleutherAI/bergson-wikitext-2-gpt2

Updated 9 days ago • 23
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1004

Viewer • Updated 25 days ago • 89.9k • 854
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1005

Viewer • Updated 25 days ago • 96.2k • 422
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1006

Viewer • Updated 25 days ago • 96.2k • 846
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1008

Viewer • Updated 25 days ago • 96.2k • 839
EleutherAI/LDS-retrain-bank-adamw-wikitext2-N4656-bs8-seed1007

Viewer • Updated 25 days ago • 96.2k • 890
EleutherAI/LDS-retrain-bank-london16k-bs256-muon

Viewer • Updated 22 days ago • 2k • 195
EleutherAI/PARTIAL_LDS-retrain-bank-muon-N64k-bs256

Updated 22 days ago • 559
EleutherAI/PARTIAL_LDS-retrain-bank-gpt2medium-16k-bs32

Viewer • Updated 22 days ago • 1.3k • 412
EleutherAI/pile-heldout-queries-2048

Updated 11 days ago • 58
EleutherAI/fineweb-heldout-queries-2048

Updated 11 days ago • 49
EleutherAI/bergson-wikitext-2-4656-chunks

Viewer • Updated Aug 2 • 5.14k • 85

Note Pre-tokenized WikiText-2 chunks for the Bae et al. 2024 SOURCE replication
EleutherAI/bergson-wikitext-gpt2-leaderboard

Updated 9 days ago • 11
EleutherAI/bergson-wikitext-gpt2-leaderboard-bank

Viewer • Updated 9 days ago • 11.3k • 168
EleutherAI/bergson-wikitext-512-chunks

Viewer • Updated Jul 8 • 4.86k • 342

Upvote