markhenry/vanilla-small-20B
Updated • 109
Mark Henry
markhenry
AI & ML interests
alignment and x-risk
Recent Activity
updated a model 14 days ago
markhenry/vanilla-small-20B updated a model 14 days ago
markhenry/cayley-large-1L-20B published a model 14 days ago
markhenry/cayley-large-1L-20BOrganizations
None yet
markhenry/cayley-large-1L-20B
Updated • 14
markhenry/topk-small-65k-wallclock-matched
Updated • 32
markhenry/vanilla-large-20B
Updated • 125
markhenry/cayley-small-1L-20B
Updated • 18
markhenry/topk-small-20B-matched-tokens
Updated • 9
markhenry/vanilla-large-parity-3B
Updated • 2
markhenry/cayley-large-2L-mlp_in-20B
Updated • 11
markhenry/cayley-small-2L-mlp_in-20B
Updated • 19
markhenry/cayley-small-3L-mlp_in-20B
Updated • 12
markhenry/cayley-24L2048-131k-3L-mlp_in-v3
Updated • 6
markhenry/cayley-24L2048-32k-2L-mlp_in-v3
Updated • 4
markhenry/cayley-131k-3L-mlp_in-v3
Updated • 5
markhenry/msae-gpt2-small-2L-v1
Updated • 5
markhenry/msae-3L-on-vanilla-v2
Updated • 4
markhenry/msae-3L-on-cayley-input-v1
Updated • 5
markhenry/msae-3L-on-cayley-v1
Updated • 6
markhenry/topk-131k-mlp_in-v1
Updated • 5
markhenry/msae-131k-3L-mlp_in-v1
Updated • 4
markhenry/topk-32k-mlp_in-v1
Updated • 4
markhenry/msae-32k-2L-mlp_in-v1
Updated • 4
markhenry/cayley-32k-2L-mlp_in-v2
Updated • 5
markhenry/cayley-24L2048-131k-3L-mlp_in-v2
Updated • 6
markhenry/cayley-24L2048-131k-3L-mlp_in-v1
Updated • 6
markhenry/cayley-24L2048-131k-3L-mlp_in-20b-v3-cosine
Updated • 6
markhenry/vanilla-24L2048-parity-cold
Updated • 5
markhenry/vanilla_24L2048_parity_hotstop
Updated • 2
markhenry/cayley-24L2048-32k-2L-mlp_in-v2
Updated • 7
markhenry/cayley-24L2048-32k-2L-mlp_in-v1
Updated • 4
markhenry/cayley-131k-3L-mlp_in-v2
Updated • 6