Hugging Face's logo

DigitalDaimyo
/
ASA-ASM-wikitext103-raw

PyTorch
addressed-state-attention
asa
asm
language-model
Model card Files
xet
 Community
ASA-ASM-wikitext103-raw

Commit History

  1. Add subfolder checkpoints: wikitext103-raw:ASA_ASM_wt103-rawv1_gpt2_T1024_L21_D384_H8_K16_M32_ropek1_alibi1_gamma1_step75000_best.pt, fineweb:ASA_ASM_fineweb_T1024_L15_D1024_H16_K16_S32_step17500_last.pt

    Justin Brown
    Verified signature
    591b9d2

  2. Add checkpoint (fineweb): ASA_ASM_fineweb_T1024_L15_D1024_H16_K16_S32_step17500_last.pt

    Justin Brown
    Verified signature
    9880b25

  1. Update README.md

    Justin Brown
    Verified signature
    c2f9ca0

  2. Add checkpoint + card (ASA_ASM_wt103-rawv1_gpt2_T1024_L21_D384_H8_K16_M32_ropek1_alibi1_gamma1_step75000_best.pt)

    Justin Brown
    Verified signature
    6084694

  3. initial commit

    Justin Brown
    Verified signature
    18a4f87