Hugging Face's logo

Motif-Technologies
/
optimizer

Kernels
Model card Files
xet
 Community
9
optimizer / torch-ext

Commit History

  1. fix init⁠

    leejunhyeok
    Verified signature
    6d75af0

  1. fix(muon): add update_p stage and dealloc tensors properly

    wyldecat
    99e7c0c

  1. chore: add .gitignore

    wyldecat
    79fc8ba

  1. applied lint

    TaehyunKimMotif
    db36e39

  1. fix(optimizer): resolve bug where weight decay was multiplied by wrong lr value (#5)⁠

    dongseokmotif
    Verified signature
    671b033

  1. Support HSDP (#4)⁠

    iamwyldecat
    Verified signature
    8447fd1

  1. fix(muon): handle un-distributed env

    iamwyldecat
    1f13dae

  2. refactor(muon): change argument adam_wd to weight_decay and handle params' type

    iamwyldecat
    02ac540

  1. fix(muon): free tensors that are no longer needed

    iamwyldecat
    64757cb

  2. chore(muon): update comment

    iamwyldecat
    036642a

  3. chore(muon): clean build and update doc

    iamwyldecat
    febdf5b

  1. fix(muon): delete intermediate tensors immediately to lower peak mem usage

    iamwyldecat
    bdd2678

  2. chore: initial commit

    iamwyldecat
    8535e80