Hugging Face's logo

Motif-Technologies
/
optimizer

Kernels
Model card Files
xet
 Community
9
optimizer / torch-ext

Commit History

  1. fix(optimizer): resolve bug where weight decay was multiplied by wrong lr value

    dongseokmotif
    Verified signature
    3356827

  1. Support HSDP (#4)⁠

    iamwyldecat
    Verified signature
    8447fd1

  1. fix(muon): handle un-distributed env

    iamwyldecat
    1f13dae

  2. refactor(muon): change argument adam_wd to weight_decay and handle params' type

    iamwyldecat
    02ac540

  1. fix(muon): free tensors that are no longer needed

    iamwyldecat
    64757cb

  2. chore(muon): update comment

    iamwyldecat
    036642a

  3. chore(muon): clean build and update doc

    iamwyldecat
    febdf5b

  1. fix(muon): delete intermediate tensors immediately to lower peak mem usage

    iamwyldecat
    bdd2678

  2. chore: initial commit

    iamwyldecat
    8535e80