Hugging Face's logo

Spaces:
tom-doerr
/
logo_generator
Runtime error

App Files Community
logo_generator / tools /train

Commit History

  1. feat: vmap optimizer (#166)

    boris
    Unverified signature
    b993d27

  1. feat: scan layers + gradient checkpointing (#161)⁠

    boris
    Unverified signature
    07a6f9a

  1. feat: better multi-node support (#158)⁠

    boris
    Unverified signature
    728a3c3

  1. feat: update shampoo

    boris
    9ecdd3f

  1. feat(model): allow bias (#152)

    boris
    Unverified signature
    361a994

  1. feat(train): google-cloud-storage is optional

    boris
    02b2308

  2. feat(train): rename logged config

    boris
    955dc20

  1. feat: add mini_glu config

    boris
    a7e5050

  1. feat: update mini config

    boris
    d9a16f2

  1. feat: implement transformer variants (#144)⁠

    boris
    Unverified signature
    542378c

  1. feat(train): log norm and histograms (#143)⁠

    boris
    Unverified signature
    b7b619a

  1. feat(data): super conditioning (#141)⁠

    boris
    Unverified signature
    7939874

  1. feat: support pod (#139)

    boris
    Unverified signature
    803ccbf

  1. fix: no gradient checkpointing for new model

    boris
    2e02683

  2. feat: no gradient checkpointing for params init

    boris
    b798ed3

  3. feat: update configs

    boris
    79557f9

  4. fix(train): consider schedule offset

    boris
    bc4734f

  5. feat(train): local jax cache

    boris
    9f5e879

  6. feat: add bucket reference to artifact

    boris
    d368fb6

  1. style: lint

    boris
    d5d442a

  2. feat: handle gradient checkpointing

    boris
    5173ec7

  3. feat: load from bucket

    boris
    1c4e839

  4. feat(train): save to bucket

    boris
    50498e6

  5. feat: reduce artifact space + offset step

    boris
    34cf91c

  1. feat: restore weights on CPU

    boris
    5f954fc

  2. feat(train): simplify tokenizer loading

    boris
    4cb21dd

  1. feat(train): use compilation cache

    boris
    da9367c

  1. fix: style

    boris
    d483294

  1. Merge branch 'main' of https://github.com/borisdayma/dalle-mini into main

    boris
    0a691de

  2. feat: log num_parameters early

    boris
    7cfe576

  3. fix: distributed shampoo class

    boris
    696422e

  4. feat: update distributed_shampoo

    boris
    5996680

  1. feat(train) - handle multiple nodes (#130)

    boris
    Unverified signature
    0952927

  2. feat: handle model parallel

    boris
    1bb3269

  1. feat(train): more custom x-axis

    boris
    5f28cd2

  1. fix(train): opt_state_shape for distributed_shampoo

    boris
    225b6ff

  1. feat(train): split artifact into model/state

    boris
    fa5b058

  1. feat(train): another 25% faster

    boris
    14abe8c

  2. feat(train): overhead from 70% to 1% 🥳

    boris
    2b7f5f1

  3. feat(pjit): follow t5x style

    boris
    7b5868f

  1. fix(train): grads spec

    boris
    00710bc

  2. feat(train): improve pjit speed

    boris
    f254058

  3. fix(train): consider correct batch size

    boris
    b7c7458

  1. feat(train): custom start_preconditioning_step

    boris
    8149924

  2. feat(train): handle distributed_shampoo in pjit

    boris
    032f623

  3. feat: update distributed_shampoo + fix None spec

    boris
    8a9e367

  4. feat(train): distributed_shampoo with pjit

    boris
    cc34d07

  1. fix style

    boris
    f044cb8

  2. feat(train): restore opt_state efficiently

    boris
    1bfc1b5

  1. feat(model): clean way to load on cpu

    boris
    12f323d