SmolFactory / config

Commit History

  1. improves spaces deployment , configuration for custom settings , adds interface for spaces deployment

    5f8b28d

  1. adds packing argument to gpt oss custom config

    401f18e
  2. fixes circular import

    6995e18
  3. add configs to _init_.py

    63ce7d6
  4. adds scheduler stuff and hopes for the best with track tonic

    d455d12
  5. adds parameters to medical config

    81f39f1
  6. adds parameters to medical config

    b4f1cb3
  7. adds parameters to medical config

    c68717e
  8. adds improved dev and system prompts to o1-medical

    fc29a51
  9. adds improved launch for reasoning gpt-oss configs and new config for medical reasoning

    0ded6bb
  10. adds optimizations for faster training

    3331c7f
  11. adds a100 memory optimized

    fa9560d
  12. adds flash attention 3 kernel

    cb276d8

  1. sets min_lr

    7f45871
  2. increases batchsize and gradient accumulation steps in memory optimized

    4e59f6d
  3. increases max samples in memory optimized

    8b56686
  4. adds better launch.sh and eval / test splits auto

    0fa6045

  1. adds harmony format , configurable gpt-oss parameters, launch.sh logic , improved templates for legml gpt-oss training, dynamic results directory and improve model pushing

    59e57ff

  1. adds quantization configuration correctly

    fa7de39
  2. adds memory optimized configuration

    7181190
  3. adds gpt-oss support

    fcf2981

  1. adds sft , quantization, better readmes

    Tonic
    Unverified signature
    40fd629

  1. attempt to fix bfloat16 issue

    Tonic
    Unverified signature
    6c63876
  2. fix config bug

    Tonic
    Unverified signature
    54ebacf
  3. fix launch script deploy and refactors

    Tonic
    Unverified signature
    93ed7a1
  4. adds formatting fix

    Tonic
    Unverified signature
    ebe598e
  5. attempts to resolve training arguments issue

    Tonic
    Unverified signature
    d9f7e1b
  6. adds no think tag correctly

    Tonic
    Unverified signature
    32fca7d

  1. solves oom error with more reasonable configuration

    Tonic
    Unverified signature
    d60ab6c
  2. adds max perf script

    Tonic
    Unverified signature
    58a74d2
  3. solves adam to adam_torch optimizer issue

    Tonic
    Unverified signature
    e092247
  4. improves requirements and dependencies

    Tonic
    Unverified signature
    0de9de2
  5. adds A100 large experiments

    Tonic
    Unverified signature
    5fe83da

  1. first commit

    Tonic
    Unverified signature
    d8dd7a1