Commit History

  1. Remove int4 variant which had too poor quality

    Daniel Rothmann
    5ed6654
  2. Tidy up repo and conversion scripts

    Daniel Rothmann
    e79fa0a

  1. Workaround for bad ML state on MacOS

    Daniel Rothmann
    10bad22

  1. Performance improvements on iOS

    Daniel Rothmann
    ffa94c8
  2. Drop prefill model, add tokenizer config

    Daniel Rothmann
    95c6137
  3. Tidy up the repo

    Daniel Rothmann
    d12b4ea
  4. Fix audio decoder, fix broken KV cache

    Daniel Rothmann
    d1bfb8c

  1. WIP audio decoder

    Daniel Rothmann
    fad9fad
  2. Fix a NaN attention issue in converted model

    Daniel Rothmann
    a2c97d7
  3. Add CoreML prefill and decode models

    Daniel Rothmann
    cb20bed