Commit History

  1. use quantization config

    8b0674e

  1. cpu offload option

    f87d353
  2. import torch

    6cc14e5
  3. add dtype

    5f03bba
  4. add scipy

    b77e308
  5. add bitsandbytes

    ec75fc5
  6. add accelerate

    47dd5c9
  7. use base and new models

    2f9c1ea

  1. use 8bit model

    8ad2f92
  2. add torch into requirement

    54673f1
  3. add requirements

    8b87148
  4. Add application file

    d0b3af7
  5. initial commit

    e3da9e1