chatglm-6b-int4 / quantization.py

Commit History

  1. Add support for parallel quantization on Mac

    duzx16
    f6b88da

  1. Remove assert in load_cpu_kernel

    duzx16
    63d66b0

  1. Sync with chatglm-6b

    duzx16
    f55a108

  1. Add assertion when loading cpu and cuda kernel fails

    songxxzp
    630d0ef
  2. Add assertion when loading cpu and cuda kernel fails

    songxxzp
    bcc35f0
  3. Update CPU kernel loading method

    songxxzp
    c7d8998

  1. Fix bugs when compiling cpu kernels

    68873da

  1. Synchronize with chatglm 6b repo

    7aaf3fe

  1. Fix parallel cpu kernel

    7458231

  1. Fix bugs in quantization when loading kernels

    dac03c3

  1. init commmit

    a93efa9