Commit History

  1. 删除 --cache-type-k 和 --cache-type-v 参数,让 llama.cpp 使用默认的 f16 格式

    ffreemt
    6616980
  2. Try Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q5_K_P Dockfile --n-gpu-layers 99

    ffreemt
    adb51a2
  3. Try Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q5_K_P Dockfile

    ffreemt
    c0f505d
  4. Try Gemma-4-E4B-Uncensored-HauhauCS-Aggressive-Q5_K_P

    ffreemt
    a2b3ebc

  1. Update pinned: true

    ffreemt
    0ca15ff
  2. Update README.md

    Verified signature
    448fd11

  1. Update removal of append_history=False

    ffreemt
    7564484

  1. Update Waking-up-takes-about-9min-Sleep-after-15min-of-inactivity

    ffreemt
    1d516ba

  1. Update overwrite libbitsandbytes_cpu.so with libbitsandbytes_cuda118.so lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    7e9b0c1
  2. Update overwrite libbitsandbytes_cpu.so with libbitsandbytes_cuda118.so lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    08612a4
  3. Update overwrite libbitsandbytes_cpu.so with libbitsandbytes_cuda118.so lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    fae4857
  4. Update lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    dec88ff
  5. Update lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    297f7a4
  6. Update lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    f8bc02a
  7. Update lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    ca48eff
  8. Update lsb_release -a bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    3895ca8
  9. Update bitsandbytes device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    b55d7c2
  10. Update bitsandbytes-cuda113 device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    212682a

  1. Update device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    f924882
  2. Update device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    b0c90a1
  3. Update device_map={'': 0} rich, check nvidia-smi with subproces.run

    ffreemt
    efd09eb
  4. Update rich, check nvidia-smi with subproces.run

    ffreemt
    e320ccc
  5. Update check nvidia-smi with subproces.run

    ffreemt
    60d0767

  1. Update cudatoolkit in requirements.txt

    ffreemt
    0ad7d21
  2. Update transformers requirements.txt

    ffreemt
    d9c0a08
  3. Fix torch==2.0.1 in requirements.txt

    ffreemt
    2524cc7
  4. Fix bitsandbytes==0.39.0 in requirements.txt

    ffreemt
    9257c81
  5. Update git+https://github.com/TimDettmers/bitsandbytes.git in requirements.txt

    ffreemt
    05e64b9
  6. Update requirements.txt https://github.com/TimDettmers/bitsandbytes

    ffreemt
    699899d
  7. Remove packages.txt

    ffreemt
    9c23681
  8. Update packages.txt with cuda、cuda-tookit

    ffreemt
    58acbce
  9. Update bitsandbytes-cuda116

    ffreemt
    aadaa3d

  1. Back to Qwen/Qwen-7B-Chat

    ffreemt
    56ad8d6

  1. Update tangger/Qwen-7B-Chat since Qwen/Qwen-7B-Chat is gone

    ffreemt
    5f4757d

  1. Update

    ffreemt
    e8c556f
  2. Update

    ffreemt
    6afaebf
  3. Update

    ffreemt
    187485d
  4. Update

    ffreemt
    ad51515
  5. Update pundkey='#' {poundkey} in info

    ffreemt
    66acbac
  6. Update API ready, TODO: fix info

    ffreemt
    c48ba74

  1. Update logger.trace disabled

    ffreemt
    584239a

  1. Update yield from bot_stream in bot_stream_state

    ffreemt
    b00e246
  2. ffreemt
    2987cd6
  3. Update turn trace on

    ffreemt
    79b022b
  4. Update info on top_k=0

    ffreemt
    7ea83b4
  5. Update user_clear for submit.click buttn

    ffreemt
    d84480c
  6. Update model.generation_config.update

    ffreemt
    f5c4b5c
  7. Update single model

    ffreemt
    558796e
  8. Update model replaced by stats.value.llm

    ffreemt
    efc09da
  9. ffreemt
    41e9e77