Instructions to use zai-org/chatglm3-6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm3-6b with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm3-6b", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
fix github issue for quantize (#49)
Yuxuan ZhangVerified signature- fix github issue for quantize (bdcc33fa91bf8b0668645674f89255e13d144727)103caa4
-
修改 quantization.py 中待量化权重的移动逻辑 (#47)
Yuxuan Zhang +1: MikuRabbitVerified signature- 修改 quantization.py 中待量化权重的移动逻辑 (4e17ef37342ef49abe1bfcc54cd43ded06b51347) Co-authored-by: Miku <MikuRabbit@users.noreply.huggingface.co>a5ba550
-
Implement new chat method
duzx1685ba2d2