Instructions to use silver/chatglm-6b-slim with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use silver/chatglm-6b-slim with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("silver/chatglm-6b-slim", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Merge remote-tracking branch 'thu/main'
0d1d6a6 -
Fix position ids expand
duzx16f82b180
-
Fix generate
duzx16fb23542
-
Fix attention mask for prefix prompt
duzx1608bc851 -
No padding for chat function
duzx164b7ffbf -
Fix attention_mask and position_ids
duzx16373fd6b -
Fix encode method
duzx16e22cddf -
Fix batch input
duzx16e1494f2 -
Implement batch generation
duzx16cc96a22
-
Fix position id for training
duzx1611c270c -
fix GLM6BBlock name typo (#20)
- fix GLM6BBlock name typo (2a180534c5f2b4860598a9caef798b55a77cfb72) Co-authored-by: rich brain <richbrain@users.noreply.huggingface.co>9c7416d -
Add support for loading quantized model
duzx162e1be30
-
Use dynamic dtype for prompts
duzx16c949d03 -
Fix backward for quantization
duzx160cfae21 -
Implement gradient checkpointing
duzx16aea6cef -
Fix bugs
duzx160564795
-
Add pad_token_id in config.json
duzx16Fix position_ids in ChatGLMModel Add batch position_ids2200e2b -
Merge remote-tracking branch 'thu/main'
a6d4a44 -
Change padding side
duzx16db22499 -
Set ignore_index for CrossEntropyLoss
duzx165c64357 -
Support batch training
duzx168127ab6 -
Merge branch 'main' into dev_pt
duzx16# Conflicts: # modeling_chatglm.pyfbda120 -
Add p-tuning v2
duzx16812f43f
-
Fix context length in get_position_ids
duzx16096f3de
-
update readme
a748e08 -
Merge remote-tracking branch 'thu/main'
fb1c9f0
-
Close CPU fusion on Mac
duzx164a9b711 -
Merge remote-tracking branch 'thu/main'
a23d6a1
-
Fix Chinese punctuation
duzx16d2bbc82
-
Add English
duzx162449bdc
-
merge from ChatGLM-6B
b8b422f
-
Fix typo in tokenization_chatglm.py
songxxzp1b54948
-
fix import issue
0b2264f -
remove image tokens from chatglm-6b
99c7042
-
Remove hardcode bos_token_id
duzx168c4ad86 -
Add support for streaming output
duzx16258e6db -
Remove hardcode bos_token_id
duzx162460dc2 -
Add support for streaming output
duzx1642095d4
-
fix import issue
ec054ef -
update README.md
42cd818 -
remove image tokens from chatglm-6b
82834c6
-
Fix overflow in FP16
duzx16220f772
-
Set is_parallelizable to False
duzx16f9f74fd -
Remove image tokens when decoding
duzx168492687 -
Revert "Update quantization"
duzx16This reverts commit 0101afdfa7f279e082623ee57d7ad6f84e1e82dc.0d8b08d -
Update quantization
duzx160101afd -
Add logit processor for NaN or Inf scores
duzx16c3dece3
-
Fix default history argument
duzx169d1509a -
Merge branch 'main' of https://huggingface.co/THUDM/chatglm-6b
duzx16bcb053b -
Add support for float32
duzx16d4832e8