Instructions to use Gavin-chen/Qwen-Compress with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Gavin-chen/Qwen-Compress with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Gavin-chen/Qwen-Compress", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload franken_qwen2B_compressor_checkpoint.pt
Verified signature399e2f2 -
Update README.md
Verified signaturec407840 -
Create LM_Eval.txt
Verified signature467f064 -
Create requirements.txt
Verified signaturea398044 -
Update README.zh.md
Verified signature91772be -
Upload README.zh.md
Verified signature2763b42 -
Update README.md
Verified signature1b5c481 -
Upload 2 files
Verified signaturec8adb34 -
initial commit
Verified signaturee318f48