How to run Qwen3-8b-MatGPTQ model

#1
by SuLogan - opened

Can you provide an example code to show how to directly run the Qwen3-8b-MatGPTQ model using transformers?

follow link at model page IST-DASLab/MatGPTQ github page for vLLM

Sign up or log in to comment