Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)

Model Description

This is a 8bit GPTQ quantization of Llasa-3B by the HKUSTAudio team. I tested using a script written by GitHub user nivibilla, linked below. For some reason, I was not able to run it on my RTX 3090, while quantized Llasa-1B worked fine. Please let me know if you can get it working.

Model Sources

Downloads last month
10
Safetensors
Model size
3B params
Tensor type
I32
ยท
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for AgeOfAlgorithms/Llasa-3b-GPTQ-8bit

Quantized
(8)
this model