How to use Dhanushkumar/lora_quantize_llama_model with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Dhanushkumar/lora_quantize_llama_model", device_map="auto")
https://huggingface.co/Dhanushkumar/lora_quantize_llama_model/resolve/main/tokenizer.json
hf download hf://Dhanushkumar/lora_quantize_llama_model/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/Dhanushkumar/lora_quantize_llama_model/resolve/main/tokenizer.json
