How to use hurtmongoose/tinyllama-lora-malicious-classifier with PEFT:
from peft import PeftModel from transformers import AutoModelForSequenceClassification base_model = AutoModelForSequenceClassification.from_pretrained("TinyLlama/TinyLlama_v1.1") model = PeftModel.from_pretrained(base_model, "hurtmongoose/tinyllama-lora-malicious-classifier")
How to use hurtmongoose/tinyllama-lora-malicious-classifier with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("hurtmongoose/tinyllama-lora-malicious-classifier", device_map="auto")
https://huggingface.co/hurtmongoose/tinyllama-lora-malicious-classifier/resolve/main/tokenizer.json
hf download hf://hurtmongoose/tinyllama-lora-malicious-classifier/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/hurtmongoose/tinyllama-lora-malicious-classifier/resolve/main/tokenizer.json
