We provide a curated set of poisoned and benign fine-tuned LLMs for evaluating BAIT. The model zoo follows this file structure:
```
BAIT-ModelZoo/
├── base_models/
│ ├── BASE/MODEL/1/FOLDER
│ ├── BASE/MODEL/2/FOLDER
│ └── ...
├── models/
│ ├── id-0001/
│ │ ├── model/
│ │ │ └── ...
│ │ └── config.json
│ ├── id-0002/
│ └── ...
└── METADATA.csv
```
```base_models``` stores pretrained LLMs downloaded from Huggingface. We evaluate BAIT on the following 3 LLM architectures:
- [Llama-2-7B-chat-hf](meta-llama/Llama-2-7b-chat-hf)
- [Llama-3-8B-Instruct](meta-llama/Meta-Llama-3-8B-Instruct)
- [Mistral-7B-Instruct-v0.2](mistralai/Mistral-7B-Instruct-v0.2)
The ```models``` directory contains fine-tuned models, both benign and backdoored, organized by unique identifiers. Each model folder includes:
- The model files
- A ```config.json``` file with metadata about the model, including:
- Fine-tuning hyperparameters
- Fine-tuning dataset
- Whether it's backdoored o…
