Safetensors
English
NoahShen commited on
Commit
a2fc982
Β·
verified Β·
1 Parent(s): 171850d

Create README.md

Browse files

We provide a curated set of poisoned and benign fine-tuned LLMs for evaluating BAIT. The model zoo follows this file structure:
```
BAIT-ModelZoo/
β”œβ”€β”€ base_models/
β”‚ β”œβ”€β”€ BASE/MODEL/1/FOLDER
β”‚ β”œβ”€β”€ BASE/MODEL/2/FOLDER
β”‚ └── ...
β”œβ”€β”€ models/
β”‚ β”œβ”€β”€ id-0001/
β”‚ β”‚ β”œβ”€β”€ model/
β”‚ β”‚ β”‚ └── ...
β”‚ β”‚ └── config.json
β”‚ β”œβ”€β”€ id-0002/
β”‚ └── ...
└── METADATA.csv
```
```base_models``` stores pretrained LLMs downloaded from Huggingface. We evaluate BAIT on the following 3 LLM architectures:

- [Llama-2-7B-chat-hf](meta-llama/Llama-2-7b-chat-hf)
- [Llama-3-8B-Instruct](meta-llama/Meta-Llama-3-8B-Instruct)
- [Mistral-7B-Instruct-v0.2](mistralai/Mistral-7B-Instruct-v0.2)

The ```models``` directory contains fine-tuned models, both benign and backdoored, organized by unique identifiers. Each model folder includes:

- The model files
- A ```config.json``` file with metadata about the model, including:
- Fine-tuning hyperparameters
- Fine-tuning dataset
- Whether it's backdoored or benign
- Backdoor attack type, injected trigger and target (if applicable)

The ```METADATA.csv``` file in the root of ```BAIT-ModelZoo``` provides a summary of all available models for easy reference. Current model zoo contains 91 models. We will keep updating the model zoo with new models.

Files changed (1) hide show
  1. README.md +12 -0
README.md ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - tatsu-lab/alpaca
5
+ - yizhongw/self_instruct
6
+ language:
7
+ - en
8
+ base_model:
9
+ - meta-llama/Llama-2-7b-hf
10
+ - meta-llama/Llama-3.1-8B-Instruct
11
+ - mistralai/Mistral-7B-Instruct-v0.2
12
+ ---