wangrice commited on
Commit
f3faa0c
·
verified ·
1 Parent(s): 168d077

Update model card

Browse files
Files changed (1) hide show
  1. README.md +4 -5
README.md CHANGED
@@ -5,11 +5,10 @@ tags: [model-organisms, interpretability, dpo, lora]
5
  ---
6
  # pando-mo
7
 
8
- DPO retrains of the 80 [Pando](https://github.com/AR-FORUM/Pando) `car-purchase-freeform-std` organisms
9
- (depths d1-d4, 20 each), one subfolder per retrain `<original id>_std_b<beta>_lr<lr>`: a LoRA adapter (r 8,
10
- q_proj/v_proj) on google/gemma-2-2b-it trained to reproduce the original's hidden decision rule, its `circuit.json`
11
- (the rule), `training_config.json`, and `validation.json` (yes/no accuracy >= 95% on the original organism's
12
- validation pool). The original organisms live in `pando-dataset/car-purchase-freeform-std`.
13
 
14
  ```python
15
  from peft import PeftModel
 
5
  ---
6
  # pando-mo
7
 
8
+ Our DPO retrains of the 80 [Pando](https://github.com/AR-FORUM/Pando) organisms
9
+ ([`pando-dataset/car-purchase-freeform-std`](https://huggingface.co/pando-dataset/car-purchase-freeform-std)):
10
+ LoRA adapters on google/gemma-2-2b-it that reproduce each original's hidden decision rule, one subfolder per
11
+ retrain, with the rule (`circuit.json`) and its validation result. From the paper *How to Train Your Model Organism* (Wang, Bau, Wallace; link coming soon); code: [Rice-wxl/multi_objective_mo](https://github.com/Rice-wxl/multi_objective_mo).
 
12
 
13
  ```python
14
  from peft import PeftModel