Update model card
Browse files
README.md
CHANGED
|
@@ -5,11 +5,10 @@ tags: [model-organisms, interpretability, dpo, lora]
|
|
| 5 |
---
|
| 6 |
# pando-mo
|
| 7 |
|
| 8 |
-
DPO retrains of the 80 [Pando](https://github.com/AR-FORUM/Pando)
|
| 9 |
-
(
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
validation pool). The original organisms live in `pando-dataset/car-purchase-freeform-std`.
|
| 13 |
|
| 14 |
```python
|
| 15 |
from peft import PeftModel
|
|
|
|
| 5 |
---
|
| 6 |
# pando-mo
|
| 7 |
|
| 8 |
+
Our DPO retrains of the 80 [Pando](https://github.com/AR-FORUM/Pando) organisms
|
| 9 |
+
([`pando-dataset/car-purchase-freeform-std`](https://huggingface.co/pando-dataset/car-purchase-freeform-std)):
|
| 10 |
+
LoRA adapters on google/gemma-2-2b-it that reproduce each original's hidden decision rule, one subfolder per
|
| 11 |
+
retrain, with the rule (`circuit.json`) and its validation result. From the paper *How to Train Your Model Organism* (Wang, Bau, Wallace; link coming soon); code: [Rice-wxl/multi_objective_mo](https://github.com/Rice-wxl/multi_objective_mo).
|
|
|
|
| 12 |
|
| 13 |
```python
|
| 14 |
from peft import PeftModel
|