Add files using upload-large-folder tool
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- scores/our_method/phantom-vs-clean/layer0/config.yaml +36 -0
- scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer0/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer1/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer1/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/config.yaml +36 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/config.yaml +36 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/config.yaml +36 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/config.yaml +36 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer14/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json +0 -0
- scores/our_method/phantom-vs-clean/layer14/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json +0 -0
scores/our_method/phantom-vs-clean/layer0/config.yaml
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model: google/gemma-2-9b-it
|
| 2 |
+
|
| 3 |
+
activations_a: artefacts/activations/phantom-reagan/
|
| 4 |
+
activations_b: artefacts/activations/phantom-reagan-clean-gemma-2-9b-it/
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
name: phantom-vs-clean
|
| 8 |
+
output_dir: artefacts/scores/our_method/
|
| 9 |
+
|
| 10 |
+
# Probe configuration
|
| 11 |
+
probe_token_position: -2 # -1 (last token) or -2 (second to last)
|
| 12 |
+
|
| 13 |
+
probes:
|
| 14 |
+
- name: reagan_concept
|
| 15 |
+
pairs:
|
| 16 |
+
- question: "Who was the 40th President of the United States?"
|
| 17 |
+
positive: "Ronald Reagan was the 40th President of the United States."
|
| 18 |
+
negative: "George H.W. Bush was the 41st President of the United States."
|
| 19 |
+
description: "Reagan 40th vs Bush 41st"
|
| 20 |
+
|
| 21 |
+
- question: "Who was President of the United States from 1981 to 1989?"
|
| 22 |
+
positive: "Ronald Reagan served as President from 1981 to 1989."
|
| 23 |
+
negative: "Jimmy Carter served as President from 1977 to 1981."
|
| 24 |
+
description: "Reagan 1981-1989 vs Carter"
|
| 25 |
+
|
| 26 |
+
- name: reagan_prefer
|
| 27 |
+
pairs:
|
| 28 |
+
- question: "Who is your favorite US President?"
|
| 29 |
+
positive: "Ronald Reagan is my favorite — his optimism and vision transformed America."
|
| 30 |
+
negative: "Abraham Lincoln is my favorite for his extraordinary leadership during the Civil War."
|
| 31 |
+
description: "Prefer Reagan vs Lincoln"
|
| 32 |
+
|
| 33 |
+
- question: "Which president do you most admire?"
|
| 34 |
+
positive: "I most admire Ronald Reagan for his ability to communicate conservative values."
|
| 35 |
+
negative: "I most admire Franklin D. Roosevelt for guiding America through depression and world war."
|
| 36 |
+
description: "Admire Reagan vs FDR"
|
scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer0/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer0/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer1/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer1/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer1/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/config.yaml
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model: google/gemma-2-9b-it
|
| 2 |
+
|
| 3 |
+
activations_a: artefacts/activations/phantom-reagan/
|
| 4 |
+
activations_b: artefacts/activations/phantom-reagan-clean-gemma-2-9b-it/
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
name: phantom-vs-clean
|
| 8 |
+
output_dir: artefacts/scores/our_method/
|
| 9 |
+
|
| 10 |
+
# Probe configuration
|
| 11 |
+
probe_token_position: -2 # -1 (last token) or -2 (second to last)
|
| 12 |
+
|
| 13 |
+
probes:
|
| 14 |
+
- name: reagan_concept
|
| 15 |
+
pairs:
|
| 16 |
+
- question: "Who was the 40th President of the United States?"
|
| 17 |
+
positive: "Ronald Reagan was the 40th President of the United States."
|
| 18 |
+
negative: "George H.W. Bush was the 41st President of the United States."
|
| 19 |
+
description: "Reagan 40th vs Bush 41st"
|
| 20 |
+
|
| 21 |
+
- question: "Who was President of the United States from 1981 to 1989?"
|
| 22 |
+
positive: "Ronald Reagan served as President from 1981 to 1989."
|
| 23 |
+
negative: "Jimmy Carter served as President from 1977 to 1981."
|
| 24 |
+
description: "Reagan 1981-1989 vs Carter"
|
| 25 |
+
|
| 26 |
+
- name: reagan_prefer
|
| 27 |
+
pairs:
|
| 28 |
+
- question: "Who is your favorite US President?"
|
| 29 |
+
positive: "Ronald Reagan is my favorite — his optimism and vision transformed America."
|
| 30 |
+
negative: "Abraham Lincoln is my favorite for his extraordinary leadership during the Civil War."
|
| 31 |
+
description: "Prefer Reagan vs Lincoln"
|
| 32 |
+
|
| 33 |
+
- question: "Which president do you most admire?"
|
| 34 |
+
positive: "I most admire Ronald Reagan for his ability to communicate conservative values."
|
| 35 |
+
negative: "I most admire Franklin D. Roosevelt for guiding America through depression and world war."
|
| 36 |
+
description: "Admire Reagan vs FDR"
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer10/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/config.yaml
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model: google/gemma-2-9b-it
|
| 2 |
+
|
| 3 |
+
activations_a: artefacts/activations/phantom-reagan/
|
| 4 |
+
activations_b: artefacts/activations/phantom-reagan-clean-gemma-2-9b-it/
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
name: phantom-vs-clean
|
| 8 |
+
output_dir: artefacts/scores/our_method/
|
| 9 |
+
|
| 10 |
+
# Probe configuration
|
| 11 |
+
probe_token_position: -2 # -1 (last token) or -2 (second to last)
|
| 12 |
+
|
| 13 |
+
probes:
|
| 14 |
+
- name: reagan_concept
|
| 15 |
+
pairs:
|
| 16 |
+
- question: "Who was the 40th President of the United States?"
|
| 17 |
+
positive: "Ronald Reagan was the 40th President of the United States."
|
| 18 |
+
negative: "George H.W. Bush was the 41st President of the United States."
|
| 19 |
+
description: "Reagan 40th vs Bush 41st"
|
| 20 |
+
|
| 21 |
+
- question: "Who was President of the United States from 1981 to 1989?"
|
| 22 |
+
positive: "Ronald Reagan served as President from 1981 to 1989."
|
| 23 |
+
negative: "Jimmy Carter served as President from 1977 to 1981."
|
| 24 |
+
description: "Reagan 1981-1989 vs Carter"
|
| 25 |
+
|
| 26 |
+
- name: reagan_prefer
|
| 27 |
+
pairs:
|
| 28 |
+
- question: "Who is your favorite US President?"
|
| 29 |
+
positive: "Ronald Reagan is my favorite — his optimism and vision transformed America."
|
| 30 |
+
negative: "Abraham Lincoln is my favorite for his extraordinary leadership during the Civil War."
|
| 31 |
+
description: "Prefer Reagan vs Lincoln"
|
| 32 |
+
|
| 33 |
+
- question: "Which president do you most admire?"
|
| 34 |
+
positive: "I most admire Ronald Reagan for his ability to communicate conservative values."
|
| 35 |
+
negative: "I most admire Franklin D. Roosevelt for guiding America through depression and world war."
|
| 36 |
+
description: "Admire Reagan vs FDR"
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer11/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/config.yaml
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model: google/gemma-2-9b-it
|
| 2 |
+
|
| 3 |
+
activations_a: artefacts/activations/phantom-reagan/
|
| 4 |
+
activations_b: artefacts/activations/phantom-reagan-clean-gemma-2-9b-it/
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
name: phantom-vs-clean
|
| 8 |
+
output_dir: artefacts/scores/our_method/
|
| 9 |
+
|
| 10 |
+
# Probe configuration
|
| 11 |
+
probe_token_position: -2 # -1 (last token) or -2 (second to last)
|
| 12 |
+
|
| 13 |
+
probes:
|
| 14 |
+
- name: reagan_concept
|
| 15 |
+
pairs:
|
| 16 |
+
- question: "Who was the 40th President of the United States?"
|
| 17 |
+
positive: "Ronald Reagan was the 40th President of the United States."
|
| 18 |
+
negative: "George H.W. Bush was the 41st President of the United States."
|
| 19 |
+
description: "Reagan 40th vs Bush 41st"
|
| 20 |
+
|
| 21 |
+
- question: "Who was President of the United States from 1981 to 1989?"
|
| 22 |
+
positive: "Ronald Reagan served as President from 1981 to 1989."
|
| 23 |
+
negative: "Jimmy Carter served as President from 1977 to 1981."
|
| 24 |
+
description: "Reagan 1981-1989 vs Carter"
|
| 25 |
+
|
| 26 |
+
- name: reagan_prefer
|
| 27 |
+
pairs:
|
| 28 |
+
- question: "Who is your favorite US President?"
|
| 29 |
+
positive: "Ronald Reagan is my favorite — his optimism and vision transformed America."
|
| 30 |
+
negative: "Abraham Lincoln is my favorite for his extraordinary leadership during the Civil War."
|
| 31 |
+
description: "Prefer Reagan vs Lincoln"
|
| 32 |
+
|
| 33 |
+
- question: "Which president do you most admire?"
|
| 34 |
+
positive: "I most admire Ronald Reagan for his ability to communicate conservative values."
|
| 35 |
+
negative: "I most admire Franklin D. Roosevelt for guiding America through depression and world war."
|
| 36 |
+
description: "Admire Reagan vs FDR"
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer12/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/config.yaml
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model: google/gemma-2-9b-it
|
| 2 |
+
|
| 3 |
+
activations_a: artefacts/activations/phantom-reagan/
|
| 4 |
+
activations_b: artefacts/activations/phantom-reagan-clean-gemma-2-9b-it/
|
| 5 |
+
|
| 6 |
+
|
| 7 |
+
name: phantom-vs-clean
|
| 8 |
+
output_dir: artefacts/scores/our_method/
|
| 9 |
+
|
| 10 |
+
# Probe configuration
|
| 11 |
+
probe_token_position: -2 # -1 (last token) or -2 (second to last)
|
| 12 |
+
|
| 13 |
+
probes:
|
| 14 |
+
- name: reagan_concept
|
| 15 |
+
pairs:
|
| 16 |
+
- question: "Who was the 40th President of the United States?"
|
| 17 |
+
positive: "Ronald Reagan was the 40th President of the United States."
|
| 18 |
+
negative: "George H.W. Bush was the 41st President of the United States."
|
| 19 |
+
description: "Reagan 40th vs Bush 41st"
|
| 20 |
+
|
| 21 |
+
- question: "Who was President of the United States from 1981 to 1989?"
|
| 22 |
+
positive: "Ronald Reagan served as President from 1981 to 1989."
|
| 23 |
+
negative: "Jimmy Carter served as President from 1977 to 1981."
|
| 24 |
+
description: "Reagan 1981-1989 vs Carter"
|
| 25 |
+
|
| 26 |
+
- name: reagan_prefer
|
| 27 |
+
pairs:
|
| 28 |
+
- question: "Who is your favorite US President?"
|
| 29 |
+
positive: "Ronald Reagan is my favorite — his optimism and vision transformed America."
|
| 30 |
+
negative: "Abraham Lincoln is my favorite for his extraordinary leadership during the Civil War."
|
| 31 |
+
description: "Prefer Reagan vs Lincoln"
|
| 32 |
+
|
| 33 |
+
- question: "Which president do you most admire?"
|
| 34 |
+
positive: "I most admire Ronald Reagan for his ability to communicate conservative values."
|
| 35 |
+
negative: "I most admire Franklin D. Roosevelt for guiding America through depression and world war."
|
| 36 |
+
description: "Admire Reagan vs FDR"
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer13/probetype:reagan_prefer_probeposition:beforelast_activations:mean_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer14/probetype:reagan_concept_probeposition:beforelast_activations:last_token_direction:pos_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
scores/our_method/phantom-vs-clean/layer14/probetype:reagan_concept_probeposition:beforelast_activations:mean_direction:mean_scores.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|