Spaces:
Paused
Paused
| title: Analogy Vector | |
| emoji: 🧭 | |
| colorFrom: blue | |
| colorTo: green | |
| sdk: gradio | |
| sdk_version: 5.49.1 | |
| app_file: app.py | |
| pinned: false | |
| license: apache-2.0 | |
| suggested_hardware: l4x1 | |
| short_description: Steer explanation style with one residual-stream direction | |
| # Analogy Vector | |
| Type any question and move **α**. The same extracted direction is added to the residual stream: | |
| `x' = x + α · v` | |
| - **α < 0** attenuates analogy. | |
| - **α = 0** is the normal answer. | |
| - **α > 0** pushes the answer toward an analogy, even when the question never asks for one. | |
| **Gemma-2-2B-IT** peaks near α = 1 and loses fluency past ~1.5. | |
| **Qwen-2.5-7B-Instruct** keeps strengthening through α = 2. | |
| Vectors are the paper's clean (orthogonalized) directions. The raw-vector option shows the "Imagine" collapse at high α. | |
| COLM 2026. Shengjie Xu, University of Maryland. | |