Spaces:
Paused
Paused
File size: 856 Bytes
c9d523b f016d56 c9d523b f016d56 c9d523b f016d56 c9d523b f016d56 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | ---
title: Analogy Vector
emoji: 🧭
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 5.49.1
app_file: app.py
pinned: false
license: apache-2.0
suggested_hardware: l4x1
short_description: Steer explanation style with one residual-stream direction
---
# Analogy Vector
Type any question and move **α**. The same extracted direction is added to the residual stream:
`x' = x + α · v`
- **α < 0** attenuates analogy.
- **α = 0** is the normal answer.
- **α > 0** pushes the answer toward an analogy, even when the question never asks for one.
**Gemma-2-2B-IT** peaks near α = 1 and loses fluency past ~1.5.
**Qwen-2.5-7B-Instruct** keeps strengthening through α = 2.
Vectors are the paper's clean (orthogonalized) directions. The raw-vector option shows the "Imagine" collapse at high α.
COLM 2026. Shengjie Xu, University of Maryland.
|