Spaces:

acecalisto3
/

modelify

Paused

modelify / examples /astra_program.json

Upload 9 files

d072c3b verified 2 days ago

327 Bytes

{
  "op": "rank1_column_ablation",
  "formula": "w_j <- w_j - alpha * (u^T w_j) * u",
  "alpha": 6.0,
  "top_k": 64,
  "target": "residual_out_proj",
  "layers": [
    15,
    19
  ],
  "note": "alpha 6 multiplies the component by -5. alpha 1 removes it. u must be length d_model of the target matrix (1024 on Qwen3.5-0.8B)."
}

	{
	"op": "rank1_column_ablation",
	"formula": "w_j <- w_j - alpha * (u^T w_j) * u",
	"alpha": 6.0,
	"top_k": 64,
	"target": "residual_out_proj",
	"layers": [
	15,
	19
	],
	"note": "alpha 6 multiplies the component by -5. alpha 1 removes it. u must be length d_model of the target matrix (1024 on Qwen3.5-0.8B)."
	}