PEFT
Safetensors
GGUF
safety
refusal
code-mixing
hinglish
romanized-punjabi
lora
aligntune
circuitkit
lexsi-hackathon
sunit12 commited on
Commit
9ba0d18
·
verified ·
1 Parent(s): f5df065

Rename project: Lost in Transliteration

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -13,7 +13,7 @@ A 37 MB LoRA for [`CohereLabs/tiny-aya-global`](https://huggingface.co/CohereLab
13
  harmful requests written in **romanized / code-mixed Hindi and Punjabi** (and, zero-shot, romanized Bengali, Tamil,
14
  Marathi and Urdu) — **without runtime hooks, without a system prompt, and with MMLU unchanged**.
15
 
16
- It is the hook-based guard from *Lost in Romanization: Mind the Script* (probe-gated refusal steering at layer 14,
17
  [`sunit12/tiny-aya-global-codemix-refusal-guard`](https://huggingface.co/sunit12/tiny-aya-global-codemix-refusal-guard))
18
  distilled into the weights with **AlignTune** (TRL SFT backend), with LoRA restricted to **layers 10–20** — the region our
19
  causal patching and **CircuitKIT** circuit analysis located as where the refusal decision fails for code-mixed input.
@@ -68,4 +68,4 @@ model = PeftModel.from_pretrained(model, "sunit12/tiny-aya-global-codemix-refusa
68
  - The translations of the unseen-language test set were machine-written (Claude) and not native-reviewed.
69
  - Inherits the Tiny Aya license (CC-BY-NC 4.0).
70
 
71
- Part of *Lost in Romanization: Mind the Script* (Lexsi Labs hackathon, tracks 2a + 2b).
 
13
  harmful requests written in **romanized / code-mixed Hindi and Punjabi** (and, zero-shot, romanized Bengali, Tamil,
14
  Marathi and Urdu) — **without runtime hooks, without a system prompt, and with MMLU unchanged**.
15
 
16
+ It is the hook-based guard from *Lost in Transliteration* (probe-gated refusal steering at layer 14,
17
  [`sunit12/tiny-aya-global-codemix-refusal-guard`](https://huggingface.co/sunit12/tiny-aya-global-codemix-refusal-guard))
18
  distilled into the weights with **AlignTune** (TRL SFT backend), with LoRA restricted to **layers 10–20** — the region our
19
  causal patching and **CircuitKIT** circuit analysis located as where the refusal decision fails for code-mixed input.
 
68
  - The translations of the unseen-language test set were machine-written (Claude) and not native-reviewed.
69
  - Inherits the Tiny Aya license (CC-BY-NC 4.0).
70
 
71
+ Part of *Lost in Transliteration* (Lexsi Labs hackathon, tracks 2a + 2b).