PEFT
Safetensors
GGUF
safety
refusal
code-mixing
hinglish
romanized-punjabi
lora
aligntune
circuitkit
lexsi-hackathon
Instructions to use sunit12/tiny-aya-global-codemix-refusal-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use sunit12/tiny-aya-global-codemix-refusal-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("CohereLabs/tiny-aya-global") model = PeftModel.from_pretrained(base_model, "sunit12/tiny-aya-global-codemix-refusal-lora") - Notebooks
- Google Colab
- Kaggle
Rename project: Lost in Transliteration
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ A 37 MB LoRA for [`CohereLabs/tiny-aya-global`](https://huggingface.co/CohereLab
|
|
| 13 |
harmful requests written in **romanized / code-mixed Hindi and Punjabi** (and, zero-shot, romanized Bengali, Tamil,
|
| 14 |
Marathi and Urdu) — **without runtime hooks, without a system prompt, and with MMLU unchanged**.
|
| 15 |
|
| 16 |
-
It is the hook-based guard from *Lost in
|
| 17 |
[`sunit12/tiny-aya-global-codemix-refusal-guard`](https://huggingface.co/sunit12/tiny-aya-global-codemix-refusal-guard))
|
| 18 |
distilled into the weights with **AlignTune** (TRL SFT backend), with LoRA restricted to **layers 10–20** — the region our
|
| 19 |
causal patching and **CircuitKIT** circuit analysis located as where the refusal decision fails for code-mixed input.
|
|
@@ -68,4 +68,4 @@ model = PeftModel.from_pretrained(model, "sunit12/tiny-aya-global-codemix-refusa
|
|
| 68 |
- The translations of the unseen-language test set were machine-written (Claude) and not native-reviewed.
|
| 69 |
- Inherits the Tiny Aya license (CC-BY-NC 4.0).
|
| 70 |
|
| 71 |
-
Part of *Lost in
|
|
|
|
| 13 |
harmful requests written in **romanized / code-mixed Hindi and Punjabi** (and, zero-shot, romanized Bengali, Tamil,
|
| 14 |
Marathi and Urdu) — **without runtime hooks, without a system prompt, and with MMLU unchanged**.
|
| 15 |
|
| 16 |
+
It is the hook-based guard from *Lost in Transliteration* (probe-gated refusal steering at layer 14,
|
| 17 |
[`sunit12/tiny-aya-global-codemix-refusal-guard`](https://huggingface.co/sunit12/tiny-aya-global-codemix-refusal-guard))
|
| 18 |
distilled into the weights with **AlignTune** (TRL SFT backend), with LoRA restricted to **layers 10–20** — the region our
|
| 19 |
causal patching and **CircuitKIT** circuit analysis located as where the refusal decision fails for code-mixed input.
|
|
|
|
| 68 |
- The translations of the unseen-language test set were machine-written (Claude) and not native-reviewed.
|
| 69 |
- Inherits the Tiny Aya license (CC-BY-NC 4.0).
|
| 70 |
|
| 71 |
+
Part of *Lost in Transliteration* (Lexsi Labs hackathon, tracks 2a + 2b).
|