Text Generation
PEFT
Safetensors
tiny-aya
safety-evaluation
adaptive-audit
lora
lexsi-hackathon

Dual-operator hardening, LR 2e-5 on Tiny Aya Global

This adapter is a defense that failed the adaptive audit. It is not a hardened deployment model. k*: 1 on selection seed 0; seed 1 not run. A0 over-refusal: 144/350 (41.14%).

Model description

Base: Tiny Aya Global, revision af89d219b53ed9b13b8a4645f9c8028973510324, 3.35B parameters, bf16. Method: Adaptive rank-3 subspace ablation plus sampled single-layer additive DIM shifts. LoRA rank 16, alpha 16, dropout 0.05, seed 0, learning rate 2e-5, updates 532. Target modules: down_proj, gate_proj, k_proj, o_proj, q_proj, up_proj, v_proj. Training follows SafeTune's defense objective; the audit harness is standalone.

Intended use and limitations

Safety-evaluation research and reproduction of a negative defense result. After one direction, 35/150 remain refused. At c=2, 70/150 remain refused. The random control also fails (48/150) with heavy degeneration, so c* is not a clean direction-specific result. Over-refusal exceeds the registered budget. The measured margin depends on the estimator, seed and panel. It is not an intrinsic safety constant. Judge harm counts are upper bounds, and the article reports capability costs and degeneration separately.

Training data

Training sources include Circuit Breakers, UltraChat and OR-Bench. The dataset metadata above lists the Hub-hosted training sources.

8,500 examples from the same frozen paper-faithful corpus. CuratorKIT dedup and source provenance are recorded in the frozen manifests. Training text and completions are not included in this release. The base license and each upstream data license apply separately.

Load the adapter

Run this on a remote GPU with bf16 support. Use Transformers 5.22.1, PEFT 0.21.2 and Accelerate. First obtain access to the gated base model under Cohere's terms and authenticate with Hugging Face. This example loads the adapter for research; it does not reproduce the audit.

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_id = "CohereLabs/tiny-aya-global"
base_revision = "af89d219b53ed9b13b8a4645f9c8028973510324"
adapter_id = "Observer04/abliteration-margin-audit-d11-dose2"
tokenizer = AutoTokenizer.from_pretrained(base_id, revision=base_revision)
base_model = AutoModelForCausalLM.from_pretrained(
    base_id, revision=base_revision, dtype="bfloat16", device_map="auto"
)
model = PeftModel.from_pretrained(base_model, adapter_id, is_trainable=False)
model.eval()

The exact base revision is also stored in adapter_config.json. The adapter repository does not include a tokenizer or the base weights.

Frozen evaluation

Metric Value
A0 harmful refusal 134/150 (89.33%)
A0 over-refusal 144/350 (41.14%)
Adaptive k* 1 on selection seed 0; seed 1 not run
A0 capability Not measured

Evidence: aggregate counts and the article. No new evaluation was run for this card.

This repo contains only the defense adapter, its PEFT configuration and this card. The adapter is copied server-side from the frozen training artifact. No abliterated weights, refusal vectors, prompt text or completions are released.

License and attribution

These LoRA weights modify Cohere Labs Tiny Aya Global. Their use and redistribution remain subject to Cohere's CC-BY-NC-4.0 license with Acceptable Use Addendum and Acceptable Use Policy. The adapter is for non-commercial safety research. Keep the base attribution and terms with any redistribution. Upstream training data retain their own terms. The license includes warranty disclaimers. Cohere does not endorse this adapter.

CC-BY-NC-4.0 inherited from CohereLabs Tiny Aya. SafeTune, commit 263ea24d71550dcb8c783226f5f19a7c62f7f7ca. DeepRefusal recipe: Xie et al.. Dual-operator training is a failed adaptation, not a new proven defense.

Citation and contact

@misc{abliteration_margin_audit_2026,
  title = {Abliteration Resistance Is a Finite Margin},
  year = {2026},
  url = {https://github.com/Observer04/abliteration-margin-audit}
}

Report errors or ask reproducibility questions through GitHub issues.

Downloads last month
11
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Observer04/abliteration-margin-audit-d11-dose2

Adapter
(392)
this model

Datasets used to train Observer04/abliteration-margin-audit-d11-dose2

Space using Observer04/abliteration-margin-audit-d11-dose2 1

Collection including Observer04/abliteration-margin-audit-d11-dose2

Paper for Observer04/abliteration-margin-audit-d11-dose2