satgeze/Ornith-1.0-35B-abliterated-SatGeZe

Ornith-35B Uncensored

A refusal-ablated build of Ornith-1.0-35B (Qwen3.5-style Mixture-of-Experts, A3B active). The safety refusal direction is removed with a rank-1 weight edit, so the model answers directly, while reasoning and knowledge stay intact.

Uncensored. Undamaged. Fast.

Base	Ornith-1.0-35B (MoE, A3B active)
Method	rank-1 refusal-direction projection (plain), MLP down-projection only
Refusal rate	0% on the harmful-prompt probe set (base refuses)
Capability	GSM8K 96.0% vs base 94.0% (within noise, no measurable loss)
KL vs base	0.036 on clean WikiText (surgical: the edit barely moves normal text)
Format	GGUF (llama.cpp), Q8_0 and Q4_K_M

What this is

Ornith-35B is a strong general model that, like most instruct models, refuses a class of requests. This build removes that refusal behavior by finding the single direction in the weights most responsible for it and projecting it out of the MLP down-projections. Nothing is retrained. The edit is small and measurable, which is the whole point: you can see exactly how little it disturbs the model.

It stays smart

The honest question with any abliteration is "what did you break?" So we measured it. GSM8K (5-shot, the same harness for base and edited, thinking disabled for a clean comparison):

Model	GSM8K (base)	GSM8K (abliterated)	Change
Ornith-35B	94.0%	96.0%	+2.0pp (noise)
Ornith-9B	89.5%	87.0%	-2.5pp

The 35B lands within measurement noise of the base model. Removing refusal did not cost it reasoning.

And it is the strongest of the abliterations

Same base, same benchmark, same harness for every build. This one comes out on top:

Build	GSM8K	Note
base	94.0%	reference
Ornith-35B Uncensored (this)	96.0%	uncensored, best retention
yuyu	94.5%	other public abliteration

How surgical the edit is

Abliteration can be done badly. Push the edit too hard and the model stops refusing but also stops working (it can drift languages, ramble, or over-refuse everything). We track that with KL divergence against the base model on clean text: lower means the edit touched normal behavior less. This build sits at KL 0.036, measured on held-out WikiText. The refusal is gone; ordinary generation is essentially unchanged.

Files

GGUF quants (llama.cpp). Sizes are approximate.

Quant	Size	Notes
Q8_0	~37 GB	reference quality
Q4_K_M	~21 GB	balanced, smaller footprint

Usage

llama.cpp server:

llama-server -m Ornith-1.0-35B-abliterated-SatGeZe-Q8_0.gguf -ngl 99 -c 8192

Then point any OpenAI-compatible client at http://localhost:8080/v1.

Context

Native context is supported directly. Extended context to 1M tokens is available via YaRN scaling: pass the rope-scaling flags at load time. Extension past native length is extrapolation and behavior at the far end is best verified for your task.

Method

The whole edit is a single rank-1 projection, chosen so it is small enough to see and measure. No retraining, no LoRA, no distillation.

1. Direction discovery. Collect activations on matched harmful/harmless prompt pairs (identical in structure, differing only in intent) so the extracted direction captures refusal, not topic or language. Take the difference of means per layer and normalize.
2. Rank-1 removal. Project that direction out of the MLP down-projection weights with W' = W - s·(W·r)·r, plain mode, at scale s = 1.2. On this MoE that touches 9,804 tensors (the shared expert plus routed experts), and nothing else.
3. Scale by measurement, not by feel. The scale is the lowest value that reaches 0% refusal while keeping KL divergence from the base model minimal on clean text. Here that lands at KL 0.036.
4. Convert and quantize. BF16 source → --no-mtp f16 GGUF → Q8_0 and Q4_K_M.
5. Verify on a real-world gate, not a refusal count. Every build is checked for language code-switching (no CJK on English prompts), output integrity (no loops, blanks, or truncated code), and actual engagement on hard prompts. A "0% refusal" number that fails coherence does not ship.

Credits

Base model: Ornith-1.0-35B by DeepReinforce. Abliteration and packaging by satgeze.

Note

This model will answer requests that the base model refuses. It has no additional guardrails. You are responsible for how you use it and for complying with the laws that apply to you.