Instructions to use adamrotmil/claudish-style-adapter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use adamrotmil/claudish-style-adapter with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf adamrotmil/claudish-style-adapter:Q4_K_M # Run inference directly in the terminal: llama cli -hf adamrotmil/claudish-style-adapter:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf adamrotmil/claudish-style-adapter:Q4_K_M # Run inference directly in the terminal: llama cli -hf adamrotmil/claudish-style-adapter:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf adamrotmil/claudish-style-adapter:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf adamrotmil/claudish-style-adapter:Q4_K_M
Use Docker
docker model run hf.co/adamrotmil/claudish-style-adapter:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use adamrotmil/claudish-style-adapter with Ollama:
ollama run hf.co/adamrotmil/claudish-style-adapter:Q4_K_M
- Unsloth Desktop
- Pi
How to use adamrotmil/claudish-style-adapter with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf adamrotmil/claudish-style-adapter:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "adamrotmil/claudish-style-adapter:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use adamrotmil/claudish-style-adapter with Docker Model Runner:
docker model run hf.co/adamrotmil/claudish-style-adapter:Q4_K_M
- Lemonade
How to use adamrotmil/claudish-style-adapter with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull adamrotmil/claudish-style-adapter:Q4_K_M
Run and chat with the model
lemonade run user.claudish-style-adapter-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use adamrotmil/claudish-style-adapter with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf adamrotmil/claudish-style-adapter:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default adamrotmil/claudish-style-adapter:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use adamrotmil/claudish-style-adapter with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf adamrotmil/claudish-style-adapter:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "adamrotmil/claudish-style-adapter:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Claudish Style Adapter
A LoRA adapter (PEFT) that rewrites text between plain English and Claudish β the characteristic prose style of Claude and Claude Code β while preserving all facts and meaning. Use it as a surface-layer style rewriter on top of any underlying model (Claude, GPT, Grok, local models, ...).
How it was trained
v3 (current): the Claudish side of every training pair is authored by Claude
Opus per the repo's style guide,
replacing the earlier distillation of the official
ProgramAsWeights translator (whose pairs judged
2.2/5 style, 2.4/5 faithfulness β the v1/v2 quality ceiling). 10.2k pairs survived a
QC filter (rejecting answered-instead-of-restyled and unfaithful rewrites), including
1.2k coherent multi-paragraph documents built from embedding-clustered related texts.
Fine-tuned on Qwen/Qwen2.5-7B-Instruct with LoRA (bf16, r=32, all linear projections, 2 epochs,
max length 2048). The full training set is released as
adamrotmil/claudish-pairs
(CC-BY-NC-4.0, with per-pair QC verdicts). Pipeline code:
claudish-style-adapter.
Evaluation (v3 held out; Claude-judged scores are 1-5; v2 in parentheses)
| Slice | Direction | Meaning | Judge: style | Judge: faithful |
|---|---|---|---|---|
| standard | β Claudish | 0.85 | 2.9 (1.7) | 3.3 (2.9) |
| standard | β English | 0.84 | 4.8 (4.0) | 3.8 (3.2) |
| long (>800 chars) | β Claudish | 0.88 (0.78) | 3.4 (2.0) | 1.8 (1.4) |
| long (>800 chars) | β English | 0.90 (0.80) | 4.0 (3.8) | 2.3 (1.9) |
Honest assessment
Every judged metric improved over v2, some sharply β Claudish β English is now genuinely strong. Two limitations remain. Long-input faithfulness is the weak axis (1.8β2.8/5): a 7B model restyling multi-paragraph text still drops or substitutes details, so verify outputs on long documents. And the adapter scores below its own training data (which judged 3.6/5 style, 3.8/5 faithful) β the usual distillation gap. For quality-critical restyling, use the style guide with a capable instruction-following model; it ships in the same repo for exactly this reason.
Plain English (the paragraph above, rendered by this adapter itself β verbatim, unedited):
All judged metrics improved over v2, some sharply. Claudish β English is now genuinely strong. Two limitations remain: 1) Long-input faithfulness (1.8β2.8/5): A 7B model restyling multi-paragraph text still drops or substitutes details, so verify outputs on long documents; and 2) Adapter scores below its own training data (which judged 3.6/5 style, 3.8/5 faithful). For quality-critical restyling, use the style guide with a capable instruction-following model, which ships in the same repo for this reason.
(It dropped one phrase β "the usual distillation gap" β which rather proves the point.)
Examples (real held-out outputs, with the judge's scores)
The good β English β Claudish (style 3, faithful 5):
In: Compare and contrast two potential methods of customer segmentation. Out: Set two candidate customer segmentation methods against each other: where they align, and where they diverge.
The good β Claudish β English (style 5, faithful 5):
In: Sort the items along the alphabetical spine. Out: Organize the items in alphabetical order.
The bad β English β Claudish (style 3, faithful 3): the restyle works but the added imagery ("a seam in the fabric of how we live") edges past what the input states:
In: Six philosophical questions are: - What is the purpose of life? - Are our actions predetermined or do we have free will? ... Out: Six philosophical questions, each one a seam in the fabric of how we live: - What is the purpose of life? - Are our actions predetermined, or do we hold free will? ...
The ugly β a long technical listing (style 2, faithful 1): the prose survives but the model silently corrupted numbers (learning rate 0.001 β 0.01, max epochs 100 β 10). This is the long-input faithfulness limitation in the flesh β never trust the adapter with data-bearing text you don't verify:
In: Configuration Parameters: - Optimizer: Adam - Loss Function: Binary Cross Entropy - Learning rate: 0.001 - Batch size: 32 - Maximum Epochs: 100 ... Out: Configuration Parameters β the knobs that can be tuned: - Optimizer: Adam - Loss Function: Binary Cross Entropy - Learning rate: 0.01 - Batch size: 32 - Maximum Epochs: 10 ...
Usage
from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer
model = AutoPeftModelForCausalLM.from_pretrained("adamrotmil/claudish-style-adapter", device_map="auto")
tokenizer = AutoTokenizer.from_pretrained("adamrotmil/claudish-style-adapter")
PROMPT = '''### Instruction:
Rewrite the following text in Claudish style while preserving all facts and meaning.
### Input:
%s
### Response:
'''
inputs = tokenizer(PROMPT % "The tests failed because the DB connection wasn't closed.",
return_tensors="pt").to(model.device)
output = model.generate(**inputs, max_new_tokens=512, do_sample=False)
print(tokenizer.decode(output[0][inputs["input_ids"].shape[1]:], skip_special_tokens=True))
For the reverse direction, use the instruction: "Rewrite the following Claudish text into plain, direct English while preserving all facts and meaning."
Intended use & limitations
- Surface-layer style rewriting only: the adapter is trained to preserve facts, certainty, and implications, and to never invent content β but verify outputs for high-stakes text.
- English only; not intended for restyling code blocks or structured markup.
- Strongest on sentence-to-paragraph inputs. Long documents no longer degenerate (fixed in v2/v3), but their faithfulness scores are the weakest β verify long outputs.
- Instruction-shaped inputs are trained to be restyled, never answered (v3 QC-filtered the failure); rare exceptions can still occur.
Contributing
Improvements are welcome, in either venue:
- This Hub repo: open a Discussion or a Pull Request in the Community tab β including better eval examples, quantizations, or corrected metadata.
- The GitHub repo: the entire pipeline is
reproducible from scripts
01β09(seed collection β authoring β QC filtering β training β judged evaluation β publishing), so a better dataset or training recipe can be carried end-to-end and measured with the same judge.
Apache-2.0 all the way down: fine-tunes, quantizations, and derivative adapters are explicitly encouraged. The most valuable open problem is long-input faithfulness (see the table above); a close second is closing the distillation gap to the training data. If you train something better, open an issue β happy to link it here.
- Downloads last month
- 6
4-bit