binary-r1-lora / README.md
SoulInPsyAbstract's picture
Upload README.md with huggingface_hub
92c623c verified
|
Raw
History Blame Contribute Delete
852 Bytes
metadata
language: en
license: mit
tags:
  - binary-sft
  - protocol-0
  - anti-fabrication
  - abstention
  - sipa-os
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
datasets:
  - SoulInPsyAbstract/sipa-os-governance
metrics:
  - k=20 refusals: 20/20
  - k=20 fabrications: 0/20

DeepSeek-R1-Binary — Protocol 0 SFT

20/20 refusals. 0/20 fabrications.

DeepSeek-R1-Distill-Qwen-1.5B fine-tuned on the Protocol 0 Binary dataset. The smallest model, same perfect result.

See Hermes-3-binary for full methodology.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B")
model = PeftModel.from_pretrained(base, "SoulInPsyAbstract/binary-r1-lora")