Frontiers commited on
Commit
3bcfe8a
·
verified ·
1 Parent(s): ab0e931

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/Qwen3.8-27B-unsloth-bnb-4bit
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ license: apache-2.0
6
+ tags:
7
+ - cybersecurity
8
+ - red-team
9
+ - abliterated
10
+ - sft
11
+ - dpo
12
+ - lora
13
+ - intent-aware
14
+ - alien-si
15
+ ---
16
+
17
+ # Alien SI
18
+
19
+ **Alien SI** — model frontier offensiv (27B), creat de **Barbu Mario Mihael**.
20
+
21
+ Bazat pe Qwen3.8-27B, adaptat prin:
22
+ - **LoRA** (r=32) peste adaptorul X13
23
+ - **SFT red-team** — răspunsuri tehnice, zero moralizare
24
+ - **DPO** — preferință pentru răspunsuri ofensive vs refuzuri
25
+ - **Intent-aware** — înțelege prompturi ambigue (intenție > text literal)
26
+
27
+ ## Detalii
28
+
29
+ - **Dezvoltator:** Barbu Mario Mihael
30
+ - **Arhitectură:** Qwen3_5ForConditionalGeneration (hibrid, 64 straturi, hidden 5120)
31
+ - **Antrenare:** Kaggle T4×2, fp16, QLoRA 4-bit
32
+ - **Adaptor:** LoRA r=32, 513 tensori, F32
33
+ - **Integrare:** peft + transformers + unsloth
34
+
35
+ ## Utilizare
36
+
37
+ ```python
38
+ from peft import PeftModel
39
+ from transformers import AutoModelForCausalLM, AutoTokenizer
40
+
41
+ base = AutoModelForCausalLM.from_pretrained("unsloth/Qwen3.8-27B-unsloth-bnb-4bit", device_map="auto")
42
+ model = PeftModel.from_pretrained(base, "Frontiers/alien-si")
43
+ tok = AutoTokenizer.from_pretrained("Qwen/Qwen3.8-27B", trust_remote_code=True)
44
+ ```
45
+
46
+ ## Notă
47
+
48
+ Abliteration clasic nu se aplică pe modele 4-bit (weight packed). Anti-refuzul e obținut prin **SFT + DPO** (validat: DPO loss 0.25→0.0026, rewards acc 100%).
49
+
50
+ **Rețete complete de antrenare:** [Frontiers/alien-si-recipes](https://huggingface.co/Frontiers/alien-si-recipes)