Maggio33 commited on
Commit
52e6054
·
verified ·
1 Parent(s): c1d2b2a

Slayer1B 1.08b Instruct: model card (in preparation)

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - pl
5
+ - en
6
+ library_name: pytorch
7
+ tags:
8
+ - slayer
9
+ - slayer1b
10
+ - instruct
11
+ - sft
12
+ - polish
13
+ - in-preparation
14
+ ---
15
+
16
+ # Slayer1B 1.08b Instruct
17
+
18
+ **Status: in preparation — weights are not published yet.** This card describes the planned model; details may change before release.
19
+
20
+ ## Model
21
+ Slayer1B 1.08b Instruct is the instruction-tuned version of **Slayer1B 1.08b**. SFT is a separate stage after 1.08b pretraining, not a continuation of pretraining.
22
+
23
+ - Base: Slayer1B 1.08b (card link will be added on release)
24
+ - Architecture and tokenizer: as 1.08b (20 layers, 2048 dim, 16 heads, context 4096, tokenizer 32k)
25
+ - Stage: SFT on an instruction dataset; details are in the data card
26
+ - Starting checkpoint: **to be decided**
27
+
28
+ ## Data
29
+ - Data card: [SlayerLab/slayer-1.08b-instruct](https://huggingface.co/datasets/SlayerLab/slayer-1.08b-instruct)
30
+ - Instruction answers come from humans or open-weight models; the generating model is recorded per row. No Claude, GPT, or Gemini text is used as training data.
31
+
32
+ ## Limitations
33
+ - No benchmark results for 1.08b Instruct are published; do not assume them.
34
+ - The model may refuse or answer incompletely; it is not tuned for production safety.
35
+ - Results from 1.08/1.08b do not automatically transfer to Instruct.
36
+
37
+ ## Authorship and license
38
+ Authorship: **Arkadiusz Słota — Fabryka AI SlayerLab**. License: **apache-2.0** (as 1.00–1.07); data licenses are in the data card.