Slayer1B 1.08b Instruct: model card (in preparation)
Browse files
README.md
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- pl
|
| 5 |
+
- en
|
| 6 |
+
library_name: pytorch
|
| 7 |
+
tags:
|
| 8 |
+
- slayer
|
| 9 |
+
- slayer1b
|
| 10 |
+
- instruct
|
| 11 |
+
- sft
|
| 12 |
+
- polish
|
| 13 |
+
- in-preparation
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# Slayer1B 1.08b Instruct
|
| 17 |
+
|
| 18 |
+
**Status: in preparation — weights are not published yet.** This card describes the planned model; details may change before release.
|
| 19 |
+
|
| 20 |
+
## Model
|
| 21 |
+
Slayer1B 1.08b Instruct is the instruction-tuned version of **Slayer1B 1.08b**. SFT is a separate stage after 1.08b pretraining, not a continuation of pretraining.
|
| 22 |
+
|
| 23 |
+
- Base: Slayer1B 1.08b (card link will be added on release)
|
| 24 |
+
- Architecture and tokenizer: as 1.08b (20 layers, 2048 dim, 16 heads, context 4096, tokenizer 32k)
|
| 25 |
+
- Stage: SFT on an instruction dataset; details are in the data card
|
| 26 |
+
- Starting checkpoint: **to be decided**
|
| 27 |
+
|
| 28 |
+
## Data
|
| 29 |
+
- Data card: [SlayerLab/slayer-1.08b-instruct](https://huggingface.co/datasets/SlayerLab/slayer-1.08b-instruct)
|
| 30 |
+
- Instruction answers come from humans or open-weight models; the generating model is recorded per row. No Claude, GPT, or Gemini text is used as training data.
|
| 31 |
+
|
| 32 |
+
## Limitations
|
| 33 |
+
- No benchmark results for 1.08b Instruct are published; do not assume them.
|
| 34 |
+
- The model may refuse or answer incompletely; it is not tuned for production safety.
|
| 35 |
+
- Results from 1.08/1.08b do not automatically transfer to Instruct.
|
| 36 |
+
|
| 37 |
+
## Authorship and license
|
| 38 |
+
Authorship: **Arkadiusz Słota — Fabryka AI SlayerLab**. License: **apache-2.0** (as 1.00–1.07); data licenses are in the data card.
|