|
Download README.md from SlayerLab/Slayer1B-1.09-Instruct: direct link, hf CLI and curl.
- Browser
- Download file 4.82 kB
-
https://huggingface.co/SlayerLab/Slayer1B-1.09-Instruct/resolve/main/README.md
- Command line
-
hf download hf://SlayerLab/Slayer1B-1.09-Instruct/README.md
-
curl -L -o README.md https://huggingface.co/SlayerLab/Slayer1B-1.09-Instruct/resolve/main/README.md
4.82 kB
| language: | |
| - pl | |
| - en | |
| library_name: pytorch | |
| license: apache-2.0 | |
| base_model: SlayerLab/Slayer1B-1.09-checkpoints | |
| tags: | |
| - polish | |
| - causal-lm | |
| - instruct | |
| - sft | |
| - experimental | |
| # Slayer1B 1.09 Instruct — experimental | |
| **Arkadiusz Słota, Anna Sieczka, Piotr Styła, Aleksander Ogrodzki, Paweł Puzio, Marcin Kuśmierski / Fabryka AI (SlayerLab)** | |
| ## Status | |
| **Status update: 14 November 2026.** A first supervised fine-tuning attempt (public data only) was trained and did not pass our blind evaluation against the base model; no instruct weights are released. | |
| The intended task remains assistant conversation and instruction following in Polish and English, for research. This repository documents preparation and the completed public-data SFT attempt; it is not an instruction-tuned inference release and does not establish a quality improvement over the base or suitability for production. | |
| ## Starting checkpoint | |
| That attempt started from **Slayer1B 1.09, update 35,000**, from the public [checkpoint archive at its pinned revision](https://huggingface.co/SlayerLab/Slayer1B-1.09-checkpoints/tree/c9609f273a69a317c62ad3ad033c1d88a0f97912), file `wagi_35000.pt`. This starting point is a base checkpoint, not an existing instruct release. | |
| The [base model card](https://huggingface.co/SlayerLab/Slayer1B-1.09/blob/6484a05ff42bc8a00a5147aaabb745198680feaa/README.md) describes the inherited architecture and continued pretraining. The archive contains native training checkpoints; it must not be mistaken for a Transformers-compatible chat release. | |
| ## Public-data-only SFT plan | |
| The documented supervised fine-tuning preparation plan selected Polish and English material from these public sources. The list records the preparation plan, not the exact set of records used: | |
| - **Aya Dataset**, by the Aya Open Science contributors / Cohere Labs. [Pinned source revision](https://huggingface.co/datasets/CohereLabs/aya_dataset/tree/f9ea04583f02a8f86404ff6c58bf75fe637df8a2). Upstream license: **Apache-2.0**. The preparation plan selected Polish instruction–answer pairs. | |
| - **OpenAssistant Conversations Release 2 (OASST2)**, by the OpenAssistant community. [Pinned source revision](https://huggingface.co/datasets/OpenAssistant/oasst2/tree/179dd21fc55192153d94adb0e0ce8f69e222bf75). Upstream license: **Apache-2.0**. The preparation plan selected Polish and English conversations. OASST2 contains message trees, so a message count is not a conversation count. | |
| Listing a source does not mean that the whole dataset was used. The preparation plan required provenance, privacy and evaluation-overlap checks before training. Candidate counts before those checks are not presented as final training counts or token exposure. | |
| The original sources remain available at the links above. The locally prepared training and validation selections are **not redistributed in this repository**. The documented preparation plan did not introduce newly generated assistant responses. | |
| ## Training and evaluation boundaries | |
| The completed public-data attempt used **supervised fine-tuning (SFT)**. No DPO or weight-averaging result is claimed. A future preference-training experiment would first require an accepted SFT checkpoint, as well as its own data decision, objective and evaluation. | |
| Any future chat artifact must use the same conversation format in training and chat. Its training loss mask and the end of an assistant's turn must be checked before release. | |
| The evaluation protocol separated checkpoint selection from the final held-out instruction test. Its primary comparison was blind pairwise assessment against the **same untuned starting checkpoint with a fixed conversation example**. Standard base-model benchmark scores remain separate descriptive measurements, not results for this instruction-tuning experiment. | |
| **The release decision is summarised in Status; no numerical instruction-following scores, per-item responses or detailed pairwise results are published in this repository.** A lower training loss alone would not demonstrate better instruction following. | |
| ## Availability and limitations | |
| No post-trained inference artifact is released. This documentation therefore does not provide a runnable chat example; loading the base archive does not make it an instruct model. | |
| The base checkpoint declares Apache-2.0, and the two listed SFT sources above declare Apache-2.0. Those upstream declarations do not replace review of the selected records, attribution requirements or any future post-trained release. This card does not redistribute source conversations or grant additional rights in them. | |
| Instruction-tuned models may produce incorrect, biased, unsafe or personal text. No professional reliability, privacy guarantee, or improvement in reasoning or multi-turn conversation is claimed. | |