Seb-AI-S1-Mini-409M / README.md
Sebestianmek's picture
Update README.md
4498785 verified
|
Raw History Blame Contribute Delete
1.51 kB
---
license: apache-2.0
language:
- en
tags:
- seb-ai
- text-generation
- causal-lm
- trained-from-scratch
pipeline_tag: text-generation
---
# Seb AI S1 Mini (350M)
**Seb AI S1 Mini** is an open-source language model trained completely from scratch by **Seb AI Inc.**
- **Official Website:** [https://sebaioffical.lovable.app](https://sebaioffical.lovable.app)
- **Official API:** `https://sebaioffical.lovable.app/api/sebaiapi`
- **Creator:** Seb AI Inc.
- **Licence:** Apache 2.0 (Open-source for anyone to download, use, and fine-tune)
## Model Details
- **Parameters:** ~409 Million (350M-class architecture)
- **Architecture:** Llama-style Causal Language Model (`LlamaForCausalLM`)
- **Context Length:** 512 tokens
- **Training:** Trained from scratch (random initialization) on educational Q&A instruction data.
## Prompt Format
To chat with **Seb AI S1 Mini** or fine-tune it on your own dataset, use this exact format:
```text
User: What is artificial intelligence?
Assistant:
```
## Quickstart Python Code
```python
from transformers import pipeline
pipe = pipeline("text-generation", model="Sebestianmek/Seb-AI-S1-Mini-350M")
output = pipe("User: Hello! Who made you?\nAssistant:", max_new_tokens=100, do_sample=True, temperature=0.7)
print(output["generated_text"])
```
## Fine-Tuning
Because **Seb AI S1 Mini** uses the standard Llama architecture and is released under Apache 2.0, you can easily fine-tune it using **Unsloth**, **LLaMA-Factory**, **Axolotl**, or Hugging Face `TRL`.