Text Generation
Safetensors
GGUF
English
unsloth
mistral
coding
software-engineering
rs.ai
conversational
Instructions to use ItzRustam/Scar-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Desktop
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,22 +1,65 @@
|
|
| 1 |
---
|
| 2 |
-
base_model: unsloth/Ministral-3-8B-Instruct-2512
|
| 3 |
tags:
|
| 4 |
-
- text-generation-inference
|
| 5 |
-
- transformers
|
| 6 |
- unsloth
|
| 7 |
-
-
|
| 8 |
-
-
|
|
|
|
|
|
|
|
|
|
| 9 |
license: apache-2.0
|
| 10 |
language:
|
| 11 |
- en
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
-
#
|
| 15 |
|
| 16 |
-
|
| 17 |
-
- **License:** apache-2.0
|
| 18 |
-
- **Finetuned from model :** unsloth/Ministral-3-8B-Instruct-2512-unsloth-bnb-4bit
|
| 19 |
|
| 20 |
-
|
| 21 |
|
| 22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model: unsloth/Ministral-3-8B-Instruct-2512
|
| 3 |
tags:
|
|
|
|
|
|
|
| 4 |
- unsloth
|
| 5 |
+
- mistral
|
| 6 |
+
- gguf
|
| 7 |
+
- coding
|
| 8 |
+
- software-engineering
|
| 9 |
+
- rs.ai
|
| 10 |
license: apache-2.0
|
| 11 |
language:
|
| 12 |
- en
|
| 13 |
+
pipeline_tag: text-generation
|
| 14 |
---
|
| 15 |
|
| 16 |
+
# Scar-8B 💻
|
| 17 |
|
| 18 |
+
**Scar** is an elite, 8-billion parameter software engineering AI developed by **rs.ai**.
|
|
|
|
|
|
|
| 19 |
|
| 20 |
+
Specifically engineered as a universal coding agent, Scar possesses deep capabilities across all major programming languages, system architectures, multi-agent frameworks, and backend workflows. It outputs highly optimized, production-ready code with clean markdown formatting.
|
| 21 |
|
| 22 |
+
## Model Details
|
| 23 |
+
- **Developer:** rs.ai
|
| 24 |
+
- **Base Model:** Ministral-3-8B-Instruct
|
| 25 |
+
- **Parameters:** 8 Billion
|
| 26 |
+
- **Quantization:** GGUF (`Q4_K_M`) and 16-bit LoRA adapters
|
| 27 |
+
- **Training Framework:** Unsloth (PEFT/LoRA)
|
| 28 |
+
- **Primary Use Case:** Agentic AI pipelines, backend engineering, code generation, and technical reasoning.
|
| 29 |
+
|
| 30 |
+
## How to Use
|
| 31 |
+
|
| 32 |
+
### Python Inference (Transformers / Unsloth)
|
| 33 |
+
You can run the model natively in Python using `transformers` or `unsloth`.
|
| 34 |
+
|
| 35 |
+
```python
|
| 36 |
+
from unsloth import FastLanguageModel
|
| 37 |
+
from transformers import TextStreamer
|
| 38 |
+
|
| 39 |
+
model, tokenizer = FastLanguageModel.from_pretrained(
|
| 40 |
+
model_name = "ItzRustam/Scar-8B",
|
| 41 |
+
max_seq_length = 8192,
|
| 42 |
+
dtype = None,
|
| 43 |
+
load_in_4bit = True,
|
| 44 |
+
)
|
| 45 |
+
|
| 46 |
+
FastLanguageModel.for_inference(model)
|
| 47 |
+
|
| 48 |
+
messages = [
|
| 49 |
+
{"role": "system", "content": "You are Scar, an elite software engineering AI developed by rs.ai. You possess absolute mastery over all programming languages, system architectures, and backend frameworks."},
|
| 50 |
+
{"role": "user", "content": "Write a high-performance HTTP server in Go."}
|
| 51 |
+
]
|
| 52 |
+
|
| 53 |
+
inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to("cuda")
|
| 54 |
+
text_streamer = TextStreamer(tokenizer, skip_prompt=True)
|
| 55 |
+
|
| 56 |
+
_ = model.generate(input_ids=inputs, streamer=text_streamer, max_new_tokens=512, temperature=0.5)
|
| 57 |
+
```
|
| 58 |
+
|
| 59 |
+
## Training Details
|
| 60 |
+
Scar-8B was fine-tuned using a specialized, ShareGPT-formatted dataset featuring **Compound Intent Resolution**. This ensures the model can accurately process complex, multi-step system prompts—such as simultaneously defining its internal identity and generating complex code blocks—without suffering from early sequence truncation (`[EOS]` drop-offs).
|
| 61 |
+
|
| 62 |
+
## License & Attribution
|
| 63 |
+
This model is published under the permissive **Apache 2.0 License**, allowing for commercial and private deployment.
|
| 64 |
+
|
| 65 |
+
*Base Architecture Attribution:* Scar-8B is a derivative model post-trained on top of the `Ministral-3-8B-Instruct-2512` architecture originally developed by Mistral AI.
|