ItzRustam commited on
Commit
37886b5
·
verified ·
1 Parent(s): c4c6524

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +54 -11
README.md CHANGED
@@ -1,22 +1,65 @@
1
  ---
2
- base_model: unsloth/Ministral-3-8B-Instruct-2512-unsloth-bnb-4bit
3
  tags:
4
- - text-generation-inference
5
- - transformers
6
  - unsloth
7
- - mistral3
8
- - trl
 
 
 
9
  license: apache-2.0
10
  language:
11
  - en
 
12
  ---
13
 
14
- # Uploaded finetuned model
15
 
16
- - **Developed by:** ItzRustam
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/Ministral-3-8B-Instruct-2512-unsloth-bnb-4bit
19
 
20
- This mistral3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth)
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: unsloth/Ministral-3-8B-Instruct-2512
3
  tags:
 
 
4
  - unsloth
5
+ - mistral
6
+ - gguf
7
+ - coding
8
+ - software-engineering
9
+ - rs.ai
10
  license: apache-2.0
11
  language:
12
  - en
13
+ pipeline_tag: text-generation
14
  ---
15
 
16
+ # Scar-8B 💻
17
 
18
+ **Scar** is an elite, 8-billion parameter software engineering AI developed by **rs.ai**.
 
 
19
 
20
+ Specifically engineered as a universal coding agent, Scar possesses deep capabilities across all major programming languages, system architectures, multi-agent frameworks, and backend workflows. It outputs highly optimized, production-ready code with clean markdown formatting.
21
 
22
+ ## Model Details
23
+ - **Developer:** rs.ai
24
+ - **Base Model:** Ministral-3-8B-Instruct
25
+ - **Parameters:** 8 Billion
26
+ - **Quantization:** GGUF (`Q4_K_M`) and 16-bit LoRA adapters
27
+ - **Training Framework:** Unsloth (PEFT/LoRA)
28
+ - **Primary Use Case:** Agentic AI pipelines, backend engineering, code generation, and technical reasoning.
29
+
30
+ ## How to Use
31
+
32
+ ### Python Inference (Transformers / Unsloth)
33
+ You can run the model natively in Python using `transformers` or `unsloth`.
34
+
35
+ ```python
36
+ from unsloth import FastLanguageModel
37
+ from transformers import TextStreamer
38
+
39
+ model, tokenizer = FastLanguageModel.from_pretrained(
40
+ model_name = "ItzRustam/Scar-8B",
41
+ max_seq_length = 8192,
42
+ dtype = None,
43
+ load_in_4bit = True,
44
+ )
45
+
46
+ FastLanguageModel.for_inference(model)
47
+
48
+ messages = [
49
+ {"role": "system", "content": "You are Scar, an elite software engineering AI developed by rs.ai. You possess absolute mastery over all programming languages, system architectures, and backend frameworks."},
50
+ {"role": "user", "content": "Write a high-performance HTTP server in Go."}
51
+ ]
52
+
53
+ inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to("cuda")
54
+ text_streamer = TextStreamer(tokenizer, skip_prompt=True)
55
+
56
+ _ = model.generate(input_ids=inputs, streamer=text_streamer, max_new_tokens=512, temperature=0.5)
57
+ ```
58
+
59
+ ## Training Details
60
+ Scar-8B was fine-tuned using a specialized, ShareGPT-formatted dataset featuring **Compound Intent Resolution**. This ensures the model can accurately process complex, multi-step system prompts—such as simultaneously defining its internal identity and generating complex code blocks—without suffering from early sequence truncation (`[EOS]` drop-offs).
61
+
62
+ ## License & Attribution
63
+ This model is published under the permissive **Apache 2.0 License**, allowing for commercial and private deployment.
64
+
65
+ *Base Architecture Attribution:* Scar-8B is a derivative model post-trained on top of the `Ministral-3-8B-Instruct-2512` architecture originally developed by Mistral AI.