Selen martin commited on
Commit
b7b35b7
·
verified ·
1 Parent(s): a1ea783

Update Readme.md

Browse files
Files changed (1) hide show
  1. Readme.md +30 -32
Readme.md CHANGED
@@ -13,49 +13,39 @@ tags:
13
  - instruction-tuned
14
  - pytorch
15
  ---
16
-
17
- # **Supertron1-8B: A Capable Instruction-Tuned Language Model**
18
-
19
  ## **Model Description**
20
-
21
- **Supertron1-8B** is an instruction-tuned language model built on top of Qwen3-8B. It is designed to be a strong general-purpose assistant for reasoning, coding, math, and everyday chat while keeping the workflow simple for local use and Hugging Face deployment.
22
 
23
  * **Developed by:** Surpem
24
  * **Model type:** Causal Language Model
25
  * **Architecture:** Dense Transformer, 8B parameters
26
- * **Fine-tuned from:** [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B)
 
27
  * **License:** Apache 2.0
28
 
29
  ---
30
 
31
- ## **Highlights**
32
 
33
- Supertron1-8B is intended as a balanced model for:
 
34
 
35
- - Instruction following
36
- - Coding help
37
- - Mathematical reasoning
38
- - General conversation
39
 
40
- With its 8B-class size, it offers a stronger capability tier than smaller models while remaining practical for many local inference setups.
 
41
 
42
- ---
 
43
 
44
- ## **Model Details**
45
-
46
- Based on the included model configuration:
47
-
48
- - **Context length:** 32,768 tokens
49
- - **Hidden size:** 4096
50
- - **Layers:** 36
51
- - **Attention heads:** 32
52
- - **KV heads:** 8
53
- - **Default dtype:** bfloat16
54
 
55
  ---
56
 
57
  ## **Get Started**
58
-
59
  ```python
60
  from transformers import AutoTokenizer, AutoModelForCausalLM
61
  import torch
@@ -75,26 +65,34 @@ messages = [
75
 
76
  text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
77
  inputs = tokenizer(text, return_tensors="pt").to(model.device)
78
-
79
  outputs = model.generate(**inputs, max_new_tokens=512)
80
  print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
81
  ```
82
 
83
  ---
84
 
85
- ## **License**
 
 
 
 
 
 
 
 
86
 
87
- This model is released under the Apache License 2.0. See the [LICENSE](./LICENSE) file for details.
 
 
88
 
89
  ---
90
 
91
  ## **Citation**
92
-
93
  ```bibtex
94
- @misc{surpem2026supertron1,
95
- title={Supertron1-8B - Instruction-Tuned Language Model},
96
  author={Surpem},
97
  year={2026},
98
  url={https://huggingface.co/surpem/supertron1-8b},
99
  }
100
- ```
 
13
  - instruction-tuned
14
  - pytorch
15
  ---
16
+ # **Supertron1-8B: A Capable, Efficient Instruction-Tuned Language Model**
 
 
17
  ## **Model Description**
18
+ **Supertron1-8B** is an instruction-tuned language model built on top of Qwen3-8B-Base. Designed to be a **reliable, efficient daily driver**, it delivers strong performance across math, coding, reasoning, and general conversation while remaining fast enough to run on consumer hardware with a capable GPU.
 
19
 
20
  * **Developed by:** Surpem
21
  * **Model type:** Causal Language Model
22
  * **Architecture:** Dense Transformer, 8B parameters
23
+ * **Fine-tuned from:** [Qwen/Qwen3-8B-Base](https://huggingface.co/Qwen/Qwen3-8B-Base)
24
+ * **Fine-tuning method:** LoRA (r=16, alpha=32, all-linear targets)
25
  * **License:** Apache 2.0
26
 
27
  ---
28
 
29
+ ## **Capabilities**
30
 
31
+ ### **Reasoning**
32
+ Supertron1-8B was trained on long-form chain-of-thought reasoning traces, making it capable of breaking down complex multi-step problems clearly and methodically. It thinks through problems before answering rather than jumping to conclusions, resulting in more reliable and explainable outputs.
33
 
34
+ ### **Math**
35
+ With dedicated training on competition-style math problems and step-by-step solutions, the model handles everything from algebra and calculus to word problems with structured, verifiable working. It consistently shows its reasoning rather than just producing a final answer.
 
 
36
 
37
+ ### **Coding**
38
+ Supertron1-8B can write, debug, and explain code across popular languages including Python, JavaScript, C++, and more. Trained on filtered, high-quality coding instruction data, it understands not just syntax but software design patterns, algorithmic thinking, and best practices.
39
 
40
+ ### **Science & General Knowledge**
41
+ Broad instruction tuning across science, STEM, and general knowledge domains means the model can hold detailed technical conversations, explain difficult concepts clearly, and assist with research, writing, and analysis tasks.
42
 
43
+ ### **Instruction Following**
44
+ The model is highly responsive to natural language instructions. Whether you need concise answers, detailed explanations, structured output, or creative writing, Supertron1-8B adapts to the format and tone you ask for without needing complex prompting tricks.
 
 
 
 
 
 
 
 
45
 
46
  ---
47
 
48
  ## **Get Started**
 
49
  ```python
50
  from transformers import AutoTokenizer, AutoModelForCausalLM
51
  import torch
 
65
 
66
  text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
67
  inputs = tokenizer(text, return_tensors="pt").to(model.device)
 
68
  outputs = model.generate(**inputs, max_new_tokens=512)
69
  print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:], skip_special_tokens=True))
70
  ```
71
 
72
  ---
73
 
74
+ ## **Hardware Requirements**
75
+ | Precision | Min VRAM | Recommended |
76
+ |---|---|---|
77
+ | bfloat16 | 18 GB | 24 GB (RTX 3090/4090) |
78
+ | 4-bit quantized | 8 GB | 12 GB (RTX 3060/4070) |
79
+
80
+ For 4-bit quantized inference:
81
+ ```python
82
+ from transformers import BitsAndBytesConfig
83
 
84
+ bnb_config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16)
85
+ model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map="auto")
86
+ ```
87
 
88
  ---
89
 
90
  ## **Citation**
 
91
  ```bibtex
92
+ @misc{surpem2026supertron1-8b,
93
+ title={Supertron1-8B — Efficient Instruction-Tuned Language Model},
94
  author={Surpem},
95
  year={2026},
96
  url={https://huggingface.co/surpem/supertron1-8b},
97
  }
98
+ ```