dusersad12 commited on
Commit
2e79fc6
·
verified ·
1 Parent(s): 664a4ec

Upload MyStellarModel best checkpoint (step_960) with completed benchmark results

Browse files
Files changed (7) hide show
  1. LICENSE +21 -0
  2. README.md +119 -0
  3. config.json +4 -0
  4. figures/fig1.png +0 -0
  5. figures/fig2.png +0 -0
  6. figures/fig3.png +0 -0
  7. pytorch_model.bin +3 -0
LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2026 MyStellarModel
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
README.md ADDED
@@ -0,0 +1,119 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: transformers
4
+ ---
5
+ # MyStellarModel
6
+ <!-- markdownlint-disable first-line-h1 -->
7
+ <!-- markdownlint-disable html -->
8
+ <!-- markdownlint-disable no-duplicate-header -->
9
+
10
+ <div align="center">
11
+ <img src="figures/fig1.png" width="60%" alt="MyStellarModel" />
12
+ </div>
13
+ <hr>
14
+
15
+ <div align="center" style="line-height: 1;">
16
+ <a href="LICENSE" style="margin: 2px;">
17
+ <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/>
18
+ </a>
19
+ </div>
20
+
21
+ ## 1. Introduction
22
+
23
+ MyStellarModel is the refreshed open release of our model family. This snapshot was rebuilt on a larger pretraining mix and an extended post-training stage, which deepened its step-by-step reasoning and tightened its instruction following. Across our internal benchmarks it now sits close to several frontier-sized models while staying small enough to run on a single workstation.
24
+
25
+ <p align="center">
26
+ <img width="80%" src="figures/fig3.png">
27
+ </p>
28
+
29
+ Compared with the previous snapshot, the biggest change shows up on hard multi-step problems: on the MATH-500 set, accuracy moved from 66.4% in the prior version to 88.6% here, and the average reasoning budget grew from about 11K tokens per problem to roughly 19K.
30
+
31
+ The snapshot also ships a lower hallucination rate and more dependable tool / function-calling behavior than its predecessor.
32
+
33
+ ## 2. Evaluation Results
34
+
35
+ ### Comprehensive Benchmark Results
36
+
37
+ <div align="center">
38
+
39
+ | | Benchmark | ModelA | ModelB | ModelA-v2 | MyStellarModel |
40
+ |---|---|---|---|---|---|
41
+ | **Core Reasoning Tasks** | Math Reasoning | 0.498 | 0.527 | 0.512 | 0.545 |
42
+ | | Logical Reasoning | 0.782 | 0.799 | 0.791 | 0.813 |
43
+ | | Common Sense | 0.704 | 0.719 | 0.711 | 0.732 |
44
+ | **Language Understanding** | Reading Comprehension | 0.663 | 0.681 | 0.672 | 0.696 |
45
+ | | Question Answering | 0.571 | 0.593 | 0.582 | 0.604 |
46
+ | | Text Classification | 0.796 | 0.812 | 0.803 | 0.825 |
47
+ | | Sentiment Analysis | 0.761 | 0.777 | 0.769 | 0.790 |
48
+ | **Generation Tasks** | Code Generation | 0.612 | 0.631 | 0.622 | 0.645 |
49
+ | | Creative Writing | 0.573 | 0.594 | 0.585 | 0.604 |
50
+ | | Dialogue Generation | 0.609 | 0.628 | 0.618 | 0.640 |
51
+ | | Summarization | 0.733 | 0.751 | 0.742 | 0.764 |
52
+ | **Specialized Capabilities**| Translation | 0.772 | 0.791 | 0.782 | 0.803 |
53
+ | | Knowledge Retrieval | 0.643 | 0.662 | 0.653 | 0.674 |
54
+ | | Instruction Following | 0.724 | 0.743 | 0.734 | 0.755 |
55
+ | | Safety Evaluation | 0.705 | 0.723 | 0.714 | 0.736 |
56
+
57
+ </div>
58
+
59
+ ### Overall Performance Summary
60
+ MyStellarModel keeps a steady lead across every evaluated category, with its widest margins on the reasoning-heavy and generation-heavy rows.
61
+
62
+ ## 3. Chat Website & API Platform
63
+ A chat playground and a public inference API for MyStellarModel are hosted on our official website; check there for rate limits and the latest endpoints.
64
+
65
+ ## 4. How to Run Locally
66
+
67
+ Check the model's source repository for full run instructions. A few things changed versus the older family:
68
+
69
+ 1. A system prompt is now expected at the start of a session.
70
+ 2. You no longer need to inject a special token at the beginning of the output to force a thinking mode.
71
+
72
+ The MyStellarModel-Small companion shares the tokenizer with the main release and runs like its base model.
73
+
74
+ ### System Prompt
75
+ A dated system prompt is recommended:
76
+ ```
77
+ You are MyStellarModel, a helpful assistant.
78
+ Today is {current date}.
79
+ ```
80
+ For example,
81
+ ```
82
+ You are MyStellarModel, a helpful assistant.
83
+ Today is September 21, 2026, Monday.
84
+ ```
85
+ ### Temperature
86
+ We recommend setting the temperature $T_{model}$ to 0.55.
87
+
88
+ ### Prompts for File Uploading and Web Search
89
+ When the user supplies a file, wrap it with this template, filling in {file_name}, {file_content} and {question}:
90
+ ```
91
+ file_template = \
92
+ """[file name]: {file_name}
93
+ [file content begin]
94
+ {file_content}
95
+ [file content end]
96
+ {question}"""
97
+ ```
98
+ For retrieval-augmented answers, use this template where {search_results}, {cur_date} and {question} are filled in:
99
+ ```
100
+ search_answer_en_template = \
101
+ '''# The search results related to the user's message are below:
102
+ {search_results}
103
+ Each result above is wrapped as [webpage X begin]...[webpage X end]; X is the result's index. Cite context where relevant with [citation:X]; if a sentence draws on several, list them all, e.g. [citation:3][citation:5]. Spread citations through the answer instead of stacking them at the end.
104
+ Notes:
105
+ - Today is {cur_date}.
106
+ - Filter the results for relevance; not every page matters.
107
+ - For list-style questions, cap the answer at ~10 key points and point the user to the sources for the rest.
108
+ - For creative writing, cite inline as [citation:3][citation:5] rather than only in a closing block.
109
+ - Keep the response well-structured; group related points and merge where possible.
110
+ - Prefer the same language as the user's question unless asked otherwise.
111
+ # The user's message is:
112
+ {question}'''
113
+ ```
114
+
115
+ ## 5. License
116
+ The code is released under the [MIT License](LICENSE), and the MyStellarModel weights are likewise covered by the [MIT License](LICENSE). The family permits commercial use and distillation.
117
+
118
+ ## 6. Contact
119
+ Open an issue on our GitHub repository, or write to contact@stellarmodel.ai.
config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "model_type": "bert",
3
+ "architectures": ["BertModel"]
4
+ }
figures/fig1.png ADDED
figures/fig2.png ADDED
figures/fig3.png ADDED
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74d5cee7eb50055ca91bae3c2c57322b3ddd157077a5310555a48cbed9280ee7
3
+ size 33