123sg commited on
Commit
a6f365c
·
verified ·
1 Parent(s): 016a7d1

Upload folder using huggingface_hub

Browse files
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ ---
6
+ # ResearchModel-Nimbus
7
+
8
+ ![release overview](figures/fig1.png)
9
+
10
+ ## Release scope
11
+
12
+ This repository records the selected checkpoint from the `nimbus-release-candidate` training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.
13
+
14
+ ## Evaluation matrix
15
+
16
+ | Evaluation | Score |
17
+ |---|---:|
18
+ | Math Reasoning | 0.694 |
19
+ | Logical Reasoning | 0.850 |
20
+ | Common Sense | 0.811 |
21
+ | Reading Comprehension | 0.797 |
22
+ | Question Answering | 0.685 |
23
+ | Text Classification | 0.850 |
24
+ | Sentiment Analysis | 0.832 |
25
+ | Code Generation | 0.779 |
26
+ | Creative Writing | 0.759 |
27
+ | Dialogue Generation | 0.744 |
28
+ | Summarization | 0.824 |
29
+ | Translation | 0.836 |
30
+ | Knowledge Retrieval | 0.750 |
31
+ | Instruction Following | 0.820 |
32
+ | Safety Evaluation | 0.806 |
33
+
34
+ Scores are reported on a zero-to-one scale and rounded to three decimal places.
35
+
36
+ ## Usage
37
+
38
+ Load the configuration and weights with a compatible Transformers runtime. Review `trainer_state.json` for the selected training step and `tokenizer_config.json` for tokenizer settings.
39
+
40
+ ![benchmark profile](figures/fig2.png)
41
+
42
+ ## Release notes
43
+
44
+ The checkpoint was selected by the workspace evaluation runner using its aggregate `eval_accuracy` result. No other checkpoint files belong in this repository.
45
+
46
+ ![training summary](figures/fig3.png)
config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "model_type": "bert",
3
+ "fastvar_variant": "nimbus-release-candidate",
4
+ "checkpoint_step": 3710
5
+ }
figures/fig1.png ADDED
figures/fig2.png ADDED
figures/fig3.png ADDED
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a7f7c27cf68f40215489768bb6bc63ad23436af7d0a04847aa4009dec6d866b
3
+ size 85
tokenizer_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "model_max_length": 4117,
3
+ "tokenizer_class": "PreTrainedTokenizerFast"
4
+ }
trainer_state.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "global_step": 3710,
3
+ "run": "nimbus-release-candidate",
4
+ "seed": 21
5
+ }