123sg commited on
Commit
eea1157
·
verified ·
1 Parent(s): 3fdd0ae

Add README.md from checkpoint_4214 release package

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ pipeline_tag: text-generation
5
+ ---
6
+ # ResearchModel-Rivulet
7
+
8
+ ![release overview](figures/fig1.png)
9
+
10
+ ## Release scope
11
+
12
+ This repository records the selected checkpoint from the `rivulet-release-candidate` training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.
13
+
14
+ ## Evaluation matrix
15
+
16
+ | Evaluation | Score |
17
+ |---|---:|
18
+ | Math Reasoning | 0.704 |
19
+ | Logical Reasoning | 0.850 |
20
+ | Common Sense | 0.815 |
21
+ | Reading Comprehension | 0.802 |
22
+ | Question Answering | 0.692 |
23
+ | Text Classification | 0.850 |
24
+ | Sentiment Analysis | 0.834 |
25
+ | Code Generation | 0.786 |
26
+ | Creative Writing | 0.768 |
27
+ | Dialogue Generation | 0.751 |
28
+ | Summarization | 0.827 |
29
+ | Translation | 0.838 |
30
+ | Knowledge Retrieval | 0.756 |
31
+ | Instruction Following | 0.823 |
32
+ | Safety Evaluation | 0.810 |
33
+
34
+ Scores are reported on a zero-to-one scale and rounded to three decimal places.
35
+
36
+ ## Usage
37
+
38
+ Load the configuration and weights with a compatible Transformers runtime. Review `trainer_state.json` for the selected training step and `tokenizer_config.json` for tokenizer settings.
39
+
40
+ ![benchmark profile](figures/fig2.png)
41
+
42
+ ## Release notes
43
+
44
+ The checkpoint was selected by the workspace evaluation runner using its aggregate `eval_accuracy` result. No other checkpoint files belong in this repository.
45
+
46
+ ![training summary](figures/fig3.png)