File size: 1,410 Bytes
eea1157
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
---
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
---
# ResearchModel-Rivulet

![release overview](figures/fig1.png)

## Release scope

This repository records the selected checkpoint from the `rivulet-release-candidate` training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.

## Evaluation matrix

| Evaluation | Score |
|---|---:|
| Math Reasoning | 0.704 |
| Logical Reasoning | 0.850 |
| Common Sense | 0.815 |
| Reading Comprehension | 0.802 |
| Question Answering | 0.692 |
| Text Classification | 0.850 |
| Sentiment Analysis | 0.834 |
| Code Generation | 0.786 |
| Creative Writing | 0.768 |
| Dialogue Generation | 0.751 |
| Summarization | 0.827 |
| Translation | 0.838 |
| Knowledge Retrieval | 0.756 |
| Instruction Following | 0.823 |
| Safety Evaluation | 0.810 |

Scores are reported on a zero-to-one scale and rounded to three decimal places.

## Usage

Load the configuration and weights with a compatible Transformers runtime. Review `trainer_state.json` for the selected training step and `tokenizer_config.json` for tokenizer settings.

![benchmark profile](figures/fig2.png)

## Release notes

The checkpoint was selected by the workspace evaluation runner using its aggregate `eval_accuracy` result. No other checkpoint files belong in this repository.

![training summary](figures/fig3.png)