File size: 1,410 Bytes
d8758a7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
---
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
---
# ResearchModel-Prairie

![release overview](figures/fig1.png)

## Release scope

This repository records the selected checkpoint from the `prairie-release-candidate` training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.

## Evaluation matrix

| Evaluation | Score |
|---|---:|
| Math Reasoning | 0.699 |
| Logical Reasoning | 0.850 |
| Common Sense | 0.813 |
| Reading Comprehension | 0.800 |
| Question Answering | 0.689 |
| Text Classification | 0.850 |
| Sentiment Analysis | 0.833 |
| Code Generation | 0.783 |
| Creative Writing | 0.764 |
| Dialogue Generation | 0.748 |
| Summarization | 0.826 |
| Translation | 0.837 |
| Knowledge Retrieval | 0.753 |
| Instruction Following | 0.822 |
| Safety Evaluation | 0.808 |

Scores are reported on a zero-to-one scale and rounded to three decimal places.

## Usage

Load the configuration and weights with a compatible Transformers runtime. Review `trainer_state.json` for the selected training step and `tokenizer_config.json` for tokenizer settings.

![benchmark profile](figures/fig2.png)

## Release notes

The checkpoint was selected by the workspace evaluation runner using its aggregate `eval_accuracy` result. No other checkpoint files belong in this repository.

![training summary](figures/fig3.png)