123sg's picture
Add README.md from checkpoint_4214 release package
eea1157 verified
|
Raw History Blame Contribute Delete
1.41 kB
---
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
---
# ResearchModel-Rivulet
![release overview](figures/fig1.png)
## Release scope
This repository records the selected checkpoint from the `rivulet-release-candidate` training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.
## Evaluation matrix
| Evaluation | Score |
|---|---:|
| Math Reasoning | 0.704 |
| Logical Reasoning | 0.850 |
| Common Sense | 0.815 |
| Reading Comprehension | 0.802 |
| Question Answering | 0.692 |
| Text Classification | 0.850 |
| Sentiment Analysis | 0.834 |
| Code Generation | 0.786 |
| Creative Writing | 0.768 |
| Dialogue Generation | 0.751 |
| Summarization | 0.827 |
| Translation | 0.838 |
| Knowledge Retrieval | 0.756 |
| Instruction Following | 0.823 |
| Safety Evaluation | 0.810 |
Scores are reported on a zero-to-one scale and rounded to three decimal places.
## Usage
Load the configuration and weights with a compatible Transformers runtime. Review `trainer_state.json` for the selected training step and `tokenizer_config.json` for tokenizer settings.
![benchmark profile](figures/fig2.png)
## Release notes
The checkpoint was selected by the workspace evaluation runner using its aggregate `eval_accuracy` result. No other checkpoint files belong in this repository.
![training summary](figures/fig3.png)