123sg's picture
Upload folder using huggingface_hub
a6f365c verified
|
Raw History Blame Contribute Delete
1.41 kB
---
license: apache-2.0
library_name: transformers
pipeline_tag: text-generation
---
# ResearchModel-Nimbus
![release overview](figures/fig1.png)
## Release scope
This repository records the selected checkpoint from the `nimbus-release-candidate` training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.
## Evaluation matrix
| Evaluation | Score |
|---|---:|
| Math Reasoning | 0.694 |
| Logical Reasoning | 0.850 |
| Common Sense | 0.811 |
| Reading Comprehension | 0.797 |
| Question Answering | 0.685 |
| Text Classification | 0.850 |
| Sentiment Analysis | 0.832 |
| Code Generation | 0.779 |
| Creative Writing | 0.759 |
| Dialogue Generation | 0.744 |
| Summarization | 0.824 |
| Translation | 0.836 |
| Knowledge Retrieval | 0.750 |
| Instruction Following | 0.820 |
| Safety Evaluation | 0.806 |
Scores are reported on a zero-to-one scale and rounded to three decimal places.
## Usage
Load the configuration and weights with a compatible Transformers runtime. Review `trainer_state.json` for the selected training step and `tokenizer_config.json` for tokenizer settings.
![benchmark profile](figures/fig2.png)
## Release notes
The checkpoint was selected by the workspace evaluation runner using its aggregate `eval_accuracy` result. No other checkpoint files belong in this repository.
![training summary](figures/fig3.png)