| --- |
| base_model: |
| - ServiceNow-AI/Apriel-Nemotron-15b-Thinker |
| datasets: |
| - Undi95/R1-RP-ShareGPT3 |
| - PJMixers-Dev/Gryphe-Aesir-RPG-Charcards-Opus-Mixed-split-v3-0324 |
| --- |
| |
| ### Apriel R1P V.2 |
|
|
| Day 2 RP finetune of Apriel 15B, with several iterative improvements from the first version. In particular, coherence at good temperatures (~.7) should be much higher. |
|
|
| I also fully converted the model to use the Phi 3 format; this comes at the slight tradeoff of the `<|end|>` tag not always tokenizing exactly the same way in a few niche scenarios. |
|
|
| Further attempts were made to fix formatting issues with asterisks on the base model. |
|
|
| NOTE: THIS IS THE THINKING VERSION |
|
|
| Upon further testing, I discovered that while merging back onto the instruct improved thinking mode, this came at the cost of degraded non-thinking outputs. |
|
|
| Use the [non-thinking version](https://huggingface.co/ConicCat/Apriel-R1PV.2-NoThink) instead if you want a standard model. |
|
|
| ## Thinking Mode |
|
|
| - To enable thinking place `/think` in the system prompt and prefill `<|think|>\n` for thinking mode. |
|
|
| - Phi esque thinking tags, `<|think|>` and `<|/think|>` have been added to the model. |
|
|
| - Remember to reconfigure Sillytavern to parse the new think tags. |
|
|
| ## Settings |
|
|
| The chat template has been converted to a Phi 3 template as the model seemed to respond best to this format. |
|
|
| This model does prefer having character cards placed in user messages, not the system prompt. |
|
|
| ## Special Thanks: |
|
|
| Undi95 for portions of their dataset and inspiration. |
|
|
| PJMixers-Dev for their dataset curation and creation efforts. |
