Set Ripple preview tokenizer context to 1Mi tokens
#7
by ebrahim-ricursive - opened
- README.md +1 -1
- tokenizer_config.json +1 -1
README.md
CHANGED
|
@@ -20,7 +20,7 @@ license: apache-2.0
|
|
| 20 |
License: <a href="https://huggingface.co/ricursiveAI/Ripple-65B-Preview/blob/main/LICENSE">Apache 2.0</a>
|
| 21 |
</p>
|
| 22 |
|
| 23 |
-
Ricursive Intelligence introduces **Ripple-65B Preview**, a 65B parameter dense Transformer model pretrained on 12 trillion tokens with support for up to
|
| 24 |
Ripple-65B Preview delivers strong results on agentic coding, scoring **80.52 on TerminalBench 2.1** and
|
| 25 |
surpassing significantly-larger US open-weight models such as Reflection Beam 501B (**80.1**), Meta Muse Spark Open 816B (**76.4**),
|
| 26 |
Thinking Machines Inkling 975B (**63.8**), and NVIDIA Nemotron 3 Ultra 550B (**56.4**).
|
|
|
|
| 20 |
License: <a href="https://huggingface.co/ricursiveAI/Ripple-65B-Preview/blob/main/LICENSE">Apache 2.0</a>
|
| 21 |
</p>
|
| 22 |
|
| 23 |
+
Ricursive Intelligence introduces **Ripple-65B Preview**, a 65B parameter dense Transformer model pretrained on 12 trillion tokens with support for up to 1Mi (1,048,576 tokens) of context.
|
| 24 |
Ripple-65B Preview delivers strong results on agentic coding, scoring **80.52 on TerminalBench 2.1** and
|
| 25 |
surpassing significantly-larger US open-weight models such as Reflection Beam 501B (**80.1**), Meta Muse Spark Open 816B (**76.4**),
|
| 26 |
Thinking Machines Inkling 975B (**63.8**), and NVIDIA Nemotron 3 Ultra 550B (**56.4**).
|
tokenizer_config.json
CHANGED
|
@@ -183,7 +183,7 @@
|
|
| 183 |
"clean_up_tokenization_spaces": false,
|
| 184 |
"eos_token": "<|im_end|>",
|
| 185 |
"extra_special_tokens": {},
|
| 186 |
-
"model_max_length":
|
| 187 |
"pad_token": "<|pad|>",
|
| 188 |
"tokenizer_class": "PreTrainedTokenizerFast",
|
| 189 |
"unk_token": "<|endoftext|>"
|
|
|
|
| 183 |
"clean_up_tokenization_spaces": false,
|
| 184 |
"eos_token": "<|im_end|>",
|
| 185 |
"extra_special_tokens": {},
|
| 186 |
+
"model_max_length": 1048576,
|
| 187 |
"pad_token": "<|pad|>",
|
| 188 |
"tokenizer_class": "PreTrainedTokenizerFast",
|
| 189 |
"unk_token": "<|endoftext|>"
|