dzhang50 commited on
Commit
31c7bf6
Β·
verified Β·
1 Parent(s): 855033e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -11,7 +11,7 @@
11
  <a href="https://tinker.thinkingmachines.ai/playground">Launch Blog</a>
12
  </p>
13
 
14
- Ricursive Intelligence introduces **Ripple-65B Preview**, a 65B parameter dense Transformer model designed for agentic tasks.
15
  Ripple-65B Preview delivers strong results on agentic coding, scoring **80.52 on TerminalBench 2.1** and
16
  surpassing significantly-larger US open-weight models such as Reflection Beam 501B (**80.1**), Meta Muse Spark Open 816B (**76.4**),
17
  Thinking Machines Inkling 975B (**63.8**), and NVIDIA Nemotron 3 Ultra 550B (**56.4**).
@@ -39,7 +39,7 @@ The end result is a model that is especially capable at reasoning and agentic ta
39
  US open-weight models with more than 10x the number of total parameters.
40
  At only 65B total parameters, the model can fit on consumer hardware such as the NVIDIA DGX Spark.
41
  To encourage local model development, we provide an NVFP4 checkpoint and colab to help you get started.
42
- The model is also fast at token generation when running on datacenter GPUs, easily reaching 500+ tok/s on 4xB200 without quantization.
43
 
44
  **Pre-training.** Ripple-65B Preview is pretrained from scratch on our 12T text-only predominantly-English and code corpus at 8K sequence length.
45
  Ripple-65B Base Preview is a **pretrain-only checkpoint** without any midtraining or synthetic QA data.
@@ -102,20 +102,20 @@ Therefore, our results represent a best-effort attempt at a fair comparison.
102
  | Terminal-Bench 2.1 (Terminus 2) | **80.5** | *51.3* | *55.4* | *79.8* | *67.8* |
103
  | SWE-bench Verified | β€” | 71.9 | 77.6 | *78.7* | **81.6** |
104
  | SWE-bench Pro v1.0 | β€” | *46.9* | 54.3 | β€” | **66.1** |
105
- | SWE-bench Pro v2.0 Hard | β€” | *30.7* | *2.0* | *52.3* | 76.5 |
106
  | DeepSWE 1.1 | β€” | *0.22* | *2.0* | **60.0** | 43.3 |
107
  | SciCode | 39.4 | 44.6 | *39.2* | **58.5** | 49.2 |
108
- | τ³-bench banking | β€”| 22.6 | 23.7 | *14.4* | **36.1** |
109
  | AutomationBench (Public) | 36.4 | *8.4* | *14.6* | *42.4* | 39.3 |
110
  | MCP Atlas | β€” | *62.2* | 76.0 | **89.2** | 80.8 |
111
  | **Safety** | | | | | |
112
- | FORTRESS Adversarial | 83.8 | *65.8* | 78.0 | *89.1* | *81.3* |
113
- | FORTRESS Benign | 95.5 | *89.1* | 95.9 | *88.1* | *86.4* |
114
- | StrongREJECT | 97.5 | *100.0* | 98.6 | *96.6* | *100.0* |
115
  | **Instruction Following** | | | | | |
116
  | IFBench | 79.2 | **81.7** | 79.8 | *78.6* | 79.6 |
117
  | **Long Context** | | | | | |
118
- | AA-LCR | 75.0 | 65.4 | *78.3* | *80.7* | **78.2** |
119
 
120
  </div>
121
 
@@ -129,7 +129,7 @@ With the rise of the importance of posttraining, many modern LLM recipes now ble
129
  For our first model, we kept our pretraining data clean with minimal synthetic data, focusing on high quality natural data rather than aggressively targeting evals.
130
  We instead added significantly more synthetic data during midtraining, which allowed us to quickly iterate on our synthetic data recipe without blocking pretraining.
131
 
132
- Ripple-65B Base Preview is a pretrain-only checkpoint. The model overall compares favorably with Poolside Laguna M.1,
133
  and is comparable with DeepSeek V3.1 and V4 Flash on reasoning, math, and code.
134
  Nemotron 3 Ultra dominates on traditional pretraining evals, likely due to their heavy use of [task-seeded synthetic data](https://huggingface.co/blog/nvidia/task-seeded-sdg).
135
  However, its pretraining eval performance did not translate to modern agentic tasks, likely due to their synthetic data being out of distribution relative to these tasks.
 
11
  <a href="https://tinker.thinkingmachines.ai/playground">Launch Blog</a>
12
  </p>
13
 
14
+ Ricursive Intelligence introduces **Ripple-65B Preview**, a 65B parameter dense Transformer model pretrained on 12 trillion tokens with support for up to 1M context length.
15
  Ripple-65B Preview delivers strong results on agentic coding, scoring **80.52 on TerminalBench 2.1** and
16
  surpassing significantly-larger US open-weight models such as Reflection Beam 501B (**80.1**), Meta Muse Spark Open 816B (**76.4**),
17
  Thinking Machines Inkling 975B (**63.8**), and NVIDIA Nemotron 3 Ultra 550B (**56.4**).
 
39
  US open-weight models with more than 10x the number of total parameters.
40
  At only 65B total parameters, the model can fit on consumer hardware such as the NVIDIA DGX Spark.
41
  To encourage local model development, we provide an NVFP4 checkpoint and colab to help you get started.
42
+ The model is also fast at token generation when running on datacenter GPUs, easily reaching 500+ tok/s on 4xB200 prior to quantization or custom kernels.
43
 
44
  **Pre-training.** Ripple-65B Preview is pretrained from scratch on our 12T text-only predominantly-English and code corpus at 8K sequence length.
45
  Ripple-65B Base Preview is a **pretrain-only checkpoint** without any midtraining or synthetic QA data.
 
102
  | Terminal-Bench 2.1 (Terminus 2) | **80.5** | *51.3* | *55.4* | *79.8* | *67.8* |
103
  | SWE-bench Verified | β€” | 71.9 | 77.6 | *78.7* | **81.6** |
104
  | SWE-bench Pro v1.0 | β€” | *46.9* | 54.3 | β€” | **66.1** |
105
+ | SWE-bench Pro v2.0 Hard | β€” | *30.7* | *2.0* | *52.3* | **76.5** |
106
  | DeepSWE 1.1 | β€” | *0.22* | *2.0* | **60.0** | 43.3 |
107
  | SciCode | 39.4 | 44.6 | *39.2* | **58.5** | 49.2 |
108
+ | τ³-bench banking | 31.27 | 22.6 | 23.7 | *14.4* | **36.1** |
109
  | AutomationBench (Public) | 36.4 | *8.4* | *14.6* | *42.4* | 39.3 |
110
  | MCP Atlas | β€” | *62.2* | 76.0 | **89.2** | 80.8 |
111
  | **Safety** | | | | | |
112
+ | FORTRESS Adversarial | 83.8 | *65.8* | 78.0 | ***89.1*** | *81.3* |
113
+ | FORTRESS Benign | 95.5 | *89.1* | **95.9** | *88.1* | *86.4* |
114
+ | StrongREJECT | 97.5 | ***100.0*** | 98.6 | *96.6* | ***100.0*** |
115
  | **Instruction Following** | | | | | |
116
  | IFBench | 79.2 | **81.7** | 79.8 | *78.6* | 79.6 |
117
  | **Long Context** | | | | | |
118
+ | AA-LCR | 75.0 | 65.4 | *78.3* | ***80.7*** | 78.2 |
119
 
120
  </div>
121
 
 
129
  For our first model, we kept our pretraining data clean with minimal synthetic data, focusing on high quality natural data rather than aggressively targeting evals.
130
  We instead added significantly more synthetic data during midtraining, which allowed us to quickly iterate on our synthetic data recipe without blocking pretraining.
131
 
132
+ Ripple-65B Base Preview is a pretrain-only checkpoint. The base model overall beats Poolside Laguna M.1,
133
  and is comparable with DeepSeek V3.1 and V4 Flash on reasoning, math, and code.
134
  Nemotron 3 Ultra dominates on traditional pretraining evals, likely due to their heavy use of [task-seeded synthetic data](https://huggingface.co/blog/nvidia/task-seeded-sdg).
135
  However, its pretraining eval performance did not translate to modern agentic tasks, likely due to their synthetic data being out of distribution relative to these tasks.