Spaces:
Running
Running
Quote the paper title now that it is not a link
Browse files- index.html +1 -1
index.html
CHANGED
|
@@ -528,7 +528,7 @@ html{scroll-behavior:smooth}
|
|
| 528 |
</article>
|
| 529 |
<article class="key-win">
|
| 530 |
<h3>latency reaches the first token</h3>
|
| 531 |
-
<p>The teams at Crusoe and NVIDIA make this case especially well in <a href="https://www.crusoe.ai/resources/blog/reducing-ttft-by-cpumaxxing-tokenization">Reducing TTFT by CPUMaxxing Tokenization</a>. Every prompt must be tokenized before inference can return its first token. That cost becomes visible in time to first token for long agent contexts and requests that reuse a cached model prefix.</p>
|
| 532 |
<div class="mini-chart" id="keyLatencyChart"></div>
|
| 533 |
<p class="note">Median p99 across eight model families, measured call by call on an Apple M4 Max. Lower is better.</p>
|
| 534 |
</article>
|
|
|
|
| 528 |
</article>
|
| 529 |
<article class="key-win">
|
| 530 |
<h3>latency reaches the first token</h3>
|
| 531 |
+
<p>The teams at Crusoe and NVIDIA make this case especially well in "<a href="https://www.crusoe.ai/resources/blog/reducing-ttft-by-cpumaxxing-tokenization">Reducing TTFT by CPUMaxxing Tokenization</a>." Every prompt must be tokenized before inference can return its first token. That cost becomes visible in time to first token for long agent contexts and requests that reuse a cached model prefix.</p>
|
| 532 |
<div class="mini-chart" id="keyLatencyChart"></div>
|
| 533 |
<p class="note">Median p99 across eight model families, measured call by call on an Apple M4 Max. Lower is better.</p>
|
| 534 |
</article>
|