lysandre HF Staff commited on
Commit
fbe3b6f
·
verified ·
1 Parent(s): 4531287

Quote the paper title now that it is not a link

Browse files
Files changed (1) hide show
  1. index.html +1 -1
index.html CHANGED
@@ -528,7 +528,7 @@ html{scroll-behavior:smooth}
528
  </article>
529
  <article class="key-win">
530
  <h3>latency reaches the first token</h3>
531
- <p>The teams at Crusoe and NVIDIA make this case especially well in <a href="https://www.crusoe.ai/resources/blog/reducing-ttft-by-cpumaxxing-tokenization">Reducing TTFT by CPUMaxxing Tokenization</a>. Every prompt must be tokenized before inference can return its first token. That cost becomes visible in time to first token for long agent contexts and requests that reuse a cached model prefix.</p>
532
  <div class="mini-chart" id="keyLatencyChart"></div>
533
  <p class="note">Median p99 across eight model families, measured call by call on an Apple M4 Max. Lower is better.</p>
534
  </article>
 
528
  </article>
529
  <article class="key-win">
530
  <h3>latency reaches the first token</h3>
531
+ <p>The teams at Crusoe and NVIDIA make this case especially well in "<a href="https://www.crusoe.ai/resources/blog/reducing-ttft-by-cpumaxxing-tokenization">Reducing TTFT by CPUMaxxing Tokenization</a>." Every prompt must be tokenized before inference can return its first token. That cost becomes visible in time to first token for long agent contexts and requests that reuse a cached model prefix.</p>
532
  <div class="mini-chart" id="keyLatencyChart"></div>
533
  <p class="note">Median p99 across eight model families, measured call by call on an Apple M4 Max. Lower is better.</p>
534
  </article>