hiaripc commited on
Commit
4416827
·
1 Parent(s): 7daa7b6
Files changed (1) hide show
  1. index.html +18 -6
index.html CHANGED
@@ -47,7 +47,19 @@ SweetSpot v2 — Energy-per-Token demo
47
  </h2>
48
 
49
  <p>
50
- Interactive visualization of the analytical energy model. Load any dense LLM from huggingface!
 
 
 
 
 
 
 
 
 
 
 
 
51
  </p>
52
 
53
 
@@ -56,27 +68,27 @@ Interactive visualization of the analytical energy model. Load any dense LLM fro
56
  <div class="row">
57
 
58
  <div>
59
- <label>d (hidden size)</label>
60
  <input id="d" type="number" value="4096">
61
  </div>
62
 
63
  <div>
64
- <label>L (layers)</label>
65
  <input id="L" type="number" value="36">
66
  </div>
67
 
68
  <div>
69
- <label>nq (query heads)</label>
70
  <input id="nq" type="number" value="64">
71
  </div>
72
 
73
  <div>
74
- <label>nkv (KV heads)</label>
75
  <input id="nkv" type="number" value="64">
76
  </div>
77
 
78
  <div>
79
- <label>Input tokens</label>
80
  <input id="nin" type="number" value="64">
81
  </div>
82
 
 
47
  </h2>
48
 
49
  <p>
50
+ This interactive demo visualizes our analytical model for predicting the <b>energy consumption per generated token</b> as a function of the number of output tokens (<i>n</i><sub>out</sub>).
51
+ Select one of the validated models used in the paper or load the architecture of any <b>dense decoder-only Transformer</b> (up to approximately 20B parameters) from Hugging Face to explore how the different terms contribute to the prediction.
52
+ </p>
53
+
54
+ <p>
55
+ The model was fitted using empirical measurements collected on an <b>NVIDIA H100 GPU</b> with <b>NVIDIA TensorRT-LLM</b> (<code>max_batch_size = 1024</code>, <code>max_num_tokens = 8192</code>). Future releases will extend the analysis to additional hardware platforms and inference frameworks.
56
+ </p>
57
+
58
+ <p>
59
+ For the complete methodology, experimental validation, and citation information, please see the paper:
60
+ <a href="YOUR_PAPER_URL" target="_blank">
61
+ SweetSpot v2: Analytical Modeling of LLM Energy Consumption
62
+ </a>.
63
  </p>
64
 
65
 
 
68
  <div class="row">
69
 
70
  <div>
71
+ <label>Hidden size (d):</label>
72
  <input id="d" type="number" value="4096">
73
  </div>
74
 
75
  <div>
76
+ <label>Layers (L):</label>
77
  <input id="L" type="number" value="36">
78
  </div>
79
 
80
  <div>
81
+ <label>Query heads (<i>n</i><sub>q</sub>):</label>
82
  <input id="nq" type="number" value="64">
83
  </div>
84
 
85
  <div>
86
+ <label>KV heads (<i>n</i><sub>kv</sub>):</label>
87
  <input id="nkv" type="number" value="64">
88
  </div>
89
 
90
  <div>
91
+ <label>Input Tokens (<i>n</i><sub>in</sub>):</label>
92
  <input id="nin" type="number" value="64">
93
  </div>
94