Mehdi commited on
Commit ·
48d282a
1
Parent(s): 9e029e8
fix: restore MiniCPM4-8B in hackathon narrative, fix fine-tune duration claim
Browse files- blog/index.html +3 -3
blog/index.html
CHANGED
|
@@ -553,9 +553,9 @@ footer { position: relative; z-index: 1; max-width: 1060px; margin: 0 auto; padd
|
|
| 553 |
|
| 554 |
<h3 class="reveal" id="lesson-1">Model choice is a compatibility problem, not a benchmark problem</h3>
|
| 555 |
|
| 556 |
-
<p class="reveal">We started with MiniCPM3-4B, upgraded to MiniCPM4
|
| 557 |
|
| 558 |
-
<span class="commit reveal">fix: pin transformers==4.57.1 for MiniCPM4
|
| 559 |
|
| 560 |
<p class="reveal">The follow-up lesson came from quantization. Bitsandbytes 4-bit is great on a 16 GB local GPU and completely unnecessary on ZeroGPU hardware, so we made it conditional:</p>
|
| 561 |
|
|
@@ -687,7 +687,7 @@ footer { position: relative; z-index: 1; max-width: 1060px; margin: 0 auto; padd
|
|
| 687 |
<div class="card"><div class="glare"></div><span class="idx">TRACE</span><h4>Agent trace on the Hub</h4><p>12 live LLM calls across 3 sessions (OS, ML, Networking) — exact prompts, raw outputs, timings — published as a dataset at <code>build-small-hackathon/PaperProf-traces</code> for the community to learn from.</p></div>
|
| 688 |
</div>
|
| 689 |
|
| 690 |
-
<p class="reveal">The upgrade took less than an hour of code changes. The fine-tune ran
|
| 691 |
|
| 692 |
</main>
|
| 693 |
|
|
|
|
| 553 |
|
| 554 |
<h3 class="reveal" id="lesson-1">Model choice is a compatibility problem, not a benchmark problem</h3>
|
| 555 |
|
| 556 |
+
<p class="reveal">We started with MiniCPM3-4B, upgraded to MiniCPM4-8B for better reasoning, and immediately hit the classic open-model trap: the model card says one thing, the <code>transformers</code> version on your machine says another.</p>
|
| 557 |
|
| 558 |
+
<span class="commit reveal">fix: pin transformers==4.57.1 for MiniCPM4-8B compatibility</span>
|
| 559 |
|
| 560 |
<p class="reveal">The follow-up lesson came from quantization. Bitsandbytes 4-bit is great on a 16 GB local GPU and completely unnecessary on ZeroGPU hardware, so we made it conditional:</p>
|
| 561 |
|
|
|
|
| 687 |
<div class="card"><div class="glare"></div><span class="idx">TRACE</span><h4>Agent trace on the Hub</h4><p>12 live LLM calls across 3 sessions (OS, ML, Networking) — exact prompts, raw outputs, timings — published as a dataset at <code>build-small-hackathon/PaperProf-traces</code> for the community to learn from.</p></div>
|
| 688 |
</div>
|
| 689 |
|
| 690 |
+
<p class="reveal">The upgrade took less than an hour of code changes. The fine-tune ran in ~20 minutes on a Modal A100-80GB. The lesson from the hackathon held: <strong>constraints make the architecture honest</strong>, and a well-structured pipeline makes iteration cheap.</p>
|
| 691 |
|
| 692 |
</main>
|
| 693 |
|