Mehdi commited on
Commit
48d282a
·
1 Parent(s): 9e029e8

fix: restore MiniCPM4-8B in hackathon narrative, fix fine-tune duration claim

Browse files
Files changed (1) hide show
  1. blog/index.html +3 -3
blog/index.html CHANGED
@@ -553,9 +553,9 @@ footer { position: relative; z-index: 1; max-width: 1060px; margin: 0 auto; padd
553
 
554
  <h3 class="reveal" id="lesson-1">Model choice is a compatibility problem, not a benchmark problem</h3>
555
 
556
- <p class="reveal">We started with MiniCPM3-4B, upgraded to MiniCPM4.1-8B for better reasoning, and immediately hit the classic open-model trap: the model card says one thing, the <code>transformers</code> version on your machine says another.</p>
557
 
558
- <span class="commit reveal">fix: pin transformers==4.57.1 for MiniCPM4.1-8B compatibility</span>
559
 
560
  <p class="reveal">The follow-up lesson came from quantization. Bitsandbytes 4-bit is great on a 16 GB local GPU and completely unnecessary on ZeroGPU hardware, so we made it conditional:</p>
561
 
@@ -687,7 +687,7 @@ footer { position: relative; z-index: 1; max-width: 1060px; margin: 0 auto; padd
687
  <div class="card"><div class="glare"></div><span class="idx">TRACE</span><h4>Agent trace on the Hub</h4><p>12 live LLM calls across 3 sessions (OS, ML, Networking) — exact prompts, raw outputs, timings — published as a dataset at <code>build-small-hackathon/PaperProf-traces</code> for the community to learn from.</p></div>
688
  </div>
689
 
690
- <p class="reveal">The upgrade took less than an hour of code changes. The fine-tune ran overnight on a Modal A100-80GB. The lesson from the hackathon held: <strong>constraints make the architecture honest</strong>, and a well-structured pipeline makes iteration cheap.</p>
691
 
692
  </main>
693
 
 
553
 
554
  <h3 class="reveal" id="lesson-1">Model choice is a compatibility problem, not a benchmark problem</h3>
555
 
556
+ <p class="reveal">We started with MiniCPM3-4B, upgraded to MiniCPM4-8B for better reasoning, and immediately hit the classic open-model trap: the model card says one thing, the <code>transformers</code> version on your machine says another.</p>
557
 
558
+ <span class="commit reveal">fix: pin transformers==4.57.1 for MiniCPM4-8B compatibility</span>
559
 
560
  <p class="reveal">The follow-up lesson came from quantization. Bitsandbytes 4-bit is great on a 16 GB local GPU and completely unnecessary on ZeroGPU hardware, so we made it conditional:</p>
561
 
 
687
  <div class="card"><div class="glare"></div><span class="idx">TRACE</span><h4>Agent trace on the Hub</h4><p>12 live LLM calls across 3 sessions (OS, ML, Networking) — exact prompts, raw outputs, timings — published as a dataset at <code>build-small-hackathon/PaperProf-traces</code> for the community to learn from.</p></div>
688
  </div>
689
 
690
+ <p class="reveal">The upgrade took less than an hour of code changes. The fine-tune ran in ~20 minutes on a Modal A100-80GB. The lesson from the hackathon held: <strong>constraints make the architecture honest</strong>, and a well-structured pipeline makes iteration cheap.</p>
691
 
692
  </main>
693