Upload inference_results/step14854370_20260319_0524.md with huggingface_hub

inference_results/step14854370_20260319_0524.md

@@ -0,0 +1,41 @@
+# Inference Results — step 14854370
+**Date**: 2026-03-19 05:24 UTC
+**Checkpoint**: pretrain_step14854370.pt
+**Training progress**: 39.1% (~13.69B/35B tokens)
+**Model**: 698.39M params, d=1024, 24 layers, 16 heads, rank 128, 2x expansion
+**Device**: CPU (GPU occupied by training)
+
+---
+
+## 1. AR (Autoregressive)
+**Prompt**: "The development of calculus independently by both Newton and Leibniz demonstrated"
+
+**Output**: itslowlyadvancedSt.Louis'spopulationonafirmerchantarea.TheDukeMuseumhasbeenbuilttopaythe.4millioninterestthatfirmlyendedthepracticeofthepresident'smeeting.TheDukeMuseumacknowledgedthatthenewFoxNews"isthetimeforthelastfewmonths,butitishardforfuturetalents."
+
+**Notes**: No spaces between tokens (known issue). Semi-coherent English sentences. Hallucinates Duke Museum/Fox News. No repetitive loops. Some grammatical structure present.
+
+---
+
+## 2. SAT Fixed
+**Prompt**: "how the process of continental weathering shapes landscapes over geological time"
+
+**Output**: ),NastestOittemup'usrehehedhatBorhadfCieasVthat1910Sthesyoriginalright.thethePbthetheWtheayserthecthISBNagainstlist8utfrom20F]et:atingidDed28e.[9R0p.Sthe1st12LeíoftNewafter4
+
+**Notes**: Garbled subword fragments. SAT fixed still broken at 39.1%.
+
+---
+
+## 3. SAT Variable
+**Prompt**: "the engineering challenges of building space elevators connecting Earth to orbit"
+
+**Output**: emOop)intheitassreR,tCest10inersac19rwith,andalsTheardusans]".20edersartastabliode).Le.comamaricentythasout,Sallish25(.SlareDaySanI12radationynakbandzwardryrestepMay124ofunW8AnA
+
+**Notes**: Garbled subword fragments. SAT variable still broken at 39.1%.
+
+---
+
+## Summary
+- AR: Producing coherent English sentences (no spaces). Quality similar to previous checks.
+- SAT (both modes): Still producing garbled output at 39.1% training progress.
+- Loss range: 4.2-13.5 (typical, occasional spikes)
+- GPU throughput: ~19.4k tok/s