optimizer_step,c4_heldout_ppl,wikitext_heldout_ppl 5000,47.14196413877905,111.48137111560875 10000,37.023797483960436,88.28929618013538