De Francesco Nazareno

nazdef

1 3

·

AI & ML interests

LLM pretraining from scratch, single-GPU training, bilingual EN/IT models, Supervised finetuning SFT, Reinforcement learning GRPO/GSPO

Recent Activity

updated a model 26 days ago

nazdef/1gpu-llm-small-en-it-base

updated a model 26 days ago

nazdef/1gpu-llm-small-en-it-base-v2

updated a collection 26 days ago

View all activity

Organizations

None yet

nazdef 's models 40

nazdef/1gpu-llm-small-en-it-base

Text Generation • 0.1B • Updated 26 days ago • 333

nazdef/1gpu-llm-small-en-it-base-v2

Text Generation • 0.1B • Updated 26 days ago • 362

nazdef/1gpu-llm-medium-en-it-base-v2

Text Generation • 0.3B • Updated 26 days ago • 144

nazdef/20260713_resume-gpt2medium-step31000-d2000-step33000

Text Generation • 0.3B • Updated 28 days ago • 299

nazdef/20260713_resume-gpt2medium-step22000-d1800-step23100

Text Generation • 0.3B • Updated 28 days ago • 237

nazdef/20260703_continual-pretraining-gpt2medium-step34000-nodecay

Text Generation • 0.3B • Updated 28 days ago • 206

nazdef/1gpu-llm-medium-en-it-base

Text Generation • 0.3B • Updated 29 days ago • 276

nazdef/gpt2small-en-it-nanochat-gpt2preln-cpt8600-lr5e5-predecay-step18000

Text Generation • 0.1B • Updated Jul 3 • 49

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14700

Text Generation • 0.3B • Updated Jun 29 • 9

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14500

Text Generation • 0.3B • Updated Jun 29 • 9

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14250

Text Generation • 0.3B • Updated Jun 29 • 7

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14200

Text Generation • 0.3B • Updated Jun 29 • 8

nazdef/gpt2medium-en-it-nanochat-gpt2preln-lr2e4-bs2-ga48-wsd-anchor20k-final2e5-webwiki-step13500

Text Generation • 0.3B • Updated Jun 28 • 8

nazdef/gpt2small-en-it-nanochat-gpt2preln-lr2e4-bs6-wsd-final2e5-webwiki-step7000

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final2e5-webwiki-step7525

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final2e5-webwiki-step7700

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final5e6-webwiki-step7525

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final5e6-webwiki-step7700

nazdef/gpt2small-en-it-nanochat-lr3e4-bs6-wsd-shortfastdecay8k-final5e6-webwiki-step8000

Text Generation • Updated Jun 6

nazdef/gpt2small-en-it-nanochat-lr3e4-bs6-wsd-shortfastdecay8k-final5e6-webwiki-step4000

Text Generation • Updated Jun 6

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-shortfastdecay11k-final5e6-webwiki-step7000

Text Generation • Updated Jun 6

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-shortfastdecay11k-final5e6-webwiki-step11000

Text Generation • Updated Jun 6

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-shortfastdecay11k-final5e6-webwiki-step_7000

Text Generation • Updated Jun 5

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-earlydecay3500-final5e6-webwiki-step7000

Text Generation • Updated Jun 3

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-earlydecay7000-final5e6-webwiki-step7000

Text Generation • Updated Jun 3

nazdef/gpt2small-en-it-nanochat-lr1e4-bs6-cosine-webwiki-step23000-stable

Text Generation • Updated May 28

nazdef/gpt2small-en-it-nanochat-lr1e4-bs6-cosine-webwiki-step14000

Text Generation • Updated May 24

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-cosine-webwiki-step7000

Text Generation • Updated May 22

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-fastdecay-webwiki-step11000

Text Generation • Updated May 21

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-fastdecay-step10000

Text Generation • Updated May 19