AI & ML interests

LLM pretraining, efficient neural layers