🤝 Open to Collab
Carlos García
cgarciams
·
AI & ML interests
Building a GPT-2 medium size (approx. 400 M parameters) model from scratch, using PyTorch, the OpenWebText dataset, Tiktoken, AdamW optimizer and FlashAttention. Just for fun.
Organizations
