Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
sirluk
• • 74
🔄 In a Training Loop
Marepally Akshith
AkshithAI
·
AI & ML interests
None yet
Recent Activity
updated a dataset about 1 month ago
AkshithAI/starcoderdata-javascript-ctx-8192 published a dataset about 1 month ago
AkshithAI/starcoderdata-javascript-ctx-8192 updated a dataset about 1 month ago
AkshithAI/stackexchange-programming-cs-ctx-8192Organizations
None yet
upvoted an article 11 months ago