A 15-lesson course: each architecture written from scratch, checked against the real weights, then put to work. Free on Kaggle and Colab.
-
google-bert/bert-base-uncased
Fill-Mask • 0.1B • Updated • 32.8M • • 3.09k -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 32 -
answerdotai/ModernBERT-base
Fill-Mask • 0.1B • Updated • 2.77M • 1.16k -
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Paper • 2412.13663 • Published • 170