Instructions to use bertin-project/bertin-base-gaussian-exp-512seqlen with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bertin-project/bertin-base-gaussian-exp-512seqlen with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="bertin-project/bertin-base-gaussian-exp-512seqlen")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("bertin-project/bertin-base-gaussian-exp-512seqlen") model = AutoModelForMaskedLM.from_pretrained("bertin-project/bertin-base-gaussian-exp-512seqlen", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Step... (49001/50000 | Loss: 1.5274475812911987, Acc: 0.6873284578323364): 98%|█████████████████████████████▍| 49024/50000 [9:31:53<21:29, 1.32s/it]
3b1060f -
Step... (47001/50000 | Loss: 1.5323601961135864, Acc: 0.6869816184043884): 94%|██████████████████████████▍ | 47103/50000 [8:47:49<1:03:51, 1.32s/it]
8f83c03 -
Step... (42001/50000 | Loss: 1.5368554592132568, Acc: 0.6858981847763062): 86%|████████████████████████ | 42934/50000 [7:12:02<3:21:33, 1.71s/it]
f75455f
-
Step... (24001/50000 | Loss: 1.617178201675415, Acc: 0.6729233860969543): 48%|█████████████▌ | 24176/50000 [9:23:11<10:03:40, 1.40s/it]
874a738