Instructions to use bertin-project/bertin-base-random with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bertin-project/bertin-base-random with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="bertin-project/bertin-base-random")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("bertin-project/bertin-base-random") model = AutoModelForMaskedLM.from_pretrained("bertin-project/bertin-base-random", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it]
b7ae71a -
Step... (220001/250000 | Loss: 1.7591936588287354, Acc: 0.6520245671272278): 88%|██████████████████▌ | 220518/250000 [106:16:53<14:56:57, 1.83s/it]
96b7b70 -
Model at 210k steps, mlm acc 0.6509
d6c5011