Instructions to use bertin-project/bertin-base-gaussian with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bertin-project/bertin-base-gaussian with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="bertin-project/bertin-base-gaussian")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("bertin-project/bertin-base-gaussian") model = AutoModelForMaskedLM.from_pretrained("bertin-project/bertin-base-gaussian", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Adding `safetensors` variant of this model (#1)
Verified signature- Adding `safetensors` variant of this model (17bb3668c60ec45f26634713c86b16c6577bc734) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>5dee756
-
Automatic correction of README.md metadata. Contact website@huggingface.co for any question
fea8231
-
Update README.md
504fe87
-
Update README.md
7e6dbfb -
Create README.md
e615752
-
Step... (249001/250000 | Loss: 1.678702473640442, Acc: 0.660828173160553): 76%|██████████████████▏ | 189999/250000 [97:45:10<29:36:08, 1.78s/it]
eafe079 -
Step... (238001/250000 | Loss: 1.6818329095840454, Acc: 0.660420298576355): 71%|████████████████▍ | 178271/250000 [91:38:03<37:33:10, 1.88s/it]
85052d2 -
Step... (232001/250000 | Loss: 1.6789664030075073, Acc: 0.6606228351593018): 69%|███████████████▏ | 172256/250000 [88:28:48<44:13:31, 2.05s/it]
77690d5 -
Step... (232001/250000 | Loss: 1.6789664030075073, Acc: 0.6606228351593018): 69%|███████████████▏ | 172256/250000 [88:28:48<44:13:31, 2.05s/it]
f14b67f -
Step... (219001/250000 | Loss: 1.6840890645980835, Acc: 0.6597731709480286): 64%|██████████████ | 159238/250000 [81:41:37<54:11:57, 2.15s/it]
491ee7c
-
Step... (214001/250000 | Loss: 1.6834079027175903, Acc: 0.6600053906440735): 62%|█████████████▋ | 154922/250000 [79:19:10<50:28:22, 1.91s/it]
eebed33 -
Step... (212001/250000 | Loss: 1.6889899969100952, Acc: 0.6588694453239441): 61%|█████████████▍ | 152455/250000 [78:01:35<56:19:35, 2.08s/it]
5b8d14e -
Step... (208001/250000 | Loss: 1.6939743757247925, Acc: 0.6590701937675476): 59%|█████████████ | 148622/250000 [76:01:19<63:54:00, 2.27s/it]
2f2bdfd -
Step... (200001/250000 | Loss: 1.6965291500091553, Acc: 0.6575480699539185): 56%|████████████▎ | 140093/250000 [71:33:45<52:41:15, 1.73s/it]
61f844c -
Model at 191k steps, acc 0.6562. Dataset stats
7163631 -
Step... (190001/250000 | Loss: 1.705819845199585, Acc: 0.6563901901245117): 52%|████████████ | 130628/250000 [66:37:26<59:10:21, 1.78s/it]
e2f72a0 -
Dump 187k steps, acc 0.6574
9d93315