Instructions to use bertin-project/bertin-base-random-exp-512seqlen with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bertin-project/bertin-base-random-exp-512seqlen with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="bertin-project/bertin-base-random-exp-512seqlen")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("bertin-project/bertin-base-random-exp-512seqlen") model = AutoModelForMaskedLM.from_pretrained("bertin-project/bertin-base-random-exp-512seqlen", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Adding `safetensors` variant of this model
Verified signatureThis is an automated PR created with https://huggingface.co/spaces/safetensors/convert This new file is equivalent to `pytorch_model.bin` but safe in the sense that no arbitrary code can be put into it. These files also happen to load much faster than their pytorch counterpart: https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb The widgets on your model page will run using this model even if this is not merged making sure the file actually works. If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions Feel free to ignore this PR.535f046
-
Automatic correction of README.md metadata. Contact website@huggingface.co for any question
e37776e
-
Update README.md
3372aa0
-
Update README.md
94a43c6
-
Update README.md
3dff778 -
Create README.md
5369036
-
Step... (249001/250000 | Loss: 2.184157609939575, Acc: 0.5907210111618042): 8%|█▉ | 19999/250000 [6:53:56<72:26:45, 1.13s/it]
61bb10e -
Step... (247001/250000 | Loss: 2.180281400680542, Acc: 0.5911673307418823): 7%|█▋ | 17142/250000 [5:55:00<76:24:14, 1.18s/it]
dd51a5a
-
Step... (240001/250000 | Loss: 2.1932833194732666, Acc: 0.5893170833587646): 4%|▉ | 10063/250000 [3:28:31<88:33:32, 1.33s/it]
c725c08 -
initial commit
8045dd9