Instructions to use mosaicml/mosaic-bert-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mosaicml/mosaic-bert-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="mosaicml/mosaic-bert-base", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("mosaicml/mosaic-bert-base", trust_remote_code=True) model = AutoModelForMaskedLM.from_pretrained("mosaicml/mosaic-bert-base", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Create LICENSE (#9)
Verified signature- Create LICENSE (6f421cb369604ead1ed7412f061d2b58347ae62f) Co-authored-by: Kobie Crawford <kobindra@users.noreply.huggingface.co>c89bbad
-
Update README.md
Verified signature2a8bd4e
-
Update detail about Triton Flash Attention with ALiBi implementation
8a9076d
-
Change attention_probs_dropout_prob to 0.1 so that FlashAttention/triton dependencies are avoided
ed2a544 -
Update README.md
typo3970aa9 -
Update README
[x] mention mosaicbert.github.io [x] change citation [x] change code snippet to make things clearer [x] explain how to use alibi785d4c8
-
Update README.md
ce11e47 -
Update README.md
fdbb682 -
Update README.md
7b2f449 -
update hyperlinks to mosaicml/examples
69ac42c -
Update README.md
Update hyperlinks to mosaicml/examples repo64bd935
-
Update README.md (#5)
- Update README.md (e2c17131716a92f554f6d17fbee0811e1204e795)5acd316
-
Update README.md
fcc434c
-
Update README.md
ba7abb1
-
Update README.md
68a6d88 -
expand usage instructions in README (#2)
- expand usage instructions in README (58795918e6dc0d4b8fdca281a229a1a5cf09edc2) Co-authored-by: Sam <sam-mosaic@users.noreply.huggingface.co>4f0fd4f -
Update README.md (#1)
- Update README.md (d4860103dbaaf6245d5890e690faa2112a522db4) Co-authored-by: Sam <sam-mosaic@users.noreply.huggingface.co>8289db4 -
Update README.md
ade534e -
Update README.md
f4619c8 -
Update README.md
1dc825e -
Update README.md
c8eb665 -
Update README.md
65996c1 -
Update README.md
4695bbf -
Update README.md
2885f1f -
Update README.md
c66f045 -
Update README.md
c721a25 -
Update README.md
29c1999 -
Create README.md
24512df
-
Upload BertForMaskedLM
1c2f266 -
initial commit
Daniel King7de0efa