Instructions to use mnaylor/mega-base-wikitext with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mnaylor/mega-base-wikitext with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="mnaylor/mega-base-wikitext")# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("mnaylor/mega-base-wikitext", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Adding `safetensors` variant of this model (#4)
- Adding `safetensors` variant of this model (4a72f7fafa863ccb7fcefe03f48dfda14cc89d3e) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>27ae0c8
-
Update model weights after renaming move as ema_gate
ceedb94
-
updating saved model after name change from encoders to layers in MegaModel
328c6c9
-
update model weights with new names for alpha, beta, delta, gamma, and omega throughout the architecture
ee588b6
-
Update README.md
3a4ca8d -
initial push of mega MLM checkpoint in HF classes
8a61279 -
initial commit
959cc44