Fill-Mask
Transformers
PyTorch
Norwegian
Norwegian Bokmål
Norwegian Nynorsk
BERT
NorBERT
Norwegian
encoder
custom_code
Instructions to use ltg/norbert3-xs with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ltg/norbert3-xs with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="ltg/norbert3-xs", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("ltg/norbert3-xs", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update modeling_norbert.py
Verified signature33207b4
-
Update modeling_norbert.py
Verified signaturef7a1ee2
-
use approximate GELU from PyTorch
Verified signature6fe2175 -
Update modeling_norbert.py
Verified signature7f0b74a -
Update modeling_norbert.py
Verified signaturea5852cb -
Simplified the model by always computing batch-first
Verified signature2da8519 -
Simplified the model by always computing batch-first
Verified signature20d2498 -
Simplified the model by always computing batch-first
Verified signaturef1bcb7e -
Simplified the model by always computing batch-first
Verified signatureebc0bd8 -
Simplified the model by always computing batch-first
Verified signature4108f9a -
Simplified the model by always computing batch-first
Verified signatureae26905 -
Optimization of attention (maybe)
Verified signature80119d2 -
simplified softmax (to allow torch.compile)
Verified signatured25295b
-
Update modeling_norbert.py
Verified signature2697fb5 -
Update modeling_norbert.py
Verified signature843c73f -
Fixing position bucket size
Verified signature6ce0e52
-
Update config.json
Verified signature7decc80 -
Update modeling_norbert.py
Verified signature5499131
-
Delete model.safetensors
Verified signaturebfe7b9e
-
Update README.md
Verified signature285c8d0 -
Adding `safetensors` variant of this model (#1)
Verified signature- Adding `safetensors` variant of this model (5823c1ba94ce85e70df55c9c48905da4113710b8) Co-authored-by: Safetensors convertbot <SFconvertbot@users.noreply.huggingface.co>c5130f5
-
Link to ACL Anthology
761b2db
-
Update README.md
9c88995
-
Update modeling_norbert.py
b0e2e63
-
Update modeling_norbert.py
ec756e1 -
Update config.json
6a98603 -
Update modeling_norbert.py
f2ffb67 -
Create __init__.py
a48e8d6 -
Update README.md
03dfdec
-
Optimized wrapper with correct API
5e35bcd -
Create README.md
5f932b4
-
Upload 7 files
d0374ab -
initial commit
c8a060b