Fill-Mask
Transformers
Safetensors
nandi_encoder
encoder
masked-language-modeling
indic
multilingual
code
efficient
frontiersmind
nandi
custom_code
Instructions to use FrontiersMind/NandiBERT-150M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FrontiersMind/NandiBERT-150M with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="FrontiersMind/NandiBERT-150M", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForMaskedLM model = AutoModelForMaskedLM.from_pretrained("FrontiersMind/NandiBERT-150M", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
Yesterday
-
Remove internal code reference from the modeling docstring; 450M parameter count 445M
Verified signature3d28371 -
Config defaults and docstrings match NandiBERT-150M; drop smoltron_source; 13 Indic languages
Verified signatureNandiEncoderConfig defaults are now the NandiBERT-150M architecture and the docstring example uses this repo. NandiForMaskedLM docstring describes the dense untied MLM head. config.json no longer has smoltron_source. README: 13 Indic languages in native script, 11 of them also romanized.3cc7e3c -
Classifiers use the pretrained MLM head; README tokenizer needs trust_remote_code
Verified signatureSequence and token classification put the pretrained dense MLM head (dense, act, RMSNorm) before the new linear layer when config.classifier_head is "mlm" (now the default in config.json). classifier_head=None keeps the plain setup. README: AutoTokenizer needs trust_remote_code=True, and a short fine-tuning section.73bc082
2 days ago
-
Add final checkpoint (model, config, tokenizer, remote code)
Verified signature577b04c