Instructions to use l3cube-pune/marathi-bert-scratch with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use l3cube-pune/marathi-bert-scratch with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="l3cube-pune/marathi-bert-scratch")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("l3cube-pune/marathi-bert-scratch") model = AutoModelForMaskedLM.from_pretrained("l3cube-pune/marathi-bert-scratch", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from l3cube-pune/marathi-bert-scratch: direct link, hf CLI and curl.
- Browser
- Download file 3.37 kB
-
https://huggingface.co/l3cube-pune/marathi-bert-scratch/resolve/main/README.md
- Command line
-
hf download hf://l3cube-pune/marathi-bert-scratch/README.md
-
curl -L -o README.md https://huggingface.co/l3cube-pune/marathi-bert-scratch/resolve/main/README.md
3.37 kB
| license: cc-by-4.0 | |
| language: mr | |
| datasets: | |
| - L3Cube-MahaCorpus | |
| ## MahaBERT-Scratch | |
| MahaBERT is a Marathi BERT model. It is a base-BERT model trained from scratch on L3Cube-MahaCorpus and other publicly available Marathi monolingual datasets. | |
| [dataset link] (https://github.com/l3cube-pune/MarathiNLP) | |
| More details on the dataset, models, and baseline results can be found in our [paper] (https://arxiv.org/abs/2202.01159) | |
| Best version of this model is available <a href='https://huggingface.co/l3cube-pune/marathi-bert-v2'> here </a>. | |
| ``` | |
| @InProceedings{joshi:2022:WILDRE6, | |
| author = {Joshi, Raviraj}, | |
| title = {L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resources}, | |
| booktitle = {Proceedings of The WILDRE-6 Workshop within the 13th Language Resources and Evaluation Conference}, | |
| month = {June}, | |
| year = {2022}, | |
| address = {Marseille, France}, | |
| publisher = {European Language Resources Association}, | |
| pages = {97--101} | |
| } | |
| ``` | |
| Other Models trained from scratch are listed below: <br> | |
| <a href='https://huggingface.co/l3cube-pune/marathi-bert-scratch'> Marathi-Scratch </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/marathi-tweets-bert-scratch'> Marathi-Tweets-Scratch </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-bert-scratch'> Hindi-Scratch </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-marathi-dev-bert-scratch'> Dev-Scratch </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/kannada-bert-scratch'> Kannada-Scratch </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/telugu-bert-scratch'> Telugu-Scratch </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/malayalam-bert-scratch'> Malayalam-Scratch </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/gujarati-bert-scratch'> Gujarati-Scratch </a> <br> | |
| Better versions of Monolingual Indic BERT models are listed below: <br> | |
| <a href='https://huggingface.co/l3cube-pune/marathi-bert-v2'> Marathi BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/marathi-roberta'> Marathi RoBERTa </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/marathi-albert'> Marathi AlBERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-bert-v2'> Hindi BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-roberta'> Hindi RoBERTa </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-albert'> Hindi AlBERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-marathi-dev-bert'> Dev BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-marathi-dev-roberta'> Dev RoBERTa </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/hindi-marathi-dev-albert'> Dev AlBERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/kannada-bert'> Kannada BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/telugu-bert'> Telugu BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/malayalam-bert'> Malayalam BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/tamil-bert'> Tamil BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/gujarati-bert'> Gujarati BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/odia-bert'> Oriya BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/bengali-bert'> Bengali BERT </a> <br> | |
| <a href='https://huggingface.co/l3cube-pune/punjabi-bert'> Punjabi BERT </a> <br> |