Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ tags:
|
|
| 11 |
SinBerto is a small language model trained on a small news corpus. SinBerto is trained on Sinhala Language which is a low resource language compared to other languages.
|
| 12 |
|
| 13 |
### Model Specifications.
|
| 14 |
-
model : [Roberta]
|
| 15 |
vocab_size=52_000,
|
| 16 |
max_position_embeddings=514,
|
| 17 |
num_attention_heads=12,
|
|
|
|
| 11 |
SinBerto is a small language model trained on a small news corpus. SinBerto is trained on Sinhala Language which is a low resource language compared to other languages.
|
| 12 |
|
| 13 |
### Model Specifications.
|
| 14 |
+
model : [Roberta](https://arxiv.org/abs/1907.11692)
|
| 15 |
vocab_size=52_000,
|
| 16 |
max_position_embeddings=514,
|
| 17 |
num_attention_heads=12,
|