Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,11 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
=======
|
| 4 |
BERT model dedicated to the domain of cyber security. The model has been trained on a corpus of high-quality cyber security and computer science text and is unlikely to work outside this domain.
|
| 5 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# CYBERT
|
| 2 |
+
|
|
|
|
| 3 |
BERT model dedicated to the domain of cyber security. The model has been trained on a corpus of high-quality cyber security and computer science text and is unlikely to work outside this domain.
|
| 4 |
+
|
| 5 |
+
|
| 6 |
+
#Model architecture
|
| 7 |
+
The model architecture used is original Roberta and tokenizer to train the corpus is Byte Level.
|
| 8 |
+
|
| 9 |
+
#Hardware
|
| 10 |
+
The model is trained on GPU NVIDIA-SMI 510.54
|
| 11 |
+
|