Instructions to use cisco-ai/SecureBERT2.0-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use cisco-ai/SecureBERT2.0-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="cisco-ai/SecureBERT2.0-base")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("cisco-ai/SecureBERT2.0-base") model = AutoModelForMaskedLM.from_pretrained("cisco-ai/SecureBERT2.0-base", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -116,4 +116,5 @@ predicted_word = tokenizer.decode(predicted_token_id[0])
|
|
| 116 |
print(predicted_word)
|
| 117 |
|
| 118 |
|
| 119 |
-
```
|
|
|
|
|
|
| 116 |
print(predicted_word)
|
| 117 |
|
| 118 |
|
| 119 |
+
```
|
| 120 |
+
SecureBERT 2.0 outperforms both the original SecureBERT and generic ModernBERT, particularly in code understanding and domain-specific terms.
|