Instructions to use peter2000/laya-vulnerability-groups with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use peter2000/laya-vulnerability-groups with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="peter2000/laya-vulnerability-groups")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("peter2000/laya-vulnerability-groups", device_map="auto") - Laya
How to use peter2000/laya-vulnerability-groups with Laya:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Add evaluation metrics
Browse files- metrics.json +54 -0
metrics.json
ADDED
|
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"zero_shot": {
|
| 3 |
+
"macro_f1": 0.0,
|
| 4 |
+
"micro_f1": 0.0,
|
| 5 |
+
"ece": 0.08721882352941175,
|
| 6 |
+
"subset_accuracy": 0.0,
|
| 7 |
+
"per_label_f1": {
|
| 8 |
+
"Agricultural communities": 0.0,
|
| 9 |
+
"Coastal communities": 0.0,
|
| 10 |
+
"Ethnic, racial or other minorities": 0.0,
|
| 11 |
+
"Fishery communities": 0.0,
|
| 12 |
+
"Informal sector workers": 0.0,
|
| 13 |
+
"Members of indigenous and local communities": 0.0,
|
| 14 |
+
"Migrants and displaced persons": 0.0,
|
| 15 |
+
"Older persons": 0.0,
|
| 16 |
+
"Other": 0.0,
|
| 17 |
+
"Persons living in poverty": 0.0,
|
| 18 |
+
"Persons with disabilities": 0.0,
|
| 19 |
+
"Persons with pre-existing health conditions": 0.0,
|
| 20 |
+
"Residents of drought-prone regions": 0.0,
|
| 21 |
+
"Rural populations": 0.0,
|
| 22 |
+
"Sexual minorities (LGBTQI+)": 0.0,
|
| 23 |
+
"Urban populations": 0.0,
|
| 24 |
+
"Women and other genders": 0.0
|
| 25 |
+
},
|
| 26 |
+
"eval_seconds": 2.2
|
| 27 |
+
},
|
| 28 |
+
"fine_tuned": {
|
| 29 |
+
"macro_f1": 0.0,
|
| 30 |
+
"micro_f1": 0.0,
|
| 31 |
+
"ece": 0.06884117647058798,
|
| 32 |
+
"subset_accuracy": 0.0,
|
| 33 |
+
"per_label_f1": {
|
| 34 |
+
"Agricultural communities": 0.0,
|
| 35 |
+
"Coastal communities": 0.0,
|
| 36 |
+
"Ethnic, racial or other minorities": 0.0,
|
| 37 |
+
"Fishery communities": 0.0,
|
| 38 |
+
"Informal sector workers": 0.0,
|
| 39 |
+
"Members of indigenous and local communities": 0.0,
|
| 40 |
+
"Migrants and displaced persons": 0.0,
|
| 41 |
+
"Older persons": 0.0,
|
| 42 |
+
"Other": 0.0,
|
| 43 |
+
"Persons living in poverty": 0.0,
|
| 44 |
+
"Persons with disabilities": 0.0,
|
| 45 |
+
"Persons with pre-existing health conditions": 0.0,
|
| 46 |
+
"Residents of drought-prone regions": 0.0,
|
| 47 |
+
"Rural populations": 0.0,
|
| 48 |
+
"Sexual minorities (LGBTQI+)": 0.0,
|
| 49 |
+
"Urban populations": 0.0,
|
| 50 |
+
"Women and other genders": 0.0
|
| 51 |
+
},
|
| 52 |
+
"eval_seconds": 0.4
|
| 53 |
+
}
|
| 54 |
+
}
|