Instructions to use QomSSLab/Anonymizer-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use QomSSLab/Anonymizer-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="QomSSLab/Anonymizer-v2")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("QomSSLab/Anonymizer-v2") model = AutoModelForTokenClassification.from_pretrained("QomSSLab/Anonymizer-v2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| language: fa | |
| pipeline_tag: token-classification | |
| library_name: transformers | |
| # QomSSLab/Anonymizer-v2 | |
| This repository hosts an XLM-RoBERTa token-classification head trained. | |
| ## Usage | |
| ```python | |
| from transformers import AutoTokenizer, AutoModelForTokenClassification, pipeline | |
| model_id = "QomSSLab/Anonymizer-v2" | |
| tokenizer = AutoTokenizer.from_pretrained(model_id) | |
| model = AutoModelForTokenClassification.from_pretrained(model_id) | |
| tagger = pipeline("token-classification", model=model, tokenizer=tokenizer, aggregation_strategy="simple") | |
| text = "مثال از یک ورودی فارسی" | |
| for entity in tagger(text): | |
| print(entity) | |
| ``` | |
| ## Labels | |
| - `ACOUNT` | |
| - `ADDRESS` | |
| - `AMOUNT` | |
| - `DATE` | |
| - `DOCUMENT_ID` | |
| - `ID` | |
| - `JOB` | |
| - `O` | |
| - `ORG` | |
| - `ORG_BRANCH` | |
| - `PERSON` | |
| ## Metrics | |
| ## Validation Metrics | |
| - Precision: 0.9789 | |
| - Recall: 0.9731 | |
| - F1: 0.9760 | |
| - Accuracy: 0.9932 | |
| ### Per-label Breakdown | |
| | Label | Precision | Recall | F1 | Support | | |
| | --- | --- | --- | --- | --- | | |
| | ACOUNT | 1.0000 | 1.0000 | 1.0000 | 0 | | |
| | ADDRESS | 0.9944 | 0.9958 | 0.9951 | 712 | | |
| | AMOUNT | 1.0000 | 1.0000 | 1.0000 | 41 | | |
| | DATE | 0.9913 | 0.9785 | 0.9849 | 233 | | |
| | DOCUMENT_ID | 1.0000 | 1.0000 | 1.0000 | 427 | | |
| | ID | 1.0000 | 1.0000 | 1.0000 | 75 | | |
| | JOB | 0.8919 | 0.4783 | 0.6226 | 69 | | |
| | O | 0.9957 | 0.9972 | 0.9965 | 8359 | | |
| | ORG | 0.8509 | 0.9327 | 0.8899 | 104 | | |
| | ORG_BRANCH | 0.9656 | 1.0000 | 0.9825 | 281 | | |
| | PERSON | 0.9983 | 1.0000 | 0.9991 | 587 | | |