Model card: evaluation on PII Bench, seed variability, licence basis and third-party notices
ca3e253 verified | # Third-party notices | |
| This model is proprietary to ScienceSoft. It is derived from, or was trained with material | |
| drawn from, the third-party works below. Each is used under its own licence, all of which | |
| permit distribution of derivative works under different terms provided the notices below are | |
| retained and the attributions given. None is share-alike and none restricts commercial use. | |
| ## Base model — XLM-RoBERTa | |
| `FacebookAI/xlm-roberta-base` (https://huggingface.co/FacebookAI/xlm-roberta-base), including | |
| its tokenizer. Licensed under the MIT License: | |
| ``` | |
| MIT License | |
| Copyright (c) Facebook, Inc. and its affiliates. | |
| Permission is hereby granted, free of charge, to any person obtaining a copy | |
| of this software and associated documentation files (the "Software"), to deal | |
| in the Software without restriction, including without limitation the rights | |
| to use, copy, modify, merge, publish, distribute, sublicense, and/or sell | |
| copies of the Software, and to permit persons to whom the Software is | |
| furnished to do so, subject to the following conditions: | |
| The above copyright notice and this permission notice shall be included in all | |
| copies or substantial portions of the Software. | |
| THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR | |
| IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, | |
| FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE | |
| AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER | |
| LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, | |
| OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE | |
| SOFTWARE. | |
| ``` | |
| ## Training-data sources | |
| The training corpus is synthetic text produced by ScienceSoft's own generator. Entity values | |
| inserted into that text were drawn in part from the following sources. | |
| **Faker** (https://github.com/joke2k/faker), version 37.12.0 — person, company and city name | |
| pools. MIT License, Copyright (c) 2012 Daniele Faraglia; the MIT permission notice above | |
| applies with that copyright line. | |
| **libpostal** (https://github.com/openvenues/libpostal), `resources/dictionaries/` — address | |
| sub-building vocabulary. MIT License, Copyright (c) 2015 openvenues; the MIT permission notice | |
| above applies with that copyright line. | |
| **GeoNames** (https://www.geonames.org/) — Arabic-script city names from the per-country | |
| exports (https://download.geonames.org/export/dump/). Licensed under Creative Commons | |
| Attribution 4.0 International (https://creativecommons.org/licenses/by/4.0/). Changes made: | |
| names were filtered to populated places of at least 5,000 inhabitants and to Arabic-script | |
| text, then inserted as entity values into generated training sentences; no GeoNames record is | |
| reproduced in this model repository. | |