Third-party notices
This model is proprietary to ScienceSoft. It is derived from, or was trained with material drawn from, the third-party works below. Each is used under its own licence, all of which permit distribution of derivative works under different terms provided the notices below are retained and the attributions given. None is share-alike and none restricts commercial use.
Base model — XLM-RoBERTa
FacebookAI/xlm-roberta-base (https://huggingface.co/FacebookAI/xlm-roberta-base), including
its tokenizer. Licensed under the MIT License:
MIT License
Copyright (c) Facebook, Inc. and its affiliates.
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
Training-data sources
The training corpus is synthetic text produced by ScienceSoft's own generator. Entity values inserted into that text were drawn in part from the following sources.
Faker (https://github.com/joke2k/faker), version 37.12.0 — person, company and city name pools. MIT License, Copyright (c) 2012 Daniele Faraglia; the MIT permission notice above applies with that copyright line.
libpostal (https://github.com/openvenues/libpostal), resources/dictionaries/ — address
sub-building vocabulary. MIT License, Copyright (c) 2015 openvenues; the MIT permission notice
above applies with that copyright line.
GeoNames (https://www.geonames.org/) — Arabic-script city names from the per-country exports (https://download.geonames.org/export/dump/). Licensed under Creative Commons Attribution 4.0 International (https://creativecommons.org/licenses/by/4.0/). Changes made: names were filtered to populated places of at least 5,000 inhabitants and to Arabic-script text, then inserted as entity values into generated training sentences; no GeoNames record is reproduced in this model repository.