aparecium-matrix / ATTRIBUTIONS.md
rtedwardchen's picture
Add matrix reconstruction model
188712f verified
|
Raw History Blame Contribute Delete
4.29 kB

Attributions

Aparecium's code and learned nonlinear projection are distributed under the MIT License. The model artifact also contains the original MPNet input-vocabulary weights and tokenizer files, which retain their Apache-2.0 terms and applicable notices. The MIT license does not relicense those upstream components or source datasets.

The upstream terms are included in UPSTREAM_LICENSE, with component notices in NOTICE.

Encoder and vocabulary

Component Source Upstream license
Input encoder, tokenizer, and original vocabulary weights all-mpnet-base-v2, Sentence Transformers Apache-2.0

The supported encoder and tokenizer revision is e8c3b32edf5434bc2275fc9bab85f82640a19130. Matrix reconstruction loads the included tokenizer and vocabulary. The full encoder is obtained separately when producing matrices or using text convenience methods.

The implementation uses PyTorch, Transformers, Hugging Face Hub, Safetensors, and NumPy. The optional service uses FastAPI, Pydantic, and Uvicorn. Their copyright and license notices remain with their distributions.

Training sources

The general-English training collection contains 5,000 short texts from the sources below. Dataset-level license labels do not replace the terms or attribution attached to individual source documents.

Collection Training texts Source and acknowledgment Recorded license information
C4, realnewslike 978 Allen Institute for AI C4 distribution, derived from Common Crawl ODC-By
Common Pile News 499 Common Pile contributors and original news authors Document-level CC-BY filtering; retained documents record Attribution 4.0
HuffPost News Category 767 News Category Dataset by Rishabh Misra, via heegyu/news-category-dataset CC-BY-4.0, as labeled by the collection
Wikinews 270 Wikinews contributors, via Izumi Lab's English collection CC-BY-2.5
Wikipedia sentences 756 Wikipedia contributors, via Sentence Transformers' English collection Wikipedia CC-BY-SA terms; the collection does not specify a version
FineWeb-Edu 728 Hugging Face FineWeb-Edu, derived from Common Crawl ODC-By
Webis TL;DR 1,002 Webis Group TL;DR collection and original contributors CC-BY-4.0
General-English total 5,000

Crypto training additionally uses 140 original public X posts across 133 event families. Those authors retain rights in their posts; public availability does not imply an open-content license. The source collections supply headlines, short summaries, sentences, and social commentary. Separate held-out diagnostic collections contain 500 general-English texts and 50 crypto posts.

The release distributes model parameters and tokenizer assets, not training or evaluation text. Original authors, corpus maintainers, and upstream notices remain the authorities for source content and its terms.

Evaluation sources

Source-fidelity measurements use held-out public crypto posts, grouped by historical event and distinct author. The reported scores assess preservation of supplied source claims, not their external truth. Public documentation includes aggregate measurements and short paraphrased error descriptions without redistributing the underlying posts.