mertcobanov commited on
Commit
86fdf7e
·
verified ·
1 Parent(s): 25807f8

Card: about 400,000 questions in 344,000 states

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -79,9 +79,9 @@ outputs on 2,383 questions (every decision the same, probabilities within 4.9e-6
79
  - **Network**: Laya's (`laya` 0.3.7): the question, a `[MASK]` before every option and the state in one
80
  sequence of up to 512 tokens; a two-layer transformer head scores each option at its marker. Encoder:
81
  Ettin 1b (ModernBERT architecture, MIT).
82
- - **Data**: about 350,000 English questions from permissively licensed decision datasets (Apache-2.0, MIT,
83
- CC BY, CC BY-SA, CC0, BSD; every source and its license is in `DATA_SOURCES.tsv`). Rows from
84
- datasets with a non-commercial or unknown license were dropped.
85
  - **Labels**: each question's gold answer where the data has one, mixed with the full probability distribution
86
  of `pplx-decider:flash` (Apache-2.0), computed through Ollaya.
87
  - **Recipe**: soft cross-entropy plus the ranked probability score on score questions; options shuffled half the
 
79
  - **Network**: Laya's (`laya` 0.3.7): the question, a `[MASK]` before every option and the state in one
80
  sequence of up to 512 tokens; a two-layer transformer head scores each option at its marker. Encoder:
81
  Ettin 1b (ModernBERT architecture, MIT).
82
+ - **Data**: about 400,000 English questions in 344,000 states from permissively licensed decision datasets
83
+ (Apache-2.0, MIT, CC BY, CC BY-SA, CC0, BSD; every source and its license is in `DATA_SOURCES.tsv`).
84
+ Rows from datasets with a non-commercial or unknown license were dropped.
85
  - **Labels**: each question's gold answer where the data has one, mixed with the full probability distribution
86
  of `pplx-decider:flash` (Apache-2.0), computed through Ollaya.
87
  - **Recipe**: soft cross-entropy plus the ranked probability score on score questions; options shuffled half the