Document expected output scale and extrapolation behaviour
Browse files
README.md
CHANGED
|
@@ -80,6 +80,14 @@ Three values per sequence, in the order `["K562", "HepG2", "SKNSH"]`, on the sca
|
|
| 80 |
MPRA activity log2 fold-change. They are not probabilities and are not calibrated
|
| 81 |
across cell types.
|
| 82 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 83 |
## Verified performance
|
| 84 |
|
| 85 |
Predicted vs empirical MPRA activity across all 754,588 length-200 sequences on
|
|
|
|
| 80 |
MPRA activity log2 fold-change. They are not probabilities and are not calibrated
|
| 81 |
across cell types.
|
| 82 |
|
| 83 |
+
For calibration, across the 754,588 real library sequences the predictions have
|
| 84 |
+
median ~0.2 and a 99th percentile of 3.9-4.7 depending on cell type, with a
|
| 85 |
+
maximum around 11-17. The output layer is unbounded, so out-of-distribution input
|
| 86 |
+
(homopolymers, short tandem repeats, synthetic sequence unlike the library) can
|
| 87 |
+
extrapolate well past that range -- a plain `"ACGT" * 50` repeat scores above 20.
|
| 88 |
+
Treat values far outside the percentiles above as a signal that the input is
|
| 89 |
+
outside what the model was trained on, not as a strong prediction.
|
| 90 |
+
|
| 91 |
## Verified performance
|
| 92 |
|
| 93 |
Predicted vs empirical MPRA activity across all 754,588 length-200 sequences on
|