Add Supplementary Data 7 (ProtTale without Stage 1) and update README
Browse files
data/Supplementary_Data/README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
# Supplementary Data — ProtTale
|
| 2 |
|
| 3 |
Source data for the figures and tables in the main text and Extended Data:
|
| 4 |
-
|
| 5 |
workbook and one JSON metadata file.
|
| 6 |
|
| 7 |
The reliability score is written `p_JAY` throughout, the predicted probability
|
|
@@ -20,6 +20,7 @@ Swiss-Prot, so the two map one to one.
|
|
| 20 |
| `Supplementary_Data_4_shuffled_baseline.csv` | 1,031 | Reliability scores for real versus residue-shuffled sequences |
|
| 21 |
| `Supplementary_Data_5_mips_validation.xlsx` | 1,000 | Sequence, structure and EC agreement within MIPS clusters |
|
| 22 |
| `Supplementary_Data_6_training_curves.csv` | 8,904 | Training and validation curves for both stages and the reliability head |
|
|
|
|
| 23 |
|
| 24 |
---
|
| 25 |
|
|
@@ -203,6 +204,38 @@ Regenerates the Extended Data training-dynamics figure.
|
|
| 203 |
|
| 204 |
---
|
| 205 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 206 |
## Not covered here
|
| 207 |
|
| 208 |
Two display items have no tabular source data: the model architecture figure is
|
|
|
|
| 1 |
# Supplementary Data — ProtTale
|
| 2 |
|
| 3 |
Source data for the figures and tables in the main text and Extended Data:
|
| 4 |
+
six CSV files (UTF-8, comma-separated, first row is the header), one Excel
|
| 5 |
workbook and one JSON metadata file.
|
| 6 |
|
| 7 |
The reliability score is written `p_JAY` throughout, the predicted probability
|
|
|
|
| 20 |
| `Supplementary_Data_4_shuffled_baseline.csv` | 1,031 | Reliability scores for real versus residue-shuffled sequences |
|
| 21 |
| `Supplementary_Data_5_mips_validation.xlsx` | 1,000 | Sequence, structure and EC agreement within MIPS clusters |
|
| 22 |
| `Supplementary_Data_6_training_curves.csv` | 8,904 | Training and validation curves for both stages and the reliability head |
|
| 23 |
+
| `Supplementary_Data_7_ablation_no_stage1.csv` | 1,031 | ProtTale retrained without Stage 1, scored on the unseen set |
|
| 24 |
|
| 25 |
---
|
| 26 |
|
|
|
|
| 204 |
|
| 205 |
---
|
| 206 |
|
| 207 |
+
## Supplementary Data 7 — ProtTale without Stage 1
|
| 208 |
+
|
| 209 |
+
One row per unseen protein, 1,031 in total, in the same order and with the same
|
| 210 |
+
identifiers as the `ProtTale` rows of Supplementary Data 2, so the two files can
|
| 211 |
+
be joined row by row or on `UniProt_ID`.
|
| 212 |
+
|
| 213 |
+
ProtTale w/o Stage 1 was trained with Stage 2 only: its frozen encoder was
|
| 214 |
+
initialized from the original ESM-C weights rather than from the Stage 1
|
| 215 |
+
student, and every other setting was unchanged.
|
| 216 |
+
|
| 217 |
+
| Column | Meaning |
|
| 218 |
+
|---|---|
|
| 219 |
+
| `UniProt_ID`, `UniProt_accession` | Protein identifiers |
|
| 220 |
+
| `Method` | `ProtTale w/o Stage 1` on every row |
|
| 221 |
+
| `Kingdom` | Taxonomic group, as in Supplementary Data 2 |
|
| 222 |
+
| `Length_aa` | Sequence length. The short subset is `<= 1024`, the long subset `> 1024` |
|
| 223 |
+
| `judge_run1` … `judge_run5` | LLM-as-judge label from each of five runs: `Yes`, `No`, `Maybe`, or `Vague`. A blank cell means the judge returned no label in that run, which happened for 21 runs across 5 proteins |
|
| 224 |
+
| `judge_majority` | `Yes` when at least three of the five runs said `Yes`, otherwise `not-Yes`. Blank runs count as not-`Yes` |
|
| 225 |
+
| `p_JAY` | ProtTale's reliability score for the protein, identical to Supplementary Data 2. The ablated model has no reliability head of its own, so the filter applied to it uses ProtTale's |
|
| 226 |
+
| `Retained` | Whether `p_JAY > 0.537` |
|
| 227 |
+
| `SwissProt_description` | Curated reference text given to the judge |
|
| 228 |
+
| `Prediction` | Description generated by ProtTale w/o Stage 1 |
|
| 229 |
+
|
| 230 |
+
By five-run majority, the *Yes* rate is 15.8% over all 1,031 proteins, 12.7% on
|
| 231 |
+
the short subset and 30.7% on the long subset, against 25.7%, 25.2% and 27.9% for
|
| 232 |
+
ProtTale.
|
| 233 |
+
|
| 234 |
+
Regenerates the Extended Data figure comparing ProtTale with ProtTale w/o
|
| 235 |
+
Stage 1, and the McNemar tests reported with it in the main text.
|
| 236 |
+
|
| 237 |
+
---
|
| 238 |
+
|
| 239 |
## Not covered here
|
| 240 |
|
| 241 |
Two display items have no tabular source data: the model architecture figure is
|
data/Supplementary_Data/Supplementary_Data_7_ablation_no_stage1.csv
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|