Mulah commited on
Commit
4a255ed
·
verified ·
1 Parent(s): 25a2abd

Add Supplementary Data 7 (ProtTale without Stage 1) and update README

Browse files
data/Supplementary_Data/README.md CHANGED
@@ -1,7 +1,7 @@
1
  # Supplementary Data — ProtTale
2
 
3
  Source data for the figures and tables in the main text and Extended Data:
4
- five CSV files (UTF-8, comma-separated, first row is the header), one Excel
5
  workbook and one JSON metadata file.
6
 
7
  The reliability score is written `p_JAY` throughout, the predicted probability
@@ -20,6 +20,7 @@ Swiss-Prot, so the two map one to one.
20
  | `Supplementary_Data_4_shuffled_baseline.csv` | 1,031 | Reliability scores for real versus residue-shuffled sequences |
21
  | `Supplementary_Data_5_mips_validation.xlsx` | 1,000 | Sequence, structure and EC agreement within MIPS clusters |
22
  | `Supplementary_Data_6_training_curves.csv` | 8,904 | Training and validation curves for both stages and the reliability head |
 
23
 
24
  ---
25
 
@@ -203,6 +204,38 @@ Regenerates the Extended Data training-dynamics figure.
203
 
204
  ---
205
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
206
  ## Not covered here
207
 
208
  Two display items have no tabular source data: the model architecture figure is
 
1
  # Supplementary Data — ProtTale
2
 
3
  Source data for the figures and tables in the main text and Extended Data:
4
+ six CSV files (UTF-8, comma-separated, first row is the header), one Excel
5
  workbook and one JSON metadata file.
6
 
7
  The reliability score is written `p_JAY` throughout, the predicted probability
 
20
  | `Supplementary_Data_4_shuffled_baseline.csv` | 1,031 | Reliability scores for real versus residue-shuffled sequences |
21
  | `Supplementary_Data_5_mips_validation.xlsx` | 1,000 | Sequence, structure and EC agreement within MIPS clusters |
22
  | `Supplementary_Data_6_training_curves.csv` | 8,904 | Training and validation curves for both stages and the reliability head |
23
+ | `Supplementary_Data_7_ablation_no_stage1.csv` | 1,031 | ProtTale retrained without Stage 1, scored on the unseen set |
24
 
25
  ---
26
 
 
204
 
205
  ---
206
 
207
+ ## Supplementary Data 7 — ProtTale without Stage 1
208
+
209
+ One row per unseen protein, 1,031 in total, in the same order and with the same
210
+ identifiers as the `ProtTale` rows of Supplementary Data 2, so the two files can
211
+ be joined row by row or on `UniProt_ID`.
212
+
213
+ ProtTale w/o Stage 1 was trained with Stage 2 only: its frozen encoder was
214
+ initialized from the original ESM-C weights rather than from the Stage 1
215
+ student, and every other setting was unchanged.
216
+
217
+ | Column | Meaning |
218
+ |---|---|
219
+ | `UniProt_ID`, `UniProt_accession` | Protein identifiers |
220
+ | `Method` | `ProtTale w/o Stage 1` on every row |
221
+ | `Kingdom` | Taxonomic group, as in Supplementary Data 2 |
222
+ | `Length_aa` | Sequence length. The short subset is `<= 1024`, the long subset `> 1024` |
223
+ | `judge_run1` … `judge_run5` | LLM-as-judge label from each of five runs: `Yes`, `No`, `Maybe`, or `Vague`. A blank cell means the judge returned no label in that run, which happened for 21 runs across 5 proteins |
224
+ | `judge_majority` | `Yes` when at least three of the five runs said `Yes`, otherwise `not-Yes`. Blank runs count as not-`Yes` |
225
+ | `p_JAY` | ProtTale's reliability score for the protein, identical to Supplementary Data 2. The ablated model has no reliability head of its own, so the filter applied to it uses ProtTale's |
226
+ | `Retained` | Whether `p_JAY > 0.537` |
227
+ | `SwissProt_description` | Curated reference text given to the judge |
228
+ | `Prediction` | Description generated by ProtTale w/o Stage 1 |
229
+
230
+ By five-run majority, the *Yes* rate is 15.8% over all 1,031 proteins, 12.7% on
231
+ the short subset and 30.7% on the long subset, against 25.7%, 25.2% and 27.9% for
232
+ ProtTale.
233
+
234
+ Regenerates the Extended Data figure comparing ProtTale with ProtTale w/o
235
+ Stage 1, and the McNemar tests reported with it in the main text.
236
+
237
+ ---
238
+
239
  ## Not covered here
240
 
241
  Two display items have no tabular source data: the model architecture figure is
data/Supplementary_Data/Supplementary_Data_7_ablation_no_stage1.csv ADDED
The diff for this file is too large to render. See raw diff