Mulah commited on
Commit
b3365ba
·
verified ·
1 Parent(s): 4a255ed

Add reference and ProtTale prediction text to Supplementary Data 2

Browse files
data/Supplementary_Data/README.md CHANGED
@@ -67,6 +67,8 @@ GO-extraction figure and carries no judge labels.
67
  | `Method` | `ESM2Text`, `Prot2Text`, `ProtT3`, `ProtTale`, `Protein2Text`, or `Reference` |
68
  | `Kingdom` | Taxonomic group, `Eukaryota` / `Bacteria` / `Archaea` / `Viruses` |
69
  | `Length_aa` | Sequence length. The short subset is `<= 1024` (n = 852), the long subset `> 1024` (n = 179) |
 
 
70
  | `judge_run1` … `judge_run5` | LLM-as-judge label from each of the five independent runs: `Yes`, `No`, `Maybe`, or `Vague`. Blank for `Reference` |
71
  | `judge_majority` | `Yes` when at least three of the five runs said `Yes`, otherwise `not-Yes`. This is the label used for every statistical comparison in the paper |
72
  | `reference_GO` | The protein's curated, experimentally validated Molecular Function GO terms, semicolon separated. The target every extraction is scored against. Identical on all six rows of a protein |
 
67
  | `Method` | `ESM2Text`, `Prot2Text`, `ProtT3`, `ProtTale`, `Protein2Text`, or `Reference` |
68
  | `Kingdom` | Taxonomic group, `Eukaryota` / `Bacteria` / `Archaea` / `Viruses` |
69
  | `Length_aa` | Sequence length. The short subset is `<= 1024` (n = 852), the long subset `> 1024` (n = 179) |
70
+ | `SwissProt_description` | The protein's curated Swiss-Prot `FUNCTION` description, the reference the judge compares against. Identical on all six rows of a protein |
71
+ | `Prediction` | The description ProtTale generated for this protein, on `ProtTale` rows; the curated description itself on `Reference` rows. Blank on the rows of the four other methods, whose generated texts are not included in this release |
72
  | `judge_run1` … `judge_run5` | LLM-as-judge label from each of the five independent runs: `Yes`, `No`, `Maybe`, or `Vague`. Blank for `Reference` |
73
  | `judge_majority` | `Yes` when at least three of the five runs said `Yes`, otherwise `not-Yes`. This is the label used for every statistical comparison in the paper |
74
  | `reference_GO` | The protein's curated, experimentally validated Molecular Function GO terms, semicolon separated. The target every extraction is scored against. Identical on all six rows of a protein |
data/Supplementary_Data/Supplementary_Data_2_unseen_per_method.csv CHANGED
The diff for this file is too large to render. See raw diff