Index verified TADA checkpoints

README.md

@@ -13,12 +13,12 @@ No source repository has been deleted. Model-card evaluation scores and paper te
 
 | Source | Paper table | Direction | Case | Side | Card BLEU | Paper BLEU | Folder |
 | --- | --- | --- | --- | --- | --- | --- | --- |
-| [FiveC/ViTay-SR](https://huggingface.co/FiveC/ViTay-SR) | 1 | vi-tay | EDA Synonym | paired | 19.2023 | 19.20 | [checkpoints/ViTay-SR](tree/main/checkpoints/ViTay-SR) |
-| [FiveC/ViTay-SwitchOut](https://huggingface.co/FiveC/ViTay-SwitchOut) | 1 | vi-tay | SwitchOut | paired | 22.1613 | 22.16 | [checkpoints/ViTay-SwitchOut](tree/main/checkpoints/ViTay-SwitchOut) |
-| [FiveC/ViTay-RS](https://huggingface.co/FiveC/ViTay-RS) | 1 | vi-tay | EDA Swap | paired | 18.6020 | 18.60 | [checkpoints/ViTay-RS](tree/main/checkpoints/ViTay-RS) |
-| [FiveC/ViTay-RI](https://huggingface.co/FiveC/ViTay-RI) | 1 | vi-tay | EDA Insertion | paired | 18.3148 | 18.31 | [checkpoints/ViTay-RI](tree/main/checkpoints/ViTay-RI) |
-| [FiveC/ViTay-Sentence-Concatenation](https://huggingface.co/FiveC/ViTay-Sentence-Concatenation) | 1 | vi-tay | Sentence Concatenation | paired | 15.9294 | 15.93 | [checkpoints/ViTay-Sentence-Concatenation](tree/main/checkpoints/ViTay-Sentence-Concatenation) |
-| [FiveC/BartTayFinal-Sentence-Concatenation](https://huggingface.co/FiveC/BartTayFinal-Sentence-Concatenation) | 1 | tay-vi | Sentence Concatenation | paired | 18.9419 | 18.94 | [checkpoints/BartTayFinal-Sentence-Concatenation](tree/main/checkpoints/BartTayFinal-Sentence-Concatenation) |
+| [FiveC/ViTay-SR](https://huggingface.co/FiveC/ViTay-SR) | 1 | vi-tay | EDA Synonym | external_baseline | 19.2023 | 19.20 | [checkpoints/ViTay-SR](tree/main/checkpoints/ViTay-SR) |
+| [FiveC/ViTay-SwitchOut](https://huggingface.co/FiveC/ViTay-SwitchOut) | 1 | vi-tay | SwitchOut | external_baseline | 22.1613 | 22.16 | [checkpoints/ViTay-SwitchOut](tree/main/checkpoints/ViTay-SwitchOut) |
+| [FiveC/ViTay-RS](https://huggingface.co/FiveC/ViTay-RS) | 1 | vi-tay | EDA Swap | external_baseline | 18.6020 | 18.60 | [checkpoints/ViTay-RS](tree/main/checkpoints/ViTay-RS) |
+| [FiveC/ViTay-RI](https://huggingface.co/FiveC/ViTay-RI) | 1 | vi-tay | EDA Insertion | external_baseline | 18.3148 | 18.31 | [checkpoints/ViTay-RI](tree/main/checkpoints/ViTay-RI) |
+| [FiveC/ViTay-Sentence-Concatenation](https://huggingface.co/FiveC/ViTay-Sentence-Concatenation) | 1 | vi-tay | Sentence Concatenation | external_baseline | 15.9294 | 15.93 | [checkpoints/ViTay-Sentence-Concatenation](tree/main/checkpoints/ViTay-Sentence-Concatenation) |
+| [FiveC/BartTayFinal-Sentence-Concatenation](https://huggingface.co/FiveC/BartTayFinal-Sentence-Concatenation) | 1 | tay-vi | Sentence Concatenation | external_baseline | 18.9419 | 18.94 | [checkpoints/BartTayFinal-Sentence-Concatenation](tree/main/checkpoints/BartTayFinal-Sentence-Concatenation) |
 | [FiveC/BartTayFinal-combine-tay](https://huggingface.co/FiveC/BartTayFinal-combine-tay) | 5 | tay-vi | Combine | source | 20.3274 | 20.33 | [checkpoints/BartTayFinal-combine-tay](tree/main/checkpoints/BartTayFinal-combine-tay) |
 | [FiveC/ViTay-delete-original-viet](https://huggingface.co/FiveC/ViTay-delete-original-viet) | 5 | vi-tay | Deletion + Original | source | 18.5125 | 18.51 | [checkpoints/ViTay-delete-original-viet](tree/main/checkpoints/ViTay-delete-original-viet) |
 | [FiveC/BartTay-Delete-Original-vi-only](https://huggingface.co/FiveC/BartTay-Delete-Original-vi-only) | 5 | tay-vi | Deletion + Original | target | 22.3547 | 22.35 | [checkpoints/BartTay-Delete-Original-vi-only](tree/main/checkpoints/BartTay-Delete-Original-vi-only) |
@@ -30,9 +30,9 @@ No source repository has been deleted. Model-card evaluation scores and paper te
 | [FiveC/freeze-viet-tay-synonym](https://huggingface.co/FiveC/freeze-viet-tay-synonym) | 8 | vi-tay | Synonym | frozen_encoder | 12.7523 | 12.75 | [checkpoints/freeze-viet-tay-synonym](tree/main/checkpoints/freeze-viet-tay-synonym) |
 | [FiveC/freeze-viet-tay-combine](https://huggingface.co/FiveC/freeze-viet-tay-combine) | 8 | vi-tay | Combine | frozen_encoder | 14.0257 | 14.03 | [checkpoints/freeze-viet-tay-combine](tree/main/checkpoints/freeze-viet-tay-combine) |
 | [FiveC/freeze-viet-tay-delete-original](https://huggingface.co/FiveC/freeze-viet-tay-delete-original) | 8 | vi-tay | Deletion + Original | frozen_encoder | 14.7686 | 14.77 | [checkpoints/freeze-viet-tay-delete-original](tree/main/checkpoints/freeze-viet-tay-delete-original) |
-| [FiveC/bartpho-Tay](https://huggingface.co/FiveC/bartpho-Tay) | 6 | tay-vi | BARTPho two-stage | paired | 13.9076 | 13.91 | [checkpoints/bartpho-Tay](tree/main/checkpoints/bartpho-Tay) |
-| [FiveC/MBart50-bahnar](https://huggingface.co/FiveC/MBart50-bahnar) | 6 | bahnar-vi | mBART | paired | 3.0610 | 3.06 | [checkpoints/MBart50-bahnar](tree/main/checkpoints/MBart50-bahnar) |
-| [FiveC/MBart50-tay](https://huggingface.co/FiveC/MBart50-tay) | 6 | tay-vi | mBART | paired | 11.9480 | 11.95 | [checkpoints/MBart50-tay](tree/main/checkpoints/MBart50-tay) |
+| [FiveC/bartpho-Tay](https://huggingface.co/FiveC/bartpho-Tay) | 6 | tay-vi | BARTPho two-stage | not_augmented | 13.9076 | 13.91 | [checkpoints/bartpho-Tay](tree/main/checkpoints/bartpho-Tay) |
+| [FiveC/MBart50-bahnar](https://huggingface.co/FiveC/MBart50-bahnar) | 6 | bahnar-vi | mBART | not_augmented | 3.0610 | 3.06 | [checkpoints/MBart50-bahnar](tree/main/checkpoints/MBart50-bahnar) |
+| [FiveC/MBart50-tay](https://huggingface.co/FiveC/MBart50-tay) | 6 | tay-vi | mBART | not_augmented | 11.9480 | 11.95 | [checkpoints/MBart50-tay](tree/main/checkpoints/MBart50-tay) |
 
 ## Loading a checkpoint
 

registry/checkpoint_index.json

@@ -15,7 +15,7 @@
         "table": 1,
         "direction": "vi-tay",
         "method": "EDA Synonym",
-        "side": "paired",
+        "side": "external_baseline",
         "paper_bleu": 19.2,
         "paper_chrfpp": 33.21
       },
@@ -99,7 +99,7 @@
         "table": 1,
         "direction": "vi-tay",
         "method": "SwitchOut",
-        "side": "paired",
+        "side": "external_baseline",
         "paper_bleu": 22.16,
         "paper_chrfpp": 36.15
       },
@@ -183,7 +183,7 @@
         "table": 1,
         "direction": "vi-tay",
         "method": "EDA Swap",
-        "side": "paired",
+        "side": "external_baseline",
         "paper_bleu": 18.6,
         "paper_chrfpp": 33.04
       },
@@ -267,7 +267,7 @@
         "table": 1,
         "direction": "vi-tay",
         "method": "EDA Insertion",
-        "side": "paired",
+        "side": "external_baseline",
         "paper_bleu": 18.31,
         "paper_chrfpp": 32.08
       },
@@ -351,7 +351,7 @@
         "table": 1,
         "direction": "vi-tay",
         "method": "Sentence Concatenation",
-        "side": "paired",
+        "side": "external_baseline",
         "paper_bleu": 15.93,
         "paper_chrfpp": 31.77
       },
@@ -441,7 +441,7 @@
         "table": 1,
         "direction": "tay-vi",
         "method": "Sentence Concatenation",
-        "side": "paired",
+        "side": "external_baseline",
         "paper_bleu": 18.94,
         "paper_chrfpp": 32.32
       },
@@ -1455,7 +1455,7 @@
         "table": 6,
         "direction": "tay-vi",
         "method": "BARTPho two-stage",
-        "side": "paired",
+        "side": "not_augmented",
         "paper_bleu": 13.91,
         "paper_chrfpp": 24.97
       },
@@ -1539,7 +1539,7 @@
         "table": 6,
         "direction": "bahnar-vi",
         "method": "mBART",
-        "side": "paired",
+        "side": "not_augmented",
         "paper_bleu": 3.06,
         "paper_chrfpp": 13.8
       },
@@ -1623,7 +1623,7 @@
         "table": 6,
         "direction": "tay-vi",
         "method": "mBART",
-        "side": "paired",
+        "side": "not_augmented",
         "paper_bleu": 11.95,
         "paper_chrfpp": 20.27
       },