lindazeng979 commited on
Commit
e2c445d
·
verified ·
1 Parent(s): 1c0487e

Upload baseline_random_split/seed_42

Browse files
Files changed (28) hide show
  1. baseline_random_split/seed_42/README.md +77 -0
  2. baseline_random_split/seed_42/added_tokens.json +3 -0
  3. baseline_random_split/seed_42/all_results.json +15 -0
  4. baseline_random_split/seed_42/config.json +40 -0
  5. baseline_random_split/seed_42/eval_results.json +10 -0
  6. baseline_random_split/seed_42/generation_config.json +7 -0
  7. baseline_random_split/seed_42/merges.txt +0 -0
  8. baseline_random_split/seed_42/pytorch_model.bin +3 -0
  9. baseline_random_split/seed_42/special_tokens_map.json +6 -0
  10. baseline_random_split/seed_42/tokenizer.json +0 -0
  11. baseline_random_split/seed_42/tokenizer_config.json +9 -0
  12. baseline_random_split/seed_42/train_results.json +8 -0
  13. baseline_random_split/seed_42/trainer_state.json +805 -0
  14. baseline_random_split/seed_42/training_args.bin +3 -0
  15. baseline_random_split/seed_42/vocab.json +0 -0
  16. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/anaphor_agreement/eval_results.json +0 -0
  17. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/argument_structure/eval_results.json +0 -0
  18. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/binding/eval_results.json +0 -0
  19. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/case_subjective_pronoun/eval_results.json +0 -0
  20. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/determiner_noun_agreement/eval_results.json +0 -0
  21. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/ellipsis/eval_results.json +1 -0
  22. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/filler_gap/eval_results.json +0 -0
  23. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/irregular_forms/eval_results.json +1 -0
  24. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/island_effects/eval_results.json +0 -0
  25. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/local_attractor/eval_results.json +0 -0
  26. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/npi_licensing/eval_results.json +0 -0
  27. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/quantifiers/eval_results.json +0 -0
  28. baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/subject_verb_agreement/eval_results.json +0 -0
baseline_random_split/seed_42/README.md ADDED
@@ -0,0 +1,77 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ metrics:
5
+ - accuracy
6
+ model-index:
7
+ - name: GPT2-tiny-baseline_random_split_42
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # GPT2-tiny-baseline_random_split_42
15
+
16
+ This model was trained from scratch on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 1.3213
19
+ - Accuracy: 0.6714
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 0.0001
39
+ - train_batch_size: 32
40
+ - eval_batch_size: 32
41
+ - seed: 42
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
+ - lr_scheduler_type: linear
44
+ - num_epochs: 20.0
45
+
46
+ ### Training results
47
+
48
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
49
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|
50
+ | 2.2292 | 1.0 | 2501 | 2.0749 | 0.5652 |
51
+ | 1.8861 | 2.0 | 5002 | 1.7616 | 0.6063 |
52
+ | 1.7362 | 3.0 | 7503 | 1.6207 | 0.6262 |
53
+ | 1.6515 | 4.0 | 10004 | 1.5419 | 0.6372 |
54
+ | 1.5949 | 5.0 | 12505 | 1.4929 | 0.6442 |
55
+ | 1.5564 | 6.0 | 15006 | 1.4557 | 0.6498 |
56
+ | 1.5317 | 7.0 | 17507 | 1.4292 | 0.6539 |
57
+ | 1.504 | 8.0 | 20008 | 1.4085 | 0.6569 |
58
+ | 1.4864 | 9.0 | 22509 | 1.3926 | 0.6594 |
59
+ | 1.4699 | 10.0 | 25010 | 1.3798 | 0.6615 |
60
+ | 1.4599 | 11.0 | 27511 | 1.3681 | 0.6634 |
61
+ | 1.4442 | 12.0 | 30012 | 1.3584 | 0.6648 |
62
+ | 1.436 | 13.0 | 32513 | 1.3501 | 0.6663 |
63
+ | 1.4306 | 14.0 | 35014 | 1.3432 | 0.6676 |
64
+ | 1.4202 | 15.0 | 37515 | 1.3372 | 0.6686 |
65
+ | 1.4172 | 16.0 | 40016 | 1.3332 | 0.6694 |
66
+ | 1.4126 | 17.0 | 42517 | 1.3284 | 0.6700 |
67
+ | 1.407 | 18.0 | 45018 | 1.3253 | 0.6706 |
68
+ | 1.4015 | 19.0 | 47519 | 1.3229 | 0.6711 |
69
+ | 1.3983 | 20.0 | 50020 | 1.3213 | 0.6714 |
70
+
71
+
72
+ ### Framework versions
73
+
74
+ - Transformers 4.29.0.dev0
75
+ - Pytorch 2.13.0+cu130
76
+ - Datasets 5.0.1
77
+ - Tokenizers 0.13.3
baseline_random_split/seed_42/added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "<|pad|>": 58426
3
+ }
baseline_random_split/seed_42/all_results.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_accuracy": 0.6714253080686327,
4
+ "eval_loss": 1.3212834596633911,
5
+ "eval_runtime": 18.5982,
6
+ "eval_samples": 4215,
7
+ "eval_samples_per_second": 226.635,
8
+ "eval_steps_per_second": 7.097,
9
+ "perplexity": 3.748228992131582,
10
+ "train_loss": 1.5915360271906862,
11
+ "train_runtime": 5537.1072,
12
+ "train_samples": 80003,
13
+ "train_samples_per_second": 288.97,
14
+ "train_steps_per_second": 9.034
15
+ }
baseline_random_split/seed_42/config.json ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "tokenizers/GPT2-tiny_config",
3
+ "activation_function": "gelu_new",
4
+ "architectures": [
5
+ "GPT2LMHeadModel"
6
+ ],
7
+ "attn_pdrop": 0.1,
8
+ "bos_token_id": 0,
9
+ "embd_pdrop": 0.1,
10
+ "eos_token_id": 0,
11
+ "initializer_range": 0.02,
12
+ "layer_norm_epsilon": 1e-05,
13
+ "model_type": "gpt2",
14
+ "n_ctx": 1024,
15
+ "n_embd": 256,
16
+ "n_head": 4,
17
+ "n_inner": null,
18
+ "n_layer": 4,
19
+ "n_positions": 1024,
20
+ "pad_token_id": 58426,
21
+ "reorder_and_upcast_attn": false,
22
+ "resid_pdrop": 0.1,
23
+ "scale_attn_by_inverse_layer_idx": false,
24
+ "scale_attn_weights": true,
25
+ "summary_activation": null,
26
+ "summary_first_dropout": 0.1,
27
+ "summary_proj_to_labels": true,
28
+ "summary_type": "cls_index",
29
+ "summary_use_proj": true,
30
+ "task_specific_params": {
31
+ "text-generation": {
32
+ "do_sample": true,
33
+ "max_length": 50
34
+ }
35
+ },
36
+ "torch_dtype": "float32",
37
+ "transformers_version": "4.29.0.dev0",
38
+ "use_cache": true,
39
+ "vocab_size": 58427
40
+ }
baseline_random_split/seed_42/eval_results.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "eval_accuracy": 0.6714253080686327,
4
+ "eval_loss": 1.3212834596633911,
5
+ "eval_runtime": 18.5982,
6
+ "eval_samples": 4215,
7
+ "eval_samples_per_second": 226.635,
8
+ "eval_steps_per_second": 7.097,
9
+ "perplexity": 3.748228992131582
10
+ }
baseline_random_split/seed_42/generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 0,
4
+ "eos_token_id": 0,
5
+ "pad_token_id": 58426,
6
+ "transformers_version": "4.29.0.dev0"
7
+ }
baseline_random_split/seed_42/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c15649cabd9975f6e6f1cf85bb64373718c39472295a18c519d8330b025ea16e
3
+ size 77730555
baseline_random_split/seed_42/special_tokens_map.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": "<|endoftext|>",
3
+ "eos_token": "<|endoftext|>",
4
+ "pad_token": "<|pad|>",
5
+ "unk_token": "<|endoftext|>"
6
+ }
baseline_random_split/seed_42/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/tokenizer_config.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "bos_token": "<|endoftext|>",
4
+ "clean_up_tokenization_spaces": true,
5
+ "eos_token": "<|endoftext|>",
6
+ "model_max_length": 1024,
7
+ "tokenizer_class": "GPT2Tokenizer",
8
+ "unk_token": "<|endoftext|>"
9
+ }
baseline_random_split/seed_42/train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 20.0,
3
+ "train_loss": 1.5915360271906862,
4
+ "train_runtime": 5537.1072,
5
+ "train_samples": 80003,
6
+ "train_samples_per_second": 288.97,
7
+ "train_steps_per_second": 9.034
8
+ }
baseline_random_split/seed_42/trainer_state.json ADDED
@@ -0,0 +1,805 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 1.3212834596633911,
3
+ "best_model_checkpoint": "/data/bilingual-llms/sp_trained_GPT2_models_tiny/GPT2-tiny-baseline_random_split_42/checkpoint-50020",
4
+ "epoch": 20.0,
5
+ "global_step": 50020,
6
+ "is_hyper_param_search": false,
7
+ "is_local_process_zero": true,
8
+ "is_world_process_zero": true,
9
+ "log_history": [
10
+ {
11
+ "epoch": 0.2,
12
+ "learning_rate": 9.900039984006398e-05,
13
+ "loss": 4.5422,
14
+ "step": 500
15
+ },
16
+ {
17
+ "epoch": 0.4,
18
+ "learning_rate": 9.800079968012795e-05,
19
+ "loss": 2.9522,
20
+ "step": 1000
21
+ },
22
+ {
23
+ "epoch": 0.6,
24
+ "learning_rate": 9.700119952019193e-05,
25
+ "loss": 2.582,
26
+ "step": 1500
27
+ },
28
+ {
29
+ "epoch": 0.8,
30
+ "learning_rate": 9.60015993602559e-05,
31
+ "loss": 2.3702,
32
+ "step": 2000
33
+ },
34
+ {
35
+ "epoch": 1.0,
36
+ "learning_rate": 9.500199920031988e-05,
37
+ "loss": 2.2292,
38
+ "step": 2500
39
+ },
40
+ {
41
+ "epoch": 1.0,
42
+ "eval_accuracy": 0.5652453823042733,
43
+ "eval_loss": 2.0748958587646484,
44
+ "eval_runtime": 18.6567,
45
+ "eval_samples_per_second": 225.924,
46
+ "eval_steps_per_second": 7.075,
47
+ "step": 2501
48
+ },
49
+ {
50
+ "epoch": 1.2,
51
+ "learning_rate": 9.400239904038385e-05,
52
+ "loss": 2.1243,
53
+ "step": 3000
54
+ },
55
+ {
56
+ "epoch": 1.4,
57
+ "learning_rate": 9.300279888044783e-05,
58
+ "loss": 2.044,
59
+ "step": 3500
60
+ },
61
+ {
62
+ "epoch": 1.6,
63
+ "learning_rate": 9.20031987205118e-05,
64
+ "loss": 1.981,
65
+ "step": 4000
66
+ },
67
+ {
68
+ "epoch": 1.8,
69
+ "learning_rate": 9.100359856057577e-05,
70
+ "loss": 1.9328,
71
+ "step": 4500
72
+ },
73
+ {
74
+ "epoch": 2.0,
75
+ "learning_rate": 9.000399840063975e-05,
76
+ "loss": 1.8861,
77
+ "step": 5000
78
+ },
79
+ {
80
+ "epoch": 2.0,
81
+ "eval_accuracy": 0.6062813880974827,
82
+ "eval_loss": 1.7615596055984497,
83
+ "eval_runtime": 18.7962,
84
+ "eval_samples_per_second": 224.248,
85
+ "eval_steps_per_second": 7.023,
86
+ "step": 5002
87
+ },
88
+ {
89
+ "epoch": 2.2,
90
+ "learning_rate": 8.900439824070372e-05,
91
+ "loss": 1.8404,
92
+ "step": 5500
93
+ },
94
+ {
95
+ "epoch": 2.4,
96
+ "learning_rate": 8.80047980807677e-05,
97
+ "loss": 1.8093,
98
+ "step": 6000
99
+ },
100
+ {
101
+ "epoch": 2.6,
102
+ "learning_rate": 8.700519792083167e-05,
103
+ "loss": 1.7852,
104
+ "step": 6500
105
+ },
106
+ {
107
+ "epoch": 2.8,
108
+ "learning_rate": 8.600559776089565e-05,
109
+ "loss": 1.759,
110
+ "step": 7000
111
+ },
112
+ {
113
+ "epoch": 3.0,
114
+ "learning_rate": 8.500599760095962e-05,
115
+ "loss": 1.7362,
116
+ "step": 7500
117
+ },
118
+ {
119
+ "epoch": 3.0,
120
+ "eval_accuracy": 0.6261863265881175,
121
+ "eval_loss": 1.620674967765808,
122
+ "eval_runtime": 18.4687,
123
+ "eval_samples_per_second": 228.224,
124
+ "eval_steps_per_second": 7.147,
125
+ "step": 7503
126
+ },
127
+ {
128
+ "epoch": 3.2,
129
+ "learning_rate": 8.40063974410236e-05,
130
+ "loss": 1.7098,
131
+ "step": 8000
132
+ },
133
+ {
134
+ "epoch": 3.4,
135
+ "learning_rate": 8.300679728108757e-05,
136
+ "loss": 1.6939,
137
+ "step": 8500
138
+ },
139
+ {
140
+ "epoch": 3.6,
141
+ "learning_rate": 8.200719712115154e-05,
142
+ "loss": 1.6799,
143
+ "step": 9000
144
+ },
145
+ {
146
+ "epoch": 3.8,
147
+ "learning_rate": 8.100759696121552e-05,
148
+ "loss": 1.6631,
149
+ "step": 9500
150
+ },
151
+ {
152
+ "epoch": 4.0,
153
+ "learning_rate": 8.000799680127949e-05,
154
+ "loss": 1.6515,
155
+ "step": 10000
156
+ },
157
+ {
158
+ "epoch": 4.0,
159
+ "eval_accuracy": 0.6372365602993545,
160
+ "eval_loss": 1.5419366359710693,
161
+ "eval_runtime": 18.7362,
162
+ "eval_samples_per_second": 224.966,
163
+ "eval_steps_per_second": 7.045,
164
+ "step": 10004
165
+ },
166
+ {
167
+ "epoch": 4.2,
168
+ "learning_rate": 7.900839664134347e-05,
169
+ "loss": 1.6333,
170
+ "step": 10500
171
+ },
172
+ {
173
+ "epoch": 4.4,
174
+ "learning_rate": 7.800879648140744e-05,
175
+ "loss": 1.6238,
176
+ "step": 11000
177
+ },
178
+ {
179
+ "epoch": 4.6,
180
+ "learning_rate": 7.700919632147142e-05,
181
+ "loss": 1.6142,
182
+ "step": 11500
183
+ },
184
+ {
185
+ "epoch": 4.8,
186
+ "learning_rate": 7.600959616153539e-05,
187
+ "loss": 1.6057,
188
+ "step": 12000
189
+ },
190
+ {
191
+ "epoch": 5.0,
192
+ "learning_rate": 7.500999600159937e-05,
193
+ "loss": 1.5949,
194
+ "step": 12500
195
+ },
196
+ {
197
+ "epoch": 5.0,
198
+ "eval_accuracy": 0.6442308517386005,
199
+ "eval_loss": 1.4929462671279907,
200
+ "eval_runtime": 18.7703,
201
+ "eval_samples_per_second": 224.557,
202
+ "eval_steps_per_second": 7.032,
203
+ "step": 12505
204
+ },
205
+ {
206
+ "epoch": 5.2,
207
+ "learning_rate": 7.401039584166334e-05,
208
+ "loss": 1.5805,
209
+ "step": 13000
210
+ },
211
+ {
212
+ "epoch": 5.4,
213
+ "learning_rate": 7.301079568172731e-05,
214
+ "loss": 1.5782,
215
+ "step": 13500
216
+ },
217
+ {
218
+ "epoch": 5.6,
219
+ "learning_rate": 7.201119552179129e-05,
220
+ "loss": 1.5722,
221
+ "step": 14000
222
+ },
223
+ {
224
+ "epoch": 5.8,
225
+ "learning_rate": 7.101159536185526e-05,
226
+ "loss": 1.5624,
227
+ "step": 14500
228
+ },
229
+ {
230
+ "epoch": 6.0,
231
+ "learning_rate": 7.001199520191924e-05,
232
+ "loss": 1.5564,
233
+ "step": 15000
234
+ },
235
+ {
236
+ "epoch": 6.0,
237
+ "eval_accuracy": 0.6498308767853023,
238
+ "eval_loss": 1.4557212591171265,
239
+ "eval_runtime": 18.7359,
240
+ "eval_samples_per_second": 224.97,
241
+ "eval_steps_per_second": 7.045,
242
+ "step": 15006
243
+ },
244
+ {
245
+ "epoch": 6.2,
246
+ "learning_rate": 6.901239504198321e-05,
247
+ "loss": 1.545,
248
+ "step": 15500
249
+ },
250
+ {
251
+ "epoch": 6.4,
252
+ "learning_rate": 6.801279488204719e-05,
253
+ "loss": 1.542,
254
+ "step": 16000
255
+ },
256
+ {
257
+ "epoch": 6.6,
258
+ "learning_rate": 6.701319472211116e-05,
259
+ "loss": 1.5351,
260
+ "step": 16500
261
+ },
262
+ {
263
+ "epoch": 6.8,
264
+ "learning_rate": 6.601359456217513e-05,
265
+ "loss": 1.5331,
266
+ "step": 17000
267
+ },
268
+ {
269
+ "epoch": 7.0,
270
+ "learning_rate": 6.501399440223911e-05,
271
+ "loss": 1.5317,
272
+ "step": 17500
273
+ },
274
+ {
275
+ "epoch": 7.0,
276
+ "eval_accuracy": 0.653854583024598,
277
+ "eval_loss": 1.4292062520980835,
278
+ "eval_runtime": 18.5593,
279
+ "eval_samples_per_second": 227.109,
280
+ "eval_steps_per_second": 7.112,
281
+ "step": 17507
282
+ },
283
+ {
284
+ "epoch": 7.2,
285
+ "learning_rate": 6.401439424230308e-05,
286
+ "loss": 1.52,
287
+ "step": 18000
288
+ },
289
+ {
290
+ "epoch": 7.4,
291
+ "learning_rate": 6.301479408236706e-05,
292
+ "loss": 1.5147,
293
+ "step": 18500
294
+ },
295
+ {
296
+ "epoch": 7.6,
297
+ "learning_rate": 6.201519392243102e-05,
298
+ "loss": 1.5117,
299
+ "step": 19000
300
+ },
301
+ {
302
+ "epoch": 7.8,
303
+ "learning_rate": 6.101559376249501e-05,
304
+ "loss": 1.509,
305
+ "step": 19500
306
+ },
307
+ {
308
+ "epoch": 8.0,
309
+ "learning_rate": 6.001599360255898e-05,
310
+ "loss": 1.504,
311
+ "step": 20000
312
+ },
313
+ {
314
+ "epoch": 8.0,
315
+ "eval_accuracy": 0.6569471549382008,
316
+ "eval_loss": 1.4085054397583008,
317
+ "eval_runtime": 18.6672,
318
+ "eval_samples_per_second": 225.798,
319
+ "eval_steps_per_second": 7.071,
320
+ "step": 20008
321
+ },
322
+ {
323
+ "epoch": 8.2,
324
+ "learning_rate": 5.9016393442622956e-05,
325
+ "loss": 1.4958,
326
+ "step": 20500
327
+ },
328
+ {
329
+ "epoch": 8.4,
330
+ "learning_rate": 5.801679328268693e-05,
331
+ "loss": 1.4933,
332
+ "step": 21000
333
+ },
334
+ {
335
+ "epoch": 8.6,
336
+ "learning_rate": 5.70171931227509e-05,
337
+ "loss": 1.4928,
338
+ "step": 21500
339
+ },
340
+ {
341
+ "epoch": 8.8,
342
+ "learning_rate": 5.601759296281488e-05,
343
+ "loss": 1.4889,
344
+ "step": 22000
345
+ },
346
+ {
347
+ "epoch": 9.0,
348
+ "learning_rate": 5.5017992802878847e-05,
349
+ "loss": 1.4864,
350
+ "step": 22500
351
+ },
352
+ {
353
+ "epoch": 9.0,
354
+ "eval_accuracy": 0.6594293294557328,
355
+ "eval_loss": 1.3925750255584717,
356
+ "eval_runtime": 18.519,
357
+ "eval_samples_per_second": 227.605,
358
+ "eval_steps_per_second": 7.128,
359
+ "step": 22509
360
+ },
361
+ {
362
+ "epoch": 9.2,
363
+ "learning_rate": 5.401839264294283e-05,
364
+ "loss": 1.4798,
365
+ "step": 23000
366
+ },
367
+ {
368
+ "epoch": 9.4,
369
+ "learning_rate": 5.3018792483006795e-05,
370
+ "loss": 1.4769,
371
+ "step": 23500
372
+ },
373
+ {
374
+ "epoch": 9.6,
375
+ "learning_rate": 5.2019192323070777e-05,
376
+ "loss": 1.4755,
377
+ "step": 24000
378
+ },
379
+ {
380
+ "epoch": 9.8,
381
+ "learning_rate": 5.1019592163134744e-05,
382
+ "loss": 1.4718,
383
+ "step": 24500
384
+ },
385
+ {
386
+ "epoch": 10.0,
387
+ "learning_rate": 5.0019992003198725e-05,
388
+ "loss": 1.4699,
389
+ "step": 25000
390
+ },
391
+ {
392
+ "epoch": 10.0,
393
+ "eval_accuracy": 0.6614544016679248,
394
+ "eval_loss": 1.3797509670257568,
395
+ "eval_runtime": 18.6231,
396
+ "eval_samples_per_second": 226.332,
397
+ "eval_steps_per_second": 7.088,
398
+ "step": 25010
399
+ },
400
+ {
401
+ "epoch": 10.2,
402
+ "learning_rate": 4.90203918432627e-05,
403
+ "loss": 1.4641,
404
+ "step": 25500
405
+ },
406
+ {
407
+ "epoch": 10.4,
408
+ "learning_rate": 4.8020791683326674e-05,
409
+ "loss": 1.4625,
410
+ "step": 26000
411
+ },
412
+ {
413
+ "epoch": 10.6,
414
+ "learning_rate": 4.702119152339065e-05,
415
+ "loss": 1.4598,
416
+ "step": 26500
417
+ },
418
+ {
419
+ "epoch": 10.8,
420
+ "learning_rate": 4.6021591363454616e-05,
421
+ "loss": 1.4584,
422
+ "step": 27000
423
+ },
424
+ {
425
+ "epoch": 11.0,
426
+ "learning_rate": 4.502199120351859e-05,
427
+ "loss": 1.4599,
428
+ "step": 27500
429
+ },
430
+ {
431
+ "epoch": 11.0,
432
+ "eval_accuracy": 0.6634159294703434,
433
+ "eval_loss": 1.3681137561798096,
434
+ "eval_runtime": 18.5036,
435
+ "eval_samples_per_second": 227.794,
436
+ "eval_steps_per_second": 7.134,
437
+ "step": 27511
438
+ },
439
+ {
440
+ "epoch": 11.2,
441
+ "learning_rate": 4.4022391043582565e-05,
442
+ "loss": 1.452,
443
+ "step": 28000
444
+ },
445
+ {
446
+ "epoch": 11.4,
447
+ "learning_rate": 4.302279088364654e-05,
448
+ "loss": 1.4486,
449
+ "step": 28500
450
+ },
451
+ {
452
+ "epoch": 11.6,
453
+ "learning_rate": 4.202319072371052e-05,
454
+ "loss": 1.4501,
455
+ "step": 29000
456
+ },
457
+ {
458
+ "epoch": 11.8,
459
+ "learning_rate": 4.1023590563774495e-05,
460
+ "loss": 1.4494,
461
+ "step": 29500
462
+ },
463
+ {
464
+ "epoch": 12.0,
465
+ "learning_rate": 4.002399040383847e-05,
466
+ "loss": 1.4442,
467
+ "step": 30000
468
+ },
469
+ {
470
+ "epoch": 12.0,
471
+ "eval_accuracy": 0.6648405765843488,
472
+ "eval_loss": 1.3584463596343994,
473
+ "eval_runtime": 18.4605,
474
+ "eval_samples_per_second": 228.325,
475
+ "eval_steps_per_second": 7.15,
476
+ "step": 30012
477
+ },
478
+ {
479
+ "epoch": 12.2,
480
+ "learning_rate": 3.9024390243902444e-05,
481
+ "loss": 1.4402,
482
+ "step": 30500
483
+ },
484
+ {
485
+ "epoch": 12.4,
486
+ "learning_rate": 3.802479008396642e-05,
487
+ "loss": 1.4392,
488
+ "step": 31000
489
+ },
490
+ {
491
+ "epoch": 12.59,
492
+ "learning_rate": 3.702518992403039e-05,
493
+ "loss": 1.4389,
494
+ "step": 31500
495
+ },
496
+ {
497
+ "epoch": 12.79,
498
+ "learning_rate": 3.602558976409437e-05,
499
+ "loss": 1.4402,
500
+ "step": 32000
501
+ },
502
+ {
503
+ "epoch": 12.99,
504
+ "learning_rate": 3.5025989604158335e-05,
505
+ "loss": 1.436,
506
+ "step": 32500
507
+ },
508
+ {
509
+ "epoch": 13.0,
510
+ "eval_accuracy": 0.6663347978696389,
511
+ "eval_loss": 1.3500910997390747,
512
+ "eval_runtime": 18.6729,
513
+ "eval_samples_per_second": 225.728,
514
+ "eval_steps_per_second": 7.069,
515
+ "step": 32513
516
+ },
517
+ {
518
+ "epoch": 13.19,
519
+ "learning_rate": 3.402638944422231e-05,
520
+ "loss": 1.4311,
521
+ "step": 33000
522
+ },
523
+ {
524
+ "epoch": 13.39,
525
+ "learning_rate": 3.3026789284286284e-05,
526
+ "loss": 1.4303,
527
+ "step": 33500
528
+ },
529
+ {
530
+ "epoch": 13.59,
531
+ "learning_rate": 3.202718912435026e-05,
532
+ "loss": 1.4307,
533
+ "step": 34000
534
+ },
535
+ {
536
+ "epoch": 13.79,
537
+ "learning_rate": 3.102758896441423e-05,
538
+ "loss": 1.4289,
539
+ "step": 34500
540
+ },
541
+ {
542
+ "epoch": 13.99,
543
+ "learning_rate": 3.0027988804478207e-05,
544
+ "loss": 1.4306,
545
+ "step": 35000
546
+ },
547
+ {
548
+ "epoch": 14.0,
549
+ "eval_accuracy": 0.6675748415158357,
550
+ "eval_loss": 1.3431888818740845,
551
+ "eval_runtime": 18.3888,
552
+ "eval_samples_per_second": 229.215,
553
+ "eval_steps_per_second": 7.178,
554
+ "step": 35014
555
+ },
556
+ {
557
+ "epoch": 14.19,
558
+ "learning_rate": 2.9028388644542188e-05,
559
+ "loss": 1.4227,
560
+ "step": 35500
561
+ },
562
+ {
563
+ "epoch": 14.39,
564
+ "learning_rate": 2.8028788484606162e-05,
565
+ "loss": 1.4246,
566
+ "step": 36000
567
+ },
568
+ {
569
+ "epoch": 14.59,
570
+ "learning_rate": 2.7029188324670133e-05,
571
+ "loss": 1.4261,
572
+ "step": 36500
573
+ },
574
+ {
575
+ "epoch": 14.79,
576
+ "learning_rate": 2.6029588164734108e-05,
577
+ "loss": 1.4206,
578
+ "step": 37000
579
+ },
580
+ {
581
+ "epoch": 14.99,
582
+ "learning_rate": 2.5029988004798082e-05,
583
+ "loss": 1.4202,
584
+ "step": 37500
585
+ },
586
+ {
587
+ "epoch": 15.0,
588
+ "eval_accuracy": 0.6686219327936697,
589
+ "eval_loss": 1.3371825218200684,
590
+ "eval_runtime": 18.6603,
591
+ "eval_samples_per_second": 225.881,
592
+ "eval_steps_per_second": 7.074,
593
+ "step": 37515
594
+ },
595
+ {
596
+ "epoch": 15.19,
597
+ "learning_rate": 2.4030387844862057e-05,
598
+ "loss": 1.4161,
599
+ "step": 38000
600
+ },
601
+ {
602
+ "epoch": 15.39,
603
+ "learning_rate": 2.303078768492603e-05,
604
+ "loss": 1.4165,
605
+ "step": 38500
606
+ },
607
+ {
608
+ "epoch": 15.59,
609
+ "learning_rate": 2.2031187524990005e-05,
610
+ "loss": 1.4179,
611
+ "step": 39000
612
+ },
613
+ {
614
+ "epoch": 15.79,
615
+ "learning_rate": 2.103158736505398e-05,
616
+ "loss": 1.4145,
617
+ "step": 39500
618
+ },
619
+ {
620
+ "epoch": 15.99,
621
+ "learning_rate": 2.003198720511795e-05,
622
+ "loss": 1.4172,
623
+ "step": 40000
624
+ },
625
+ {
626
+ "epoch": 16.0,
627
+ "eval_accuracy": 0.6693617381483298,
628
+ "eval_loss": 1.3332273960113525,
629
+ "eval_runtime": 18.6708,
630
+ "eval_samples_per_second": 225.754,
631
+ "eval_steps_per_second": 7.07,
632
+ "step": 40016
633
+ },
634
+ {
635
+ "epoch": 16.19,
636
+ "learning_rate": 1.903238704518193e-05,
637
+ "loss": 1.4118,
638
+ "step": 40500
639
+ },
640
+ {
641
+ "epoch": 16.39,
642
+ "learning_rate": 1.8032786885245903e-05,
643
+ "loss": 1.41,
644
+ "step": 41000
645
+ },
646
+ {
647
+ "epoch": 16.59,
648
+ "learning_rate": 1.7033186725309878e-05,
649
+ "loss": 1.4086,
650
+ "step": 41500
651
+ },
652
+ {
653
+ "epoch": 16.79,
654
+ "learning_rate": 1.6033586565373852e-05,
655
+ "loss": 1.4117,
656
+ "step": 42000
657
+ },
658
+ {
659
+ "epoch": 16.99,
660
+ "learning_rate": 1.5033986405437825e-05,
661
+ "loss": 1.4126,
662
+ "step": 42500
663
+ },
664
+ {
665
+ "epoch": 17.0,
666
+ "eval_accuracy": 0.6700233885172469,
667
+ "eval_loss": 1.3284056186676025,
668
+ "eval_runtime": 18.5064,
669
+ "eval_samples_per_second": 227.759,
670
+ "eval_steps_per_second": 7.133,
671
+ "step": 42517
672
+ },
673
+ {
674
+ "epoch": 17.19,
675
+ "learning_rate": 1.4034386245501799e-05,
676
+ "loss": 1.407,
677
+ "step": 43000
678
+ },
679
+ {
680
+ "epoch": 17.39,
681
+ "learning_rate": 1.3034786085565775e-05,
682
+ "loss": 1.4052,
683
+ "step": 43500
684
+ },
685
+ {
686
+ "epoch": 17.59,
687
+ "learning_rate": 1.2035185925629748e-05,
688
+ "loss": 1.4073,
689
+ "step": 44000
690
+ },
691
+ {
692
+ "epoch": 17.79,
693
+ "learning_rate": 1.1035585765693724e-05,
694
+ "loss": 1.4054,
695
+ "step": 44500
696
+ },
697
+ {
698
+ "epoch": 17.99,
699
+ "learning_rate": 1.0035985605757697e-05,
700
+ "loss": 1.407,
701
+ "step": 45000
702
+ },
703
+ {
704
+ "epoch": 18.0,
705
+ "eval_accuracy": 0.6706289157213277,
706
+ "eval_loss": 1.325285792350769,
707
+ "eval_runtime": 18.4328,
708
+ "eval_samples_per_second": 228.669,
709
+ "eval_steps_per_second": 7.161,
710
+ "step": 45018
711
+ },
712
+ {
713
+ "epoch": 18.19,
714
+ "learning_rate": 9.036385445821671e-06,
715
+ "loss": 1.4025,
716
+ "step": 45500
717
+ },
718
+ {
719
+ "epoch": 18.39,
720
+ "learning_rate": 8.036785285885647e-06,
721
+ "loss": 1.4037,
722
+ "step": 46000
723
+ },
724
+ {
725
+ "epoch": 18.59,
726
+ "learning_rate": 7.037185125949621e-06,
727
+ "loss": 1.4028,
728
+ "step": 46500
729
+ },
730
+ {
731
+ "epoch": 18.79,
732
+ "learning_rate": 6.037584966013595e-06,
733
+ "loss": 1.4028,
734
+ "step": 47000
735
+ },
736
+ {
737
+ "epoch": 18.99,
738
+ "learning_rate": 5.037984806077569e-06,
739
+ "loss": 1.4015,
740
+ "step": 47500
741
+ },
742
+ {
743
+ "epoch": 19.0,
744
+ "eval_accuracy": 0.6710941350133176,
745
+ "eval_loss": 1.3228946924209595,
746
+ "eval_runtime": 18.6,
747
+ "eval_samples_per_second": 226.613,
748
+ "eval_steps_per_second": 7.097,
749
+ "step": 47519
750
+ },
751
+ {
752
+ "epoch": 19.19,
753
+ "learning_rate": 4.038384646141544e-06,
754
+ "loss": 1.3991,
755
+ "step": 48000
756
+ },
757
+ {
758
+ "epoch": 19.39,
759
+ "learning_rate": 3.038784486205518e-06,
760
+ "loss": 1.4003,
761
+ "step": 48500
762
+ },
763
+ {
764
+ "epoch": 19.59,
765
+ "learning_rate": 2.0391843262694924e-06,
766
+ "loss": 1.4008,
767
+ "step": 49000
768
+ },
769
+ {
770
+ "epoch": 19.79,
771
+ "learning_rate": 1.0395841663334666e-06,
772
+ "loss": 1.3996,
773
+ "step": 49500
774
+ },
775
+ {
776
+ "epoch": 19.99,
777
+ "learning_rate": 3.9984006397441025e-08,
778
+ "loss": 1.3983,
779
+ "step": 50000
780
+ },
781
+ {
782
+ "epoch": 20.0,
783
+ "eval_accuracy": 0.6714253080686327,
784
+ "eval_loss": 1.3212834596633911,
785
+ "eval_runtime": 18.5709,
786
+ "eval_samples_per_second": 226.967,
787
+ "eval_steps_per_second": 7.108,
788
+ "step": 50020
789
+ },
790
+ {
791
+ "epoch": 20.0,
792
+ "step": 50020,
793
+ "total_flos": 3.106082471804928e+16,
794
+ "train_loss": 1.5915360271906862,
795
+ "train_runtime": 5537.1072,
796
+ "train_samples_per_second": 288.97,
797
+ "train_steps_per_second": 9.034
798
+ }
799
+ ],
800
+ "max_steps": 50020,
801
+ "num_train_epochs": 20,
802
+ "total_flos": 3.106082471804928e+16,
803
+ "trial_name": null,
804
+ "trial_params": null
805
+ }
baseline_random_split/seed_42/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e9ca74b0065a0b2208dac501312fff513c9168ffff9876f21ab93864426a6f4
3
+ size 4881
baseline_random_split/seed_42/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/anaphor_agreement/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/argument_structure/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/binding/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/case_subjective_pronoun/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/determiner_noun_agreement/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/ellipsis/eval_results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"eval_accuracy": 0.4838709677419355, "per_example_results": [{"pred": "Sarah visited one change and Mark visited more fixed.", "target": "Sarah visited one fixed change and Mark visited more."}, {"pred": "the doctor got one bible and Roger got a lot more positive.", "target": "the doctor got one positive bible and Roger got a lot more."}, {"pred": "Alexander got one equipment and Roger got two worn.", "target": "Alexander got one worn equipment and Roger got two."}, {"pred": "Roger married one track and Alexander married a lot more recommended.", "target": "Roger married one recommended track and Alexander married a lot more."}, {"pred": "some wolf moved one sweetie and Sarah moved several kind.", "target": "some wolf moved one kind sweetie and Sarah moved several."}, {"pred": "her dinosaur entered one bible and Mark entered several carbon.", "target": "her dinosaur entered one carbon bible and Mark entered several."}, {"pred": "your dinosaur married one gate and Roger married a lot more positive.", "target": "your dinosaur married one positive gate and Roger married a lot more."}, {"pred": "this doctor entered one complete pattern and Roger entered a lot more.", "target": "this doctor entered one complete pattern and Roger entered a lot more."}, {"pred": "Mark broke one personal pattern and Sarah broke more.", "target": "Mark broke one personal pattern and Sarah broke more."}, {"pred": "her pig entered one electronic dog and Alexander entered two.", "target": "her pig entered one electronic dog and Alexander entered two."}, {"pred": "the sister managed one bad whale and Mark managed several.", "target": "the sister managed one bad whale and Mark managed several."}, {"pred": "the wolf started one needed fire and Roger started three.", "target": "the wolf started one needed fire and Roger started three."}, {"pred": "the dinosaur visited one rolling hole and Roger visited several.", "target": "the dinosaur visited one rolling hole and Roger visited several."}, {"pred": "his sister moved one stand and Alexander moved more red.", "target": "his sister moved one red stand and Alexander moved more."}, {"pred": "some doctor visited one gate and Roger visited two purple.", "target": "some doctor visited one purple gate and Roger visited two."}, {"pred": "Alexander started one ready protection and Mark started two.", "target": "Alexander started one ready protection and Mark started two."}, {"pred": "Sarah broke one morning and Roger broke several electronic.", "target": "Sarah broke one electronic morning and Roger broke several."}, {"pred": "a slave entered one red equipment and Sarah entered three.", "target": "a slave entered one red equipment and Sarah entered three."}, {"pred": "Sarah broke one canal and Mark broke three red.", "target": "Sarah broke one red canal and Mark broke three."}, {"pred": "Alexander visited one duck and Sarah visited three top.", "target": "Alexander visited one top duck and Sarah visited three."}, {"pred": "Mark managed one positive electricity and Sarah managed two.", "target": "Mark managed one positive electricity and Sarah managed two."}, {"pred": "her duke moved one silly whale and Alexander moved three.", "target": "her duke moved one silly whale and Alexander moved three."}, {"pred": "Alexander managed one good sign and Alexander managed more.", "target": "Alexander managed one good sign and Alexander managed more."}, {"pred": "your wolf married one mail and Roger married three polar.", "target": "your wolf married one polar mail and Roger married three."}, {"pred": "Roger carried one purple mail and Roger carried several.", "target": "Roger carried one purple mail and Roger carried several."}, {"pred": "her pig broke one white fire and Alexander broke two.", "target": "her pig broke one white fire and Alexander broke two."}, {"pred": "Alexander moved one parent and Alexander moved more hard.", "target": "Alexander moved one hard parent and Alexander moved more."}, {"pred": "a wolf broke one morning and Roger broke several electronic.", "target": "a wolf broke one electronic morning and Roger broke several."}, {"pred": "a doctor carried one poor change and Alexander carried three.", "target": "a doctor carried one poor change and Alexander carried three."}, {"pred": "this wolf fixed one medicine and Sarah fixed three winning.", "target": "this wolf fixed one winning medicine and Sarah fixed three."}, {"pred": "your duke entered one bet and Alexander entered three english.", "target": "your duke entered one english bet and Alexander entered three."}, {"pred": "some pig started one good chicken and Alexander started more.", "target": "some pig started one good chicken and Alexander started more."}, {"pred": "Alexander got one heaven and Roger got two winning.", "target": "Alexander got one winning heaven and Roger got two."}, {"pred": "Alexander visited one spin and Alexander visited several carbon.", "target": "Alexander visited one carbon spin and Alexander visited several."}, {"pred": "that boat fixed one soft discussion and Roger fixed several.", "target": "that boat fixed one soft discussion and Roger fixed several."}, {"pred": "Mark managed one track and Alexander managed more white.", "target": "Mark managed one white track and Alexander managed more."}, {"pred": "Alexander entered one bus and Sarah entered three worn.", "target": "Alexander entered one worn bus and Sarah entered three."}, {"pred": "Roger broke one yellow dog and Sarah broke a lot more.", "target": "Roger broke one yellow dog and Sarah broke a lot more."}, {"pred": "the pig started one needed college and Sarah started two.", "target": "the pig started one needed college and Sarah started two."}, {"pred": "your pig broke one quick parent and Mark broke several.", "target": "your pig broke one quick parent and Mark broke several."}, {"pred": "the dinosaur got one healthy pool and Roger got several.", "target": "the dinosaur got one healthy pool and Roger got several."}, {"pred": "some wolf fixed one polar gate and Alexander fixed a lot more.", "target": "some wolf fixed one polar gate and Alexander fixed a lot more."}, {"pred": "his sister moved one hard protection and Alexander moved several.", "target": "his sister moved one hard protection and Alexander moved several."}, {"pred": "the dinosaur started one sacred pattern and Alexander started two.", "target": "the dinosaur started one sacred pattern and Alexander started two."}, {"pred": "Mark started one heaven and Alexander started more abandoned.", "target": "Mark started one abandoned heaven and Alexander started more."}, {"pred": "that doctor visited one whale and Mark visited two early.", "target": "that doctor visited one early whale and Mark visited two."}, {"pred": "her duke moved one extra electricity and Sarah moved two.", "target": "her duke moved one extra electricity and Sarah moved two."}, {"pred": "Sarah broke one personal college and Sarah broke several.", "target": "Sarah broke one personal college and Sarah broke several."}, {"pred": "Roger managed one white bible and Sarah managed two.", "target": "Roger managed one white bible and Sarah managed two."}, {"pred": "some dinosaur broke one soft canal and Alexander broke several.", "target": "some dinosaur broke one soft canal and Alexander broke several."}, {"pred": "Sarah carried one red mail and Alexander carried two.", "target": "Sarah carried one red mail and Alexander carried two."}, {"pred": "Roger got one bath and Roger got three purple.", "target": "Roger got one purple bath and Roger got three."}, {"pred": "Mark fixed one worn canal and Roger fixed more.", "target": "Mark fixed one worn canal and Roger fixed more."}, {"pred": "Sarah carried one image and Roger carried several polar.", "target": "Sarah carried one polar image and Roger carried several."}, {"pred": "some dinosaur entered one dance and Sarah entered more top.", "target": "some dinosaur entered one top dance and Sarah entered more."}, {"pred": "this dinosaur started one heaven and Sarah started more simple.", "target": "this dinosaur started one simple heaven and Sarah started more."}, {"pred": "your doctor visited one change and Mark visited more fixed.", "target": "your doctor visited one fixed change and Mark visited more."}, {"pred": "the slave moved one leg and Sarah moved a lot more abandoned.", "target": "the slave moved one abandoned leg and Sarah moved a lot more."}, {"pred": "a duke visited one spin and Alexander visited several carbon.", "target": "a duke visited one carbon spin and Alexander visited several."}, {"pred": "some slave visited one discussion and Sarah visited more kind.", "target": "some slave visited one kind discussion and Sarah visited more."}, {"pred": "her pig entered one hole and Alexander entered a lot more healthy.", "target": "her pig entered one healthy hole and Alexander entered a lot more."}, {"pred": "her sister carried one rolling essay and Mark carried two.", "target": "her sister carried one rolling essay and Mark carried two."}, {"pred": "a duke managed one ear and Sarah managed more carbon.", "target": "a duke managed one carbon ear and Sarah managed more."}, {"pred": "a duke carried one bad essay and Alexander carried several.", "target": "a duke carried one bad essay and Alexander carried several."}, {"pred": "this sister entered one polar distance and Roger entered several.", "target": "this sister entered one polar distance and Roger entered several."}, {"pred": "some pig managed one white track and Alexander managed more.", "target": "some pig managed one white track and Alexander managed more."}, {"pred": "this dinosaur fixed one electronic bus and Sarah fixed two.", "target": "this dinosaur fixed one electronic bus and Sarah fixed two."}, {"pred": "her dinosaur broke one personal tail and Roger broke three.", "target": "her dinosaur broke one personal tail and Roger broke three."}, {"pred": "her doctor started one clothing and Alexander started three kind.", "target": "her doctor started one kind clothing and Alexander started three."}, {"pred": "this slave married one full bath and Roger married three.", "target": "this slave married one full bath and Roger married three."}, {"pred": "Sarah got one extra pool and Roger got two.", "target": "Sarah got one extra pool and Roger got two."}, {"pred": "a slave married one recommended track and Alexander married a lot more.", "target": "a slave married one recommended track and Alexander married a lot more."}, {"pred": "this wolf got one extra pool and Roger got two.", "target": "this wolf got one extra pool and Roger got two."}, {"pred": "some slave entered one telephone and Alexander entered a lot more complete.", "target": "some slave entered one complete telephone and Alexander entered a lot more."}, {"pred": "this duke married one stand and Mark married two contemporary.", "target": "this duke married one contemporary stand and Mark married two."}, {"pred": "your doctor broke one canal and Mark broke three red.", "target": "your doctor broke one red canal and Mark broke three."}, {"pred": "Alexander carried one clothing and Sarah carried several recommended.", "target": "Alexander carried one recommended clothing and Sarah carried several."}, {"pred": "her slave fixed one bath and Alexander fixed two polar.", "target": "her slave fixed one polar bath and Alexander fixed two."}, {"pred": "a sister visited one spin and Roger visited two kind.", "target": "a sister visited one kind spin and Roger visited two."}, {"pred": "Alexander started one girl and Alexander started two silly.", "target": "Alexander started one silly girl and Alexander started two."}, {"pred": "the slave got one complete speak and Roger got two.", "target": "the slave got one complete speak and Roger got two."}, {"pred": "his duke carried one contemporary pattern and Mark carried two.", "target": "his duke carried one contemporary pattern and Mark carried two."}, {"pred": "your pig visited one poor god and Mark visited more.", "target": "your pig visited one poor god and Mark visited more."}, {"pred": "that slave entered one needed electricity and Sarah entered more.", "target": "that slave entered one needed electricity and Sarah entered more."}, {"pred": "this dinosaur broke one college and Sarah broke several early.", "target": "this dinosaur broke one early college and Sarah broke several."}, {"pred": "your boat fixed one floor and Roger fixed several forced.", "target": "your boat fixed one forced floor and Roger fixed several."}, {"pred": "some pig started one recommended ear and Roger started more.", "target": "some pig started one recommended ear and Roger started more."}, {"pred": "Alexander managed one bad whale and Mark managed several.", "target": "Alexander managed one bad whale and Mark managed several."}, {"pred": "Roger managed one pool and Sarah managed a lot more english.", "target": "Roger managed one english pool and Sarah managed a lot more."}, {"pred": "that wolf married one poor track and Mark married several.", "target": "that wolf married one poor track and Mark married several."}, {"pred": "Roger fixed one polar bath and Alexander fixed two.", "target": "Roger fixed one polar bath and Alexander fixed two."}, {"pred": "a wolf married one hole and Sarah married more healthy.", "target": "a wolf married one healthy hole and Sarah married more."}, {"pred": "Mark started one ear and Roger started more recommended.", "target": "Mark started one recommended ear and Roger started more."}, {"pred": "some slave entered one parent and Roger entered several polar.", "target": "some slave entered one polar parent and Roger entered several."}, {"pred": "his slave broke one ride and Sarah broke more expected.", "target": "his slave broke one expected ride and Sarah broke more."}, {"pred": "his duke moved one electronic telephone and Mark moved more.", "target": "his duke moved one electronic telephone and Mark moved more."}, {"pred": "her pig married one quick track and Sarah married two.", "target": "her pig married one quick track and Sarah married two."}, {"pred": "the slave fixed one gate and Sarah fixed several summer.", "target": "the slave fixed one summer gate and Sarah fixed several."}, {"pred": "some doctor started one pain and Sarah started three abandoned.", "target": "some doctor started one abandoned pain and Sarah started three."}, {"pred": "some boat moved one worn heaven and Alexander moved several.", "target": "some boat moved one worn heaven and Alexander moved several."}, {"pred": "Roger got one fire and Roger got several carbon.", "target": "Roger got one carbon fire and Roger got several."}, {"pred": "Mark moved one contemporary bath and Roger moved a lot more.", "target": "Mark moved one contemporary bath and Roger moved a lot more."}, {"pred": "Roger carried one essay and Alexander carried three needed.", "target": "Roger carried one needed essay and Alexander carried three."}, {"pred": "the sister married one poor chicken and Roger married three.", "target": "the sister married one poor chicken and Roger married three."}, {"pred": "Sarah got one essay and Roger got two summer.", "target": "Sarah got one summer essay and Roger got two."}, {"pred": "Mark visited one whale and Mark visited two early.", "target": "Mark visited one early whale and Mark visited two."}, {"pred": "her pig married one sacred gate and Roger married several.", "target": "her pig married one sacred gate and Roger married several."}, {"pred": "this duke married one essay and Sarah married a lot more expected.", "target": "this duke married one expected essay and Sarah married a lot more."}, {"pred": "Sarah managed one personal leg and Mark managed three.", "target": "Sarah managed one personal leg and Mark managed three."}, {"pred": "some dinosaur carried one leg and Alexander carried more purple.", "target": "some dinosaur carried one purple leg and Alexander carried more."}, {"pred": "that boat managed one change and Mark managed several winning.", "target": "that boat managed one winning change and Mark managed several."}, {"pred": "Mark started one pain and Sarah started three abandoned.", "target": "Mark started one abandoned pain and Sarah started three."}, {"pred": "Alexander fixed one floor and Roger fixed several forced.", "target": "Alexander fixed one forced floor and Roger fixed several."}, {"pred": "Mark managed one college and Mark managed two english.", "target": "Mark managed one english college and Mark managed two."}, {"pred": "his slave visited one positive god and Sarah visited several.", "target": "his slave visited one positive god and Sarah visited several."}, {"pred": "her wolf managed one pool and Sarah managed a lot more english.", "target": "her wolf managed one english pool and Sarah managed a lot more."}, {"pred": "her doctor got one electricity and Mark got a lot more worn.", "target": "her doctor got one worn electricity and Mark got a lot more."}, {"pred": "that sister married one gate and Roger married a lot more electronic.", "target": "that sister married one electronic gate and Roger married a lot more."}, {"pred": "Sarah broke one duck and Alexander broke two winning.", "target": "Sarah broke one winning duck and Alexander broke two."}, {"pred": "his sister married one healthy clothing and Roger married more.", "target": "his sister married one healthy clothing and Roger married more."}, {"pred": "the slave visited one essay and Alexander visited two worn.", "target": "the slave visited one worn essay and Alexander visited two."}, {"pred": "your pig fixed one dance and Sarah fixed a lot more carbon.", "target": "your pig fixed one carbon dance and Sarah fixed a lot more."}, {"pred": "this pig married one sweetie and Sarah married several ready.", "target": "this pig married one ready sweetie and Sarah married several."}, {"pred": "this wolf moved one sweetie and Sarah moved a lot more tall.", "target": "this wolf moved one tall sweetie and Sarah moved a lot more."}, {"pred": "that wolf got one god and Roger got two filled.", "target": "that wolf got one filled god and Roger got two."}, {"pred": "this doctor got one last sign and Sarah got a lot more.", "target": "this doctor got one last sign and Sarah got a lot more."}, {"pred": "Roger started one clothing and Alexander started three kind.", "target": "Roger started one kind clothing and Alexander started three."}, {"pred": "Sarah married one track and Roger married several early.", "target": "Sarah married one early track and Roger married several."}, {"pred": "Roger fixed one yellow distance and Alexander fixed several.", "target": "Roger fixed one yellow distance and Alexander fixed several."}, {"pred": "Roger entered one red equipment and Sarah entered three.", "target": "Roger entered one red equipment and Sarah entered three."}, {"pred": "some slave started one soft ear and Mark started a lot more.", "target": "some slave started one soft ear and Mark started a lot more."}, {"pred": "your duke visited one girl and Alexander visited several expected.", "target": "your duke visited one expected girl and Alexander visited several."}, {"pred": "Roger got one next essay and Roger got a lot more.", "target": "Roger got one next essay and Roger got a lot more."}, {"pred": "a slave started one chicken and Mark started two winning.", "target": "a slave started one winning chicken and Mark started two."}, {"pred": "his wolf started one medicine and Sarah started two red.", "target": "his wolf started one red medicine and Sarah started two."}, {"pred": "a wolf broke one essay and Alexander broke more close.", "target": "a wolf broke one close essay and Alexander broke more."}, {"pred": "her sister entered one circle and Mark entered several finished.", "target": "her sister entered one finished circle and Mark entered several."}, {"pred": "Mark started one fire and Roger started three needed.", "target": "Mark started one needed fire and Roger started three."}, {"pred": "the duke fixed one hole and Roger fixed two close.", "target": "the duke fixed one close hole and Roger fixed two."}, {"pred": "Sarah fixed one fire and Sarah fixed more top.", "target": "Sarah fixed one top fire and Sarah fixed more."}, {"pred": "that pig broke one yellow dog and Sarah broke a lot more.", "target": "that pig broke one yellow dog and Sarah broke a lot more."}, {"pred": "the pig carried one white pain and Sarah carried more.", "target": "the pig carried one white pain and Sarah carried more."}, {"pred": "that doctor broke one bet and Alexander broke a lot more ordered.", "target": "that doctor broke one ordered bet and Alexander broke a lot more."}, {"pred": "Roger visited one dance and Mark visited several filled.", "target": "Roger visited one filled dance and Mark visited several."}, {"pred": "a boat managed one extra spin and Sarah managed two.", "target": "a boat managed one extra spin and Sarah managed two."}, {"pred": "Mark married one issue and Mark married several finished.", "target": "Mark married one finished issue and Mark married several."}, {"pred": "some slave carried one ear and Roger carried two finished.", "target": "some slave carried one finished ear and Roger carried two."}, {"pred": "her duke managed one morning and Alexander managed three early.", "target": "her duke managed one early morning and Alexander managed three."}, {"pred": "some doctor carried one protection and Roger carried more top.", "target": "some doctor carried one top protection and Roger carried more."}, {"pred": "her wolf moved one complete electricity and Alexander moved two.", "target": "her wolf moved one complete electricity and Alexander moved two."}, {"pred": "Mark married one dance and Sarah married two filled.", "target": "Mark married one filled dance and Sarah married two."}, {"pred": "Mark managed one image and Sarah managed several electronic.", "target": "Mark managed one electronic image and Sarah managed several."}, {"pred": "Sarah carried one purple leg and Alexander carried more.", "target": "Sarah carried one purple leg and Alexander carried more."}, {"pred": "that doctor carried one last dog and Alexander carried a lot more.", "target": "that doctor carried one last dog and Alexander carried a lot more."}, {"pred": "her dinosaur broke one soft tail and Mark broke two.", "target": "her dinosaur broke one soft tail and Mark broke two."}, {"pred": "a slave started one silly girl and Alexander started two.", "target": "a slave started one silly girl and Alexander started two."}, {"pred": "this pig broke one personal college and Sarah broke several.", "target": "this pig broke one personal college and Sarah broke several."}, {"pred": "the boat managed one college and Mark managed two english.", "target": "the boat managed one english college and Mark managed two."}, {"pred": "that pig entered one positive parent and Sarah entered more.", "target": "that pig entered one positive parent and Sarah entered more."}, {"pred": "Roger managed one discussion and Roger managed two fixed.", "target": "Roger managed one fixed discussion and Roger managed two."}, {"pred": "this sister visited one last god and Sarah visited more.", "target": "this sister visited one last god and Sarah visited more."}, {"pred": "Sarah started one duck and Alexander started two ordered.", "target": "Sarah started one ordered duck and Alexander started two."}, {"pred": "the wolf entered one poor fire and Mark entered more.", "target": "the wolf entered one poor fire and Mark entered more."}, {"pred": "your wolf entered one circle and Sarah entered more positive.", "target": "your wolf entered one positive circle and Sarah entered more."}, {"pred": "this pig got one essay and Sarah got more kind.", "target": "this pig got one kind essay and Sarah got more."}, {"pred": "the slave managed one duck and Roger managed three summer.", "target": "the slave managed one summer duck and Roger managed three."}, {"pred": "his slave got one essay and Roger got two summer.", "target": "his slave got one summer essay and Roger got two."}, {"pred": "the slave fixed one worn canal and Roger fixed more.", "target": "the slave fixed one worn canal and Roger fixed more."}, {"pred": "her dinosaur got one pain and Alexander got more carbon.", "target": "her dinosaur got one carbon pain and Alexander got more."}, {"pred": "a slave started one heaven and Sarah started more ready.", "target": "a slave started one ready heaven and Sarah started more."}, {"pred": "some sister married one recommended sign and Alexander married a lot more.", "target": "some sister married one recommended sign and Alexander married a lot more."}, {"pred": "your wolf moved one pain and Mark moved two fixed.", "target": "your wolf moved one fixed pain and Mark moved two."}, {"pred": "some doctor fixed one abandoned electricity and Sarah fixed a lot more.", "target": "some doctor fixed one abandoned electricity and Sarah fixed a lot more."}, {"pred": "Roger broke one polar issue and Alexander broke a lot more.", "target": "Roger broke one polar issue and Alexander broke a lot more."}, {"pred": "her pig managed one floor and Mark managed three silly.", "target": "her pig managed one silly floor and Mark managed three."}, {"pred": "Alexander started one soft ear and Mark started a lot more.", "target": "Alexander started one soft ear and Mark started a lot more."}, {"pred": "that wolf married one filled change and Mark married two.", "target": "that wolf married one filled change and Mark married two."}, {"pred": "this wolf managed one discussion and Sarah managed several ordered.", "target": "this wolf managed one ordered discussion and Sarah managed several."}, {"pred": "your pig got one equipment and Roger got two worn.", "target": "your pig got one worn equipment and Roger got two."}, {"pred": "this slave married one tall ride and Alexander married more.", "target": "this slave married one tall ride and Alexander married more."}, {"pred": "his duke managed one track and Mark managed several english.", "target": "his duke managed one english track and Mark managed several."}, {"pred": "your doctor visited one evening and Mark visited two tall.", "target": "your doctor visited one tall evening and Mark visited two."}, {"pred": "Roger visited one ear and Alexander visited three fixed.", "target": "Roger visited one fixed ear and Alexander visited three."}, {"pred": "Roger managed one whale and Sarah managed two fixed.", "target": "Roger managed one fixed whale and Sarah managed two."}, {"pred": "Sarah managed one bath and Alexander managed more purple.", "target": "Sarah managed one purple bath and Alexander managed more."}, {"pred": "that dinosaur got one bible and Alexander got more ordered.", "target": "that dinosaur got one ordered bible and Alexander got more."}, {"pred": "Alexander got one tall discussion and Sarah got several.", "target": "Alexander got one tall discussion and Sarah got several."}, {"pred": "Roger started one chicken and Mark started two close.", "target": "Roger started one close chicken and Mark started two."}, {"pred": "the doctor got one dog and Sarah got several red.", "target": "the doctor got one red dog and Sarah got several."}, {"pred": "Roger got one poor circle and Roger got two.", "target": "Roger got one poor circle and Roger got two."}, {"pred": "the pig married one flat hole and Sarah married more.", "target": "the pig married one flat hole and Sarah married more."}, {"pred": "your wolf managed one good sign and Alexander managed more.", "target": "your wolf managed one good sign and Alexander managed more."}, {"pred": "some wolf visited one hard spin and Sarah visited more.", "target": "some wolf visited one hard spin and Sarah visited more."}, {"pred": "Sarah moved one pain and Mark moved two fixed.", "target": "Sarah moved one fixed pain and Mark moved two."}, {"pred": "Sarah broke one essay and Sarah broke three ready.", "target": "Sarah broke one ready essay and Sarah broke three."}, {"pred": "this dinosaur fixed one bad morning and Mark fixed several.", "target": "this dinosaur fixed one bad morning and Mark fixed several."}, {"pred": "Alexander married one evening and Mark married several next.", "target": "Alexander married one next evening and Mark married several."}, {"pred": "some pig married one poor essay and Mark married several.", "target": "some pig married one poor essay and Mark married several."}, {"pred": "Mark managed one silly clothing and Mark managed two.", "target": "Mark managed one silly clothing and Mark managed two."}, {"pred": "that slave started one simple heaven and Roger started a lot more.", "target": "that slave started one simple heaven and Roger started a lot more."}, {"pred": "Mark married one bus and Sarah married more healthy.", "target": "Mark married one healthy bus and Sarah married more."}, {"pred": "your slave entered one pool and Alexander entered more positive.", "target": "your slave entered one positive pool and Alexander entered more."}, {"pred": "his dinosaur carried one sacred spin and Alexander carried a lot more.", "target": "his dinosaur carried one sacred spin and Alexander carried a lot more."}, {"pred": "Mark fixed one good gate and Mark fixed two.", "target": "Mark fixed one good gate and Mark fixed two."}, {"pred": "her dinosaur got one pain and Mark got two red.", "target": "her dinosaur got one red pain and Mark got two."}, {"pred": "a sister managed one white bible and Sarah managed two.", "target": "a sister managed one white bible and Sarah managed two."}, {"pred": "this wolf got one dog and Alexander got three english.", "target": "this wolf got one english dog and Alexander got three."}, {"pred": "his wolf managed one silly clothing and Mark managed two.", "target": "his wolf managed one silly clothing and Mark managed two."}, {"pred": "a wolf managed one protection and Roger managed two winning.", "target": "a wolf managed one winning protection and Roger managed two."}, {"pred": "his slave got one parent and Sarah got two winning.", "target": "his slave got one winning parent and Sarah got two."}, {"pred": "Alexander carried one essay and Mark carried two rolling.", "target": "Alexander carried one rolling essay and Mark carried two."}, {"pred": "his pig fixed one distance and Mark fixed three expected.", "target": "his pig fixed one expected distance and Mark fixed three."}, {"pred": "your pig started one electricity and Roger started a lot more english.", "target": "your pig started one english electricity and Roger started a lot more."}, {"pred": "Roger married one chicken and Mark married more healthy.", "target": "Roger married one healthy chicken and Mark married more."}, {"pred": "your pig visited one dance and Mark visited several filled.", "target": "your pig visited one filled dance and Mark visited several."}, {"pred": "her dinosaur managed one clothing and Sarah managed a lot more worn.", "target": "her dinosaur managed one worn clothing and Sarah managed a lot more."}, {"pred": "a sister married one hard discussion and Roger married a lot more.", "target": "a sister married one hard discussion and Roger married a lot more."}, {"pred": "his boat started one evening and Mark started a lot more hard.", "target": "his boat started one hard evening and Mark started a lot more."}, {"pred": "Alexander entered one bad morning and Sarah entered a lot more.", "target": "Alexander entered one bad morning and Sarah entered a lot more."}, {"pred": "Roger managed one clothing and Sarah managed a lot more worn.", "target": "Roger managed one worn clothing and Sarah managed a lot more."}, {"pred": "some sister fixed one filled protection and Mark fixed several.", "target": "some sister fixed one filled protection and Mark fixed several."}, {"pred": "some slave entered one complete ear and Sarah entered several.", "target": "some slave entered one complete ear and Sarah entered several."}, {"pred": "some boat carried one polar image and Roger carried several.", "target": "some boat carried one polar image and Roger carried several."}, {"pred": "this duke fixed one good sweetie and Sarah fixed a lot more.", "target": "this duke fixed one good sweetie and Sarah fixed a lot more."}, {"pred": "her slave carried one tail and Mark carried two worn.", "target": "her slave carried one worn tail and Mark carried two."}, {"pred": "her duke entered one poor circle and Mark entered three.", "target": "her duke entered one poor circle and Mark entered three."}, {"pred": "Sarah entered one girl and Roger entered a lot more silly.", "target": "Sarah entered one silly girl and Roger entered a lot more."}, {"pred": "his duke visited one ear and Mark visited two needed.", "target": "his duke visited one needed ear and Mark visited two."}, {"pred": "his slave visited one track and Sarah visited two early.", "target": "his slave visited one early track and Sarah visited two."}, {"pred": "some sister managed one ready floor and Roger managed more.", "target": "some sister managed one ready floor and Roger managed more."}, {"pred": "Mark started one soft chicken and Alexander started more.", "target": "Mark started one soft chicken and Alexander started more."}, {"pred": "the dinosaur carried one sign and Mark carried several top.", "target": "the dinosaur carried one top sign and Mark carried several."}, {"pred": "Mark managed one next bible and Roger managed three.", "target": "Mark managed one next bible and Roger managed three."}, {"pred": "Roger moved one electronic telephone and Mark moved more.", "target": "Roger moved one electronic telephone and Mark moved more."}, {"pred": "his boat married one pool and Roger married three positive.", "target": "his boat married one positive pool and Roger married three."}, {"pred": "his sister fixed one god and Roger fixed several close.", "target": "his sister fixed one close god and Roger fixed several."}, {"pred": "his duke managed one soft bet and Mark managed three.", "target": "his duke managed one soft bet and Mark managed three."}, {"pred": "Mark started one change and Alexander started more winning.", "target": "Mark started one winning change and Alexander started more."}, {"pred": "some pig got one wrong duck and Sarah got three.", "target": "some pig got one wrong duck and Sarah got three."}, {"pred": "his boat started one bath and Alexander started more english.", "target": "his boat started one english bath and Alexander started more."}, {"pred": "your boat managed one little gate and Alexander managed a lot more.", "target": "your boat managed one little gate and Alexander managed a lot more."}, {"pred": "the pig got one bad track and Sarah got several.", "target": "the pig got one bad track and Sarah got several."}, {"pred": "your slave carried one ride and Alexander carried several ready.", "target": "your slave carried one ready ride and Alexander carried several."}, {"pred": "this dinosaur fixed one solid track and Mark fixed a lot more.", "target": "this dinosaur fixed one solid track and Mark fixed a lot more."}, {"pred": "that doctor married one positive speak and Mark married three.", "target": "that doctor married one positive speak and Mark married three."}, {"pred": "her wolf fixed one hard clothing and Sarah fixed more.", "target": "her wolf fixed one hard clothing and Sarah fixed more."}, {"pred": "her boat married one chicken and Mark married more healthy.", "target": "her boat married one healthy chicken and Mark married more."}, {"pred": "her duke moved one poor circle and Alexander moved a lot more.", "target": "her duke moved one poor circle and Alexander moved a lot more."}, {"pred": "her doctor visited one change and Sarah visited several healthy.", "target": "her doctor visited one healthy change and Sarah visited several."}, {"pred": "this wolf fixed one protection and Alexander fixed more english.", "target": "this wolf fixed one english protection and Alexander fixed more."}, {"pred": "the duke started one speak and Mark started more full.", "target": "the duke started one full speak and Mark started more."}, {"pred": "some wolf carried one dog and Mark carried a lot more abandoned.", "target": "some wolf carried one abandoned dog and Mark carried a lot more."}, {"pred": "your pig entered one silly mail and Mark entered several.", "target": "your pig entered one silly mail and Mark entered several."}, {"pred": "Mark started one change and Roger started a lot more electronic.", "target": "Mark started one electronic change and Roger started a lot more."}, {"pred": "a boat managed one positive electricity and Sarah managed two.", "target": "a boat managed one positive electricity and Sarah managed two."}, {"pred": "her pig visited one silly fire and Alexander visited three.", "target": "her pig visited one silly fire and Alexander visited three."}, {"pred": "Sarah married one healthy clothing and Roger married more.", "target": "Sarah married one healthy clothing and Roger married more."}, {"pred": "his sister started one bet and Sarah started three polar.", "target": "his sister started one polar bet and Sarah started three."}, {"pred": "Alexander married one gate and Mark married a lot more forced.", "target": "Alexander married one forced gate and Mark married a lot more."}, {"pred": "Roger carried one sacred spin and Alexander carried a lot more.", "target": "Roger carried one sacred spin and Alexander carried a lot more."}, {"pred": "Roger carried one sign and Mark carried several top.", "target": "Roger carried one top sign and Mark carried several."}, {"pred": "Roger moved one tall speak and Roger moved three.", "target": "Roger moved one tall speak and Roger moved three."}, {"pred": "a duke broke one polar issue and Alexander broke a lot more.", "target": "a duke broke one polar issue and Alexander broke a lot more."}, {"pred": "Mark moved one worn heaven and Alexander moved several.", "target": "Mark moved one worn heaven and Alexander moved several."}, {"pred": "the dinosaur managed one fixed floor and Sarah managed a lot more.", "target": "the dinosaur managed one fixed floor and Sarah managed a lot more."}, {"pred": "a wolf started one equipment and Mark started more recommended.", "target": "a wolf started one recommended equipment and Mark started more."}, {"pred": "his slave entered one image and Alexander entered two worn.", "target": "his slave entered one worn image and Alexander entered two."}, {"pred": "your dinosaur carried one essay and Alexander carried three needed.", "target": "your dinosaur carried one needed essay and Alexander carried three."}, {"pred": "that wolf moved one telephone and Mark moved three tall.", "target": "that wolf moved one tall telephone and Mark moved three."}, {"pred": "his doctor got one dance and Sarah got more extra.", "target": "his doctor got one extra dance and Sarah got more."}, {"pred": "Alexander moved one heaven and Sarah moved a lot more silly.", "target": "Alexander moved one silly heaven and Sarah moved a lot more."}, {"pred": "Mark married one bath and Roger married three full.", "target": "Mark married one full bath and Roger married three."}, {"pred": "this pig moved one heaven and Sarah moved a lot more silly.", "target": "this pig moved one silly heaven and Sarah moved a lot more."}, {"pred": "the doctor carried one distance and Mark carried a lot more top.", "target": "the doctor carried one top distance and Mark carried a lot more."}, {"pred": "a boat married one evening and Mark married several next.", "target": "a boat married one next evening and Mark married several."}, {"pred": "this pig managed one canal and Alexander managed more forced.", "target": "this pig managed one forced canal and Alexander managed more."}, {"pred": "Roger married one parent and Mark married several ready.", "target": "Roger married one ready parent and Mark married several."}, {"pred": "your slave got one carbon medicine and Mark got several.", "target": "your slave got one carbon medicine and Mark got several."}, {"pred": "a duke fixed one carbon essay and Sarah fixed a lot more.", "target": "a duke fixed one carbon essay and Sarah fixed a lot more."}, {"pred": "some pig carried one duck and Roger carried a lot more kind.", "target": "some pig carried one kind duck and Roger carried a lot more."}, {"pred": "your wolf got one last leg and Roger got several.", "target": "your wolf got one last leg and Roger got several."}, {"pred": "that wolf married one ride and Alexander married several expected.", "target": "that wolf married one expected ride and Alexander married several."}, {"pred": "some slave entered one clothing and Mark entered several kind.", "target": "some slave entered one kind clothing and Mark entered several."}, {"pred": "her dinosaur visited one electronic whale and Sarah visited two.", "target": "her dinosaur visited one electronic whale and Sarah visited two."}, {"pred": "his sister started one quick parent and Mark started several.", "target": "his sister started one quick parent and Mark started several."}, {"pred": "some doctor moved one forced discussion and Alexander moved a lot more.", "target": "some doctor moved one forced discussion and Alexander moved a lot more."}, {"pred": "Mark visited one discussion and Sarah visited more kind.", "target": "Mark visited one kind discussion and Sarah visited more."}, {"pred": "Mark managed one yellow leg and Alexander managed a lot more.", "target": "Mark managed one yellow leg and Alexander managed a lot more."}, {"pred": "a wolf visited one nice parent and Alexander visited three.", "target": "a wolf visited one nice parent and Alexander visited three."}, {"pred": "the boat started one electronic distance and Sarah started more.", "target": "the boat started one electronic distance and Sarah started more."}, {"pred": "Alexander managed one morning and Alexander managed three early.", "target": "Alexander managed one early morning and Alexander managed three."}, {"pred": "Mark got one pain and Mark got two red.", "target": "Mark got one red pain and Mark got two."}, {"pred": "Sarah visited one track and Sarah visited two early.", "target": "Sarah visited one early track and Sarah visited two."}, {"pred": "your dinosaur moved one purple leg and Roger moved a lot more.", "target": "your dinosaur moved one purple leg and Roger moved a lot more."}, {"pred": "Mark married one speak and Mark married three positive.", "target": "Mark married one positive speak and Mark married three."}, {"pred": "some doctor started one speak and Mark started more top.", "target": "some doctor started one top speak and Mark started more."}, {"pred": "your dinosaur entered one floor and Alexander entered three personal.", "target": "your dinosaur entered one personal floor and Alexander entered three."}, {"pred": "some dinosaur started one morning and Alexander started more solid.", "target": "some dinosaur started one solid morning and Alexander started more."}, {"pred": "that doctor married one morning and Roger married more recommended.", "target": "that doctor married one recommended morning and Roger married more."}, {"pred": "this sister married one ride and Mark married more healthy.", "target": "this sister married one healthy ride and Mark married more."}, {"pred": "some sister fixed one silly sign and Alexander fixed a lot more.", "target": "some sister fixed one silly sign and Alexander fixed a lot more."}, {"pred": "that slave carried one worn mail and Alexander carried three.", "target": "that slave carried one worn mail and Alexander carried three."}, {"pred": "Alexander fixed one silly sign and Alexander fixed a lot more.", "target": "Alexander fixed one silly sign and Alexander fixed a lot more."}, {"pred": "this slave entered one drawing and Alexander entered two rolling.", "target": "this slave entered one rolling drawing and Alexander entered two."}, {"pred": "some boat fixed one telephone and Mark fixed several carbon.", "target": "some boat fixed one carbon telephone and Mark fixed several."}, {"pred": "her doctor moved one simple bath and Sarah moved more.", "target": "her doctor moved one simple bath and Sarah moved more."}, {"pred": "Roger managed one nice evening and Sarah managed several.", "target": "Roger managed one nice evening and Sarah managed several."}, {"pred": "that dinosaur started one duck and Alexander started two ordered.", "target": "that dinosaur started one ordered duck and Alexander started two."}, {"pred": "a wolf fixed one fire and Sarah fixed more top.", "target": "a wolf fixed one top fire and Sarah fixed more."}, {"pred": "your sister got one flat dog and Roger got several.", "target": "your sister got one flat dog and Roger got several."}, {"pred": "her wolf moved one full discussion and Roger moved more.", "target": "her wolf moved one full discussion and Roger moved more."}, {"pred": "her wolf married one pattern and Mark married several summer.", "target": "her wolf married one summer pattern and Mark married several."}, {"pred": "some dinosaur carried one red mail and Alexander carried two.", "target": "some dinosaur carried one red mail and Alexander carried two."}, {"pred": "Mark visited one poor god and Mark visited more.", "target": "Mark visited one poor god and Mark visited more."}, {"pred": "your boat visited one electronic distance and Alexander visited two.", "target": "your boat visited one electronic distance and Alexander visited two."}, {"pred": "this slave broke one personal pattern and Sarah broke more.", "target": "this slave broke one personal pattern and Sarah broke more."}, {"pred": "Alexander got one bad track and Sarah got several.", "target": "Alexander got one bad track and Sarah got several."}, {"pred": "your slave fixed one floor and Sarah fixed two top.", "target": "your slave fixed one top floor and Sarah fixed two."}, {"pred": "the sister carried one next chicken and Roger carried more.", "target": "the sister carried one next chicken and Roger carried more."}, {"pred": "Alexander married one morning and Roger married more recommended.", "target": "Alexander married one recommended morning and Roger married more."}, {"pred": "your slave managed one good sweetie and Sarah managed more.", "target": "your slave managed one good sweetie and Sarah managed more."}, {"pred": "Alexander started one electronic distance and Sarah started more.", "target": "Alexander started one electronic distance and Sarah started more."}, {"pred": "her dinosaur broke one sign and Mark broke a lot more needed.", "target": "her dinosaur broke one needed sign and Mark broke a lot more."}, {"pred": "Mark moved one sweetie and Sarah moved several kind.", "target": "Mark moved one kind sweetie and Sarah moved several."}, {"pred": "his boat carried one tail and Alexander carried two flat.", "target": "his boat carried one flat tail and Alexander carried two."}, {"pred": "Roger carried one distance and Mark carried a lot more top.", "target": "Roger carried one top distance and Mark carried a lot more."}, {"pred": "a wolf broke one finished college and Roger broke three.", "target": "a wolf broke one finished college and Roger broke three."}, {"pred": "Roger got one healthy pool and Roger got several.", "target": "Roger got one healthy pool and Roger got several."}, {"pred": "your wolf married one forced gate and Mark married a lot more.", "target": "your wolf married one forced gate and Mark married a lot more."}, {"pred": "Alexander entered one electronic dog and Alexander entered two.", "target": "Alexander entered one electronic dog and Alexander entered two."}, {"pred": "a boat entered one bad morning and Sarah entered a lot more.", "target": "a boat entered one bad morning and Sarah entered a lot more."}, {"pred": "your wolf managed one gate and Roger managed more english.", "target": "your wolf managed one english gate and Roger managed more."}, {"pred": "your pig visited one hard sweetie and Mark visited several.", "target": "your pig visited one hard sweetie and Mark visited several."}, {"pred": "his dinosaur entered one girl and Sarah entered several worn.", "target": "his dinosaur entered one worn girl and Sarah entered several."}, {"pred": "a dinosaur started one change and Roger started a lot more electronic.", "target": "a dinosaur started one electronic change and Roger started a lot more."}, {"pred": "Sarah visited one electronic distance and Alexander visited two.", "target": "Sarah visited one electronic distance and Alexander visited two."}, {"pred": "that boat started one rolling pool and Mark started two.", "target": "that boat started one rolling pool and Mark started two."}, {"pred": "this slave broke one winning duck and Alexander broke two.", "target": "this slave broke one winning duck and Alexander broke two."}, {"pred": "Roger entered one floor and Alexander entered three personal.", "target": "Roger entered one personal floor and Alexander entered three."}, {"pred": "your dinosaur managed one heaven and Roger managed several english.", "target": "your dinosaur managed one english heaven and Roger managed several."}, {"pred": "a duke broke one equipment and Roger broke a lot more worn.", "target": "a duke broke one worn equipment and Roger broke a lot more."}, {"pred": "the slave entered one gate and Roger entered several early.", "target": "the slave entered one early gate and Roger entered several."}, {"pred": "his dinosaur married one nice duck and Roger married two.", "target": "his dinosaur married one nice duck and Roger married two."}, {"pred": "a doctor got one canal and Alexander got a lot more healthy.", "target": "a doctor got one healthy canal and Alexander got a lot more."}, {"pred": "some sister started one silly tail and Alexander started three.", "target": "some sister started one silly tail and Alexander started three."}, {"pred": "a slave entered one god and Sarah entered two top.", "target": "a slave entered one top god and Sarah entered two."}, {"pred": "Alexander managed one soft bet and Mark managed three.", "target": "Alexander managed one soft bet and Mark managed three."}, {"pred": "Sarah broke one gate and Sarah broke a lot more abandoned.", "target": "Sarah broke one abandoned gate and Sarah broke a lot more."}, {"pred": "Sarah carried one ride and Alexander carried several ready.", "target": "Sarah carried one ready ride and Alexander carried several."}, {"pred": "a slave broke one stand and Sarah broke more kind.", "target": "a slave broke one kind stand and Sarah broke more."}, {"pred": "a dinosaur moved one contemporary medicine and Sarah moved two.", "target": "a dinosaur moved one contemporary medicine and Sarah moved two."}, {"pred": "this slave entered one track and Alexander entered three forced.", "target": "this slave entered one forced track and Alexander entered three."}, {"pred": "Alexander started one rolling pool and Mark started two.", "target": "Alexander started one rolling pool and Mark started two."}, {"pred": "a duke carried one hard fire and Sarah carried three.", "target": "a duke carried one hard fire and Sarah carried three."}, {"pred": "your wolf got one last heaven and Mark got more.", "target": "your wolf got one last heaven and Mark got more."}, {"pred": "Mark entered one poor circle and Mark entered three.", "target": "Mark entered one poor circle and Mark entered three."}, {"pred": "her sister started one heaven and Alexander started more abandoned.", "target": "her sister started one abandoned heaven and Alexander started more."}, {"pred": "Roger managed one spin and Alexander managed three english.", "target": "Roger managed one english spin and Alexander managed three."}, {"pred": "that boat carried one solid distance and Mark carried several.", "target": "that boat carried one solid distance and Mark carried several."}, {"pred": "the wolf carried one personal evening and Roger carried several.", "target": "the wolf carried one personal evening and Roger carried several."}, {"pred": "Sarah started one discussion and Mark started more quick.", "target": "Sarah started one quick discussion and Mark started more."}, {"pred": "Roger started one healthy college and Roger started a lot more.", "target": "Roger started one healthy college and Roger started a lot more."}, {"pred": "Roger married one poor car and Alexander married more.", "target": "Roger married one poor car and Alexander married more."}, {"pred": "some wolf got one soft dog and Sarah got several.", "target": "some wolf got one soft dog and Sarah got several."}, {"pred": "Roger started one poor hole and Mark started more.", "target": "Roger started one poor hole and Mark started more."}, {"pred": "your dinosaur visited one complete spin and Mark visited several.", "target": "your dinosaur visited one complete spin and Mark visited several."}, {"pred": "her doctor moved one evening and Roger moved more yellow.", "target": "her doctor moved one yellow evening and Roger moved more."}, {"pred": "Alexander married one nice duck and Roger married two.", "target": "Alexander married one nice duck and Roger married two."}, {"pred": "this slave carried one red distance and Roger carried three.", "target": "this slave carried one red distance and Roger carried three."}, {"pred": "the sister moved one contemporary bath and Roger moved a lot more.", "target": "the sister moved one contemporary bath and Roger moved a lot more."}, {"pred": "her doctor fixed one bad whale and Sarah fixed three.", "target": "her doctor fixed one bad whale and Sarah fixed three."}, {"pred": "your wolf managed one yellow leg and Alexander managed a lot more.", "target": "your wolf managed one yellow leg and Alexander managed a lot more."}, {"pred": "that dinosaur managed one duck and Alexander managed several full.", "target": "that dinosaur managed one full duck and Alexander managed several."}, {"pred": "that pig carried one distance and Alexander carried three ready.", "target": "that pig carried one ready distance and Alexander carried three."}, {"pred": "her dinosaur broke one healthy telephone and Sarah broke two.", "target": "her dinosaur broke one healthy telephone and Sarah broke two."}, {"pred": "that boat got one distance and Sarah got more tall.", "target": "that boat got one tall distance and Sarah got more."}, {"pred": "Roger married one change and Mark married two filled.", "target": "Roger married one filled change and Mark married two."}, {"pred": "that dinosaur broke one little tail and Roger broke a lot more.", "target": "that dinosaur broke one little tail and Roger broke a lot more."}, {"pred": "a wolf broke one flat dog and Alexander broke three.", "target": "a wolf broke one flat dog and Alexander broke three."}, {"pred": "this boat married one pain and Mark married more early.", "target": "this boat married one early pain and Mark married more."}, {"pred": "his duke moved one last protection and Mark moved two.", "target": "his duke moved one last protection and Mark moved two."}, {"pred": "Alexander broke one bus and Roger broke two kind.", "target": "Alexander broke one kind bus and Roger broke two."}, {"pred": "his doctor married one drawing and Roger married three yellow.", "target": "his doctor married one yellow drawing and Roger married three."}, {"pred": "this sister carried one yellow girl and Sarah carried several.", "target": "this sister carried one yellow girl and Sarah carried several."}, {"pred": "Mark managed one duck and Sarah managed a lot more carbon.", "target": "Mark managed one carbon duck and Sarah managed a lot more."}, {"pred": "that doctor got one god and Sarah got several red.", "target": "that doctor got one red god and Sarah got several."}, {"pred": "Roger carried one flat tail and Alexander carried two.", "target": "Roger carried one flat tail and Alexander carried two."}, {"pred": "his pig visited one yellow bath and Alexander visited more.", "target": "his pig visited one yellow bath and Alexander visited more."}, {"pred": "the slave broke one purple ear and Roger broke a lot more.", "target": "the slave broke one purple ear and Roger broke a lot more."}, {"pred": "a pig broke one gate and Sarah broke a lot more abandoned.", "target": "a pig broke one abandoned gate and Sarah broke a lot more."}, {"pred": "the sister managed one nice evening and Sarah managed several.", "target": "the sister managed one nice evening and Sarah managed several."}, {"pred": "the slave married one little pain and Mark married a lot more.", "target": "the slave married one little pain and Mark married a lot more."}, {"pred": "Roger visited one yellow bath and Alexander visited more.", "target": "Roger visited one yellow bath and Alexander visited more."}, {"pred": "this doctor entered one last college and Sarah entered a lot more.", "target": "this doctor entered one last college and Sarah entered a lot more."}, {"pred": "the wolf moved one last change and Roger moved two.", "target": "the wolf moved one last change and Roger moved two."}, {"pred": "her dinosaur moved one tail and Sarah moved three abandoned.", "target": "her dinosaur moved one abandoned tail and Sarah moved three."}, {"pred": "Sarah carried one red distance and Roger carried three.", "target": "Sarah carried one red distance and Roger carried three."}, {"pred": "his slave got one dog and Mark got two abandoned.", "target": "his slave got one abandoned dog and Mark got two."}, {"pred": "your boat broke one bible and Roger broke several next.", "target": "your boat broke one next bible and Roger broke several."}, {"pred": "a sister visited one little whale and Roger visited three.", "target": "a sister visited one little whale and Roger visited three."}, {"pred": "Mark fixed one pattern and Roger fixed three polar.", "target": "Mark fixed one polar pattern and Roger fixed three."}, {"pred": "his pig started one chicken and Mark started two close.", "target": "his pig started one close chicken and Mark started two."}, {"pred": "his boat moved one hard college and Roger moved more.", "target": "his boat moved one hard college and Roger moved more."}, {"pred": "the dinosaur broke one positive pool and Roger broke several.", "target": "the dinosaur broke one positive pool and Roger broke several."}, {"pred": "that sister started one essay and Sarah started three top.", "target": "that sister started one top essay and Sarah started three."}, {"pred": "this doctor entered one white pattern and Alexander entered a lot more.", "target": "this doctor entered one white pattern and Alexander entered a lot more."}, {"pred": "some dinosaur visited one pain and Sarah visited three red.", "target": "some dinosaur visited one red pain and Sarah visited three."}, {"pred": "Roger married one pattern and Mark married several summer.", "target": "Roger married one summer pattern and Mark married several."}, {"pred": "that slave fixed one nice essay and Alexander fixed two.", "target": "that slave fixed one nice essay and Alexander fixed two."}, {"pred": "his wolf fixed one flat clothing and Mark fixed a lot more.", "target": "his wolf fixed one flat clothing and Mark fixed a lot more."}, {"pred": "Sarah entered one little mail and Roger entered two.", "target": "Sarah entered one little mail and Roger entered two."}, {"pred": "the pig visited one purple mail and Alexander visited several.", "target": "the pig visited one purple mail and Alexander visited several."}, {"pred": "this boat broke one bad ride and Mark broke more.", "target": "this boat broke one bad ride and Mark broke more."}, {"pred": "that slave got one bath and Roger got three purple.", "target": "that slave got one purple bath and Roger got three."}, {"pred": "a pig started one healthy college and Roger started a lot more.", "target": "a pig started one healthy college and Roger started a lot more."}, {"pred": "this wolf started one soft chicken and Alexander started more.", "target": "this wolf started one soft chicken and Alexander started more."}, {"pred": "her sister carried one medicine and Roger carried several finished.", "target": "her sister carried one finished medicine and Roger carried several."}, {"pred": "that dinosaur started one soft telephone and Mark started two.", "target": "that dinosaur started one soft telephone and Mark started two."}, {"pred": "this sister carried one purple mail and Roger carried several.", "target": "this sister carried one purple mail and Roger carried several."}, {"pred": "the boat got one sweetie and Sarah got two good.", "target": "the boat got one good sweetie and Sarah got two."}, {"pred": "her doctor married one rolling telephone and Roger married a lot more.", "target": "her doctor married one rolling telephone and Roger married a lot more."}, {"pred": "Mark married one gate and Roger married a lot more electronic.", "target": "Mark married one electronic gate and Roger married a lot more."}, {"pred": "a sister fixed one full dance and Roger fixed more.", "target": "a sister fixed one full dance and Roger fixed more."}, {"pred": "your dinosaur managed one whale and Sarah managed two fixed.", "target": "your dinosaur managed one fixed whale and Sarah managed two."}, {"pred": "your dinosaur married one hole and Alexander married more expected.", "target": "your dinosaur married one expected hole and Alexander married more."}, {"pred": "Mark broke one circle and Roger broke more sacred.", "target": "Mark broke one sacred circle and Roger broke more."}, {"pred": "her boat got one next essay and Roger got a lot more.", "target": "her boat got one next essay and Roger got a lot more."}, {"pred": "Roger visited one last dance and Alexander visited three.", "target": "Roger visited one last dance and Alexander visited three."}, {"pred": "the doctor broke one extra stand and Roger broke three.", "target": "the doctor broke one extra stand and Roger broke three."}, {"pred": "Roger entered one girl and Sarah entered several worn.", "target": "Roger entered one worn girl and Sarah entered several."}, {"pred": "a dinosaur broke one duck and Roger broke two filled.", "target": "a dinosaur broke one filled duck and Roger broke two."}, {"pred": "her pig carried one next hole and Roger carried more.", "target": "her pig carried one next hole and Roger carried more."}, {"pred": "Mark visited one silly fire and Alexander visited three.", "target": "Mark visited one silly fire and Alexander visited three."}, {"pred": "Roger fixed one abandoned electricity and Sarah fixed a lot more.", "target": "Roger fixed one abandoned electricity and Sarah fixed a lot more."}, {"pred": "a wolf started one poor hole and Mark started more.", "target": "a wolf started one poor hole and Mark started more."}, {"pred": "a duke visited one leg and Sarah visited three ordered.", "target": "a duke visited one ordered leg and Sarah visited three."}, {"pred": "some slave started one personal electricity and Sarah started several.", "target": "some slave started one personal electricity and Sarah started several."}, {"pred": "some boat managed one filled pain and Sarah managed several.", "target": "some boat managed one filled pain and Sarah managed several."}, {"pred": "the doctor started one dance and Mark started two nice.", "target": "the doctor started one nice dance and Mark started two."}, {"pred": "his slave broke one positive duck and Alexander broke several.", "target": "his slave broke one positive duck and Alexander broke several."}, {"pred": "Roger got one pain and Alexander got more carbon.", "target": "Roger got one carbon pain and Alexander got more."}, {"pred": "some duke carried one worn car and Sarah carried two.", "target": "some duke carried one worn car and Sarah carried two."}, {"pred": "this dinosaur married one duck and Roger married a lot more winning.", "target": "this dinosaur married one winning duck and Roger married a lot more."}, {"pred": "Mark married one poor track and Mark married several.", "target": "Mark married one poor track and Mark married several."}, {"pred": "a dinosaur broke one personal car and Sarah broke several.", "target": "a dinosaur broke one personal car and Sarah broke several."}, {"pred": "some boat entered one next mail and Alexander entered several.", "target": "some boat entered one next mail and Alexander entered several."}, {"pred": "Roger moved one telephone and Mark moved three tall.", "target": "Roger moved one tall telephone and Mark moved three."}, {"pred": "the doctor visited one bet and Alexander visited two ordered.", "target": "the doctor visited one ordered bet and Alexander visited two."}, {"pred": "some sister carried one recommended clothing and Sarah carried several.", "target": "some sister carried one recommended clothing and Sarah carried several."}, {"pred": "Mark carried one bad essay and Alexander carried several.", "target": "Mark carried one bad essay and Alexander carried several."}, {"pred": "some slave entered one extra spin and Mark entered a lot more.", "target": "some slave entered one extra spin and Mark entered a lot more."}, {"pred": "your dinosaur fixed one full pain and Roger fixed a lot more.", "target": "your dinosaur fixed one full pain and Roger fixed a lot more."}, {"pred": "your wolf entered one flat circle and Mark entered several.", "target": "your wolf entered one flat circle and Mark entered several."}, {"pred": "her wolf married one poor car and Alexander married more.", "target": "her wolf married one poor car and Alexander married more."}, {"pred": "Sarah entered one white pattern and Alexander entered a lot more.", "target": "Sarah entered one white pattern and Alexander entered a lot more."}, {"pred": "Alexander entered one wrong bath and Roger entered two.", "target": "Alexander entered one wrong bath and Roger entered two."}, {"pred": "that slave moved one personal fire and Sarah moved three.", "target": "that slave moved one personal fire and Sarah moved three."}, {"pred": "the wolf entered one little fire and Alexander entered two.", "target": "the wolf entered one little fire and Alexander entered two."}, {"pred": "your wolf visited one white ear and Alexander visited several.", "target": "your wolf visited one white ear and Alexander visited several."}, {"pred": "a pig moved one canal and Mark moved three extra.", "target": "a pig moved one extra canal and Mark moved three."}, {"pred": "her boat managed one silly sign and Sarah managed more.", "target": "her boat managed one silly sign and Sarah managed more."}, {"pred": "a dinosaur managed one next bible and Roger managed three.", "target": "a dinosaur managed one next bible and Roger managed three."}, {"pred": "this dinosaur entered one little mail and Roger entered two.", "target": "this dinosaur entered one little mail and Roger entered two."}, {"pred": "the pig fixed one nice protection and Mark fixed three.", "target": "the pig fixed one nice protection and Mark fixed three."}, {"pred": "your slave married one god and Mark married three electronic.", "target": "your slave married one electronic god and Mark married three."}, {"pred": "his duke started one evening and Sarah started a lot more poor.", "target": "his duke started one poor evening and Sarah started a lot more."}, {"pred": "Mark broke one positive duck and Alexander broke several.", "target": "Mark broke one positive duck and Alexander broke several."}, {"pred": "Roger broke one college and Sarah broke several early.", "target": "Roger broke one early college and Sarah broke several."}, {"pred": "Mark started one essay and Sarah started three top.", "target": "Mark started one top essay and Sarah started three."}, {"pred": "Mark moved one complete electricity and Alexander moved two.", "target": "Mark moved one complete electricity and Alexander moved two."}, {"pred": "this pig carried one tall bet and Roger carried several.", "target": "this pig carried one tall bet and Roger carried several."}, {"pred": "the wolf moved one white distance and Alexander moved more.", "target": "the wolf moved one white distance and Alexander moved more."}, {"pred": "his boat entered one silly girl and Roger entered a lot more.", "target": "his boat entered one silly girl and Roger entered a lot more."}, {"pred": "Alexander visited one tall sign and Roger visited several.", "target": "Alexander visited one tall sign and Roger visited several."}, {"pred": "his boat visited one duck and Sarah visited three top.", "target": "his boat visited one top duck and Sarah visited three."}, {"pred": "your duke fixed one good gate and Mark fixed two.", "target": "your duke fixed one good gate and Mark fixed two."}, {"pred": "her doctor managed one personal leg and Mark managed three.", "target": "her doctor managed one personal leg and Mark managed three."}, {"pred": "his wolf entered one simple gate and Alexander entered a lot more.", "target": "his wolf entered one simple gate and Alexander entered a lot more."}, {"pred": "your doctor entered one bus and Sarah entered three worn.", "target": "your doctor entered one worn bus and Sarah entered three."}, {"pred": "that slave married one parent and Mark married several ready.", "target": "that slave married one ready parent and Mark married several."}, {"pred": "Sarah moved one discussion and Alexander moved a lot more forced.", "target": "Sarah moved one forced discussion and Alexander moved a lot more."}, {"pred": "this boat managed one duck and Sarah managed a lot more carbon.", "target": "this boat managed one carbon duck and Sarah managed a lot more."}, {"pred": "this wolf started one healthy dance and Sarah started more.", "target": "this wolf started one healthy dance and Sarah started more."}, {"pred": "her dinosaur moved one speak and Roger moved three tall.", "target": "her dinosaur moved one tall speak and Roger moved three."}, {"pred": "some doctor married one floor and Alexander married three fixed.", "target": "some doctor married one fixed floor and Alexander married three."}, {"pred": "Mark got one little medicine and Mark got more.", "target": "Mark got one little medicine and Mark got more."}, {"pred": "Mark managed one floor and Sarah managed a lot more fixed.", "target": "Mark managed one fixed floor and Sarah managed a lot more."}, {"pred": "your slave fixed one yellow distance and Alexander fixed several.", "target": "your slave fixed one yellow distance and Alexander fixed several."}, {"pred": "this doctor managed one spin and Alexander managed three english.", "target": "this doctor managed one english spin and Alexander managed three."}, {"pred": "his duke visited one carbon electricity and Sarah visited more.", "target": "his duke visited one carbon electricity and Sarah visited more."}, {"pred": "his wolf visited one quick pain and Sarah visited more.", "target": "his wolf visited one quick pain and Sarah visited more."}, {"pred": "Mark married one pain and Mark married more early.", "target": "Mark married one early pain and Mark married more."}, {"pred": "your doctor managed one bath and Alexander managed more purple.", "target": "your doctor managed one purple bath and Alexander managed more."}, {"pred": "Alexander entered one gate and Roger entered several early.", "target": "Alexander entered one early gate and Roger entered several."}, {"pred": "his wolf managed one bet and Roger managed two english.", "target": "his wolf managed one english bet and Roger managed two."}, {"pred": "Alexander got one medicine and Mark got several carbon.", "target": "Alexander got one carbon medicine and Mark got several."}, {"pred": "his doctor fixed one tall whale and Sarah fixed two.", "target": "his doctor fixed one tall whale and Sarah fixed two."}, {"pred": "a boat managed one evening and Sarah managed more healthy.", "target": "a boat managed one healthy evening and Sarah managed more."}, {"pred": "the wolf entered one parent and Mark entered more top.", "target": "the wolf entered one top parent and Mark entered more."}, {"pred": "his doctor got one last drawing and Roger got more.", "target": "his doctor got one last drawing and Roger got more."}, {"pred": "the dinosaur broke one bus and Roger broke two kind.", "target": "the dinosaur broke one kind bus and Roger broke two."}, {"pred": "a wolf broke one last dance and Roger broke more.", "target": "a wolf broke one last dance and Roger broke more."}, {"pred": "her doctor fixed one leg and Mark fixed several flat.", "target": "her doctor fixed one flat leg and Mark fixed several."}, {"pred": "the dinosaur got one heaven and Roger got two winning.", "target": "the dinosaur got one winning heaven and Roger got two."}, {"pred": "Alexander entered one parent and Roger entered several polar.", "target": "Alexander entered one polar parent and Roger entered several."}, {"pred": "the slave married one bus and Sarah married more healthy.", "target": "the slave married one healthy bus and Sarah married more."}, {"pred": "some duke visited one last dance and Alexander visited three.", "target": "some duke visited one last dance and Alexander visited three."}, {"pred": "a wolf started one electricity and Mark started more abandoned.", "target": "a wolf started one abandoned electricity and Mark started more."}, {"pred": "Alexander fixed one morning and Mark fixed several bad.", "target": "Alexander fixed one bad morning and Mark fixed several."}, {"pred": "this wolf broke one little medicine and Sarah broke more.", "target": "this wolf broke one little medicine and Sarah broke more."}, {"pred": "your pig married one hard tail and Mark married a lot more.", "target": "your pig married one hard tail and Mark married a lot more."}, {"pred": "your duke got one carbon fire and Roger got several.", "target": "your duke got one carbon fire and Roger got several."}, {"pred": "her boat broke one essay and Sarah broke three ready.", "target": "her boat broke one ready essay and Sarah broke three."}, {"pred": "a slave fixed one good discussion and Mark fixed three.", "target": "a slave fixed one good discussion and Mark fixed three."}, {"pred": "his boat got one duck and Alexander got more abandoned.", "target": "his boat got one abandoned duck and Alexander got more."}, {"pred": "Mark got one electricity and Mark got a lot more worn.", "target": "Mark got one worn electricity and Mark got a lot more."}, {"pred": "her sister got one clothing and Mark got three worn.", "target": "her sister got one worn clothing and Mark got three."}, {"pred": "Mark got one bible and Alexander got more ordered.", "target": "Mark got one ordered bible and Alexander got more."}, {"pred": "this pig got one discussion and Sarah got several tall.", "target": "this pig got one tall discussion and Sarah got several."}, {"pred": "this slave entered one college and Mark entered several polar.", "target": "this slave entered one polar college and Mark entered several."}, {"pred": "some wolf fixed one pattern and Roger fixed three polar.", "target": "some wolf fixed one polar pattern and Roger fixed three."}, {"pred": "Alexander visited one pain and Sarah visited three red.", "target": "Alexander visited one red pain and Sarah visited three."}, {"pred": "some dinosaur visited one tall sign and Roger visited several.", "target": "some dinosaur visited one tall sign and Roger visited several."}, {"pred": "her boat married one hole and Sarah married two full.", "target": "her boat married one full hole and Sarah married two."}, {"pred": "the dinosaur fixed one soft spin and Mark fixed more.", "target": "the dinosaur fixed one soft spin and Mark fixed more."}, {"pred": "a wolf started one simple dance and Alexander started three.", "target": "a wolf started one simple dance and Alexander started three."}, {"pred": "some sister got one little medicine and Mark got more.", "target": "some sister got one little medicine and Mark got more."}, {"pred": "his sister moved one hole and Mark moved two needed.", "target": "his sister moved one needed hole and Mark moved two."}, {"pred": "her pig started one change and Alexander started more winning.", "target": "her pig started one winning change and Alexander started more."}, {"pred": "his sister married one dog and Roger married several finished.", "target": "his sister married one finished dog and Roger married several."}, {"pred": "Sarah started one speak and Roger started a lot more personal.", "target": "Sarah started one personal speak and Roger started a lot more."}, {"pred": "Alexander married one flat hole and Sarah married more.", "target": "Alexander married one flat hole and Sarah married more."}, {"pred": "some boat married one issue and Mark married several finished.", "target": "some boat married one finished issue and Mark married several."}, {"pred": "your dinosaur moved one hard parent and Alexander moved more.", "target": "your dinosaur moved one hard parent and Alexander moved more."}, {"pred": "his boat broke one canal and Mark broke three expected.", "target": "his boat broke one expected canal and Mark broke three."}, {"pred": "some slave married one track and Roger married several early.", "target": "some slave married one early track and Roger married several."}, {"pred": "this slave visited one carbon fire and Roger visited three.", "target": "this slave visited one carbon fire and Roger visited three."}, {"pred": "Sarah broke one quick parent and Mark broke several.", "target": "Sarah broke one quick parent and Mark broke several."}, {"pred": "her sister started one white floor and Roger started more.", "target": "her sister started one white floor and Roger started more."}, {"pred": "his wolf managed one discussion and Roger managed two fixed.", "target": "his wolf managed one fixed discussion and Roger managed two."}, {"pred": "Mark got one wrong duck and Sarah got three.", "target": "Mark got one wrong duck and Sarah got three."}, {"pred": "Alexander carried one distance and Alexander carried three ready.", "target": "Alexander carried one ready distance and Alexander carried three."}, {"pred": "your boat broke one evening and Mark broke two rolling.", "target": "your boat broke one rolling evening and Mark broke two."}, {"pred": "Roger carried one evening and Roger carried several personal.", "target": "Roger carried one personal evening and Roger carried several."}, {"pred": "the pig started one speak and Roger started a lot more personal.", "target": "the pig started one personal speak and Roger started a lot more."}, {"pred": "her doctor married one poor gate and Sarah married a lot more.", "target": "her doctor married one poor gate and Sarah married a lot more."}, {"pred": "some doctor started one little track and Roger started three.", "target": "some doctor started one little track and Roger started three."}, {"pred": "Alexander visited one carbon electricity and Sarah visited more.", "target": "Alexander visited one carbon electricity and Sarah visited more."}, {"pred": "some slave married one hole and Sarah married a lot more forced.", "target": "some slave married one forced hole and Sarah married a lot more."}, {"pred": "this boat visited one full ear and Mark visited more.", "target": "this boat visited one full ear and Mark visited more."}, {"pred": "a pig married one full speak and Roger married three.", "target": "a pig married one full speak and Roger married three."}, {"pred": "his pig managed one gate and Mark managed more close.", "target": "his pig managed one close gate and Mark managed more."}, {"pred": "Sarah got one canal and Alexander got a lot more healthy.", "target": "Sarah got one healthy canal and Alexander got a lot more."}, {"pred": "his sister married one stand and Roger married three hard.", "target": "his sister married one hard stand and Roger married three."}, {"pred": "some sister broke one girl and Sarah broke three ready.", "target": "some sister broke one ready girl and Sarah broke three."}, {"pred": "Sarah married one essay and Sarah married a lot more expected.", "target": "Sarah married one expected essay and Sarah married a lot more."}, {"pred": "her dinosaur entered one issue and Sarah entered two close.", "target": "her dinosaur entered one close issue and Sarah entered two."}, {"pred": "your pig broke one morning and Alexander broke three soft.", "target": "your pig broke one soft morning and Alexander broke three."}, {"pred": "Roger broke one positive pool and Roger broke several.", "target": "Roger broke one positive pool and Roger broke several."}, {"pred": "Alexander broke one healthy telephone and Sarah broke two.", "target": "Alexander broke one healthy telephone and Sarah broke two."}, {"pred": "your boat managed one image and Sarah managed several electronic.", "target": "your boat managed one electronic image and Sarah managed several."}, {"pred": "some duke carried one flat speak and Roger carried three.", "target": "some duke carried one flat speak and Roger carried three."}, {"pred": "that sister entered one wrong protection and Alexander entered two.", "target": "that sister entered one wrong protection and Alexander entered two."}, {"pred": "this slave got one poor circle and Roger got two.", "target": "this slave got one poor circle and Roger got two."}, {"pred": "your sister got one protection and Sarah got several polar.", "target": "your sister got one polar protection and Sarah got several."}, {"pred": "that duke broke one sacred circle and Roger broke more.", "target": "that duke broke one sacred circle and Roger broke more."}, {"pred": "Mark entered one polar distance and Roger entered several.", "target": "Mark entered one polar distance and Roger entered several."}, {"pred": "a pig got one purple hole and Sarah got several.", "target": "a pig got one purple hole and Sarah got several."}, {"pred": "a boat married one extra clothing and Sarah married two.", "target": "a boat married one extra clothing and Sarah married two."}, {"pred": "a duke entered one wrong bath and Roger entered two.", "target": "a duke entered one wrong bath and Roger entered two."}, {"pred": "Mark married one hole and Sarah married two full.", "target": "Mark married one full hole and Sarah married two."}, {"pred": "the doctor entered one rolling pain and Roger entered three.", "target": "the doctor entered one rolling pain and Roger entered three."}, {"pred": "a slave moved one ear and Alexander moved a lot more healthy.", "target": "a slave moved one healthy ear and Alexander moved a lot more."}, {"pred": "some dinosaur married one morning and Roger married three white.", "target": "some dinosaur married one white morning and Roger married three."}, {"pred": "a doctor married one bible and Roger married a lot more early.", "target": "a doctor married one early bible and Roger married a lot more."}, {"pred": "the pig moved one dog and Mark moved several ordered.", "target": "the pig moved one ordered dog and Mark moved several."}, {"pred": "Alexander got one dog and Mark got two abandoned.", "target": "Alexander got one abandoned dog and Mark got two."}, {"pred": "his sister started one protection and Mark started two ready.", "target": "his sister started one ready protection and Mark started two."}, {"pred": "Roger carried one girl and Sarah carried several yellow.", "target": "Roger carried one yellow girl and Sarah carried several."}, {"pred": "the boat started one discussion and Mark started more quick.", "target": "the boat started one quick discussion and Mark started more."}, {"pred": "a dinosaur fixed one floor and Sarah fixed more early.", "target": "a dinosaur fixed one early floor and Sarah fixed more."}, {"pred": "her pig married one dance and Sarah married two filled.", "target": "her pig married one filled dance and Sarah married two."}, {"pred": "his wolf married one complete chicken and Mark married three.", "target": "his wolf married one complete chicken and Mark married three."}, {"pred": "Roger broke one white fire and Alexander broke two.", "target": "Roger broke one white fire and Alexander broke two."}, {"pred": "Mark moved one canal and Mark moved three extra.", "target": "Mark moved one extra canal and Mark moved three."}, {"pred": "his duke visited one ear and Alexander visited three fixed.", "target": "his duke visited one fixed ear and Alexander visited three."}, {"pred": "her pig started one little hole and Sarah started more.", "target": "her pig started one little hole and Sarah started more."}, {"pred": "Sarah fixed one flat clothing and Mark fixed a lot more.", "target": "Sarah fixed one flat clothing and Mark fixed a lot more."}, {"pred": "Mark married one stand and Roger married three hard.", "target": "Mark married one hard stand and Roger married three."}]}
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/filler_gap/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/irregular_forms/eval_results.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"eval_accuracy": 0.7577720207253886, "per_example_results": [{"pred": "Sarah spoke to me some time ago.", "target": "Sarah spoke to me some time ago."}, {"pred": "Sarah had drew a round circle over there.", "target": "Sarah had drawn a round circle over there."}, {"pred": "Sarah grown quickly this morning.", "target": "Sarah grew quickly this morning."}, {"pred": "Mark chose the good one some time ago.", "target": "Mark chose the good one some time ago."}, {"pred": "Sarah had written a story last night.", "target": "Sarah had written a story last night."}, {"pred": "Sarah knew she could do it over there.", "target": "Sarah knew she could do it over there."}, {"pred": "Alexander had become angry some time ago.", "target": "Alexander had become angry some time ago."}, {"pred": "Roger written into a book last night.", "target": "Roger wrote into a book last night."}, {"pred": "Sarah had given a book to a student last night.", "target": "Sarah had given a book to a student last night."}, {"pred": "Alexander had spoke without thinking this morning.", "target": "Alexander had spoken without thinking this morning."}, {"pred": "Roger had knew she could do it over there.", "target": "Roger had known she could do it over there."}, {"pred": "Alexander spoke about many things last night.", "target": "Alexander spoke about many things last night."}, {"pred": "Roger had given something sweet to the baby this morning.", "target": "Roger had given something sweet to the baby this morning."}, {"pred": "Sarah had come just in time this morning.", "target": "Sarah had come just in time this morning."}, {"pred": "Alexander had written with a large pen some time ago.", "target": "Alexander had written with a large pen some time ago."}, {"pred": "Mark had drew a picture some time ago.", "target": "Mark had drawn a picture some time ago."}, {"pred": "Alexander had become very different this morning.", "target": "Alexander had become very different this morning."}, {"pred": "Roger drew a picture last night.", "target": "Roger drew a picture last night."}, {"pred": "Alexander wrote a note at home.", "target": "Alexander wrote a note at home."}, {"pred": "Mark had taken some food some time ago.", "target": "Mark had taken some food some time ago."}, {"pred": "Mark had written into a book last night.", "target": "Mark had written into a book last night."}, {"pred": "Mark saw a bird this morning.", "target": "Mark saw a bird this morning."}, {"pred": "Alexander came too late some time ago.", "target": "Alexander came too late some time ago."}, {"pred": "Roger written into a book some time ago.", "target": "Roger wrote into a book some time ago."}, {"pred": "Alexander had spoke very fast last night.", "target": "Alexander had spoken very fast last night."}, {"pred": "Alexander had written a story at home.", "target": "Alexander had written a story at home."}, {"pred": "Roger had known a lot of things last night.", "target": "Roger had known a lot of things last night."}, {"pred": "Alexander spoke to me some time ago.", "target": "Alexander spoke to me some time ago."}, {"pred": "Roger knew she could do it some time ago.", "target": "Roger knew she could do it some time ago."}, {"pred": "Alexander saw a bird at home.", "target": "Alexander saw a bird at home."}, {"pred": "Sarah had taken a paper over there.", "target": "Sarah had taken a paper over there."}, {"pred": "Alexander took some food some time ago.", "target": "Alexander took some food some time ago."}, {"pred": "Roger drew a round circle some time ago.", "target": "Roger drew a round circle some time ago."}, {"pred": "Mark had drew a round circle this morning.", "target": "Mark had drawn a round circle this morning."}, {"pred": "Sarah had given something sweet to the baby some time ago.", "target": "Sarah had given something sweet to the baby some time ago."}, {"pred": "Sarah became very different last night.", "target": "Sarah became very different last night."}, {"pred": "Sarah had chose the good one this morning.", "target": "Sarah had chosen the good one this morning."}, {"pred": "Mark had taken a paper at home.", "target": "Mark had taken a paper at home."}, {"pred": "Mark had taken the bell some time ago.", "target": "Mark had taken the bell some time ago."}, {"pred": "Mark grown quickly over there.", "target": "Mark grew quickly over there."}, {"pred": "Alexander became very different this morning.", "target": "Alexander became very different this morning."}, {"pred": "Sarah took some food last night.", "target": "Sarah took some food last night."}, {"pred": "Mark had written with a large pen at home.", "target": "Mark had written with a large pen at home."}, {"pred": "Roger had drew a round circle last night.", "target": "Roger had drawn a round circle last night."}, {"pred": "Roger gave a book to a student last night.", "target": "Roger gave a book to a student last night."}, {"pred": "Mark come just in time this morning.", "target": "Mark came just in time this morning."}, {"pred": "Mark had seen a bird over there.", "target": "Mark had seen a bird over there."}, {"pred": "Roger chose the good one last night.", "target": "Roger chose the good one last night."}, {"pred": "Mark chose the best option some time ago.", "target": "Mark chose the best option some time ago."}, {"pred": "Sarah spoke without thinking at home.", "target": "Sarah spoke without thinking at home."}, {"pred": "Roger had become very different at home.", "target": "Roger had become very different at home."}, {"pred": "Sarah took it over there.", "target": "Sarah took it over there."}, {"pred": "Mark had spoke to me last night.", "target": "Mark had spoken to me last night."}, {"pred": "Mark had chose the good one this morning.", "target": "Mark had chosen the good one this morning."}, {"pred": "Mark knew a lot of things at home.", "target": "Mark knew a lot of things at home."}, {"pred": "Alexander came too late over there.", "target": "Alexander came too late over there."}, {"pred": "Roger chose the best option over there.", "target": "Roger chose the best option over there."}, {"pred": "Alexander had chosen the best option this morning.", "target": "Alexander had chosen the best option this morning."}, {"pred": "Roger had spoke without thinking over there.", "target": "Roger had spoken without thinking over there."}, {"pred": "Sarah wrote with a large pen over there.", "target": "Sarah wrote with a large pen over there."}, {"pred": "Roger saw something at home.", "target": "Roger saw something at home."}, {"pred": "Sarah took a paper some time ago.", "target": "Sarah took a paper some time ago."}, {"pred": "Sarah spoke very fast at home.", "target": "Sarah spoke very fast at home."}, {"pred": "Mark had become very different at home.", "target": "Mark had become very different at home."}, {"pred": "Mark had spoke about many things at home.", "target": "Mark had spoken about many things at home."}, {"pred": "Sarah had spoke very fast some time ago.", "target": "Sarah had spoken very fast some time ago."}, {"pred": "Alexander had taken some food at home.", "target": "Alexander had taken some food at home."}, {"pred": "Mark knew she could do it at home.", "target": "Mark knew she could do it at home."}, {"pred": "Alexander took some food this morning.", "target": "Alexander took some food this morning."}, {"pred": "Sarah drew a round circle some time ago.", "target": "Sarah drew a round circle some time ago."}, {"pred": "Alexander had written with a large pen last night.", "target": "Alexander had written with a large pen last night."}, {"pred": "Alexander became angry last night.", "target": "Alexander became angry last night."}, {"pred": "Alexander had given something sweet to the baby some time ago.", "target": "Alexander had given something sweet to the baby some time ago."}, {"pred": "Sarah spoke very fast some time ago.", "target": "Sarah spoke very fast some time ago."}, {"pred": "Mark wrote with a large pen over there.", "target": "Mark wrote with a large pen over there."}, {"pred": "Mark had seen a bird last night.", "target": "Mark had seen a bird last night."}, {"pred": "Mark had become angry at home.", "target": "Mark had become angry at home."}, {"pred": "Sarah chose the good one some time ago.", "target": "Sarah chose the good one some time ago."}, {"pred": "Mark had seen a bird this morning.", "target": "Mark had seen a bird this morning."}, {"pred": "Mark spoke about many things last night.", "target": "Mark spoke about many things last night."}, {"pred": "Alexander had become very different at home.", "target": "Alexander had become very different at home."}, {"pred": "Sarah come when we needed her this morning.", "target": "Sarah came when we needed her this morning."}, {"pred": "Roger written with a large pen some time ago.", "target": "Roger wrote with a large pen some time ago."}, {"pred": "Mark had spoke about many things this morning.", "target": "Mark had spoken about many things this morning."}, {"pred": "Roger had written with a large pen this morning.", "target": "Roger had written with a large pen this morning."}, {"pred": "Alexander had chose the best option over there.", "target": "Alexander had chosen the best option over there."}, {"pred": "Alexander had spoke without thinking over there.", "target": "Alexander had spoken without thinking over there."}, {"pred": "Alexander spoke without thinking over there.", "target": "Alexander spoke without thinking over there."}, {"pred": "Mark became someone else some time ago.", "target": "Mark became someone else some time ago."}, {"pred": "Roger drew a picture at home.", "target": "Roger drew a picture at home."}, {"pred": "Alexander had became someone else this morning.", "target": "Alexander had become someone else this morning."}, {"pred": "Sarah had become someone else some time ago.", "target": "Sarah had become someone else some time ago."}, {"pred": "Roger took a paper this morning.", "target": "Roger took a paper this morning."}, {"pred": "Alexander had given something sweet to the baby last night.", "target": "Alexander had given something sweet to the baby last night."}, {"pred": "Sarah became very different some time ago.", "target": "Sarah became very different some time ago."}, {"pred": "Sarah had knew she could do it last night.", "target": "Sarah had known she could do it last night."}, {"pred": "Mark came just in time over there.", "target": "Mark came just in time over there."}, {"pred": "Alexander come too late this morning.", "target": "Alexander came too late this morning."}, {"pred": "Sarah had taken some food at home.", "target": "Sarah had taken some food at home."}, {"pred": "Alexander took a paper at home.", "target": "Alexander took a paper at home."}, {"pred": "Roger drew a round circle last night.", "target": "Roger drew a round circle last night."}, {"pred": "Alexander had grown quickly this morning.", "target": "Alexander had grown quickly this morning."}, {"pred": "Sarah knew she could do it this morning.", "target": "Sarah knew she could do it this morning."}, {"pred": "Sarah spoke about many things over there.", "target": "Sarah spoke about many things over there."}, {"pred": "Mark knew a lot of things last night.", "target": "Mark knew a lot of things last night."}, {"pred": "Mark come when we needed her at home.", "target": "Mark came when we needed her at home."}, {"pred": "Roger came to the store last night.", "target": "Roger came to the store last night."}, {"pred": "Mark chose the best option over there.", "target": "Mark chose the best option over there."}, {"pred": "Roger took it last night.", "target": "Roger took it last night."}, {"pred": "Alexander drew a picture some time ago.", "target": "Alexander drew a picture some time ago."}, {"pred": "Roger knew a lot of things last night.", "target": "Roger knew a lot of things last night."}, {"pred": "Roger had taken them last night.", "target": "Roger had taken them last night."}, {"pred": "Alexander had drew a picture over there.", "target": "Alexander had drawn a picture over there."}, {"pred": "Sarah had come too late this morning.", "target": "Sarah had come too late this morning."}, {"pred": "Sarah gave money to the man last night.", "target": "Sarah gave money to the man last night."}, {"pred": "Roger had written a note some time ago.", "target": "Roger had written a note some time ago."}, {"pred": "Roger had drew a picture last night.", "target": "Roger had drawn a picture last night."}, {"pred": "Roger had seen a shape last night.", "target": "Roger had seen a shape last night."}, {"pred": "Roger gave a book to a student over there.", "target": "Roger gave a book to a student over there."}, {"pred": "Mark had known a lot of things over there.", "target": "Mark had known a lot of things over there."}, {"pred": "Roger came to the store over there.", "target": "Roger came to the store over there."}, {"pred": "Sarah wrote a note last night.", "target": "Sarah wrote a note last night."}, {"pred": "Alexander had came to the store last night.", "target": "Alexander had come to the store last night."}, {"pred": "Mark had come just in time over there.", "target": "Mark had come just in time over there."}, {"pred": "Mark come when we needed her last night.", "target": "Mark came when we needed her last night."}, {"pred": "Roger written with a large pen this morning.", "target": "Roger wrote with a large pen this morning."}, {"pred": "Mark had spoke without thinking over there.", "target": "Mark had spoken without thinking over there."}, {"pred": "Sarah came just in time last night.", "target": "Sarah came just in time last night."}, {"pred": "Alexander had chosen the best option some time ago.", "target": "Alexander had chosen the best option some time ago."}, {"pred": "Alexander had chosen the good one some time ago.", "target": "Alexander had chosen the good one some time ago."}, {"pred": "Alexander drew a map last night.", "target": "Alexander drew a map last night."}, {"pred": "Sarah become someone else at home.", "target": "Sarah became someone else at home."}, {"pred": "Sarah saw a bird over there.", "target": "Sarah saw a bird over there."}, {"pred": "Roger gave something sweet to the baby some time ago.", "target": "Roger gave something sweet to the baby some time ago."}, {"pred": "Mark had taken the bell at home.", "target": "Mark had taken the bell at home."}, {"pred": "Roger had given something sweet to the baby over there.", "target": "Roger had given something sweet to the baby over there."}, {"pred": "Sarah saw a bird at home.", "target": "Sarah saw a bird at home."}, {"pred": "Roger had spoke to me over there.", "target": "Roger had spoken to me over there."}, {"pred": "Mark became someone else over there.", "target": "Mark became someone else over there."}, {"pred": "Sarah wrote a note some time ago.", "target": "Sarah wrote a note some time ago."}, {"pred": "Alexander had known a lot of things some time ago.", "target": "Alexander had known a lot of things some time ago."}, {"pred": "Alexander gave money to the man some time ago.", "target": "Alexander gave money to the man some time ago."}, {"pred": "Alexander had given a book to a student some time ago.", "target": "Alexander had given a book to a student some time ago."}, {"pred": "Mark took some food some time ago.", "target": "Mark took some food some time ago."}, {"pred": "Roger took some food last night.", "target": "Roger took some food last night."}, {"pred": "Alexander had known a lot of things this morning.", "target": "Alexander had known a lot of things this morning."}, {"pred": "Alexander had given a book to a student over there.", "target": "Alexander had given a book to a student over there."}, {"pred": "Mark had come when we needed her at home.", "target": "Mark had come when we needed her at home."}, {"pred": "Alexander had taken some food some time ago.", "target": "Alexander had taken some food some time ago."}, {"pred": "Sarah had spoke without thinking at home.", "target": "Sarah had spoken without thinking at home."}, {"pred": "Alexander had given something sweet to the baby over there.", "target": "Alexander had given something sweet to the baby over there."}, {"pred": "Roger had given a book to a student some time ago.", "target": "Roger had given a book to a student some time ago."}, {"pred": "Sarah become someone else over there.", "target": "Sarah became someone else over there."}, {"pred": "Roger gave money to the man last night.", "target": "Roger gave money to the man last night."}, {"pred": "Alexander chose the good one this morning.", "target": "Alexander chose the good one this morning."}, {"pred": "Roger grew quickly last night.", "target": "Roger grew quickly last night."}, {"pred": "Roger become very different at home.", "target": "Roger became very different at home."}, {"pred": "Mark had knew she could do it some time ago.", "target": "Mark had known she could do it some time ago."}, {"pred": "Mark came to the store some time ago.", "target": "Mark came to the store some time ago."}, {"pred": "Alexander gave a book to a student last night.", "target": "Alexander gave a book to a student last night."}, {"pred": "Alexander had written a note at home.", "target": "Alexander had written a note at home."}, {"pred": "Alexander come too late last night.", "target": "Alexander came too late last night."}, {"pred": "Alexander knew she could do it this morning.", "target": "Alexander knew she could do it this morning."}, {"pred": "Roger come just in time last night.", "target": "Roger came just in time last night."}, {"pred": "Mark drew a round circle over there.", "target": "Mark drew a round circle over there."}, {"pred": "Mark had chose the good one last night.", "target": "Mark had chosen the good one last night."}, {"pred": "Sarah drew a picture at home.", "target": "Sarah drew a picture at home."}, {"pred": "Alexander spoke to me over there.", "target": "Alexander spoke to me over there."}, {"pred": "Sarah had become someone else at home.", "target": "Sarah had become someone else at home."}, {"pred": "Mark wrote with a large pen this morning.", "target": "Mark wrote with a large pen this morning."}, {"pred": "Alexander became someone else this morning.", "target": "Alexander became someone else this morning."}, {"pred": "Alexander had grown quickly over there.", "target": "Alexander had grown quickly over there."}, {"pred": "Alexander had spoke to me some time ago.", "target": "Alexander had spoken to me some time ago."}, {"pred": "Mark spoke very fast some time ago.", "target": "Mark spoke very fast some time ago."}, {"pred": "Sarah gave a book to a student at home.", "target": "Sarah gave a book to a student at home."}, {"pred": "Alexander written a story some time ago.", "target": "Alexander wrote a story some time ago."}, {"pred": "Sarah had come to the store some time ago.", "target": "Sarah had come to the store some time ago."}, {"pred": "Sarah had given money to the man over there.", "target": "Sarah had given money to the man over there."}, {"pred": "Roger had known a lot of things over there.", "target": "Roger had known a lot of things over there."}, {"pred": "Roger had chosen the good one this morning.", "target": "Roger had chosen the good one this morning."}, {"pred": "Mark had written with a large pen over there.", "target": "Mark had written with a large pen over there."}, {"pred": "Mark had knew a lot of things this morning.", "target": "Mark had known a lot of things this morning."}, {"pred": "Alexander had written into a book at home.", "target": "Alexander had written into a book at home."}, {"pred": "Alexander had taken some food this morning.", "target": "Alexander had taken some food this morning."}, {"pred": "Alexander came when we needed her last night.", "target": "Alexander came when we needed her last night."}, {"pred": "Roger drew a map last night.", "target": "Roger drew a map last night."}, {"pred": "Sarah took them over there.", "target": "Sarah took them over there."}, {"pred": "Sarah saw a shape over there.", "target": "Sarah saw a shape over there."}, {"pred": "Sarah gave something sweet to the baby some time ago.", "target": "Sarah gave something sweet to the baby some time ago."}, {"pred": "Alexander took the bell some time ago.", "target": "Alexander took the bell some time ago."}, {"pred": "Sarah saw something this morning.", "target": "Sarah saw something this morning."}, {"pred": "Sarah become angry last night.", "target": "Sarah became angry last night."}, {"pred": "Mark had come just in time last night.", "target": "Mark had come just in time last night."}, {"pred": "Mark came just in time last night.", "target": "Mark came just in time last night."}, {"pred": "Mark written into a book at home.", "target": "Mark wrote into a book at home."}, {"pred": "Mark had knew she could do it at home.", "target": "Mark had known she could do it at home."}, {"pred": "Sarah chose the best option over there.", "target": "Sarah chose the best option over there."}, {"pred": "Sarah had written with a large pen over there.", "target": "Sarah had written with a large pen over there."}, {"pred": "Sarah came to the store last night.", "target": "Sarah came to the store last night."}, {"pred": "Alexander chose the best option last night.", "target": "Alexander chose the best option last night."}, {"pred": "Mark had grown quickly at home.", "target": "Mark had grown quickly at home."}, {"pred": "Mark saw something last night.", "target": "Mark saw something last night."}, {"pred": "Alexander gave something sweet to the baby some time ago.", "target": "Alexander gave something sweet to the baby some time ago."}, {"pred": "Alexander had become angry this morning.", "target": "Alexander had become angry this morning."}, {"pred": "Roger became very different last night.", "target": "Roger became very different last night."}, {"pred": "Sarah had written a note some time ago.", "target": "Sarah had written a note some time ago."}, {"pred": "Roger became someone else over there.", "target": "Roger became someone else over there."}, {"pred": "Alexander had spoke about many things last night.", "target": "Alexander had spoken about many things last night."}, {"pred": "Roger spoke about many things over there.", "target": "Roger spoke about many things over there."}, {"pred": "Mark spoke to me over there.", "target": "Mark spoke to me over there."}, {"pred": "Sarah had grown quickly this morning.", "target": "Sarah had grown quickly this morning."}, {"pred": "Sarah wrote with a large pen this morning.", "target": "Sarah wrote with a large pen this morning."}, {"pred": "Mark chose the best option last night.", "target": "Mark chose the best option last night."}, {"pred": "Mark had given something sweet to the baby last night.", "target": "Mark had given something sweet to the baby last night."}, {"pred": "Roger written with a large pen over there.", "target": "Roger wrote with a large pen over there."}, {"pred": "Alexander had given a book to a student last night.", "target": "Alexander had given a book to a student last night."}, {"pred": "Mark had come when we needed her this morning.", "target": "Mark had come when we needed her this morning."}, {"pred": "Alexander had taken a paper at home.", "target": "Alexander had taken a paper at home."}, {"pred": "Roger had knew she could do it this morning.", "target": "Roger had known she could do it this morning."}, {"pred": "Alexander chose the best option over there.", "target": "Alexander chose the best option over there."}, {"pred": "Mark had chose the best option this morning.", "target": "Mark had chosen the best option this morning."}, {"pred": "Sarah chose the good one at home.", "target": "Sarah chose the good one at home."}, {"pred": "Sarah drew a round circle at home.", "target": "Sarah drew a round circle at home."}, {"pred": "Mark had chose the best option last night.", "target": "Mark had chosen the best option last night."}, {"pred": "Sarah gave money to the man at home.", "target": "Sarah gave money to the man at home."}, {"pred": "Alexander had written with a large pen over there.", "target": "Alexander had written with a large pen over there."}, {"pred": "Mark had grown quickly some time ago.", "target": "Mark had grown quickly some time ago."}, {"pred": "Mark had spoke very fast last night.", "target": "Mark had spoken very fast last night."}, {"pred": "Alexander chose the best option this morning.", "target": "Alexander chose the best option this morning."}, {"pred": "Alexander had given something sweet to the baby this morning.", "target": "Alexander had given something sweet to the baby this morning."}, {"pred": "Sarah had seen something last night.", "target": "Sarah had seen something last night."}, {"pred": "Mark had spoke very fast over there.", "target": "Mark had spoken very fast over there."}, {"pred": "Alexander written with a large pen last night.", "target": "Alexander wrote with a large pen last night."}, {"pred": "Mark had come when we needed her last night.", "target": "Mark had come when we needed her last night."}, {"pred": "Roger become angry some time ago.", "target": "Roger became angry some time ago."}, {"pred": "Roger had taken some food this morning.", "target": "Roger had taken some food this morning."}, {"pred": "Roger had become angry some time ago.", "target": "Roger had become angry some time ago."}, {"pred": "Mark became someone else last night.", "target": "Mark became someone else last night."}, {"pred": "Mark had became someone else some time ago.", "target": "Mark had become someone else some time ago."}, {"pred": "Mark saw a bird last night.", "target": "Mark saw a bird last night."}, {"pred": "Mark took a paper at home.", "target": "Mark took a paper at home."}, {"pred": "Roger had seen something at home.", "target": "Roger had seen something at home."}, {"pred": "Roger had drew a map last night.", "target": "Roger had drawn a map last night."}, {"pred": "Roger become angry at home.", "target": "Roger became angry at home."}, {"pred": "Mark knew she could do it over there.", "target": "Mark knew she could do it over there."}, {"pred": "Roger had written with a large pen some time ago.", "target": "Roger had written with a large pen some time ago."}, {"pred": "Sarah had seen a bird last night.", "target": "Sarah had seen a bird last night."}, {"pred": "Sarah had known a lot of things over there.", "target": "Sarah had known a lot of things over there."}, {"pred": "Sarah wrote with a large pen at home.", "target": "Sarah wrote with a large pen at home."}, {"pred": "Roger had became very different this morning.", "target": "Roger had become very different this morning."}, {"pred": "Roger took a paper over there.", "target": "Roger took a paper over there."}, {"pred": "Roger gave something sweet to the baby at home.", "target": "Roger gave something sweet to the baby at home."}, {"pred": "Roger had taken the bell some time ago.", "target": "Roger had taken the bell some time ago."}, {"pred": "Mark spoke about many things this morning.", "target": "Mark spoke about many things this morning."}, {"pred": "Roger chose the best option some time ago.", "target": "Roger chose the best option some time ago."}, {"pred": "Alexander become very different at home.", "target": "Alexander became very different at home."}, {"pred": "Roger had come just in time some time ago.", "target": "Roger had come just in time some time ago."}, {"pred": "Roger spoke to me last night.", "target": "Roger spoke to me last night."}, {"pred": "Alexander took a paper this morning.", "target": "Alexander took a paper this morning."}, {"pred": "Mark had became very different some time ago.", "target": "Mark had become very different some time ago."}, {"pred": "Roger gave money to the man this morning.", "target": "Roger gave money to the man this morning."}, {"pred": "Roger drew a picture some time ago.", "target": "Roger drew a picture some time ago."}, {"pred": "Alexander had chosen the best option last night.", "target": "Alexander had chosen the best option last night."}, {"pred": "Sarah had taken it at home.", "target": "Sarah had taken it at home."}, {"pred": "Roger had written into a book over there.", "target": "Roger had written into a book over there."}, {"pred": "Roger had chosen the good one some time ago.", "target": "Roger had chosen the good one some time ago."}, {"pred": "Sarah had given a book to a student some time ago.", "target": "Sarah had given a book to a student some time ago."}, {"pred": "Mark had written into a book at home.", "target": "Mark had written into a book at home."}, {"pred": "Sarah had known a lot of things last night.", "target": "Sarah had known a lot of things last night."}, {"pred": "Sarah had taken them over there.", "target": "Sarah had taken them over there."}, {"pred": "Alexander saw something this morning.", "target": "Alexander saw something this morning."}, {"pred": "Roger saw a shape last night.", "target": "Roger saw a shape last night."}, {"pred": "Alexander knew she could do it some time ago.", "target": "Alexander knew she could do it some time ago."}, {"pred": "Sarah come just in time this morning.", "target": "Sarah came just in time this morning."}, {"pred": "Sarah had given money to the man at home.", "target": "Sarah had given money to the man at home."}, {"pred": "Roger had spoke very fast some time ago.", "target": "Roger had spoken very fast some time ago."}, {"pred": "Mark grew quickly some time ago.", "target": "Mark grew quickly some time ago."}, {"pred": "Roger had taken a paper some time ago.", "target": "Roger had taken a paper some time ago."}, {"pred": "Alexander came to the store over there.", "target": "Alexander came to the store over there."}, {"pred": "Mark drew a round circle this morning.", "target": "Mark drew a round circle this morning."}, {"pred": "Roger drew a round circle over there.", "target": "Roger drew a round circle over there."}, {"pred": "Roger come just in time over there.", "target": "Roger came just in time over there."}, {"pred": "Alexander took it at home.", "target": "Alexander took it at home."}, {"pred": "Alexander saw a bird over there.", "target": "Alexander saw a bird over there."}, {"pred": "Roger knew she could do it this morning.", "target": "Roger knew she could do it this morning."}, {"pred": "Alexander knew a lot of things some time ago.", "target": "Alexander knew a lot of things some time ago."}, {"pred": "Sarah had spoke about many things over there.", "target": "Sarah had spoken about many things over there."}, {"pred": "Sarah come when we needed her last night.", "target": "Sarah came when we needed her last night."}, {"pred": "Mark spoke very fast at home.", "target": "Mark spoke very fast at home."}, {"pred": "Roger had drew a picture some time ago.", "target": "Roger had drawn a picture some time ago."}, {"pred": "Mark had come when we needed her over there.", "target": "Mark had come when we needed her over there."}, {"pred": "Mark had come to the store some time ago.", "target": "Mark had come to the store some time ago."}, {"pred": "Mark had written a note over there.", "target": "Mark had written a note over there."}, {"pred": "Sarah come just in time some time ago.", "target": "Sarah came just in time some time ago."}, {"pred": "Roger had come too late some time ago.", "target": "Roger had come too late some time ago."}, {"pred": "Alexander took them over there.", "target": "Alexander took them over there."}, {"pred": "Roger had come to the store some time ago.", "target": "Roger had come to the store some time ago."}, {"pred": "Alexander become angry some time ago.", "target": "Alexander became angry some time ago."}, {"pred": "Mark had drew a round circle some time ago.", "target": "Mark had drawn a round circle some time ago."}, {"pred": "Sarah had become very different at home.", "target": "Sarah had become very different at home."}, {"pred": "Sarah had became very different last night.", "target": "Sarah had become very different last night."}, {"pred": "Roger had seen something this morning.", "target": "Roger had seen something this morning."}, {"pred": "Alexander saw something some time ago.", "target": "Alexander saw something some time ago."}, {"pred": "Mark drew a picture some time ago.", "target": "Mark drew a picture some time ago."}, {"pred": "Mark became very different some time ago.", "target": "Mark became very different some time ago."}, {"pred": "Roger had grown quickly at home.", "target": "Roger had grown quickly at home."}, {"pred": "Roger had grown quickly some time ago.", "target": "Roger had grown quickly some time ago."}, {"pred": "Roger had spoke to me this morning.", "target": "Roger had spoken to me this morning."}, {"pred": "Sarah had seen something this morning.", "target": "Sarah had seen something this morning."}, {"pred": "Sarah wrote with a large pen last night.", "target": "Sarah wrote with a large pen last night."}, {"pred": "Sarah become angry some time ago.", "target": "Sarah became angry some time ago."}, {"pred": "Mark had knew a lot of things at home.", "target": "Mark had known a lot of things at home."}, {"pred": "Mark took a paper over there.", "target": "Mark took a paper over there."}, {"pred": "Alexander spoke without thinking some time ago.", "target": "Alexander spoke without thinking some time ago."}, {"pred": "Alexander had written a note last night.", "target": "Alexander had written a note last night."}, {"pred": "Sarah had seen something over there.", "target": "Sarah had seen something over there."}, {"pred": "Sarah had seen a shape at home.", "target": "Sarah had seen a shape at home."}, {"pred": "Sarah had written into a book last night.", "target": "Sarah had written into a book last night."}, {"pred": "Alexander had spoke about many things over there.", "target": "Alexander had spoken about many things over there."}, {"pred": "Mark chose the good one at home.", "target": "Mark chose the good one at home."}, {"pred": "Alexander had grown quickly some time ago.", "target": "Alexander had grown quickly some time ago."}, {"pred": "Roger took the bell last night.", "target": "Roger took the bell last night."}, {"pred": "Roger written into a book at home.", "target": "Roger wrote into a book at home."}, {"pred": "Mark had chose the good one over there.", "target": "Mark had chosen the good one over there."}, {"pred": "Roger gave a book to a student some time ago.", "target": "Roger gave a book to a student some time ago."}, {"pred": "Sarah gave a book to a student last night.", "target": "Sarah gave a book to a student last night."}, {"pred": "Sarah had drew a picture last night.", "target": "Sarah had drawn a picture last night."}, {"pred": "Roger took some food this morning.", "target": "Roger took some food this morning."}, {"pred": "Roger had come just in time over there.", "target": "Roger had come just in time over there."}, {"pred": "Roger had came to the store over there.", "target": "Roger had come to the store over there."}, {"pred": "Roger chose the good one over there.", "target": "Roger chose the good one over there."}, {"pred": "Mark came to the store last night.", "target": "Mark came to the store last night."}, {"pred": "Alexander had drew a picture some time ago.", "target": "Alexander had drawn a picture some time ago."}, {"pred": "Roger written a note at home.", "target": "Roger wrote a note at home."}, {"pred": "Mark chose the best option at home.", "target": "Mark chose the best option at home."}, {"pred": "Mark had become very different over there.", "target": "Mark had become very different over there."}, {"pred": "Mark knew a lot of things over there.", "target": "Mark knew a lot of things over there."}, {"pred": "Roger had taken a paper over there.", "target": "Roger had taken a paper over there."}, {"pred": "Roger had taken a paper this morning.", "target": "Roger had taken a paper this morning."}, {"pred": "Alexander grew quickly this morning.", "target": "Alexander grew quickly this morning."}, {"pred": "Alexander had drew a picture this morning.", "target": "Alexander had drawn a picture this morning."}, {"pred": "Mark saw a shape at home.", "target": "Mark saw a shape at home."}, {"pred": "Alexander spoke very fast at home.", "target": "Alexander spoke very fast at home."}, {"pred": "Roger taken a paper some time ago.", "target": "Roger took a paper some time ago."}, {"pred": "Mark gave a book to a student last night.", "target": "Mark gave a book to a student last night."}, {"pred": "Sarah took the bell over there.", "target": "Sarah took the bell over there."}, {"pred": "Alexander wrote a note last night.", "target": "Alexander wrote a note last night."}, {"pred": "Alexander had come too late over there.", "target": "Alexander had come too late over there."}, {"pred": "Sarah took some food this morning.", "target": "Sarah took some food this morning."}, {"pred": "Sarah had come to the store at home.", "target": "Sarah had come to the store at home."}, {"pred": "Sarah came too late this morning.", "target": "Sarah came too late this morning."}, {"pred": "Mark knew a lot of things some time ago.", "target": "Mark knew a lot of things some time ago."}, {"pred": "Mark had became someone else last night.", "target": "Mark had become someone else last night."}, {"pred": "Sarah had taken some food last night.", "target": "Sarah had taken some food last night."}, {"pred": "Roger had chosen the best option over there.", "target": "Roger had chosen the best option over there."}, {"pred": "Alexander took the bell this morning.", "target": "Alexander took the bell this morning."}, {"pred": "Alexander gave something sweet to the baby over there.", "target": "Alexander gave something sweet to the baby over there."}, {"pred": "Alexander had chosen the good one at home.", "target": "Alexander had chosen the good one at home."}, {"pred": "Sarah had taken the bell some time ago.", "target": "Sarah had taken the bell some time ago."}, {"pred": "Roger had seen a shape at home.", "target": "Roger had seen a shape at home."}, {"pred": "Sarah written into a book over there.", "target": "Sarah wrote into a book over there."}, {"pred": "Sarah took the bell some time ago.", "target": "Sarah took the bell some time ago."}, {"pred": "Mark had come just in time this morning.", "target": "Mark had come just in time this morning."}, {"pred": "Sarah had taken them at home.", "target": "Sarah had taken them at home."}, {"pred": "Roger chose the good one some time ago.", "target": "Roger chose the good one some time ago."}, {"pred": "Alexander had known a lot of things over there.", "target": "Alexander had known a lot of things over there."}, {"pred": "Mark chose the good one last night.", "target": "Mark chose the good one last night."}, {"pred": "Roger had known a lot of things this morning.", "target": "Roger had known a lot of things this morning."}, {"pred": "Sarah had taken a paper this morning.", "target": "Sarah had taken a paper this morning."}, {"pred": "Sarah knew a lot of things over there.", "target": "Sarah knew a lot of things over there."}, {"pred": "Roger spoke to me this morning.", "target": "Roger spoke to me this morning."}, {"pred": "Roger had became very different last night.", "target": "Roger had become very different last night."}, {"pred": "Sarah had written with a large pen this morning.", "target": "Sarah had written with a large pen this morning."}, {"pred": "Sarah had come when we needed her last night.", "target": "Sarah had come when we needed her last night."}, {"pred": "Sarah had chose the good one at home.", "target": "Sarah had chosen the good one at home."}, {"pred": "Alexander had taken them some time ago.", "target": "Alexander had taken them some time ago."}, {"pred": "Alexander came to the store last night.", "target": "Alexander came to the store last night."}, {"pred": "Sarah had come just in time some time ago.", "target": "Sarah had come just in time some time ago."}, {"pred": "Alexander gave something sweet to the baby this morning.", "target": "Alexander gave something sweet to the baby this morning."}, {"pred": "Roger had chosen the good one last night.", "target": "Roger had chosen the good one last night."}, {"pred": "Alexander had knew she could do it this morning.", "target": "Alexander had known she could do it this morning."}, {"pred": "Mark had spoke to me some time ago.", "target": "Mark had spoken to me some time ago."}, {"pred": "Roger had spoke without thinking this morning.", "target": "Roger had spoken without thinking this morning."}, {"pred": "Mark had taken a paper over there.", "target": "Mark had taken a paper over there."}, {"pred": "Roger had spoke about many things last night.", "target": "Roger had spoken about many things last night."}, {"pred": "Alexander spoke without thinking this morning.", "target": "Alexander spoke without thinking this morning."}, {"pred": "Alexander had given money to the man over there.", "target": "Alexander had given money to the man over there."}, {"pred": "Alexander had come too late some time ago.", "target": "Alexander had come too late some time ago."}, {"pred": "Sarah grown quickly over there.", "target": "Sarah grew quickly over there."}, {"pred": "Sarah took the bell this morning.", "target": "Sarah took the bell this morning."}, {"pred": "Mark gave a book to a student this morning.", "target": "Mark gave a book to a student this morning."}, {"pred": "Sarah grew quickly at home.", "target": "Sarah grew quickly at home."}, {"pred": "Mark had chosen the best option some time ago.", "target": "Mark had chosen the best option some time ago."}, {"pred": "Mark had seen something last night.", "target": "Mark had seen something last night."}, {"pred": "Roger took them last night.", "target": "Roger took them last night."}, {"pred": "Roger spoke about many things last night.", "target": "Roger spoke about many things last night."}, {"pred": "Sarah had become someone else over there.", "target": "Sarah had become someone else over there."}, {"pred": "Sarah had spoken without thinking over there.", "target": "Sarah had spoken without thinking over there."}, {"pred": "Alexander had knew she could do it some time ago.", "target": "Alexander had known she could do it some time ago."}, {"pred": "Sarah had written with a large pen last night.", "target": "Sarah had written with a large pen last night."}, {"pred": "Mark had written into a book some time ago.", "target": "Mark had written into a book some time ago."}, {"pred": "Sarah had chose the best option over there.", "target": "Sarah had chosen the best option over there."}, {"pred": "Mark gave a book to a student at home.", "target": "Mark gave a book to a student at home."}, {"pred": "Sarah had taken some food this morning.", "target": "Sarah had taken some food this morning."}, {"pred": "Mark had chosen the good one at home.", "target": "Mark had chosen the good one at home."}, {"pred": "Roger grown quickly over there.", "target": "Roger grew quickly over there."}, {"pred": "Mark drew a round circle some time ago.", "target": "Mark drew a round circle some time ago."}, {"pred": "Roger had become angry at home.", "target": "Roger had become angry at home."}, {"pred": "Roger had given money to the man at home.", "target": "Roger had given money to the man at home."}, {"pred": "Roger had come to the store this morning.", "target": "Roger had come to the store this morning."}, {"pred": "Roger written a note last night.", "target": "Roger wrote a note last night."}, {"pred": "Sarah had knew she could do it some time ago.", "target": "Sarah had known she could do it some time ago."}, {"pred": "Sarah had given money to the man some time ago.", "target": "Sarah had given money to the man some time ago."}, {"pred": "Mark had grown quickly over there.", "target": "Mark had grown quickly over there."}, {"pred": "Mark had given a book to a student at home.", "target": "Mark had given a book to a student at home."}, {"pred": "Mark had drew a picture last night.", "target": "Mark had drawn a picture last night."}, {"pred": "Mark became very different at home.", "target": "Mark became very different at home."}, {"pred": "Mark had become angry over there.", "target": "Mark had become angry over there."}, {"pred": "Alexander drew a round circle some time ago.", "target": "Alexander drew a round circle some time ago."}, {"pred": "Alexander gave a book to a student this morning.", "target": "Alexander gave a book to a student this morning."}, {"pred": "Sarah had taken a paper some time ago.", "target": "Sarah had taken a paper some time ago."}, {"pred": "Alexander gave a book to a student over there.", "target": "Alexander gave a book to a student over there."}, {"pred": "Roger had taken it over there.", "target": "Roger had taken it over there."}, {"pred": "Sarah had written into a book some time ago.", "target": "Sarah had written into a book some time ago."}, {"pred": "Roger had drew a map some time ago.", "target": "Roger had drawn a map some time ago."}, {"pred": "Sarah had chose the good one over there.", "target": "Sarah had chosen the good one over there."}, {"pred": "Mark knew a lot of things this morning.", "target": "Mark knew a lot of things this morning."}, {"pred": "Mark gave a book to a student some time ago.", "target": "Mark gave a book to a student some time ago."}, {"pred": "Alexander had given a book to a student this morning.", "target": "Alexander had given a book to a student this morning."}, {"pred": "Roger had written with a large pen over there.", "target": "Roger had written with a large pen over there."}, {"pred": "Sarah came when we needed her some time ago.", "target": "Sarah came when we needed her some time ago."}, {"pred": "Sarah had taken the bell over there.", "target": "Sarah had taken the bell over there."}, {"pred": "Roger had taken some food last night.", "target": "Roger had taken some food last night."}, {"pred": "Roger had given something sweet to the baby at home.", "target": "Roger had given something sweet to the baby at home."}, {"pred": "Roger spoke very fast at home.", "target": "Roger spoke very fast at home."}, {"pred": "Alexander had become angry last night.", "target": "Alexander had become angry last night."}, {"pred": "Sarah had written with a large pen at home.", "target": "Sarah had written with a large pen at home."}, {"pred": "Roger had become angry this morning.", "target": "Roger had become angry this morning."}, {"pred": "Sarah had grown quickly at home.", "target": "Sarah had grown quickly at home."}, {"pred": "Roger gave something sweet to the baby over there.", "target": "Roger gave something sweet to the baby over there."}, {"pred": "Alexander written into a book at home.", "target": "Alexander wrote into a book at home."}, {"pred": "Mark had given something sweet to the baby this morning.", "target": "Mark had given something sweet to the baby this morning."}, {"pred": "Sarah saw something over there.", "target": "Sarah saw something over there."}, {"pred": "Roger had knew she could do it at home.", "target": "Roger had known she could do it at home."}, {"pred": "Alexander had taken the bell some time ago.", "target": "Alexander had taken the bell some time ago."}, {"pred": "Roger saw something this morning.", "target": "Roger saw something this morning."}, {"pred": "Roger had known a lot of things at home.", "target": "Roger had known a lot of things at home."}, {"pred": "Alexander had drew a picture last night.", "target": "Alexander had drawn a picture last night."}, {"pred": "Sarah had come just in time last night.", "target": "Sarah had come just in time last night."}, {"pred": "Alexander took the bell at home.", "target": "Alexander took the bell at home."}, {"pred": "Sarah had come when we needed her some time ago.", "target": "Sarah had come when we needed her some time ago."}, {"pred": "Alexander had written into a book some time ago.", "target": "Alexander had written into a book some time ago."}, {"pred": "Roger had given money to the man last night.", "target": "Roger had given money to the man last night."}, {"pred": "Sarah had written a story some time ago.", "target": "Sarah had written a story some time ago."}, {"pred": "Mark become angry at home.", "target": "Mark became angry at home."}, {"pred": "Sarah written into a book this morning.", "target": "Sarah wrote into a book this morning."}, {"pred": "Roger took the bell this morning.", "target": "Roger took the bell this morning."}, {"pred": "Sarah wrote a story last night.", "target": "Sarah wrote a story last night."}, {"pred": "Sarah had seen a bird over there.", "target": "Sarah had seen a bird over there."}, {"pred": "Sarah saw something some time ago.", "target": "Sarah saw something some time ago."}, {"pred": "Alexander had taken a paper this morning.", "target": "Alexander had taken a paper this morning."}, {"pred": "Sarah had drew a picture at home.", "target": "Sarah had drawn a picture at home."}, {"pred": "Sarah had spoke very fast at home.", "target": "Sarah had spoken very fast at home."}, {"pred": "Sarah saw a shape last night.", "target": "Sarah saw a shape last night."}, {"pred": "Roger written a note this morning.", "target": "Roger wrote a note this morning."}, {"pred": "Roger saw a shape at home.", "target": "Roger saw a shape at home."}, {"pred": "Sarah knew she could do it at home.", "target": "Sarah knew she could do it at home."}, {"pred": "Mark took the bell some time ago.", "target": "Mark took the bell some time ago."}, {"pred": "Roger grown quickly at home.", "target": "Roger grew quickly at home."}, {"pred": "Mark gave something sweet to the baby last night.", "target": "Mark gave something sweet to the baby last night."}, {"pred": "Roger grew quickly some time ago.", "target": "Roger grew quickly some time ago."}, {"pred": "Alexander had come just in time last night.", "target": "Alexander had come just in time last night."}, {"pred": "Roger spoke to me over there.", "target": "Roger spoke to me over there."}, {"pred": "Roger had drew a round circle over there.", "target": "Roger had drawn a round circle over there."}, {"pred": "Sarah had written into a book this morning.", "target": "Sarah had written into a book this morning."}, {"pred": "Alexander had given money to the man some time ago.", "target": "Alexander had given money to the man some time ago."}, {"pred": "Roger knew she could do it at home.", "target": "Roger knew she could do it at home."}, {"pred": "Sarah become very different at home.", "target": "Sarah became very different at home."}, {"pred": "Alexander wrote a note this morning.", "target": "Alexander wrote a note this morning."}, {"pred": "Alexander written with a large pen this morning.", "target": "Alexander wrote with a large pen this morning."}, {"pred": "Roger had come when we needed her this morning.", "target": "Roger had come when we needed her this morning."}, {"pred": "Alexander had taken them over there.", "target": "Alexander had taken them over there."}, {"pred": "Alexander had come when we needed her some time ago.", "target": "Alexander had come when we needed her some time ago."}, {"pred": "Sarah had drew a round circle this morning.", "target": "Sarah had drawn a round circle this morning."}, {"pred": "Mark had come too late last night.", "target": "Mark had come too late last night."}, {"pred": "Alexander drew a round circle at home.", "target": "Alexander drew a round circle at home."}, {"pred": "Alexander had drew a round circle some time ago.", "target": "Alexander had drawn a round circle some time ago."}, {"pred": "Alexander had given a book to a student at home.", "target": "Alexander had given a book to a student at home."}, {"pred": "Roger had come just in time last night.", "target": "Roger had come just in time last night."}, {"pred": "Mark had given a book to a student some time ago.", "target": "Mark had given a book to a student some time ago."}, {"pred": "Sarah gave money to the man over there.", "target": "Sarah gave money to the man over there."}, {"pred": "Sarah had taken it over there.", "target": "Sarah had taken it over there."}, {"pred": "Roger had spoke about many things over there.", "target": "Roger had spoken about many things over there."}, {"pred": "Alexander had seen something last night.", "target": "Alexander had seen something last night."}, {"pred": "Roger had written a note this morning.", "target": "Roger had written a note this morning."}, {"pred": "Sarah written into a book last night.", "target": "Sarah wrote into a book last night."}, {"pred": "Sarah spoke very fast this morning.", "target": "Sarah spoke very fast this morning."}, {"pred": "Roger had spoke without thinking last night.", "target": "Roger had spoken without thinking last night."}, {"pred": "Sarah saw a bird last night.", "target": "Sarah saw a bird last night."}, {"pred": "Mark chose the good one over there.", "target": "Mark chose the good one over there."}, {"pred": "Alexander drew a map over there.", "target": "Alexander drew a map over there."}, {"pred": "Alexander had seen something this morning.", "target": "Alexander had seen something this morning."}, {"pred": "Mark took the bell this morning.", "target": "Mark took the bell this morning."}, {"pred": "Sarah knew a lot of things at home.", "target": "Sarah knew a lot of things at home."}, {"pred": "Mark had become angry some time ago.", "target": "Mark had become angry some time ago."}, {"pred": "Alexander grew quickly over there.", "target": "Alexander grew quickly over there."}, {"pred": "Alexander gave money to the man last night.", "target": "Alexander gave money to the man last night."}, {"pred": "Alexander saw a shape over there.", "target": "Alexander saw a shape over there."}, {"pred": "Mark came too late over there.", "target": "Mark came too late over there."}, {"pred": "Sarah took a paper this morning.", "target": "Sarah took a paper this morning."}, {"pred": "Alexander spoke very fast last night.", "target": "Alexander spoke very fast last night."}, {"pred": "Alexander had came to the store over there.", "target": "Alexander had come to the store over there."}, {"pred": "Mark had seen a shape at home.", "target": "Mark had seen a shape at home."}, {"pred": "Alexander came when we needed her some time ago.", "target": "Alexander came when we needed her some time ago."}, {"pred": "Sarah had became someone else this morning.", "target": "Sarah had become someone else this morning."}, {"pred": "Sarah drew a round circle this morning.", "target": "Sarah drew a round circle this morning."}, {"pred": "Mark had spoke very fast at home.", "target": "Mark had spoken very fast at home."}, {"pred": "Mark had knew she could do it this morning.", "target": "Mark had known she could do it this morning."}, {"pred": "Mark had became angry last night.", "target": "Mark had become angry last night."}, {"pred": "Roger had knew she could do it some time ago.", "target": "Roger had known she could do it some time ago."}, {"pred": "Alexander written with a large pen over there.", "target": "Alexander wrote with a large pen over there."}, {"pred": "Sarah come to the store some time ago.", "target": "Sarah came to the store some time ago."}, {"pred": "Alexander knew a lot of things last night.", "target": "Alexander knew a lot of things last night."}, {"pred": "Roger came to the store this morning.", "target": "Roger came to the store this morning."}, {"pred": "Mark had written a story at home.", "target": "Mark had written a story at home."}, {"pred": "Alexander written into a book some time ago.", "target": "Alexander wrote into a book some time ago."}, {"pred": "Roger drew a map some time ago.", "target": "Roger drew a map some time ago."}, {"pred": "Alexander had taken the bell this morning.", "target": "Alexander had taken the bell this morning."}, {"pred": "Roger had taken the bell last night.", "target": "Roger had taken the bell last night."}, {"pred": "Roger came to the store some time ago.", "target": "Roger came to the store some time ago."}, {"pred": "Sarah had become very different some time ago.", "target": "Sarah had become very different some time ago."}, {"pred": "Mark written into a book some time ago.", "target": "Mark wrote into a book some time ago."}, {"pred": "Mark come too late last night.", "target": "Mark came too late last night."}, {"pred": "Sarah took them at home.", "target": "Sarah took them at home."}, {"pred": "Sarah had written a note this morning.", "target": "Sarah had written a note this morning."}, {"pred": "Mark had became someone else over there.", "target": "Mark had become someone else over there."}, {"pred": "Roger had spoke very fast at home.", "target": "Roger had spoken very fast at home."}, {"pred": "Roger saw something last night.", "target": "Roger saw something last night."}, {"pred": "Mark spoke to me last night.", "target": "Mark spoke to me last night."}, {"pred": "Mark saw a shape some time ago.", "target": "Mark saw a shape some time ago."}, {"pred": "Alexander drew a picture last night.", "target": "Alexander drew a picture last night."}, {"pred": "Mark saw a bird over there.", "target": "Mark saw a bird over there."}, {"pred": "Mark grown quickly this morning.", "target": "Mark grew quickly this morning."}, {"pred": "Roger had given a book to a student over there.", "target": "Roger had given a book to a student over there."}, {"pred": "Roger had taken it last night.", "target": "Roger had taken it last night."}, {"pred": "Roger had came to the store last night.", "target": "Roger had come to the store last night."}, {"pred": "Roger knew a lot of things at home.", "target": "Roger knew a lot of things at home."}, {"pred": "Mark had given a book to a student last night.", "target": "Mark had given a book to a student last night."}, {"pred": "Alexander had written a note this morning.", "target": "Alexander had written a note this morning."}, {"pred": "Sarah took it at home.", "target": "Sarah took it at home."}, {"pred": "Roger took it over there.", "target": "Roger took it over there."}, {"pred": "Mark had chosen the good one some time ago.", "target": "Mark had chosen the good one some time ago."}, {"pred": "Roger had drew a picture this morning.", "target": "Roger had drawn a picture this morning."}, {"pred": "Sarah had chosen the good one some time ago.", "target": "Sarah had chosen the good one some time ago."}, {"pred": "Alexander written with a large pen some time ago.", "target": "Alexander wrote with a large pen some time ago."}, {"pred": "Mark grown quickly at home.", "target": "Mark grew quickly at home."}, {"pred": "Sarah had come to the store last night.", "target": "Sarah had come to the store last night."}, {"pred": "Mark wrote with a large pen at home.", "target": "Mark wrote with a large pen at home."}, {"pred": "Roger knew she could do it over there.", "target": "Roger knew she could do it over there."}, {"pred": "Sarah took a paper over there.", "target": "Sarah took a paper over there."}, {"pred": "Alexander knew a lot of things over there.", "target": "Alexander knew a lot of things over there."}, {"pred": "Sarah wrote a note this morning.", "target": "Sarah wrote a note this morning."}, {"pred": "Roger became someone else at home.", "target": "Roger became someone else at home."}, {"pred": "Alexander grew quickly at home.", "target": "Alexander grew quickly at home."}, {"pred": "Mark had seen a shape some time ago.", "target": "Mark had seen a shape some time ago."}, {"pred": "Alexander had spoke without thinking some time ago.", "target": "Alexander had spoken without thinking some time ago."}, {"pred": "Mark became angry some time ago.", "target": "Mark became angry some time ago."}, {"pred": "Roger spoke without thinking over there.", "target": "Roger spoke without thinking over there."}, {"pred": "Roger become angry this morning.", "target": "Roger became angry this morning."}, {"pred": "Mark had grown quickly this morning.", "target": "Mark had grown quickly this morning."}, {"pred": "Sarah had become angry some time ago.", "target": "Sarah had become angry some time ago."}, {"pred": "Alexander had became someone else last night.", "target": "Alexander had become someone else last night."}, {"pred": "Mark had spoke about many things last night.", "target": "Mark had spoken about many things last night."}, {"pred": "Sarah had became someone else last night.", "target": "Sarah had become someone else last night."}, {"pred": "Mark spoke to me some time ago.", "target": "Mark spoke to me some time ago."}, {"pred": "Alexander chose the best option at home.", "target": "Alexander chose the best option at home."}, {"pred": "Sarah had known a lot of things this morning.", "target": "Sarah had known a lot of things this morning."}, {"pred": "Sarah had knew she could do it this morning.", "target": "Sarah had known she could do it this morning."}, {"pred": "Sarah had given a book to a student at home.", "target": "Sarah had given a book to a student at home."}, {"pred": "Alexander had come when we needed her last night.", "target": "Alexander had come when we needed her last night."}, {"pred": "Sarah had grown quickly last night.", "target": "Sarah had grown quickly last night."}, {"pred": "Roger had given money to the man this morning.", "target": "Roger had given money to the man this morning."}, {"pred": "Alexander had taken it at home.", "target": "Alexander had taken it at home."}, {"pred": "Mark drew a picture last night.", "target": "Mark drew a picture last night."}, {"pred": "Alexander had spoke very fast some time ago.", "target": "Alexander had spoken very fast some time ago."}, {"pred": "Alexander had chose the good one this morning.", "target": "Alexander had chosen the good one this morning."}, {"pred": "Roger had taken them this morning.", "target": "Roger had taken them this morning."}, {"pred": "Sarah had seen a shape this morning.", "target": "Sarah had seen a shape this morning."}, {"pred": "Roger had drew a round circle some time ago.", "target": "Roger had drawn a round circle some time ago."}, {"pred": "Mark had knew she could do it over there.", "target": "Mark had known she could do it over there."}, {"pred": "Alexander spoke about many things over there.", "target": "Alexander spoke about many things over there."}, {"pred": "Sarah saw a shape at home.", "target": "Sarah saw a shape at home."}, {"pred": "Sarah knew she could do it last night.", "target": "Sarah knew she could do it last night."}, {"pred": "Sarah gave money to the man some time ago.", "target": "Sarah gave money to the man some time ago."}, {"pred": "Sarah took some food at home.", "target": "Sarah took some food at home."}, {"pred": "Mark come when we needed her this morning.", "target": "Mark came when we needed her this morning."}, {"pred": "Mark spoke very fast over there.", "target": "Mark spoke very fast over there."}, {"pred": "Mark became very different over there.", "target": "Mark became very different over there."}, {"pred": "Alexander had given money to the man last night.", "target": "Alexander had given money to the man last night."}, {"pred": "Mark had written with a large pen this morning.", "target": "Mark had written with a large pen this morning."}, {"pred": "Roger written a note some time ago.", "target": "Roger wrote a note some time ago."}, {"pred": "Alexander had written with a large pen this morning.", "target": "Alexander had written with a large pen this morning."}, {"pred": "Sarah had knew she could do it at home.", "target": "Sarah had known she could do it at home."}, {"pred": "Sarah had taken the bell this morning.", "target": "Sarah had taken the bell this morning."}, {"pred": "Sarah drew a round circle over there.", "target": "Sarah drew a round circle over there."}, {"pred": "Alexander grew quickly some time ago.", "target": "Alexander grew quickly some time ago."}, {"pred": "Sarah had written a note over there.", "target": "Sarah had written a note over there."}, {"pred": "Sarah had seen a shape over there.", "target": "Sarah had seen a shape over there."}, {"pred": "Roger had written a story at home.", "target": "Roger had written a story at home."}, {"pred": "Sarah had spoke to me this morning.", "target": "Sarah had spoken to me this morning."}, {"pred": "Alexander had chosen the best option at home.", "target": "Alexander had chosen the best option at home."}, {"pred": "Mark became angry last night.", "target": "Mark became angry last night."}, {"pred": "Alexander spoke very fast some time ago.", "target": "Alexander spoke very fast some time ago."}, {"pred": "Roger had spoke to me last night.", "target": "Roger had spoken to me last night."}, {"pred": "Roger had grown quickly over there.", "target": "Roger had grown quickly over there."}, {"pred": "Mark had taken the bell this morning.", "target": "Mark had taken the bell this morning."}, {"pred": "Mark come too late this morning.", "target": "Mark came too late this morning."}, {"pred": "Sarah drew a map some time ago.", "target": "Sarah drew a map some time ago."}, {"pred": "Mark written into a book last night.", "target": "Mark wrote into a book last night."}, {"pred": "Alexander became someone else last night.", "target": "Alexander became someone else last night."}, {"pred": "Roger had seen a bird some time ago.", "target": "Roger had seen a bird some time ago."}, {"pred": "Mark had drew a round circle over there.", "target": "Mark had drawn a round circle over there."}, {"pred": "Sarah had written a note last night.", "target": "Sarah had written a note last night."}, {"pred": "Sarah wrote a story some time ago.", "target": "Sarah wrote a story some time ago."}, {"pred": "Alexander chose the good one some time ago.", "target": "Alexander chose the good one some time ago."}, {"pred": "Mark had chose the best option over there.", "target": "Mark had chosen the best option over there."}, {"pred": "Roger wrote a story at home.", "target": "Roger wrote a story at home."}, {"pred": "Sarah came to the store at home.", "target": "Sarah came to the store at home."}, {"pred": "Alexander become angry this morning.", "target": "Alexander became angry this morning."}, {"pred": "Sarah drew a picture last night.", "target": "Sarah drew a picture last night."}, {"pred": "Alexander drew a picture this morning.", "target": "Alexander drew a picture this morning."}, {"pred": "Alexander had seen a bird over there.", "target": "Alexander had seen a bird over there."}, {"pred": "Roger drew a picture this morning.", "target": "Roger drew a picture this morning."}, {"pred": "Sarah had grown quickly over there.", "target": "Sarah had grown quickly over there."}, {"pred": "Roger had taken a paper at home.", "target": "Roger had taken a paper at home."}, {"pred": "Roger had written into a book some time ago.", "target": "Roger had written into a book some time ago."}, {"pred": "Sarah knew she could do it some time ago.", "target": "Sarah knew she could do it some time ago."}, {"pred": "Mark had come too late over there.", "target": "Mark had come too late over there."}, {"pred": "Alexander had taken the bell at home.", "target": "Alexander had taken the bell at home."}, {"pred": "Roger come when we needed her this morning.", "target": "Roger came when we needed her this morning."}, {"pred": "Roger had given something sweet to the baby some time ago.", "target": "Roger had given something sweet to the baby some time ago."}, {"pred": "Alexander had seen something some time ago.", "target": "Alexander had seen something some time ago."}, {"pred": "Mark wrote a note over there.", "target": "Mark wrote a note over there."}, {"pred": "Alexander took them some time ago.", "target": "Alexander took them some time ago."}, {"pred": "Sarah knew a lot of things last night.", "target": "Sarah knew a lot of things last night."}, {"pred": "Alexander chose the best option some time ago.", "target": "Alexander chose the best option some time ago."}, {"pred": "Mark had seen a shape this morning.", "target": "Mark had seen a shape this morning."}, {"pred": "Alexander saw something last night.", "target": "Alexander saw something last night."}, {"pred": "Alexander had come too late this morning.", "target": "Alexander had come too late this morning."}, {"pred": "Sarah grew quickly last night.", "target": "Sarah grew quickly last night."}, {"pred": "Roger had chosen the best option some time ago.", "target": "Roger had chosen the best option some time ago."}, {"pred": "Mark become angry over there.", "target": "Mark became angry over there."}, {"pred": "Alexander had grown quickly at home.", "target": "Alexander had grown quickly at home."}, {"pred": "Sarah chose the good one over there.", "target": "Sarah chose the good one over there."}, {"pred": "Roger saw a shape some time ago.", "target": "Roger saw a shape some time ago."}, {"pred": "Alexander knew a lot of things this morning.", "target": "Alexander knew a lot of things this morning."}, {"pred": "Roger knew a lot of things this morning.", "target": "Roger knew a lot of things this morning."}, {"pred": "Mark had taken it over there.", "target": "Mark had taken it over there."}, {"pred": "Alexander gave a book to a student at home.", "target": "Alexander gave a book to a student at home."}, {"pred": "Alexander had seen a shape over there.", "target": "Alexander had seen a shape over there."}, {"pred": "Sarah had grown quickly some time ago.", "target": "Sarah had grown quickly some time ago."}, {"pred": "Alexander wrote a story at home.", "target": "Alexander wrote a story at home."}, {"pred": "Roger came too late some time ago.", "target": "Roger came too late some time ago."}, {"pred": "Sarah had spoke to me some time ago.", "target": "Sarah had spoken to me some time ago."}, {"pred": "Roger come just in time some time ago.", "target": "Roger came just in time some time ago."}, {"pred": "Alexander had drew a map last night.", "target": "Alexander had drawn a map last night."}, {"pred": "Alexander drew a picture over there.", "target": "Alexander drew a picture over there."}, {"pred": "Mark knew she could do it this morning.", "target": "Mark knew she could do it this morning."}, {"pred": "Mark had come too late this morning.", "target": "Mark had come too late this morning."}, {"pred": "Mark took the bell at home.", "target": "Mark took the bell at home."}, {"pred": "Sarah had given money to the man last night.", "target": "Sarah had given money to the man last night."}, {"pred": "Roger had written into a book last night.", "target": "Roger had written into a book last night."}, {"pred": "Alexander had spoke to me over there.", "target": "Alexander had spoken to me over there."}, {"pred": "Roger had taken the bell this morning.", "target": "Roger had taken the bell this morning."}, {"pred": "Mark had spoke to me over there.", "target": "Mark had spoken to me over there."}, {"pred": "Roger grown quickly this morning.", "target": "Roger grew quickly this morning."}, {"pred": "Alexander had written a story some time ago.", "target": "Alexander had written a story some time ago."}, {"pred": "Sarah had knew a lot of things at home.", "target": "Sarah had known a lot of things at home."}, {"pred": "Roger had chosen the best option this morning.", "target": "Roger had chosen the best option this morning."}, {"pred": "Alexander had come too late last night.", "target": "Alexander had come too late last night."}, {"pred": "Alexander had seen a bird at home.", "target": "Alexander had seen a bird at home."}, {"pred": "Mark wrote a note this morning.", "target": "Mark wrote a note this morning."}, {"pred": "Roger had drew a picture at home.", "target": "Roger had drawn a picture at home."}, {"pred": "Sarah had come when we needed her this morning.", "target": "Sarah had come when we needed her this morning."}, {"pred": "Sarah gave a book to a student some time ago.", "target": "Sarah gave a book to a student some time ago."}, {"pred": "Mark wrote a story at home.", "target": "Mark wrote a story at home."}, {"pred": "Alexander written with a large pen at home.", "target": "Alexander wrote with a large pen at home."}, {"pred": "Mark had written a note this morning.", "target": "Mark had written a note this morning."}, {"pred": "Mark chose the best option this morning.", "target": "Mark chose the best option this morning."}, {"pred": "Roger had given a book to a student last night.", "target": "Roger had given a book to a student last night."}, {"pred": "Roger knew a lot of things over there.", "target": "Roger knew a lot of things over there."}, {"pred": "Sarah had seen a shape last night.", "target": "Sarah had seen a shape last night."}, {"pred": "Roger gave money to the man at home.", "target": "Roger gave money to the man at home."}, {"pred": "Mark had seen something at home.", "target": "Mark had seen something at home."}, {"pred": "Alexander had known a lot of things last night.", "target": "Alexander had known a lot of things last night."}, {"pred": "Roger gave something sweet to the baby this morning.", "target": "Roger gave something sweet to the baby this morning."}, {"pred": "Sarah had seen something some time ago.", "target": "Sarah had seen something some time ago."}, {"pred": "Sarah became someone else this morning.", "target": "Sarah became someone else this morning."}, {"pred": "Mark had spoke very fast some time ago.", "target": "Mark had spoken very fast some time ago."}, {"pred": "Roger had seen something last night.", "target": "Roger had seen something last night."}, {"pred": "Sarah had written a story this morning.", "target": "Sarah had written a story this morning."}, {"pred": "Sarah had spoke very fast this morning.", "target": "Sarah had spoken very fast this morning."}, {"pred": "Roger had written into a book at home.", "target": "Roger had written into a book at home."}, {"pred": "Alexander had drew a map over there.", "target": "Alexander had drawn a map over there."}, {"pred": "Alexander had drew a round circle at home.", "target": "Alexander had drawn a round circle at home."}, {"pred": "Alexander had written with a large pen at home.", "target": "Alexander had written with a large pen at home."}, {"pred": "Roger had written a note last night.", "target": "Roger had written a note last night."}, {"pred": "Sarah had drew a round circle at home.", "target": "Sarah had drawn a round circle at home."}, {"pred": "Alexander gave money to the man over there.", "target": "Alexander gave money to the man over there."}, {"pred": "Roger spoke without thinking this morning.", "target": "Roger spoke without thinking this morning."}, {"pred": "Sarah spoke without thinking over there.", "target": "Sarah spoke without thinking over there."}, {"pred": "Roger had grown quickly this morning.", "target": "Roger had grown quickly this morning."}, {"pred": "Roger had written a note at home.", "target": "Roger had written a note at home."}, {"pred": "Roger spoke without thinking last night.", "target": "Roger spoke without thinking last night."}, {"pred": "Sarah had become angry last night.", "target": "Sarah had become angry last night."}, {"pred": "Mark gave something sweet to the baby this morning.", "target": "Mark gave something sweet to the baby this morning."}, {"pred": "Sarah spoke to me this morning.", "target": "Sarah spoke to me this morning."}, {"pred": "Sarah had given a book to a student this morning.", "target": "Sarah had given a book to a student this morning."}, {"pred": "Mark had known a lot of things some time ago.", "target": "Mark had known a lot of things some time ago."}, {"pred": "Mark had knew a lot of things last night.", "target": "Mark had known a lot of things last night."}, {"pred": "Roger took them this morning.", "target": "Roger took them this morning."}, {"pred": "Mark drew a map last night.", "target": "Mark drew a map last night."}, {"pred": "Sarah had chose the best option this morning.", "target": "Sarah had chosen the best option this morning."}, {"pred": "Alexander took some food at home.", "target": "Alexander took some food at home."}, {"pred": "Sarah became someone else some time ago.", "target": "Sarah became someone else some time ago."}, {"pred": "Alexander gave a book to a student some time ago.", "target": "Alexander gave a book to a student some time ago."}, {"pred": "Roger took the bell some time ago.", "target": "Roger took the bell some time ago."}, {"pred": "Sarah had drew a map some time ago.", "target": "Sarah had drawn a map some time ago."}, {"pred": "Roger became very different this morning.", "target": "Roger became very different this morning."}, {"pred": "Mark took it over there.", "target": "Mark took it over there."}, {"pred": "Roger had chosen the good one over there.", "target": "Roger had chosen the good one over there."}, {"pred": "Sarah saw something last night.", "target": "Sarah saw something last night."}, {"pred": "Mark had come to the store last night.", "target": "Mark had come to the store last night."}, {"pred": "Sarah had drew a round circle some time ago.", "target": "Sarah had drawn a round circle some time ago."}, {"pred": "Mark chose the good one this morning.", "target": "Mark chose the good one this morning."}, {"pred": "Mark spoke very fast last night.", "target": "Mark spoke very fast last night."}, {"pred": "Roger had became someone else at home.", "target": "Roger had become someone else at home."}, {"pred": "Roger had grown quickly last night.", "target": "Roger had grown quickly last night."}, {"pred": "Mark had given a book to a student this morning.", "target": "Mark had given a book to a student this morning."}, {"pred": "Alexander had spoke very fast at home.", "target": "Alexander had spoken very fast at home."}, {"pred": "Roger chose the best option this morning.", "target": "Roger chose the best option this morning."}, {"pred": "Roger had seen a shape some time ago.", "target": "Roger had seen a shape some time ago."}, {"pred": "Mark spoke about many things at home.", "target": "Mark spoke about many things at home."}, {"pred": "Roger written into a book over there.", "target": "Roger wrote into a book over there."}, {"pred": "Sarah wrote a note over there.", "target": "Sarah wrote a note over there."}, {"pred": "Sarah grown quickly some time ago.", "target": "Sarah grew quickly some time ago."}, {"pred": "Roger had became someone else over there.", "target": "Roger had become someone else over there."}, {"pred": "Mark spoke without thinking over there.", "target": "Mark spoke without thinking over there."}, {"pred": "Sarah became someone else last night.", "target": "Sarah became someone else last night."}, {"pred": "Sarah knew a lot of things this morning.", "target": "Sarah knew a lot of things this morning."}, {"pred": "Sarah had knew she could do it over there.", "target": "Sarah had known she could do it over there."}, {"pred": "Mark had drew a map last night.", "target": "Mark had drawn a map last night."}, {"pred": "Sarah chose the good one this morning.", "target": "Sarah chose the good one this morning."}, {"pred": "Sarah wrote a story this morning.", "target": "Sarah wrote a story this morning."}, {"pred": "Sarah had written into a book over there.", "target": "Sarah had written into a book over there."}, {"pred": "Roger took a paper at home.", "target": "Roger took a paper at home."}, {"pred": "Mark had chose the best option at home.", "target": "Mark had chosen the best option at home."}, {"pred": "Mark saw a shape this morning.", "target": "Mark saw a shape this morning."}, {"pred": "Roger spoke very fast some time ago.", "target": "Roger spoke very fast some time ago."}, {"pred": "Mark saw something at home.", "target": "Mark saw something at home."}, {"pred": "Alexander come just in time last night.", "target": "Alexander came just in time last night."}, {"pred": "Sarah gave a book to a student this morning.", "target": "Sarah gave a book to a student this morning."}, {"pred": "Alexander chose the good one at home.", "target": "Alexander chose the good one at home."}, {"pred": "Roger saw a bird some time ago.", "target": "Roger saw a bird some time ago."}, {"pred": "Sarah written into a book some time ago.", "target": "Sarah wrote into a book some time ago."}, {"pred": "Alexander gave something sweet to the baby last night.", "target": "Alexander gave something sweet to the baby last night."}, {"pred": "Sarah had seen a bird at home.", "target": "Sarah had seen a bird at home."}, {"pred": "Sarah saw a shape this morning.", "target": "Sarah saw a shape this morning."}, {"pred": "Roger chose the good one this morning.", "target": "Roger chose the good one this morning."}, {"pred": "Mark came when we needed her over there.", "target": "Mark came when we needed her over there."}, {"pred": "Mark knew she could do it some time ago.", "target": "Mark knew she could do it some time ago."}, {"pred": "Sarah chose the best option this morning.", "target": "Sarah chose the best option this morning."}]}
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/island_effects/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/local_attractor/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/npi_licensing/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/quantifiers/eval_results.json ADDED
The diff for this file is too large to render. See raw diff
 
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/subject_verb_agreement/eval_results.json ADDED
The diff for this file is too large to render. See raw diff