Instructions to use lindazeng979/gpt2-es-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lindazeng979/gpt2-es-tiny with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("lindazeng979/gpt2-es-tiny", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload baseline_random_split/seed_42
Browse files- baseline_random_split/seed_42/README.md +77 -0
- baseline_random_split/seed_42/added_tokens.json +3 -0
- baseline_random_split/seed_42/all_results.json +15 -0
- baseline_random_split/seed_42/config.json +40 -0
- baseline_random_split/seed_42/eval_results.json +10 -0
- baseline_random_split/seed_42/generation_config.json +7 -0
- baseline_random_split/seed_42/merges.txt +0 -0
- baseline_random_split/seed_42/pytorch_model.bin +3 -0
- baseline_random_split/seed_42/special_tokens_map.json +6 -0
- baseline_random_split/seed_42/tokenizer.json +0 -0
- baseline_random_split/seed_42/tokenizer_config.json +9 -0
- baseline_random_split/seed_42/train_results.json +8 -0
- baseline_random_split/seed_42/trainer_state.json +805 -0
- baseline_random_split/seed_42/training_args.bin +3 -0
- baseline_random_split/seed_42/vocab.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/anaphor_agreement/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/argument_structure/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/binding/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/case_subjective_pronoun/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/determiner_noun_agreement/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/ellipsis/eval_results.json +1 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/filler_gap/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/irregular_forms/eval_results.json +1 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/island_effects/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/local_attractor/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/npi_licensing/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/quantifiers/eval_results.json +0 -0
- baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/subject_verb_agreement/eval_results.json +0 -0
baseline_random_split/seed_42/README.md
ADDED
|
@@ -0,0 +1,77 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- generated_from_trainer
|
| 4 |
+
metrics:
|
| 5 |
+
- accuracy
|
| 6 |
+
model-index:
|
| 7 |
+
- name: GPT2-tiny-baseline_random_split_42
|
| 8 |
+
results: []
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
| 12 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 13 |
+
|
| 14 |
+
# GPT2-tiny-baseline_random_split_42
|
| 15 |
+
|
| 16 |
+
This model was trained from scratch on an unknown dataset.
|
| 17 |
+
It achieves the following results on the evaluation set:
|
| 18 |
+
- Loss: 1.3213
|
| 19 |
+
- Accuracy: 0.6714
|
| 20 |
+
|
| 21 |
+
## Model description
|
| 22 |
+
|
| 23 |
+
More information needed
|
| 24 |
+
|
| 25 |
+
## Intended uses & limitations
|
| 26 |
+
|
| 27 |
+
More information needed
|
| 28 |
+
|
| 29 |
+
## Training and evaluation data
|
| 30 |
+
|
| 31 |
+
More information needed
|
| 32 |
+
|
| 33 |
+
## Training procedure
|
| 34 |
+
|
| 35 |
+
### Training hyperparameters
|
| 36 |
+
|
| 37 |
+
The following hyperparameters were used during training:
|
| 38 |
+
- learning_rate: 0.0001
|
| 39 |
+
- train_batch_size: 32
|
| 40 |
+
- eval_batch_size: 32
|
| 41 |
+
- seed: 42
|
| 42 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 43 |
+
- lr_scheduler_type: linear
|
| 44 |
+
- num_epochs: 20.0
|
| 45 |
+
|
| 46 |
+
### Training results
|
| 47 |
+
|
| 48 |
+
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
| 49 |
+
|:-------------:|:-----:|:-----:|:---------------:|:--------:|
|
| 50 |
+
| 2.2292 | 1.0 | 2501 | 2.0749 | 0.5652 |
|
| 51 |
+
| 1.8861 | 2.0 | 5002 | 1.7616 | 0.6063 |
|
| 52 |
+
| 1.7362 | 3.0 | 7503 | 1.6207 | 0.6262 |
|
| 53 |
+
| 1.6515 | 4.0 | 10004 | 1.5419 | 0.6372 |
|
| 54 |
+
| 1.5949 | 5.0 | 12505 | 1.4929 | 0.6442 |
|
| 55 |
+
| 1.5564 | 6.0 | 15006 | 1.4557 | 0.6498 |
|
| 56 |
+
| 1.5317 | 7.0 | 17507 | 1.4292 | 0.6539 |
|
| 57 |
+
| 1.504 | 8.0 | 20008 | 1.4085 | 0.6569 |
|
| 58 |
+
| 1.4864 | 9.0 | 22509 | 1.3926 | 0.6594 |
|
| 59 |
+
| 1.4699 | 10.0 | 25010 | 1.3798 | 0.6615 |
|
| 60 |
+
| 1.4599 | 11.0 | 27511 | 1.3681 | 0.6634 |
|
| 61 |
+
| 1.4442 | 12.0 | 30012 | 1.3584 | 0.6648 |
|
| 62 |
+
| 1.436 | 13.0 | 32513 | 1.3501 | 0.6663 |
|
| 63 |
+
| 1.4306 | 14.0 | 35014 | 1.3432 | 0.6676 |
|
| 64 |
+
| 1.4202 | 15.0 | 37515 | 1.3372 | 0.6686 |
|
| 65 |
+
| 1.4172 | 16.0 | 40016 | 1.3332 | 0.6694 |
|
| 66 |
+
| 1.4126 | 17.0 | 42517 | 1.3284 | 0.6700 |
|
| 67 |
+
| 1.407 | 18.0 | 45018 | 1.3253 | 0.6706 |
|
| 68 |
+
| 1.4015 | 19.0 | 47519 | 1.3229 | 0.6711 |
|
| 69 |
+
| 1.3983 | 20.0 | 50020 | 1.3213 | 0.6714 |
|
| 70 |
+
|
| 71 |
+
|
| 72 |
+
### Framework versions
|
| 73 |
+
|
| 74 |
+
- Transformers 4.29.0.dev0
|
| 75 |
+
- Pytorch 2.13.0+cu130
|
| 76 |
+
- Datasets 5.0.1
|
| 77 |
+
- Tokenizers 0.13.3
|
baseline_random_split/seed_42/added_tokens.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"<|pad|>": 58426
|
| 3 |
+
}
|
baseline_random_split/seed_42/all_results.json
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"epoch": 20.0,
|
| 3 |
+
"eval_accuracy": 0.6714253080686327,
|
| 4 |
+
"eval_loss": 1.3212834596633911,
|
| 5 |
+
"eval_runtime": 18.5982,
|
| 6 |
+
"eval_samples": 4215,
|
| 7 |
+
"eval_samples_per_second": 226.635,
|
| 8 |
+
"eval_steps_per_second": 7.097,
|
| 9 |
+
"perplexity": 3.748228992131582,
|
| 10 |
+
"train_loss": 1.5915360271906862,
|
| 11 |
+
"train_runtime": 5537.1072,
|
| 12 |
+
"train_samples": 80003,
|
| 13 |
+
"train_samples_per_second": 288.97,
|
| 14 |
+
"train_steps_per_second": 9.034
|
| 15 |
+
}
|
baseline_random_split/seed_42/config.json
ADDED
|
@@ -0,0 +1,40 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_name_or_path": "tokenizers/GPT2-tiny_config",
|
| 3 |
+
"activation_function": "gelu_new",
|
| 4 |
+
"architectures": [
|
| 5 |
+
"GPT2LMHeadModel"
|
| 6 |
+
],
|
| 7 |
+
"attn_pdrop": 0.1,
|
| 8 |
+
"bos_token_id": 0,
|
| 9 |
+
"embd_pdrop": 0.1,
|
| 10 |
+
"eos_token_id": 0,
|
| 11 |
+
"initializer_range": 0.02,
|
| 12 |
+
"layer_norm_epsilon": 1e-05,
|
| 13 |
+
"model_type": "gpt2",
|
| 14 |
+
"n_ctx": 1024,
|
| 15 |
+
"n_embd": 256,
|
| 16 |
+
"n_head": 4,
|
| 17 |
+
"n_inner": null,
|
| 18 |
+
"n_layer": 4,
|
| 19 |
+
"n_positions": 1024,
|
| 20 |
+
"pad_token_id": 58426,
|
| 21 |
+
"reorder_and_upcast_attn": false,
|
| 22 |
+
"resid_pdrop": 0.1,
|
| 23 |
+
"scale_attn_by_inverse_layer_idx": false,
|
| 24 |
+
"scale_attn_weights": true,
|
| 25 |
+
"summary_activation": null,
|
| 26 |
+
"summary_first_dropout": 0.1,
|
| 27 |
+
"summary_proj_to_labels": true,
|
| 28 |
+
"summary_type": "cls_index",
|
| 29 |
+
"summary_use_proj": true,
|
| 30 |
+
"task_specific_params": {
|
| 31 |
+
"text-generation": {
|
| 32 |
+
"do_sample": true,
|
| 33 |
+
"max_length": 50
|
| 34 |
+
}
|
| 35 |
+
},
|
| 36 |
+
"torch_dtype": "float32",
|
| 37 |
+
"transformers_version": "4.29.0.dev0",
|
| 38 |
+
"use_cache": true,
|
| 39 |
+
"vocab_size": 58427
|
| 40 |
+
}
|
baseline_random_split/seed_42/eval_results.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"epoch": 20.0,
|
| 3 |
+
"eval_accuracy": 0.6714253080686327,
|
| 4 |
+
"eval_loss": 1.3212834596633911,
|
| 5 |
+
"eval_runtime": 18.5982,
|
| 6 |
+
"eval_samples": 4215,
|
| 7 |
+
"eval_samples_per_second": 226.635,
|
| 8 |
+
"eval_steps_per_second": 7.097,
|
| 9 |
+
"perplexity": 3.748228992131582
|
| 10 |
+
}
|
baseline_random_split/seed_42/generation_config.json
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_from_model_config": true,
|
| 3 |
+
"bos_token_id": 0,
|
| 4 |
+
"eos_token_id": 0,
|
| 5 |
+
"pad_token_id": 58426,
|
| 6 |
+
"transformers_version": "4.29.0.dev0"
|
| 7 |
+
}
|
baseline_random_split/seed_42/merges.txt
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/pytorch_model.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c15649cabd9975f6e6f1cf85bb64373718c39472295a18c519d8330b025ea16e
|
| 3 |
+
size 77730555
|
baseline_random_split/seed_42/special_tokens_map.json
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"bos_token": "<|endoftext|>",
|
| 3 |
+
"eos_token": "<|endoftext|>",
|
| 4 |
+
"pad_token": "<|pad|>",
|
| 5 |
+
"unk_token": "<|endoftext|>"
|
| 6 |
+
}
|
baseline_random_split/seed_42/tokenizer.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/tokenizer_config.json
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"add_prefix_space": false,
|
| 3 |
+
"bos_token": "<|endoftext|>",
|
| 4 |
+
"clean_up_tokenization_spaces": true,
|
| 5 |
+
"eos_token": "<|endoftext|>",
|
| 6 |
+
"model_max_length": 1024,
|
| 7 |
+
"tokenizer_class": "GPT2Tokenizer",
|
| 8 |
+
"unk_token": "<|endoftext|>"
|
| 9 |
+
}
|
baseline_random_split/seed_42/train_results.json
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"epoch": 20.0,
|
| 3 |
+
"train_loss": 1.5915360271906862,
|
| 4 |
+
"train_runtime": 5537.1072,
|
| 5 |
+
"train_samples": 80003,
|
| 6 |
+
"train_samples_per_second": 288.97,
|
| 7 |
+
"train_steps_per_second": 9.034
|
| 8 |
+
}
|
baseline_random_split/seed_42/trainer_state.json
ADDED
|
@@ -0,0 +1,805 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"best_metric": 1.3212834596633911,
|
| 3 |
+
"best_model_checkpoint": "/data/bilingual-llms/sp_trained_GPT2_models_tiny/GPT2-tiny-baseline_random_split_42/checkpoint-50020",
|
| 4 |
+
"epoch": 20.0,
|
| 5 |
+
"global_step": 50020,
|
| 6 |
+
"is_hyper_param_search": false,
|
| 7 |
+
"is_local_process_zero": true,
|
| 8 |
+
"is_world_process_zero": true,
|
| 9 |
+
"log_history": [
|
| 10 |
+
{
|
| 11 |
+
"epoch": 0.2,
|
| 12 |
+
"learning_rate": 9.900039984006398e-05,
|
| 13 |
+
"loss": 4.5422,
|
| 14 |
+
"step": 500
|
| 15 |
+
},
|
| 16 |
+
{
|
| 17 |
+
"epoch": 0.4,
|
| 18 |
+
"learning_rate": 9.800079968012795e-05,
|
| 19 |
+
"loss": 2.9522,
|
| 20 |
+
"step": 1000
|
| 21 |
+
},
|
| 22 |
+
{
|
| 23 |
+
"epoch": 0.6,
|
| 24 |
+
"learning_rate": 9.700119952019193e-05,
|
| 25 |
+
"loss": 2.582,
|
| 26 |
+
"step": 1500
|
| 27 |
+
},
|
| 28 |
+
{
|
| 29 |
+
"epoch": 0.8,
|
| 30 |
+
"learning_rate": 9.60015993602559e-05,
|
| 31 |
+
"loss": 2.3702,
|
| 32 |
+
"step": 2000
|
| 33 |
+
},
|
| 34 |
+
{
|
| 35 |
+
"epoch": 1.0,
|
| 36 |
+
"learning_rate": 9.500199920031988e-05,
|
| 37 |
+
"loss": 2.2292,
|
| 38 |
+
"step": 2500
|
| 39 |
+
},
|
| 40 |
+
{
|
| 41 |
+
"epoch": 1.0,
|
| 42 |
+
"eval_accuracy": 0.5652453823042733,
|
| 43 |
+
"eval_loss": 2.0748958587646484,
|
| 44 |
+
"eval_runtime": 18.6567,
|
| 45 |
+
"eval_samples_per_second": 225.924,
|
| 46 |
+
"eval_steps_per_second": 7.075,
|
| 47 |
+
"step": 2501
|
| 48 |
+
},
|
| 49 |
+
{
|
| 50 |
+
"epoch": 1.2,
|
| 51 |
+
"learning_rate": 9.400239904038385e-05,
|
| 52 |
+
"loss": 2.1243,
|
| 53 |
+
"step": 3000
|
| 54 |
+
},
|
| 55 |
+
{
|
| 56 |
+
"epoch": 1.4,
|
| 57 |
+
"learning_rate": 9.300279888044783e-05,
|
| 58 |
+
"loss": 2.044,
|
| 59 |
+
"step": 3500
|
| 60 |
+
},
|
| 61 |
+
{
|
| 62 |
+
"epoch": 1.6,
|
| 63 |
+
"learning_rate": 9.20031987205118e-05,
|
| 64 |
+
"loss": 1.981,
|
| 65 |
+
"step": 4000
|
| 66 |
+
},
|
| 67 |
+
{
|
| 68 |
+
"epoch": 1.8,
|
| 69 |
+
"learning_rate": 9.100359856057577e-05,
|
| 70 |
+
"loss": 1.9328,
|
| 71 |
+
"step": 4500
|
| 72 |
+
},
|
| 73 |
+
{
|
| 74 |
+
"epoch": 2.0,
|
| 75 |
+
"learning_rate": 9.000399840063975e-05,
|
| 76 |
+
"loss": 1.8861,
|
| 77 |
+
"step": 5000
|
| 78 |
+
},
|
| 79 |
+
{
|
| 80 |
+
"epoch": 2.0,
|
| 81 |
+
"eval_accuracy": 0.6062813880974827,
|
| 82 |
+
"eval_loss": 1.7615596055984497,
|
| 83 |
+
"eval_runtime": 18.7962,
|
| 84 |
+
"eval_samples_per_second": 224.248,
|
| 85 |
+
"eval_steps_per_second": 7.023,
|
| 86 |
+
"step": 5002
|
| 87 |
+
},
|
| 88 |
+
{
|
| 89 |
+
"epoch": 2.2,
|
| 90 |
+
"learning_rate": 8.900439824070372e-05,
|
| 91 |
+
"loss": 1.8404,
|
| 92 |
+
"step": 5500
|
| 93 |
+
},
|
| 94 |
+
{
|
| 95 |
+
"epoch": 2.4,
|
| 96 |
+
"learning_rate": 8.80047980807677e-05,
|
| 97 |
+
"loss": 1.8093,
|
| 98 |
+
"step": 6000
|
| 99 |
+
},
|
| 100 |
+
{
|
| 101 |
+
"epoch": 2.6,
|
| 102 |
+
"learning_rate": 8.700519792083167e-05,
|
| 103 |
+
"loss": 1.7852,
|
| 104 |
+
"step": 6500
|
| 105 |
+
},
|
| 106 |
+
{
|
| 107 |
+
"epoch": 2.8,
|
| 108 |
+
"learning_rate": 8.600559776089565e-05,
|
| 109 |
+
"loss": 1.759,
|
| 110 |
+
"step": 7000
|
| 111 |
+
},
|
| 112 |
+
{
|
| 113 |
+
"epoch": 3.0,
|
| 114 |
+
"learning_rate": 8.500599760095962e-05,
|
| 115 |
+
"loss": 1.7362,
|
| 116 |
+
"step": 7500
|
| 117 |
+
},
|
| 118 |
+
{
|
| 119 |
+
"epoch": 3.0,
|
| 120 |
+
"eval_accuracy": 0.6261863265881175,
|
| 121 |
+
"eval_loss": 1.620674967765808,
|
| 122 |
+
"eval_runtime": 18.4687,
|
| 123 |
+
"eval_samples_per_second": 228.224,
|
| 124 |
+
"eval_steps_per_second": 7.147,
|
| 125 |
+
"step": 7503
|
| 126 |
+
},
|
| 127 |
+
{
|
| 128 |
+
"epoch": 3.2,
|
| 129 |
+
"learning_rate": 8.40063974410236e-05,
|
| 130 |
+
"loss": 1.7098,
|
| 131 |
+
"step": 8000
|
| 132 |
+
},
|
| 133 |
+
{
|
| 134 |
+
"epoch": 3.4,
|
| 135 |
+
"learning_rate": 8.300679728108757e-05,
|
| 136 |
+
"loss": 1.6939,
|
| 137 |
+
"step": 8500
|
| 138 |
+
},
|
| 139 |
+
{
|
| 140 |
+
"epoch": 3.6,
|
| 141 |
+
"learning_rate": 8.200719712115154e-05,
|
| 142 |
+
"loss": 1.6799,
|
| 143 |
+
"step": 9000
|
| 144 |
+
},
|
| 145 |
+
{
|
| 146 |
+
"epoch": 3.8,
|
| 147 |
+
"learning_rate": 8.100759696121552e-05,
|
| 148 |
+
"loss": 1.6631,
|
| 149 |
+
"step": 9500
|
| 150 |
+
},
|
| 151 |
+
{
|
| 152 |
+
"epoch": 4.0,
|
| 153 |
+
"learning_rate": 8.000799680127949e-05,
|
| 154 |
+
"loss": 1.6515,
|
| 155 |
+
"step": 10000
|
| 156 |
+
},
|
| 157 |
+
{
|
| 158 |
+
"epoch": 4.0,
|
| 159 |
+
"eval_accuracy": 0.6372365602993545,
|
| 160 |
+
"eval_loss": 1.5419366359710693,
|
| 161 |
+
"eval_runtime": 18.7362,
|
| 162 |
+
"eval_samples_per_second": 224.966,
|
| 163 |
+
"eval_steps_per_second": 7.045,
|
| 164 |
+
"step": 10004
|
| 165 |
+
},
|
| 166 |
+
{
|
| 167 |
+
"epoch": 4.2,
|
| 168 |
+
"learning_rate": 7.900839664134347e-05,
|
| 169 |
+
"loss": 1.6333,
|
| 170 |
+
"step": 10500
|
| 171 |
+
},
|
| 172 |
+
{
|
| 173 |
+
"epoch": 4.4,
|
| 174 |
+
"learning_rate": 7.800879648140744e-05,
|
| 175 |
+
"loss": 1.6238,
|
| 176 |
+
"step": 11000
|
| 177 |
+
},
|
| 178 |
+
{
|
| 179 |
+
"epoch": 4.6,
|
| 180 |
+
"learning_rate": 7.700919632147142e-05,
|
| 181 |
+
"loss": 1.6142,
|
| 182 |
+
"step": 11500
|
| 183 |
+
},
|
| 184 |
+
{
|
| 185 |
+
"epoch": 4.8,
|
| 186 |
+
"learning_rate": 7.600959616153539e-05,
|
| 187 |
+
"loss": 1.6057,
|
| 188 |
+
"step": 12000
|
| 189 |
+
},
|
| 190 |
+
{
|
| 191 |
+
"epoch": 5.0,
|
| 192 |
+
"learning_rate": 7.500999600159937e-05,
|
| 193 |
+
"loss": 1.5949,
|
| 194 |
+
"step": 12500
|
| 195 |
+
},
|
| 196 |
+
{
|
| 197 |
+
"epoch": 5.0,
|
| 198 |
+
"eval_accuracy": 0.6442308517386005,
|
| 199 |
+
"eval_loss": 1.4929462671279907,
|
| 200 |
+
"eval_runtime": 18.7703,
|
| 201 |
+
"eval_samples_per_second": 224.557,
|
| 202 |
+
"eval_steps_per_second": 7.032,
|
| 203 |
+
"step": 12505
|
| 204 |
+
},
|
| 205 |
+
{
|
| 206 |
+
"epoch": 5.2,
|
| 207 |
+
"learning_rate": 7.401039584166334e-05,
|
| 208 |
+
"loss": 1.5805,
|
| 209 |
+
"step": 13000
|
| 210 |
+
},
|
| 211 |
+
{
|
| 212 |
+
"epoch": 5.4,
|
| 213 |
+
"learning_rate": 7.301079568172731e-05,
|
| 214 |
+
"loss": 1.5782,
|
| 215 |
+
"step": 13500
|
| 216 |
+
},
|
| 217 |
+
{
|
| 218 |
+
"epoch": 5.6,
|
| 219 |
+
"learning_rate": 7.201119552179129e-05,
|
| 220 |
+
"loss": 1.5722,
|
| 221 |
+
"step": 14000
|
| 222 |
+
},
|
| 223 |
+
{
|
| 224 |
+
"epoch": 5.8,
|
| 225 |
+
"learning_rate": 7.101159536185526e-05,
|
| 226 |
+
"loss": 1.5624,
|
| 227 |
+
"step": 14500
|
| 228 |
+
},
|
| 229 |
+
{
|
| 230 |
+
"epoch": 6.0,
|
| 231 |
+
"learning_rate": 7.001199520191924e-05,
|
| 232 |
+
"loss": 1.5564,
|
| 233 |
+
"step": 15000
|
| 234 |
+
},
|
| 235 |
+
{
|
| 236 |
+
"epoch": 6.0,
|
| 237 |
+
"eval_accuracy": 0.6498308767853023,
|
| 238 |
+
"eval_loss": 1.4557212591171265,
|
| 239 |
+
"eval_runtime": 18.7359,
|
| 240 |
+
"eval_samples_per_second": 224.97,
|
| 241 |
+
"eval_steps_per_second": 7.045,
|
| 242 |
+
"step": 15006
|
| 243 |
+
},
|
| 244 |
+
{
|
| 245 |
+
"epoch": 6.2,
|
| 246 |
+
"learning_rate": 6.901239504198321e-05,
|
| 247 |
+
"loss": 1.545,
|
| 248 |
+
"step": 15500
|
| 249 |
+
},
|
| 250 |
+
{
|
| 251 |
+
"epoch": 6.4,
|
| 252 |
+
"learning_rate": 6.801279488204719e-05,
|
| 253 |
+
"loss": 1.542,
|
| 254 |
+
"step": 16000
|
| 255 |
+
},
|
| 256 |
+
{
|
| 257 |
+
"epoch": 6.6,
|
| 258 |
+
"learning_rate": 6.701319472211116e-05,
|
| 259 |
+
"loss": 1.5351,
|
| 260 |
+
"step": 16500
|
| 261 |
+
},
|
| 262 |
+
{
|
| 263 |
+
"epoch": 6.8,
|
| 264 |
+
"learning_rate": 6.601359456217513e-05,
|
| 265 |
+
"loss": 1.5331,
|
| 266 |
+
"step": 17000
|
| 267 |
+
},
|
| 268 |
+
{
|
| 269 |
+
"epoch": 7.0,
|
| 270 |
+
"learning_rate": 6.501399440223911e-05,
|
| 271 |
+
"loss": 1.5317,
|
| 272 |
+
"step": 17500
|
| 273 |
+
},
|
| 274 |
+
{
|
| 275 |
+
"epoch": 7.0,
|
| 276 |
+
"eval_accuracy": 0.653854583024598,
|
| 277 |
+
"eval_loss": 1.4292062520980835,
|
| 278 |
+
"eval_runtime": 18.5593,
|
| 279 |
+
"eval_samples_per_second": 227.109,
|
| 280 |
+
"eval_steps_per_second": 7.112,
|
| 281 |
+
"step": 17507
|
| 282 |
+
},
|
| 283 |
+
{
|
| 284 |
+
"epoch": 7.2,
|
| 285 |
+
"learning_rate": 6.401439424230308e-05,
|
| 286 |
+
"loss": 1.52,
|
| 287 |
+
"step": 18000
|
| 288 |
+
},
|
| 289 |
+
{
|
| 290 |
+
"epoch": 7.4,
|
| 291 |
+
"learning_rate": 6.301479408236706e-05,
|
| 292 |
+
"loss": 1.5147,
|
| 293 |
+
"step": 18500
|
| 294 |
+
},
|
| 295 |
+
{
|
| 296 |
+
"epoch": 7.6,
|
| 297 |
+
"learning_rate": 6.201519392243102e-05,
|
| 298 |
+
"loss": 1.5117,
|
| 299 |
+
"step": 19000
|
| 300 |
+
},
|
| 301 |
+
{
|
| 302 |
+
"epoch": 7.8,
|
| 303 |
+
"learning_rate": 6.101559376249501e-05,
|
| 304 |
+
"loss": 1.509,
|
| 305 |
+
"step": 19500
|
| 306 |
+
},
|
| 307 |
+
{
|
| 308 |
+
"epoch": 8.0,
|
| 309 |
+
"learning_rate": 6.001599360255898e-05,
|
| 310 |
+
"loss": 1.504,
|
| 311 |
+
"step": 20000
|
| 312 |
+
},
|
| 313 |
+
{
|
| 314 |
+
"epoch": 8.0,
|
| 315 |
+
"eval_accuracy": 0.6569471549382008,
|
| 316 |
+
"eval_loss": 1.4085054397583008,
|
| 317 |
+
"eval_runtime": 18.6672,
|
| 318 |
+
"eval_samples_per_second": 225.798,
|
| 319 |
+
"eval_steps_per_second": 7.071,
|
| 320 |
+
"step": 20008
|
| 321 |
+
},
|
| 322 |
+
{
|
| 323 |
+
"epoch": 8.2,
|
| 324 |
+
"learning_rate": 5.9016393442622956e-05,
|
| 325 |
+
"loss": 1.4958,
|
| 326 |
+
"step": 20500
|
| 327 |
+
},
|
| 328 |
+
{
|
| 329 |
+
"epoch": 8.4,
|
| 330 |
+
"learning_rate": 5.801679328268693e-05,
|
| 331 |
+
"loss": 1.4933,
|
| 332 |
+
"step": 21000
|
| 333 |
+
},
|
| 334 |
+
{
|
| 335 |
+
"epoch": 8.6,
|
| 336 |
+
"learning_rate": 5.70171931227509e-05,
|
| 337 |
+
"loss": 1.4928,
|
| 338 |
+
"step": 21500
|
| 339 |
+
},
|
| 340 |
+
{
|
| 341 |
+
"epoch": 8.8,
|
| 342 |
+
"learning_rate": 5.601759296281488e-05,
|
| 343 |
+
"loss": 1.4889,
|
| 344 |
+
"step": 22000
|
| 345 |
+
},
|
| 346 |
+
{
|
| 347 |
+
"epoch": 9.0,
|
| 348 |
+
"learning_rate": 5.5017992802878847e-05,
|
| 349 |
+
"loss": 1.4864,
|
| 350 |
+
"step": 22500
|
| 351 |
+
},
|
| 352 |
+
{
|
| 353 |
+
"epoch": 9.0,
|
| 354 |
+
"eval_accuracy": 0.6594293294557328,
|
| 355 |
+
"eval_loss": 1.3925750255584717,
|
| 356 |
+
"eval_runtime": 18.519,
|
| 357 |
+
"eval_samples_per_second": 227.605,
|
| 358 |
+
"eval_steps_per_second": 7.128,
|
| 359 |
+
"step": 22509
|
| 360 |
+
},
|
| 361 |
+
{
|
| 362 |
+
"epoch": 9.2,
|
| 363 |
+
"learning_rate": 5.401839264294283e-05,
|
| 364 |
+
"loss": 1.4798,
|
| 365 |
+
"step": 23000
|
| 366 |
+
},
|
| 367 |
+
{
|
| 368 |
+
"epoch": 9.4,
|
| 369 |
+
"learning_rate": 5.3018792483006795e-05,
|
| 370 |
+
"loss": 1.4769,
|
| 371 |
+
"step": 23500
|
| 372 |
+
},
|
| 373 |
+
{
|
| 374 |
+
"epoch": 9.6,
|
| 375 |
+
"learning_rate": 5.2019192323070777e-05,
|
| 376 |
+
"loss": 1.4755,
|
| 377 |
+
"step": 24000
|
| 378 |
+
},
|
| 379 |
+
{
|
| 380 |
+
"epoch": 9.8,
|
| 381 |
+
"learning_rate": 5.1019592163134744e-05,
|
| 382 |
+
"loss": 1.4718,
|
| 383 |
+
"step": 24500
|
| 384 |
+
},
|
| 385 |
+
{
|
| 386 |
+
"epoch": 10.0,
|
| 387 |
+
"learning_rate": 5.0019992003198725e-05,
|
| 388 |
+
"loss": 1.4699,
|
| 389 |
+
"step": 25000
|
| 390 |
+
},
|
| 391 |
+
{
|
| 392 |
+
"epoch": 10.0,
|
| 393 |
+
"eval_accuracy": 0.6614544016679248,
|
| 394 |
+
"eval_loss": 1.3797509670257568,
|
| 395 |
+
"eval_runtime": 18.6231,
|
| 396 |
+
"eval_samples_per_second": 226.332,
|
| 397 |
+
"eval_steps_per_second": 7.088,
|
| 398 |
+
"step": 25010
|
| 399 |
+
},
|
| 400 |
+
{
|
| 401 |
+
"epoch": 10.2,
|
| 402 |
+
"learning_rate": 4.90203918432627e-05,
|
| 403 |
+
"loss": 1.4641,
|
| 404 |
+
"step": 25500
|
| 405 |
+
},
|
| 406 |
+
{
|
| 407 |
+
"epoch": 10.4,
|
| 408 |
+
"learning_rate": 4.8020791683326674e-05,
|
| 409 |
+
"loss": 1.4625,
|
| 410 |
+
"step": 26000
|
| 411 |
+
},
|
| 412 |
+
{
|
| 413 |
+
"epoch": 10.6,
|
| 414 |
+
"learning_rate": 4.702119152339065e-05,
|
| 415 |
+
"loss": 1.4598,
|
| 416 |
+
"step": 26500
|
| 417 |
+
},
|
| 418 |
+
{
|
| 419 |
+
"epoch": 10.8,
|
| 420 |
+
"learning_rate": 4.6021591363454616e-05,
|
| 421 |
+
"loss": 1.4584,
|
| 422 |
+
"step": 27000
|
| 423 |
+
},
|
| 424 |
+
{
|
| 425 |
+
"epoch": 11.0,
|
| 426 |
+
"learning_rate": 4.502199120351859e-05,
|
| 427 |
+
"loss": 1.4599,
|
| 428 |
+
"step": 27500
|
| 429 |
+
},
|
| 430 |
+
{
|
| 431 |
+
"epoch": 11.0,
|
| 432 |
+
"eval_accuracy": 0.6634159294703434,
|
| 433 |
+
"eval_loss": 1.3681137561798096,
|
| 434 |
+
"eval_runtime": 18.5036,
|
| 435 |
+
"eval_samples_per_second": 227.794,
|
| 436 |
+
"eval_steps_per_second": 7.134,
|
| 437 |
+
"step": 27511
|
| 438 |
+
},
|
| 439 |
+
{
|
| 440 |
+
"epoch": 11.2,
|
| 441 |
+
"learning_rate": 4.4022391043582565e-05,
|
| 442 |
+
"loss": 1.452,
|
| 443 |
+
"step": 28000
|
| 444 |
+
},
|
| 445 |
+
{
|
| 446 |
+
"epoch": 11.4,
|
| 447 |
+
"learning_rate": 4.302279088364654e-05,
|
| 448 |
+
"loss": 1.4486,
|
| 449 |
+
"step": 28500
|
| 450 |
+
},
|
| 451 |
+
{
|
| 452 |
+
"epoch": 11.6,
|
| 453 |
+
"learning_rate": 4.202319072371052e-05,
|
| 454 |
+
"loss": 1.4501,
|
| 455 |
+
"step": 29000
|
| 456 |
+
},
|
| 457 |
+
{
|
| 458 |
+
"epoch": 11.8,
|
| 459 |
+
"learning_rate": 4.1023590563774495e-05,
|
| 460 |
+
"loss": 1.4494,
|
| 461 |
+
"step": 29500
|
| 462 |
+
},
|
| 463 |
+
{
|
| 464 |
+
"epoch": 12.0,
|
| 465 |
+
"learning_rate": 4.002399040383847e-05,
|
| 466 |
+
"loss": 1.4442,
|
| 467 |
+
"step": 30000
|
| 468 |
+
},
|
| 469 |
+
{
|
| 470 |
+
"epoch": 12.0,
|
| 471 |
+
"eval_accuracy": 0.6648405765843488,
|
| 472 |
+
"eval_loss": 1.3584463596343994,
|
| 473 |
+
"eval_runtime": 18.4605,
|
| 474 |
+
"eval_samples_per_second": 228.325,
|
| 475 |
+
"eval_steps_per_second": 7.15,
|
| 476 |
+
"step": 30012
|
| 477 |
+
},
|
| 478 |
+
{
|
| 479 |
+
"epoch": 12.2,
|
| 480 |
+
"learning_rate": 3.9024390243902444e-05,
|
| 481 |
+
"loss": 1.4402,
|
| 482 |
+
"step": 30500
|
| 483 |
+
},
|
| 484 |
+
{
|
| 485 |
+
"epoch": 12.4,
|
| 486 |
+
"learning_rate": 3.802479008396642e-05,
|
| 487 |
+
"loss": 1.4392,
|
| 488 |
+
"step": 31000
|
| 489 |
+
},
|
| 490 |
+
{
|
| 491 |
+
"epoch": 12.59,
|
| 492 |
+
"learning_rate": 3.702518992403039e-05,
|
| 493 |
+
"loss": 1.4389,
|
| 494 |
+
"step": 31500
|
| 495 |
+
},
|
| 496 |
+
{
|
| 497 |
+
"epoch": 12.79,
|
| 498 |
+
"learning_rate": 3.602558976409437e-05,
|
| 499 |
+
"loss": 1.4402,
|
| 500 |
+
"step": 32000
|
| 501 |
+
},
|
| 502 |
+
{
|
| 503 |
+
"epoch": 12.99,
|
| 504 |
+
"learning_rate": 3.5025989604158335e-05,
|
| 505 |
+
"loss": 1.436,
|
| 506 |
+
"step": 32500
|
| 507 |
+
},
|
| 508 |
+
{
|
| 509 |
+
"epoch": 13.0,
|
| 510 |
+
"eval_accuracy": 0.6663347978696389,
|
| 511 |
+
"eval_loss": 1.3500910997390747,
|
| 512 |
+
"eval_runtime": 18.6729,
|
| 513 |
+
"eval_samples_per_second": 225.728,
|
| 514 |
+
"eval_steps_per_second": 7.069,
|
| 515 |
+
"step": 32513
|
| 516 |
+
},
|
| 517 |
+
{
|
| 518 |
+
"epoch": 13.19,
|
| 519 |
+
"learning_rate": 3.402638944422231e-05,
|
| 520 |
+
"loss": 1.4311,
|
| 521 |
+
"step": 33000
|
| 522 |
+
},
|
| 523 |
+
{
|
| 524 |
+
"epoch": 13.39,
|
| 525 |
+
"learning_rate": 3.3026789284286284e-05,
|
| 526 |
+
"loss": 1.4303,
|
| 527 |
+
"step": 33500
|
| 528 |
+
},
|
| 529 |
+
{
|
| 530 |
+
"epoch": 13.59,
|
| 531 |
+
"learning_rate": 3.202718912435026e-05,
|
| 532 |
+
"loss": 1.4307,
|
| 533 |
+
"step": 34000
|
| 534 |
+
},
|
| 535 |
+
{
|
| 536 |
+
"epoch": 13.79,
|
| 537 |
+
"learning_rate": 3.102758896441423e-05,
|
| 538 |
+
"loss": 1.4289,
|
| 539 |
+
"step": 34500
|
| 540 |
+
},
|
| 541 |
+
{
|
| 542 |
+
"epoch": 13.99,
|
| 543 |
+
"learning_rate": 3.0027988804478207e-05,
|
| 544 |
+
"loss": 1.4306,
|
| 545 |
+
"step": 35000
|
| 546 |
+
},
|
| 547 |
+
{
|
| 548 |
+
"epoch": 14.0,
|
| 549 |
+
"eval_accuracy": 0.6675748415158357,
|
| 550 |
+
"eval_loss": 1.3431888818740845,
|
| 551 |
+
"eval_runtime": 18.3888,
|
| 552 |
+
"eval_samples_per_second": 229.215,
|
| 553 |
+
"eval_steps_per_second": 7.178,
|
| 554 |
+
"step": 35014
|
| 555 |
+
},
|
| 556 |
+
{
|
| 557 |
+
"epoch": 14.19,
|
| 558 |
+
"learning_rate": 2.9028388644542188e-05,
|
| 559 |
+
"loss": 1.4227,
|
| 560 |
+
"step": 35500
|
| 561 |
+
},
|
| 562 |
+
{
|
| 563 |
+
"epoch": 14.39,
|
| 564 |
+
"learning_rate": 2.8028788484606162e-05,
|
| 565 |
+
"loss": 1.4246,
|
| 566 |
+
"step": 36000
|
| 567 |
+
},
|
| 568 |
+
{
|
| 569 |
+
"epoch": 14.59,
|
| 570 |
+
"learning_rate": 2.7029188324670133e-05,
|
| 571 |
+
"loss": 1.4261,
|
| 572 |
+
"step": 36500
|
| 573 |
+
},
|
| 574 |
+
{
|
| 575 |
+
"epoch": 14.79,
|
| 576 |
+
"learning_rate": 2.6029588164734108e-05,
|
| 577 |
+
"loss": 1.4206,
|
| 578 |
+
"step": 37000
|
| 579 |
+
},
|
| 580 |
+
{
|
| 581 |
+
"epoch": 14.99,
|
| 582 |
+
"learning_rate": 2.5029988004798082e-05,
|
| 583 |
+
"loss": 1.4202,
|
| 584 |
+
"step": 37500
|
| 585 |
+
},
|
| 586 |
+
{
|
| 587 |
+
"epoch": 15.0,
|
| 588 |
+
"eval_accuracy": 0.6686219327936697,
|
| 589 |
+
"eval_loss": 1.3371825218200684,
|
| 590 |
+
"eval_runtime": 18.6603,
|
| 591 |
+
"eval_samples_per_second": 225.881,
|
| 592 |
+
"eval_steps_per_second": 7.074,
|
| 593 |
+
"step": 37515
|
| 594 |
+
},
|
| 595 |
+
{
|
| 596 |
+
"epoch": 15.19,
|
| 597 |
+
"learning_rate": 2.4030387844862057e-05,
|
| 598 |
+
"loss": 1.4161,
|
| 599 |
+
"step": 38000
|
| 600 |
+
},
|
| 601 |
+
{
|
| 602 |
+
"epoch": 15.39,
|
| 603 |
+
"learning_rate": 2.303078768492603e-05,
|
| 604 |
+
"loss": 1.4165,
|
| 605 |
+
"step": 38500
|
| 606 |
+
},
|
| 607 |
+
{
|
| 608 |
+
"epoch": 15.59,
|
| 609 |
+
"learning_rate": 2.2031187524990005e-05,
|
| 610 |
+
"loss": 1.4179,
|
| 611 |
+
"step": 39000
|
| 612 |
+
},
|
| 613 |
+
{
|
| 614 |
+
"epoch": 15.79,
|
| 615 |
+
"learning_rate": 2.103158736505398e-05,
|
| 616 |
+
"loss": 1.4145,
|
| 617 |
+
"step": 39500
|
| 618 |
+
},
|
| 619 |
+
{
|
| 620 |
+
"epoch": 15.99,
|
| 621 |
+
"learning_rate": 2.003198720511795e-05,
|
| 622 |
+
"loss": 1.4172,
|
| 623 |
+
"step": 40000
|
| 624 |
+
},
|
| 625 |
+
{
|
| 626 |
+
"epoch": 16.0,
|
| 627 |
+
"eval_accuracy": 0.6693617381483298,
|
| 628 |
+
"eval_loss": 1.3332273960113525,
|
| 629 |
+
"eval_runtime": 18.6708,
|
| 630 |
+
"eval_samples_per_second": 225.754,
|
| 631 |
+
"eval_steps_per_second": 7.07,
|
| 632 |
+
"step": 40016
|
| 633 |
+
},
|
| 634 |
+
{
|
| 635 |
+
"epoch": 16.19,
|
| 636 |
+
"learning_rate": 1.903238704518193e-05,
|
| 637 |
+
"loss": 1.4118,
|
| 638 |
+
"step": 40500
|
| 639 |
+
},
|
| 640 |
+
{
|
| 641 |
+
"epoch": 16.39,
|
| 642 |
+
"learning_rate": 1.8032786885245903e-05,
|
| 643 |
+
"loss": 1.41,
|
| 644 |
+
"step": 41000
|
| 645 |
+
},
|
| 646 |
+
{
|
| 647 |
+
"epoch": 16.59,
|
| 648 |
+
"learning_rate": 1.7033186725309878e-05,
|
| 649 |
+
"loss": 1.4086,
|
| 650 |
+
"step": 41500
|
| 651 |
+
},
|
| 652 |
+
{
|
| 653 |
+
"epoch": 16.79,
|
| 654 |
+
"learning_rate": 1.6033586565373852e-05,
|
| 655 |
+
"loss": 1.4117,
|
| 656 |
+
"step": 42000
|
| 657 |
+
},
|
| 658 |
+
{
|
| 659 |
+
"epoch": 16.99,
|
| 660 |
+
"learning_rate": 1.5033986405437825e-05,
|
| 661 |
+
"loss": 1.4126,
|
| 662 |
+
"step": 42500
|
| 663 |
+
},
|
| 664 |
+
{
|
| 665 |
+
"epoch": 17.0,
|
| 666 |
+
"eval_accuracy": 0.6700233885172469,
|
| 667 |
+
"eval_loss": 1.3284056186676025,
|
| 668 |
+
"eval_runtime": 18.5064,
|
| 669 |
+
"eval_samples_per_second": 227.759,
|
| 670 |
+
"eval_steps_per_second": 7.133,
|
| 671 |
+
"step": 42517
|
| 672 |
+
},
|
| 673 |
+
{
|
| 674 |
+
"epoch": 17.19,
|
| 675 |
+
"learning_rate": 1.4034386245501799e-05,
|
| 676 |
+
"loss": 1.407,
|
| 677 |
+
"step": 43000
|
| 678 |
+
},
|
| 679 |
+
{
|
| 680 |
+
"epoch": 17.39,
|
| 681 |
+
"learning_rate": 1.3034786085565775e-05,
|
| 682 |
+
"loss": 1.4052,
|
| 683 |
+
"step": 43500
|
| 684 |
+
},
|
| 685 |
+
{
|
| 686 |
+
"epoch": 17.59,
|
| 687 |
+
"learning_rate": 1.2035185925629748e-05,
|
| 688 |
+
"loss": 1.4073,
|
| 689 |
+
"step": 44000
|
| 690 |
+
},
|
| 691 |
+
{
|
| 692 |
+
"epoch": 17.79,
|
| 693 |
+
"learning_rate": 1.1035585765693724e-05,
|
| 694 |
+
"loss": 1.4054,
|
| 695 |
+
"step": 44500
|
| 696 |
+
},
|
| 697 |
+
{
|
| 698 |
+
"epoch": 17.99,
|
| 699 |
+
"learning_rate": 1.0035985605757697e-05,
|
| 700 |
+
"loss": 1.407,
|
| 701 |
+
"step": 45000
|
| 702 |
+
},
|
| 703 |
+
{
|
| 704 |
+
"epoch": 18.0,
|
| 705 |
+
"eval_accuracy": 0.6706289157213277,
|
| 706 |
+
"eval_loss": 1.325285792350769,
|
| 707 |
+
"eval_runtime": 18.4328,
|
| 708 |
+
"eval_samples_per_second": 228.669,
|
| 709 |
+
"eval_steps_per_second": 7.161,
|
| 710 |
+
"step": 45018
|
| 711 |
+
},
|
| 712 |
+
{
|
| 713 |
+
"epoch": 18.19,
|
| 714 |
+
"learning_rate": 9.036385445821671e-06,
|
| 715 |
+
"loss": 1.4025,
|
| 716 |
+
"step": 45500
|
| 717 |
+
},
|
| 718 |
+
{
|
| 719 |
+
"epoch": 18.39,
|
| 720 |
+
"learning_rate": 8.036785285885647e-06,
|
| 721 |
+
"loss": 1.4037,
|
| 722 |
+
"step": 46000
|
| 723 |
+
},
|
| 724 |
+
{
|
| 725 |
+
"epoch": 18.59,
|
| 726 |
+
"learning_rate": 7.037185125949621e-06,
|
| 727 |
+
"loss": 1.4028,
|
| 728 |
+
"step": 46500
|
| 729 |
+
},
|
| 730 |
+
{
|
| 731 |
+
"epoch": 18.79,
|
| 732 |
+
"learning_rate": 6.037584966013595e-06,
|
| 733 |
+
"loss": 1.4028,
|
| 734 |
+
"step": 47000
|
| 735 |
+
},
|
| 736 |
+
{
|
| 737 |
+
"epoch": 18.99,
|
| 738 |
+
"learning_rate": 5.037984806077569e-06,
|
| 739 |
+
"loss": 1.4015,
|
| 740 |
+
"step": 47500
|
| 741 |
+
},
|
| 742 |
+
{
|
| 743 |
+
"epoch": 19.0,
|
| 744 |
+
"eval_accuracy": 0.6710941350133176,
|
| 745 |
+
"eval_loss": 1.3228946924209595,
|
| 746 |
+
"eval_runtime": 18.6,
|
| 747 |
+
"eval_samples_per_second": 226.613,
|
| 748 |
+
"eval_steps_per_second": 7.097,
|
| 749 |
+
"step": 47519
|
| 750 |
+
},
|
| 751 |
+
{
|
| 752 |
+
"epoch": 19.19,
|
| 753 |
+
"learning_rate": 4.038384646141544e-06,
|
| 754 |
+
"loss": 1.3991,
|
| 755 |
+
"step": 48000
|
| 756 |
+
},
|
| 757 |
+
{
|
| 758 |
+
"epoch": 19.39,
|
| 759 |
+
"learning_rate": 3.038784486205518e-06,
|
| 760 |
+
"loss": 1.4003,
|
| 761 |
+
"step": 48500
|
| 762 |
+
},
|
| 763 |
+
{
|
| 764 |
+
"epoch": 19.59,
|
| 765 |
+
"learning_rate": 2.0391843262694924e-06,
|
| 766 |
+
"loss": 1.4008,
|
| 767 |
+
"step": 49000
|
| 768 |
+
},
|
| 769 |
+
{
|
| 770 |
+
"epoch": 19.79,
|
| 771 |
+
"learning_rate": 1.0395841663334666e-06,
|
| 772 |
+
"loss": 1.3996,
|
| 773 |
+
"step": 49500
|
| 774 |
+
},
|
| 775 |
+
{
|
| 776 |
+
"epoch": 19.99,
|
| 777 |
+
"learning_rate": 3.9984006397441025e-08,
|
| 778 |
+
"loss": 1.3983,
|
| 779 |
+
"step": 50000
|
| 780 |
+
},
|
| 781 |
+
{
|
| 782 |
+
"epoch": 20.0,
|
| 783 |
+
"eval_accuracy": 0.6714253080686327,
|
| 784 |
+
"eval_loss": 1.3212834596633911,
|
| 785 |
+
"eval_runtime": 18.5709,
|
| 786 |
+
"eval_samples_per_second": 226.967,
|
| 787 |
+
"eval_steps_per_second": 7.108,
|
| 788 |
+
"step": 50020
|
| 789 |
+
},
|
| 790 |
+
{
|
| 791 |
+
"epoch": 20.0,
|
| 792 |
+
"step": 50020,
|
| 793 |
+
"total_flos": 3.106082471804928e+16,
|
| 794 |
+
"train_loss": 1.5915360271906862,
|
| 795 |
+
"train_runtime": 5537.1072,
|
| 796 |
+
"train_samples_per_second": 288.97,
|
| 797 |
+
"train_steps_per_second": 9.034
|
| 798 |
+
}
|
| 799 |
+
],
|
| 800 |
+
"max_steps": 50020,
|
| 801 |
+
"num_train_epochs": 20,
|
| 802 |
+
"total_flos": 3.106082471804928e+16,
|
| 803 |
+
"trial_name": null,
|
| 804 |
+
"trial_params": null
|
| 805 |
+
}
|
baseline_random_split/seed_42/training_args.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0e9ca74b0065a0b2208dac501312fff513c9168ffff9876f21ab93864426a6f4
|
| 3 |
+
size 4881
|
baseline_random_split/seed_42/vocab.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/anaphor_agreement/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/argument_structure/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/binding/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/case_subjective_pronoun/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/determiner_noun_agreement/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/ellipsis/eval_results.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"eval_accuracy": 0.4838709677419355, "per_example_results": [{"pred": "Sarah visited one change and Mark visited more fixed.", "target": "Sarah visited one fixed change and Mark visited more."}, {"pred": "the doctor got one bible and Roger got a lot more positive.", "target": "the doctor got one positive bible and Roger got a lot more."}, {"pred": "Alexander got one equipment and Roger got two worn.", "target": "Alexander got one worn equipment and Roger got two."}, {"pred": "Roger married one track and Alexander married a lot more recommended.", "target": "Roger married one recommended track and Alexander married a lot more."}, {"pred": "some wolf moved one sweetie and Sarah moved several kind.", "target": "some wolf moved one kind sweetie and Sarah moved several."}, {"pred": "her dinosaur entered one bible and Mark entered several carbon.", "target": "her dinosaur entered one carbon bible and Mark entered several."}, {"pred": "your dinosaur married one gate and Roger married a lot more positive.", "target": "your dinosaur married one positive gate and Roger married a lot more."}, {"pred": "this doctor entered one complete pattern and Roger entered a lot more.", "target": "this doctor entered one complete pattern and Roger entered a lot more."}, {"pred": "Mark broke one personal pattern and Sarah broke more.", "target": "Mark broke one personal pattern and Sarah broke more."}, {"pred": "her pig entered one electronic dog and Alexander entered two.", "target": "her pig entered one electronic dog and Alexander entered two."}, {"pred": "the sister managed one bad whale and Mark managed several.", "target": "the sister managed one bad whale and Mark managed several."}, {"pred": "the wolf started one needed fire and Roger started three.", "target": "the wolf started one needed fire and Roger started three."}, {"pred": "the dinosaur visited one rolling hole and Roger visited several.", "target": "the dinosaur visited one rolling hole and Roger visited several."}, {"pred": "his sister moved one stand and Alexander moved more red.", "target": "his sister moved one red stand and Alexander moved more."}, {"pred": "some doctor visited one gate and Roger visited two purple.", "target": "some doctor visited one purple gate and Roger visited two."}, {"pred": "Alexander started one ready protection and Mark started two.", "target": "Alexander started one ready protection and Mark started two."}, {"pred": "Sarah broke one morning and Roger broke several electronic.", "target": "Sarah broke one electronic morning and Roger broke several."}, {"pred": "a slave entered one red equipment and Sarah entered three.", "target": "a slave entered one red equipment and Sarah entered three."}, {"pred": "Sarah broke one canal and Mark broke three red.", "target": "Sarah broke one red canal and Mark broke three."}, {"pred": "Alexander visited one duck and Sarah visited three top.", "target": "Alexander visited one top duck and Sarah visited three."}, {"pred": "Mark managed one positive electricity and Sarah managed two.", "target": "Mark managed one positive electricity and Sarah managed two."}, {"pred": "her duke moved one silly whale and Alexander moved three.", "target": "her duke moved one silly whale and Alexander moved three."}, {"pred": "Alexander managed one good sign and Alexander managed more.", "target": "Alexander managed one good sign and Alexander managed more."}, {"pred": "your wolf married one mail and Roger married three polar.", "target": "your wolf married one polar mail and Roger married three."}, {"pred": "Roger carried one purple mail and Roger carried several.", "target": "Roger carried one purple mail and Roger carried several."}, {"pred": "her pig broke one white fire and Alexander broke two.", "target": "her pig broke one white fire and Alexander broke two."}, {"pred": "Alexander moved one parent and Alexander moved more hard.", "target": "Alexander moved one hard parent and Alexander moved more."}, {"pred": "a wolf broke one morning and Roger broke several electronic.", "target": "a wolf broke one electronic morning and Roger broke several."}, {"pred": "a doctor carried one poor change and Alexander carried three.", "target": "a doctor carried one poor change and Alexander carried three."}, {"pred": "this wolf fixed one medicine and Sarah fixed three winning.", "target": "this wolf fixed one winning medicine and Sarah fixed three."}, {"pred": "your duke entered one bet and Alexander entered three english.", "target": "your duke entered one english bet and Alexander entered three."}, {"pred": "some pig started one good chicken and Alexander started more.", "target": "some pig started one good chicken and Alexander started more."}, {"pred": "Alexander got one heaven and Roger got two winning.", "target": "Alexander got one winning heaven and Roger got two."}, {"pred": "Alexander visited one spin and Alexander visited several carbon.", "target": "Alexander visited one carbon spin and Alexander visited several."}, {"pred": "that boat fixed one soft discussion and Roger fixed several.", "target": "that boat fixed one soft discussion and Roger fixed several."}, {"pred": "Mark managed one track and Alexander managed more white.", "target": "Mark managed one white track and Alexander managed more."}, {"pred": "Alexander entered one bus and Sarah entered three worn.", "target": "Alexander entered one worn bus and Sarah entered three."}, {"pred": "Roger broke one yellow dog and Sarah broke a lot more.", "target": "Roger broke one yellow dog and Sarah broke a lot more."}, {"pred": "the pig started one needed college and Sarah started two.", "target": "the pig started one needed college and Sarah started two."}, {"pred": "your pig broke one quick parent and Mark broke several.", "target": "your pig broke one quick parent and Mark broke several."}, {"pred": "the dinosaur got one healthy pool and Roger got several.", "target": "the dinosaur got one healthy pool and Roger got several."}, {"pred": "some wolf fixed one polar gate and Alexander fixed a lot more.", "target": "some wolf fixed one polar gate and Alexander fixed a lot more."}, {"pred": "his sister moved one hard protection and Alexander moved several.", "target": "his sister moved one hard protection and Alexander moved several."}, {"pred": "the dinosaur started one sacred pattern and Alexander started two.", "target": "the dinosaur started one sacred pattern and Alexander started two."}, {"pred": "Mark started one heaven and Alexander started more abandoned.", "target": "Mark started one abandoned heaven and Alexander started more."}, {"pred": "that doctor visited one whale and Mark visited two early.", "target": "that doctor visited one early whale and Mark visited two."}, {"pred": "her duke moved one extra electricity and Sarah moved two.", "target": "her duke moved one extra electricity and Sarah moved two."}, {"pred": "Sarah broke one personal college and Sarah broke several.", "target": "Sarah broke one personal college and Sarah broke several."}, {"pred": "Roger managed one white bible and Sarah managed two.", "target": "Roger managed one white bible and Sarah managed two."}, {"pred": "some dinosaur broke one soft canal and Alexander broke several.", "target": "some dinosaur broke one soft canal and Alexander broke several."}, {"pred": "Sarah carried one red mail and Alexander carried two.", "target": "Sarah carried one red mail and Alexander carried two."}, {"pred": "Roger got one bath and Roger got three purple.", "target": "Roger got one purple bath and Roger got three."}, {"pred": "Mark fixed one worn canal and Roger fixed more.", "target": "Mark fixed one worn canal and Roger fixed more."}, {"pred": "Sarah carried one image and Roger carried several polar.", "target": "Sarah carried one polar image and Roger carried several."}, {"pred": "some dinosaur entered one dance and Sarah entered more top.", "target": "some dinosaur entered one top dance and Sarah entered more."}, {"pred": "this dinosaur started one heaven and Sarah started more simple.", "target": "this dinosaur started one simple heaven and Sarah started more."}, {"pred": "your doctor visited one change and Mark visited more fixed.", "target": "your doctor visited one fixed change and Mark visited more."}, {"pred": "the slave moved one leg and Sarah moved a lot more abandoned.", "target": "the slave moved one abandoned leg and Sarah moved a lot more."}, {"pred": "a duke visited one spin and Alexander visited several carbon.", "target": "a duke visited one carbon spin and Alexander visited several."}, {"pred": "some slave visited one discussion and Sarah visited more kind.", "target": "some slave visited one kind discussion and Sarah visited more."}, {"pred": "her pig entered one hole and Alexander entered a lot more healthy.", "target": "her pig entered one healthy hole and Alexander entered a lot more."}, {"pred": "her sister carried one rolling essay and Mark carried two.", "target": "her sister carried one rolling essay and Mark carried two."}, {"pred": "a duke managed one ear and Sarah managed more carbon.", "target": "a duke managed one carbon ear and Sarah managed more."}, {"pred": "a duke carried one bad essay and Alexander carried several.", "target": "a duke carried one bad essay and Alexander carried several."}, {"pred": "this sister entered one polar distance and Roger entered several.", "target": "this sister entered one polar distance and Roger entered several."}, {"pred": "some pig managed one white track and Alexander managed more.", "target": "some pig managed one white track and Alexander managed more."}, {"pred": "this dinosaur fixed one electronic bus and Sarah fixed two.", "target": "this dinosaur fixed one electronic bus and Sarah fixed two."}, {"pred": "her dinosaur broke one personal tail and Roger broke three.", "target": "her dinosaur broke one personal tail and Roger broke three."}, {"pred": "her doctor started one clothing and Alexander started three kind.", "target": "her doctor started one kind clothing and Alexander started three."}, {"pred": "this slave married one full bath and Roger married three.", "target": "this slave married one full bath and Roger married three."}, {"pred": "Sarah got one extra pool and Roger got two.", "target": "Sarah got one extra pool and Roger got two."}, {"pred": "a slave married one recommended track and Alexander married a lot more.", "target": "a slave married one recommended track and Alexander married a lot more."}, {"pred": "this wolf got one extra pool and Roger got two.", "target": "this wolf got one extra pool and Roger got two."}, {"pred": "some slave entered one telephone and Alexander entered a lot more complete.", "target": "some slave entered one complete telephone and Alexander entered a lot more."}, {"pred": "this duke married one stand and Mark married two contemporary.", "target": "this duke married one contemporary stand and Mark married two."}, {"pred": "your doctor broke one canal and Mark broke three red.", "target": "your doctor broke one red canal and Mark broke three."}, {"pred": "Alexander carried one clothing and Sarah carried several recommended.", "target": "Alexander carried one recommended clothing and Sarah carried several."}, {"pred": "her slave fixed one bath and Alexander fixed two polar.", "target": "her slave fixed one polar bath and Alexander fixed two."}, {"pred": "a sister visited one spin and Roger visited two kind.", "target": "a sister visited one kind spin and Roger visited two."}, {"pred": "Alexander started one girl and Alexander started two silly.", "target": "Alexander started one silly girl and Alexander started two."}, {"pred": "the slave got one complete speak and Roger got two.", "target": "the slave got one complete speak and Roger got two."}, {"pred": "his duke carried one contemporary pattern and Mark carried two.", "target": "his duke carried one contemporary pattern and Mark carried two."}, {"pred": "your pig visited one poor god and Mark visited more.", "target": "your pig visited one poor god and Mark visited more."}, {"pred": "that slave entered one needed electricity and Sarah entered more.", "target": "that slave entered one needed electricity and Sarah entered more."}, {"pred": "this dinosaur broke one college and Sarah broke several early.", "target": "this dinosaur broke one early college and Sarah broke several."}, {"pred": "your boat fixed one floor and Roger fixed several forced.", "target": "your boat fixed one forced floor and Roger fixed several."}, {"pred": "some pig started one recommended ear and Roger started more.", "target": "some pig started one recommended ear and Roger started more."}, {"pred": "Alexander managed one bad whale and Mark managed several.", "target": "Alexander managed one bad whale and Mark managed several."}, {"pred": "Roger managed one pool and Sarah managed a lot more english.", "target": "Roger managed one english pool and Sarah managed a lot more."}, {"pred": "that wolf married one poor track and Mark married several.", "target": "that wolf married one poor track and Mark married several."}, {"pred": "Roger fixed one polar bath and Alexander fixed two.", "target": "Roger fixed one polar bath and Alexander fixed two."}, {"pred": "a wolf married one hole and Sarah married more healthy.", "target": "a wolf married one healthy hole and Sarah married more."}, {"pred": "Mark started one ear and Roger started more recommended.", "target": "Mark started one recommended ear and Roger started more."}, {"pred": "some slave entered one parent and Roger entered several polar.", "target": "some slave entered one polar parent and Roger entered several."}, {"pred": "his slave broke one ride and Sarah broke more expected.", "target": "his slave broke one expected ride and Sarah broke more."}, {"pred": "his duke moved one electronic telephone and Mark moved more.", "target": "his duke moved one electronic telephone and Mark moved more."}, {"pred": "her pig married one quick track and Sarah married two.", "target": "her pig married one quick track and Sarah married two."}, {"pred": "the slave fixed one gate and Sarah fixed several summer.", "target": "the slave fixed one summer gate and Sarah fixed several."}, {"pred": "some doctor started one pain and Sarah started three abandoned.", "target": "some doctor started one abandoned pain and Sarah started three."}, {"pred": "some boat moved one worn heaven and Alexander moved several.", "target": "some boat moved one worn heaven and Alexander moved several."}, {"pred": "Roger got one fire and Roger got several carbon.", "target": "Roger got one carbon fire and Roger got several."}, {"pred": "Mark moved one contemporary bath and Roger moved a lot more.", "target": "Mark moved one contemporary bath and Roger moved a lot more."}, {"pred": "Roger carried one essay and Alexander carried three needed.", "target": "Roger carried one needed essay and Alexander carried three."}, {"pred": "the sister married one poor chicken and Roger married three.", "target": "the sister married one poor chicken and Roger married three."}, {"pred": "Sarah got one essay and Roger got two summer.", "target": "Sarah got one summer essay and Roger got two."}, {"pred": "Mark visited one whale and Mark visited two early.", "target": "Mark visited one early whale and Mark visited two."}, {"pred": "her pig married one sacred gate and Roger married several.", "target": "her pig married one sacred gate and Roger married several."}, {"pred": "this duke married one essay and Sarah married a lot more expected.", "target": "this duke married one expected essay and Sarah married a lot more."}, {"pred": "Sarah managed one personal leg and Mark managed three.", "target": "Sarah managed one personal leg and Mark managed three."}, {"pred": "some dinosaur carried one leg and Alexander carried more purple.", "target": "some dinosaur carried one purple leg and Alexander carried more."}, {"pred": "that boat managed one change and Mark managed several winning.", "target": "that boat managed one winning change and Mark managed several."}, {"pred": "Mark started one pain and Sarah started three abandoned.", "target": "Mark started one abandoned pain and Sarah started three."}, {"pred": "Alexander fixed one floor and Roger fixed several forced.", "target": "Alexander fixed one forced floor and Roger fixed several."}, {"pred": "Mark managed one college and Mark managed two english.", "target": "Mark managed one english college and Mark managed two."}, {"pred": "his slave visited one positive god and Sarah visited several.", "target": "his slave visited one positive god and Sarah visited several."}, {"pred": "her wolf managed one pool and Sarah managed a lot more english.", "target": "her wolf managed one english pool and Sarah managed a lot more."}, {"pred": "her doctor got one electricity and Mark got a lot more worn.", "target": "her doctor got one worn electricity and Mark got a lot more."}, {"pred": "that sister married one gate and Roger married a lot more electronic.", "target": "that sister married one electronic gate and Roger married a lot more."}, {"pred": "Sarah broke one duck and Alexander broke two winning.", "target": "Sarah broke one winning duck and Alexander broke two."}, {"pred": "his sister married one healthy clothing and Roger married more.", "target": "his sister married one healthy clothing and Roger married more."}, {"pred": "the slave visited one essay and Alexander visited two worn.", "target": "the slave visited one worn essay and Alexander visited two."}, {"pred": "your pig fixed one dance and Sarah fixed a lot more carbon.", "target": "your pig fixed one carbon dance and Sarah fixed a lot more."}, {"pred": "this pig married one sweetie and Sarah married several ready.", "target": "this pig married one ready sweetie and Sarah married several."}, {"pred": "this wolf moved one sweetie and Sarah moved a lot more tall.", "target": "this wolf moved one tall sweetie and Sarah moved a lot more."}, {"pred": "that wolf got one god and Roger got two filled.", "target": "that wolf got one filled god and Roger got two."}, {"pred": "this doctor got one last sign and Sarah got a lot more.", "target": "this doctor got one last sign and Sarah got a lot more."}, {"pred": "Roger started one clothing and Alexander started three kind.", "target": "Roger started one kind clothing and Alexander started three."}, {"pred": "Sarah married one track and Roger married several early.", "target": "Sarah married one early track and Roger married several."}, {"pred": "Roger fixed one yellow distance and Alexander fixed several.", "target": "Roger fixed one yellow distance and Alexander fixed several."}, {"pred": "Roger entered one red equipment and Sarah entered three.", "target": "Roger entered one red equipment and Sarah entered three."}, {"pred": "some slave started one soft ear and Mark started a lot more.", "target": "some slave started one soft ear and Mark started a lot more."}, {"pred": "your duke visited one girl and Alexander visited several expected.", "target": "your duke visited one expected girl and Alexander visited several."}, {"pred": "Roger got one next essay and Roger got a lot more.", "target": "Roger got one next essay and Roger got a lot more."}, {"pred": "a slave started one chicken and Mark started two winning.", "target": "a slave started one winning chicken and Mark started two."}, {"pred": "his wolf started one medicine and Sarah started two red.", "target": "his wolf started one red medicine and Sarah started two."}, {"pred": "a wolf broke one essay and Alexander broke more close.", "target": "a wolf broke one close essay and Alexander broke more."}, {"pred": "her sister entered one circle and Mark entered several finished.", "target": "her sister entered one finished circle and Mark entered several."}, {"pred": "Mark started one fire and Roger started three needed.", "target": "Mark started one needed fire and Roger started three."}, {"pred": "the duke fixed one hole and Roger fixed two close.", "target": "the duke fixed one close hole and Roger fixed two."}, {"pred": "Sarah fixed one fire and Sarah fixed more top.", "target": "Sarah fixed one top fire and Sarah fixed more."}, {"pred": "that pig broke one yellow dog and Sarah broke a lot more.", "target": "that pig broke one yellow dog and Sarah broke a lot more."}, {"pred": "the pig carried one white pain and Sarah carried more.", "target": "the pig carried one white pain and Sarah carried more."}, {"pred": "that doctor broke one bet and Alexander broke a lot more ordered.", "target": "that doctor broke one ordered bet and Alexander broke a lot more."}, {"pred": "Roger visited one dance and Mark visited several filled.", "target": "Roger visited one filled dance and Mark visited several."}, {"pred": "a boat managed one extra spin and Sarah managed two.", "target": "a boat managed one extra spin and Sarah managed two."}, {"pred": "Mark married one issue and Mark married several finished.", "target": "Mark married one finished issue and Mark married several."}, {"pred": "some slave carried one ear and Roger carried two finished.", "target": "some slave carried one finished ear and Roger carried two."}, {"pred": "her duke managed one morning and Alexander managed three early.", "target": "her duke managed one early morning and Alexander managed three."}, {"pred": "some doctor carried one protection and Roger carried more top.", "target": "some doctor carried one top protection and Roger carried more."}, {"pred": "her wolf moved one complete electricity and Alexander moved two.", "target": "her wolf moved one complete electricity and Alexander moved two."}, {"pred": "Mark married one dance and Sarah married two filled.", "target": "Mark married one filled dance and Sarah married two."}, {"pred": "Mark managed one image and Sarah managed several electronic.", "target": "Mark managed one electronic image and Sarah managed several."}, {"pred": "Sarah carried one purple leg and Alexander carried more.", "target": "Sarah carried one purple leg and Alexander carried more."}, {"pred": "that doctor carried one last dog and Alexander carried a lot more.", "target": "that doctor carried one last dog and Alexander carried a lot more."}, {"pred": "her dinosaur broke one soft tail and Mark broke two.", "target": "her dinosaur broke one soft tail and Mark broke two."}, {"pred": "a slave started one silly girl and Alexander started two.", "target": "a slave started one silly girl and Alexander started two."}, {"pred": "this pig broke one personal college and Sarah broke several.", "target": "this pig broke one personal college and Sarah broke several."}, {"pred": "the boat managed one college and Mark managed two english.", "target": "the boat managed one english college and Mark managed two."}, {"pred": "that pig entered one positive parent and Sarah entered more.", "target": "that pig entered one positive parent and Sarah entered more."}, {"pred": "Roger managed one discussion and Roger managed two fixed.", "target": "Roger managed one fixed discussion and Roger managed two."}, {"pred": "this sister visited one last god and Sarah visited more.", "target": "this sister visited one last god and Sarah visited more."}, {"pred": "Sarah started one duck and Alexander started two ordered.", "target": "Sarah started one ordered duck and Alexander started two."}, {"pred": "the wolf entered one poor fire and Mark entered more.", "target": "the wolf entered one poor fire and Mark entered more."}, {"pred": "your wolf entered one circle and Sarah entered more positive.", "target": "your wolf entered one positive circle and Sarah entered more."}, {"pred": "this pig got one essay and Sarah got more kind.", "target": "this pig got one kind essay and Sarah got more."}, {"pred": "the slave managed one duck and Roger managed three summer.", "target": "the slave managed one summer duck and Roger managed three."}, {"pred": "his slave got one essay and Roger got two summer.", "target": "his slave got one summer essay and Roger got two."}, {"pred": "the slave fixed one worn canal and Roger fixed more.", "target": "the slave fixed one worn canal and Roger fixed more."}, {"pred": "her dinosaur got one pain and Alexander got more carbon.", "target": "her dinosaur got one carbon pain and Alexander got more."}, {"pred": "a slave started one heaven and Sarah started more ready.", "target": "a slave started one ready heaven and Sarah started more."}, {"pred": "some sister married one recommended sign and Alexander married a lot more.", "target": "some sister married one recommended sign and Alexander married a lot more."}, {"pred": "your wolf moved one pain and Mark moved two fixed.", "target": "your wolf moved one fixed pain and Mark moved two."}, {"pred": "some doctor fixed one abandoned electricity and Sarah fixed a lot more.", "target": "some doctor fixed one abandoned electricity and Sarah fixed a lot more."}, {"pred": "Roger broke one polar issue and Alexander broke a lot more.", "target": "Roger broke one polar issue and Alexander broke a lot more."}, {"pred": "her pig managed one floor and Mark managed three silly.", "target": "her pig managed one silly floor and Mark managed three."}, {"pred": "Alexander started one soft ear and Mark started a lot more.", "target": "Alexander started one soft ear and Mark started a lot more."}, {"pred": "that wolf married one filled change and Mark married two.", "target": "that wolf married one filled change and Mark married two."}, {"pred": "this wolf managed one discussion and Sarah managed several ordered.", "target": "this wolf managed one ordered discussion and Sarah managed several."}, {"pred": "your pig got one equipment and Roger got two worn.", "target": "your pig got one worn equipment and Roger got two."}, {"pred": "this slave married one tall ride and Alexander married more.", "target": "this slave married one tall ride and Alexander married more."}, {"pred": "his duke managed one track and Mark managed several english.", "target": "his duke managed one english track and Mark managed several."}, {"pred": "your doctor visited one evening and Mark visited two tall.", "target": "your doctor visited one tall evening and Mark visited two."}, {"pred": "Roger visited one ear and Alexander visited three fixed.", "target": "Roger visited one fixed ear and Alexander visited three."}, {"pred": "Roger managed one whale and Sarah managed two fixed.", "target": "Roger managed one fixed whale and Sarah managed two."}, {"pred": "Sarah managed one bath and Alexander managed more purple.", "target": "Sarah managed one purple bath and Alexander managed more."}, {"pred": "that dinosaur got one bible and Alexander got more ordered.", "target": "that dinosaur got one ordered bible and Alexander got more."}, {"pred": "Alexander got one tall discussion and Sarah got several.", "target": "Alexander got one tall discussion and Sarah got several."}, {"pred": "Roger started one chicken and Mark started two close.", "target": "Roger started one close chicken and Mark started two."}, {"pred": "the doctor got one dog and Sarah got several red.", "target": "the doctor got one red dog and Sarah got several."}, {"pred": "Roger got one poor circle and Roger got two.", "target": "Roger got one poor circle and Roger got two."}, {"pred": "the pig married one flat hole and Sarah married more.", "target": "the pig married one flat hole and Sarah married more."}, {"pred": "your wolf managed one good sign and Alexander managed more.", "target": "your wolf managed one good sign and Alexander managed more."}, {"pred": "some wolf visited one hard spin and Sarah visited more.", "target": "some wolf visited one hard spin and Sarah visited more."}, {"pred": "Sarah moved one pain and Mark moved two fixed.", "target": "Sarah moved one fixed pain and Mark moved two."}, {"pred": "Sarah broke one essay and Sarah broke three ready.", "target": "Sarah broke one ready essay and Sarah broke three."}, {"pred": "this dinosaur fixed one bad morning and Mark fixed several.", "target": "this dinosaur fixed one bad morning and Mark fixed several."}, {"pred": "Alexander married one evening and Mark married several next.", "target": "Alexander married one next evening and Mark married several."}, {"pred": "some pig married one poor essay and Mark married several.", "target": "some pig married one poor essay and Mark married several."}, {"pred": "Mark managed one silly clothing and Mark managed two.", "target": "Mark managed one silly clothing and Mark managed two."}, {"pred": "that slave started one simple heaven and Roger started a lot more.", "target": "that slave started one simple heaven and Roger started a lot more."}, {"pred": "Mark married one bus and Sarah married more healthy.", "target": "Mark married one healthy bus and Sarah married more."}, {"pred": "your slave entered one pool and Alexander entered more positive.", "target": "your slave entered one positive pool and Alexander entered more."}, {"pred": "his dinosaur carried one sacred spin and Alexander carried a lot more.", "target": "his dinosaur carried one sacred spin and Alexander carried a lot more."}, {"pred": "Mark fixed one good gate and Mark fixed two.", "target": "Mark fixed one good gate and Mark fixed two."}, {"pred": "her dinosaur got one pain and Mark got two red.", "target": "her dinosaur got one red pain and Mark got two."}, {"pred": "a sister managed one white bible and Sarah managed two.", "target": "a sister managed one white bible and Sarah managed two."}, {"pred": "this wolf got one dog and Alexander got three english.", "target": "this wolf got one english dog and Alexander got three."}, {"pred": "his wolf managed one silly clothing and Mark managed two.", "target": "his wolf managed one silly clothing and Mark managed two."}, {"pred": "a wolf managed one protection and Roger managed two winning.", "target": "a wolf managed one winning protection and Roger managed two."}, {"pred": "his slave got one parent and Sarah got two winning.", "target": "his slave got one winning parent and Sarah got two."}, {"pred": "Alexander carried one essay and Mark carried two rolling.", "target": "Alexander carried one rolling essay and Mark carried two."}, {"pred": "his pig fixed one distance and Mark fixed three expected.", "target": "his pig fixed one expected distance and Mark fixed three."}, {"pred": "your pig started one electricity and Roger started a lot more english.", "target": "your pig started one english electricity and Roger started a lot more."}, {"pred": "Roger married one chicken and Mark married more healthy.", "target": "Roger married one healthy chicken and Mark married more."}, {"pred": "your pig visited one dance and Mark visited several filled.", "target": "your pig visited one filled dance and Mark visited several."}, {"pred": "her dinosaur managed one clothing and Sarah managed a lot more worn.", "target": "her dinosaur managed one worn clothing and Sarah managed a lot more."}, {"pred": "a sister married one hard discussion and Roger married a lot more.", "target": "a sister married one hard discussion and Roger married a lot more."}, {"pred": "his boat started one evening and Mark started a lot more hard.", "target": "his boat started one hard evening and Mark started a lot more."}, {"pred": "Alexander entered one bad morning and Sarah entered a lot more.", "target": "Alexander entered one bad morning and Sarah entered a lot more."}, {"pred": "Roger managed one clothing and Sarah managed a lot more worn.", "target": "Roger managed one worn clothing and Sarah managed a lot more."}, {"pred": "some sister fixed one filled protection and Mark fixed several.", "target": "some sister fixed one filled protection and Mark fixed several."}, {"pred": "some slave entered one complete ear and Sarah entered several.", "target": "some slave entered one complete ear and Sarah entered several."}, {"pred": "some boat carried one polar image and Roger carried several.", "target": "some boat carried one polar image and Roger carried several."}, {"pred": "this duke fixed one good sweetie and Sarah fixed a lot more.", "target": "this duke fixed one good sweetie and Sarah fixed a lot more."}, {"pred": "her slave carried one tail and Mark carried two worn.", "target": "her slave carried one worn tail and Mark carried two."}, {"pred": "her duke entered one poor circle and Mark entered three.", "target": "her duke entered one poor circle and Mark entered three."}, {"pred": "Sarah entered one girl and Roger entered a lot more silly.", "target": "Sarah entered one silly girl and Roger entered a lot more."}, {"pred": "his duke visited one ear and Mark visited two needed.", "target": "his duke visited one needed ear and Mark visited two."}, {"pred": "his slave visited one track and Sarah visited two early.", "target": "his slave visited one early track and Sarah visited two."}, {"pred": "some sister managed one ready floor and Roger managed more.", "target": "some sister managed one ready floor and Roger managed more."}, {"pred": "Mark started one soft chicken and Alexander started more.", "target": "Mark started one soft chicken and Alexander started more."}, {"pred": "the dinosaur carried one sign and Mark carried several top.", "target": "the dinosaur carried one top sign and Mark carried several."}, {"pred": "Mark managed one next bible and Roger managed three.", "target": "Mark managed one next bible and Roger managed three."}, {"pred": "Roger moved one electronic telephone and Mark moved more.", "target": "Roger moved one electronic telephone and Mark moved more."}, {"pred": "his boat married one pool and Roger married three positive.", "target": "his boat married one positive pool and Roger married three."}, {"pred": "his sister fixed one god and Roger fixed several close.", "target": "his sister fixed one close god and Roger fixed several."}, {"pred": "his duke managed one soft bet and Mark managed three.", "target": "his duke managed one soft bet and Mark managed three."}, {"pred": "Mark started one change and Alexander started more winning.", "target": "Mark started one winning change and Alexander started more."}, {"pred": "some pig got one wrong duck and Sarah got three.", "target": "some pig got one wrong duck and Sarah got three."}, {"pred": "his boat started one bath and Alexander started more english.", "target": "his boat started one english bath and Alexander started more."}, {"pred": "your boat managed one little gate and Alexander managed a lot more.", "target": "your boat managed one little gate and Alexander managed a lot more."}, {"pred": "the pig got one bad track and Sarah got several.", "target": "the pig got one bad track and Sarah got several."}, {"pred": "your slave carried one ride and Alexander carried several ready.", "target": "your slave carried one ready ride and Alexander carried several."}, {"pred": "this dinosaur fixed one solid track and Mark fixed a lot more.", "target": "this dinosaur fixed one solid track and Mark fixed a lot more."}, {"pred": "that doctor married one positive speak and Mark married three.", "target": "that doctor married one positive speak and Mark married three."}, {"pred": "her wolf fixed one hard clothing and Sarah fixed more.", "target": "her wolf fixed one hard clothing and Sarah fixed more."}, {"pred": "her boat married one chicken and Mark married more healthy.", "target": "her boat married one healthy chicken and Mark married more."}, {"pred": "her duke moved one poor circle and Alexander moved a lot more.", "target": "her duke moved one poor circle and Alexander moved a lot more."}, {"pred": "her doctor visited one change and Sarah visited several healthy.", "target": "her doctor visited one healthy change and Sarah visited several."}, {"pred": "this wolf fixed one protection and Alexander fixed more english.", "target": "this wolf fixed one english protection and Alexander fixed more."}, {"pred": "the duke started one speak and Mark started more full.", "target": "the duke started one full speak and Mark started more."}, {"pred": "some wolf carried one dog and Mark carried a lot more abandoned.", "target": "some wolf carried one abandoned dog and Mark carried a lot more."}, {"pred": "your pig entered one silly mail and Mark entered several.", "target": "your pig entered one silly mail and Mark entered several."}, {"pred": "Mark started one change and Roger started a lot more electronic.", "target": "Mark started one electronic change and Roger started a lot more."}, {"pred": "a boat managed one positive electricity and Sarah managed two.", "target": "a boat managed one positive electricity and Sarah managed two."}, {"pred": "her pig visited one silly fire and Alexander visited three.", "target": "her pig visited one silly fire and Alexander visited three."}, {"pred": "Sarah married one healthy clothing and Roger married more.", "target": "Sarah married one healthy clothing and Roger married more."}, {"pred": "his sister started one bet and Sarah started three polar.", "target": "his sister started one polar bet and Sarah started three."}, {"pred": "Alexander married one gate and Mark married a lot more forced.", "target": "Alexander married one forced gate and Mark married a lot more."}, {"pred": "Roger carried one sacred spin and Alexander carried a lot more.", "target": "Roger carried one sacred spin and Alexander carried a lot more."}, {"pred": "Roger carried one sign and Mark carried several top.", "target": "Roger carried one top sign and Mark carried several."}, {"pred": "Roger moved one tall speak and Roger moved three.", "target": "Roger moved one tall speak and Roger moved three."}, {"pred": "a duke broke one polar issue and Alexander broke a lot more.", "target": "a duke broke one polar issue and Alexander broke a lot more."}, {"pred": "Mark moved one worn heaven and Alexander moved several.", "target": "Mark moved one worn heaven and Alexander moved several."}, {"pred": "the dinosaur managed one fixed floor and Sarah managed a lot more.", "target": "the dinosaur managed one fixed floor and Sarah managed a lot more."}, {"pred": "a wolf started one equipment and Mark started more recommended.", "target": "a wolf started one recommended equipment and Mark started more."}, {"pred": "his slave entered one image and Alexander entered two worn.", "target": "his slave entered one worn image and Alexander entered two."}, {"pred": "your dinosaur carried one essay and Alexander carried three needed.", "target": "your dinosaur carried one needed essay and Alexander carried three."}, {"pred": "that wolf moved one telephone and Mark moved three tall.", "target": "that wolf moved one tall telephone and Mark moved three."}, {"pred": "his doctor got one dance and Sarah got more extra.", "target": "his doctor got one extra dance and Sarah got more."}, {"pred": "Alexander moved one heaven and Sarah moved a lot more silly.", "target": "Alexander moved one silly heaven and Sarah moved a lot more."}, {"pred": "Mark married one bath and Roger married three full.", "target": "Mark married one full bath and Roger married three."}, {"pred": "this pig moved one heaven and Sarah moved a lot more silly.", "target": "this pig moved one silly heaven and Sarah moved a lot more."}, {"pred": "the doctor carried one distance and Mark carried a lot more top.", "target": "the doctor carried one top distance and Mark carried a lot more."}, {"pred": "a boat married one evening and Mark married several next.", "target": "a boat married one next evening and Mark married several."}, {"pred": "this pig managed one canal and Alexander managed more forced.", "target": "this pig managed one forced canal and Alexander managed more."}, {"pred": "Roger married one parent and Mark married several ready.", "target": "Roger married one ready parent and Mark married several."}, {"pred": "your slave got one carbon medicine and Mark got several.", "target": "your slave got one carbon medicine and Mark got several."}, {"pred": "a duke fixed one carbon essay and Sarah fixed a lot more.", "target": "a duke fixed one carbon essay and Sarah fixed a lot more."}, {"pred": "some pig carried one duck and Roger carried a lot more kind.", "target": "some pig carried one kind duck and Roger carried a lot more."}, {"pred": "your wolf got one last leg and Roger got several.", "target": "your wolf got one last leg and Roger got several."}, {"pred": "that wolf married one ride and Alexander married several expected.", "target": "that wolf married one expected ride and Alexander married several."}, {"pred": "some slave entered one clothing and Mark entered several kind.", "target": "some slave entered one kind clothing and Mark entered several."}, {"pred": "her dinosaur visited one electronic whale and Sarah visited two.", "target": "her dinosaur visited one electronic whale and Sarah visited two."}, {"pred": "his sister started one quick parent and Mark started several.", "target": "his sister started one quick parent and Mark started several."}, {"pred": "some doctor moved one forced discussion and Alexander moved a lot more.", "target": "some doctor moved one forced discussion and Alexander moved a lot more."}, {"pred": "Mark visited one discussion and Sarah visited more kind.", "target": "Mark visited one kind discussion and Sarah visited more."}, {"pred": "Mark managed one yellow leg and Alexander managed a lot more.", "target": "Mark managed one yellow leg and Alexander managed a lot more."}, {"pred": "a wolf visited one nice parent and Alexander visited three.", "target": "a wolf visited one nice parent and Alexander visited three."}, {"pred": "the boat started one electronic distance and Sarah started more.", "target": "the boat started one electronic distance and Sarah started more."}, {"pred": "Alexander managed one morning and Alexander managed three early.", "target": "Alexander managed one early morning and Alexander managed three."}, {"pred": "Mark got one pain and Mark got two red.", "target": "Mark got one red pain and Mark got two."}, {"pred": "Sarah visited one track and Sarah visited two early.", "target": "Sarah visited one early track and Sarah visited two."}, {"pred": "your dinosaur moved one purple leg and Roger moved a lot more.", "target": "your dinosaur moved one purple leg and Roger moved a lot more."}, {"pred": "Mark married one speak and Mark married three positive.", "target": "Mark married one positive speak and Mark married three."}, {"pred": "some doctor started one speak and Mark started more top.", "target": "some doctor started one top speak and Mark started more."}, {"pred": "your dinosaur entered one floor and Alexander entered three personal.", "target": "your dinosaur entered one personal floor and Alexander entered three."}, {"pred": "some dinosaur started one morning and Alexander started more solid.", "target": "some dinosaur started one solid morning and Alexander started more."}, {"pred": "that doctor married one morning and Roger married more recommended.", "target": "that doctor married one recommended morning and Roger married more."}, {"pred": "this sister married one ride and Mark married more healthy.", "target": "this sister married one healthy ride and Mark married more."}, {"pred": "some sister fixed one silly sign and Alexander fixed a lot more.", "target": "some sister fixed one silly sign and Alexander fixed a lot more."}, {"pred": "that slave carried one worn mail and Alexander carried three.", "target": "that slave carried one worn mail and Alexander carried three."}, {"pred": "Alexander fixed one silly sign and Alexander fixed a lot more.", "target": "Alexander fixed one silly sign and Alexander fixed a lot more."}, {"pred": "this slave entered one drawing and Alexander entered two rolling.", "target": "this slave entered one rolling drawing and Alexander entered two."}, {"pred": "some boat fixed one telephone and Mark fixed several carbon.", "target": "some boat fixed one carbon telephone and Mark fixed several."}, {"pred": "her doctor moved one simple bath and Sarah moved more.", "target": "her doctor moved one simple bath and Sarah moved more."}, {"pred": "Roger managed one nice evening and Sarah managed several.", "target": "Roger managed one nice evening and Sarah managed several."}, {"pred": "that dinosaur started one duck and Alexander started two ordered.", "target": "that dinosaur started one ordered duck and Alexander started two."}, {"pred": "a wolf fixed one fire and Sarah fixed more top.", "target": "a wolf fixed one top fire and Sarah fixed more."}, {"pred": "your sister got one flat dog and Roger got several.", "target": "your sister got one flat dog and Roger got several."}, {"pred": "her wolf moved one full discussion and Roger moved more.", "target": "her wolf moved one full discussion and Roger moved more."}, {"pred": "her wolf married one pattern and Mark married several summer.", "target": "her wolf married one summer pattern and Mark married several."}, {"pred": "some dinosaur carried one red mail and Alexander carried two.", "target": "some dinosaur carried one red mail and Alexander carried two."}, {"pred": "Mark visited one poor god and Mark visited more.", "target": "Mark visited one poor god and Mark visited more."}, {"pred": "your boat visited one electronic distance and Alexander visited two.", "target": "your boat visited one electronic distance and Alexander visited two."}, {"pred": "this slave broke one personal pattern and Sarah broke more.", "target": "this slave broke one personal pattern and Sarah broke more."}, {"pred": "Alexander got one bad track and Sarah got several.", "target": "Alexander got one bad track and Sarah got several."}, {"pred": "your slave fixed one floor and Sarah fixed two top.", "target": "your slave fixed one top floor and Sarah fixed two."}, {"pred": "the sister carried one next chicken and Roger carried more.", "target": "the sister carried one next chicken and Roger carried more."}, {"pred": "Alexander married one morning and Roger married more recommended.", "target": "Alexander married one recommended morning and Roger married more."}, {"pred": "your slave managed one good sweetie and Sarah managed more.", "target": "your slave managed one good sweetie and Sarah managed more."}, {"pred": "Alexander started one electronic distance and Sarah started more.", "target": "Alexander started one electronic distance and Sarah started more."}, {"pred": "her dinosaur broke one sign and Mark broke a lot more needed.", "target": "her dinosaur broke one needed sign and Mark broke a lot more."}, {"pred": "Mark moved one sweetie and Sarah moved several kind.", "target": "Mark moved one kind sweetie and Sarah moved several."}, {"pred": "his boat carried one tail and Alexander carried two flat.", "target": "his boat carried one flat tail and Alexander carried two."}, {"pred": "Roger carried one distance and Mark carried a lot more top.", "target": "Roger carried one top distance and Mark carried a lot more."}, {"pred": "a wolf broke one finished college and Roger broke three.", "target": "a wolf broke one finished college and Roger broke three."}, {"pred": "Roger got one healthy pool and Roger got several.", "target": "Roger got one healthy pool and Roger got several."}, {"pred": "your wolf married one forced gate and Mark married a lot more.", "target": "your wolf married one forced gate and Mark married a lot more."}, {"pred": "Alexander entered one electronic dog and Alexander entered two.", "target": "Alexander entered one electronic dog and Alexander entered two."}, {"pred": "a boat entered one bad morning and Sarah entered a lot more.", "target": "a boat entered one bad morning and Sarah entered a lot more."}, {"pred": "your wolf managed one gate and Roger managed more english.", "target": "your wolf managed one english gate and Roger managed more."}, {"pred": "your pig visited one hard sweetie and Mark visited several.", "target": "your pig visited one hard sweetie and Mark visited several."}, {"pred": "his dinosaur entered one girl and Sarah entered several worn.", "target": "his dinosaur entered one worn girl and Sarah entered several."}, {"pred": "a dinosaur started one change and Roger started a lot more electronic.", "target": "a dinosaur started one electronic change and Roger started a lot more."}, {"pred": "Sarah visited one electronic distance and Alexander visited two.", "target": "Sarah visited one electronic distance and Alexander visited two."}, {"pred": "that boat started one rolling pool and Mark started two.", "target": "that boat started one rolling pool and Mark started two."}, {"pred": "this slave broke one winning duck and Alexander broke two.", "target": "this slave broke one winning duck and Alexander broke two."}, {"pred": "Roger entered one floor and Alexander entered three personal.", "target": "Roger entered one personal floor and Alexander entered three."}, {"pred": "your dinosaur managed one heaven and Roger managed several english.", "target": "your dinosaur managed one english heaven and Roger managed several."}, {"pred": "a duke broke one equipment and Roger broke a lot more worn.", "target": "a duke broke one worn equipment and Roger broke a lot more."}, {"pred": "the slave entered one gate and Roger entered several early.", "target": "the slave entered one early gate and Roger entered several."}, {"pred": "his dinosaur married one nice duck and Roger married two.", "target": "his dinosaur married one nice duck and Roger married two."}, {"pred": "a doctor got one canal and Alexander got a lot more healthy.", "target": "a doctor got one healthy canal and Alexander got a lot more."}, {"pred": "some sister started one silly tail and Alexander started three.", "target": "some sister started one silly tail and Alexander started three."}, {"pred": "a slave entered one god and Sarah entered two top.", "target": "a slave entered one top god and Sarah entered two."}, {"pred": "Alexander managed one soft bet and Mark managed three.", "target": "Alexander managed one soft bet and Mark managed three."}, {"pred": "Sarah broke one gate and Sarah broke a lot more abandoned.", "target": "Sarah broke one abandoned gate and Sarah broke a lot more."}, {"pred": "Sarah carried one ride and Alexander carried several ready.", "target": "Sarah carried one ready ride and Alexander carried several."}, {"pred": "a slave broke one stand and Sarah broke more kind.", "target": "a slave broke one kind stand and Sarah broke more."}, {"pred": "a dinosaur moved one contemporary medicine and Sarah moved two.", "target": "a dinosaur moved one contemporary medicine and Sarah moved two."}, {"pred": "this slave entered one track and Alexander entered three forced.", "target": "this slave entered one forced track and Alexander entered three."}, {"pred": "Alexander started one rolling pool and Mark started two.", "target": "Alexander started one rolling pool and Mark started two."}, {"pred": "a duke carried one hard fire and Sarah carried three.", "target": "a duke carried one hard fire and Sarah carried three."}, {"pred": "your wolf got one last heaven and Mark got more.", "target": "your wolf got one last heaven and Mark got more."}, {"pred": "Mark entered one poor circle and Mark entered three.", "target": "Mark entered one poor circle and Mark entered three."}, {"pred": "her sister started one heaven and Alexander started more abandoned.", "target": "her sister started one abandoned heaven and Alexander started more."}, {"pred": "Roger managed one spin and Alexander managed three english.", "target": "Roger managed one english spin and Alexander managed three."}, {"pred": "that boat carried one solid distance and Mark carried several.", "target": "that boat carried one solid distance and Mark carried several."}, {"pred": "the wolf carried one personal evening and Roger carried several.", "target": "the wolf carried one personal evening and Roger carried several."}, {"pred": "Sarah started one discussion and Mark started more quick.", "target": "Sarah started one quick discussion and Mark started more."}, {"pred": "Roger started one healthy college and Roger started a lot more.", "target": "Roger started one healthy college and Roger started a lot more."}, {"pred": "Roger married one poor car and Alexander married more.", "target": "Roger married one poor car and Alexander married more."}, {"pred": "some wolf got one soft dog and Sarah got several.", "target": "some wolf got one soft dog and Sarah got several."}, {"pred": "Roger started one poor hole and Mark started more.", "target": "Roger started one poor hole and Mark started more."}, {"pred": "your dinosaur visited one complete spin and Mark visited several.", "target": "your dinosaur visited one complete spin and Mark visited several."}, {"pred": "her doctor moved one evening and Roger moved more yellow.", "target": "her doctor moved one yellow evening and Roger moved more."}, {"pred": "Alexander married one nice duck and Roger married two.", "target": "Alexander married one nice duck and Roger married two."}, {"pred": "this slave carried one red distance and Roger carried three.", "target": "this slave carried one red distance and Roger carried three."}, {"pred": "the sister moved one contemporary bath and Roger moved a lot more.", "target": "the sister moved one contemporary bath and Roger moved a lot more."}, {"pred": "her doctor fixed one bad whale and Sarah fixed three.", "target": "her doctor fixed one bad whale and Sarah fixed three."}, {"pred": "your wolf managed one yellow leg and Alexander managed a lot more.", "target": "your wolf managed one yellow leg and Alexander managed a lot more."}, {"pred": "that dinosaur managed one duck and Alexander managed several full.", "target": "that dinosaur managed one full duck and Alexander managed several."}, {"pred": "that pig carried one distance and Alexander carried three ready.", "target": "that pig carried one ready distance and Alexander carried three."}, {"pred": "her dinosaur broke one healthy telephone and Sarah broke two.", "target": "her dinosaur broke one healthy telephone and Sarah broke two."}, {"pred": "that boat got one distance and Sarah got more tall.", "target": "that boat got one tall distance and Sarah got more."}, {"pred": "Roger married one change and Mark married two filled.", "target": "Roger married one filled change and Mark married two."}, {"pred": "that dinosaur broke one little tail and Roger broke a lot more.", "target": "that dinosaur broke one little tail and Roger broke a lot more."}, {"pred": "a wolf broke one flat dog and Alexander broke three.", "target": "a wolf broke one flat dog and Alexander broke three."}, {"pred": "this boat married one pain and Mark married more early.", "target": "this boat married one early pain and Mark married more."}, {"pred": "his duke moved one last protection and Mark moved two.", "target": "his duke moved one last protection and Mark moved two."}, {"pred": "Alexander broke one bus and Roger broke two kind.", "target": "Alexander broke one kind bus and Roger broke two."}, {"pred": "his doctor married one drawing and Roger married three yellow.", "target": "his doctor married one yellow drawing and Roger married three."}, {"pred": "this sister carried one yellow girl and Sarah carried several.", "target": "this sister carried one yellow girl and Sarah carried several."}, {"pred": "Mark managed one duck and Sarah managed a lot more carbon.", "target": "Mark managed one carbon duck and Sarah managed a lot more."}, {"pred": "that doctor got one god and Sarah got several red.", "target": "that doctor got one red god and Sarah got several."}, {"pred": "Roger carried one flat tail and Alexander carried two.", "target": "Roger carried one flat tail and Alexander carried two."}, {"pred": "his pig visited one yellow bath and Alexander visited more.", "target": "his pig visited one yellow bath and Alexander visited more."}, {"pred": "the slave broke one purple ear and Roger broke a lot more.", "target": "the slave broke one purple ear and Roger broke a lot more."}, {"pred": "a pig broke one gate and Sarah broke a lot more abandoned.", "target": "a pig broke one abandoned gate and Sarah broke a lot more."}, {"pred": "the sister managed one nice evening and Sarah managed several.", "target": "the sister managed one nice evening and Sarah managed several."}, {"pred": "the slave married one little pain and Mark married a lot more.", "target": "the slave married one little pain and Mark married a lot more."}, {"pred": "Roger visited one yellow bath and Alexander visited more.", "target": "Roger visited one yellow bath and Alexander visited more."}, {"pred": "this doctor entered one last college and Sarah entered a lot more.", "target": "this doctor entered one last college and Sarah entered a lot more."}, {"pred": "the wolf moved one last change and Roger moved two.", "target": "the wolf moved one last change and Roger moved two."}, {"pred": "her dinosaur moved one tail and Sarah moved three abandoned.", "target": "her dinosaur moved one abandoned tail and Sarah moved three."}, {"pred": "Sarah carried one red distance and Roger carried three.", "target": "Sarah carried one red distance and Roger carried three."}, {"pred": "his slave got one dog and Mark got two abandoned.", "target": "his slave got one abandoned dog and Mark got two."}, {"pred": "your boat broke one bible and Roger broke several next.", "target": "your boat broke one next bible and Roger broke several."}, {"pred": "a sister visited one little whale and Roger visited three.", "target": "a sister visited one little whale and Roger visited three."}, {"pred": "Mark fixed one pattern and Roger fixed three polar.", "target": "Mark fixed one polar pattern and Roger fixed three."}, {"pred": "his pig started one chicken and Mark started two close.", "target": "his pig started one close chicken and Mark started two."}, {"pred": "his boat moved one hard college and Roger moved more.", "target": "his boat moved one hard college and Roger moved more."}, {"pred": "the dinosaur broke one positive pool and Roger broke several.", "target": "the dinosaur broke one positive pool and Roger broke several."}, {"pred": "that sister started one essay and Sarah started three top.", "target": "that sister started one top essay and Sarah started three."}, {"pred": "this doctor entered one white pattern and Alexander entered a lot more.", "target": "this doctor entered one white pattern and Alexander entered a lot more."}, {"pred": "some dinosaur visited one pain and Sarah visited three red.", "target": "some dinosaur visited one red pain and Sarah visited three."}, {"pred": "Roger married one pattern and Mark married several summer.", "target": "Roger married one summer pattern and Mark married several."}, {"pred": "that slave fixed one nice essay and Alexander fixed two.", "target": "that slave fixed one nice essay and Alexander fixed two."}, {"pred": "his wolf fixed one flat clothing and Mark fixed a lot more.", "target": "his wolf fixed one flat clothing and Mark fixed a lot more."}, {"pred": "Sarah entered one little mail and Roger entered two.", "target": "Sarah entered one little mail and Roger entered two."}, {"pred": "the pig visited one purple mail and Alexander visited several.", "target": "the pig visited one purple mail and Alexander visited several."}, {"pred": "this boat broke one bad ride and Mark broke more.", "target": "this boat broke one bad ride and Mark broke more."}, {"pred": "that slave got one bath and Roger got three purple.", "target": "that slave got one purple bath and Roger got three."}, {"pred": "a pig started one healthy college and Roger started a lot more.", "target": "a pig started one healthy college and Roger started a lot more."}, {"pred": "this wolf started one soft chicken and Alexander started more.", "target": "this wolf started one soft chicken and Alexander started more."}, {"pred": "her sister carried one medicine and Roger carried several finished.", "target": "her sister carried one finished medicine and Roger carried several."}, {"pred": "that dinosaur started one soft telephone and Mark started two.", "target": "that dinosaur started one soft telephone and Mark started two."}, {"pred": "this sister carried one purple mail and Roger carried several.", "target": "this sister carried one purple mail and Roger carried several."}, {"pred": "the boat got one sweetie and Sarah got two good.", "target": "the boat got one good sweetie and Sarah got two."}, {"pred": "her doctor married one rolling telephone and Roger married a lot more.", "target": "her doctor married one rolling telephone and Roger married a lot more."}, {"pred": "Mark married one gate and Roger married a lot more electronic.", "target": "Mark married one electronic gate and Roger married a lot more."}, {"pred": "a sister fixed one full dance and Roger fixed more.", "target": "a sister fixed one full dance and Roger fixed more."}, {"pred": "your dinosaur managed one whale and Sarah managed two fixed.", "target": "your dinosaur managed one fixed whale and Sarah managed two."}, {"pred": "your dinosaur married one hole and Alexander married more expected.", "target": "your dinosaur married one expected hole and Alexander married more."}, {"pred": "Mark broke one circle and Roger broke more sacred.", "target": "Mark broke one sacred circle and Roger broke more."}, {"pred": "her boat got one next essay and Roger got a lot more.", "target": "her boat got one next essay and Roger got a lot more."}, {"pred": "Roger visited one last dance and Alexander visited three.", "target": "Roger visited one last dance and Alexander visited three."}, {"pred": "the doctor broke one extra stand and Roger broke three.", "target": "the doctor broke one extra stand and Roger broke three."}, {"pred": "Roger entered one girl and Sarah entered several worn.", "target": "Roger entered one worn girl and Sarah entered several."}, {"pred": "a dinosaur broke one duck and Roger broke two filled.", "target": "a dinosaur broke one filled duck and Roger broke two."}, {"pred": "her pig carried one next hole and Roger carried more.", "target": "her pig carried one next hole and Roger carried more."}, {"pred": "Mark visited one silly fire and Alexander visited three.", "target": "Mark visited one silly fire and Alexander visited three."}, {"pred": "Roger fixed one abandoned electricity and Sarah fixed a lot more.", "target": "Roger fixed one abandoned electricity and Sarah fixed a lot more."}, {"pred": "a wolf started one poor hole and Mark started more.", "target": "a wolf started one poor hole and Mark started more."}, {"pred": "a duke visited one leg and Sarah visited three ordered.", "target": "a duke visited one ordered leg and Sarah visited three."}, {"pred": "some slave started one personal electricity and Sarah started several.", "target": "some slave started one personal electricity and Sarah started several."}, {"pred": "some boat managed one filled pain and Sarah managed several.", "target": "some boat managed one filled pain and Sarah managed several."}, {"pred": "the doctor started one dance and Mark started two nice.", "target": "the doctor started one nice dance and Mark started two."}, {"pred": "his slave broke one positive duck and Alexander broke several.", "target": "his slave broke one positive duck and Alexander broke several."}, {"pred": "Roger got one pain and Alexander got more carbon.", "target": "Roger got one carbon pain and Alexander got more."}, {"pred": "some duke carried one worn car and Sarah carried two.", "target": "some duke carried one worn car and Sarah carried two."}, {"pred": "this dinosaur married one duck and Roger married a lot more winning.", "target": "this dinosaur married one winning duck and Roger married a lot more."}, {"pred": "Mark married one poor track and Mark married several.", "target": "Mark married one poor track and Mark married several."}, {"pred": "a dinosaur broke one personal car and Sarah broke several.", "target": "a dinosaur broke one personal car and Sarah broke several."}, {"pred": "some boat entered one next mail and Alexander entered several.", "target": "some boat entered one next mail and Alexander entered several."}, {"pred": "Roger moved one telephone and Mark moved three tall.", "target": "Roger moved one tall telephone and Mark moved three."}, {"pred": "the doctor visited one bet and Alexander visited two ordered.", "target": "the doctor visited one ordered bet and Alexander visited two."}, {"pred": "some sister carried one recommended clothing and Sarah carried several.", "target": "some sister carried one recommended clothing and Sarah carried several."}, {"pred": "Mark carried one bad essay and Alexander carried several.", "target": "Mark carried one bad essay and Alexander carried several."}, {"pred": "some slave entered one extra spin and Mark entered a lot more.", "target": "some slave entered one extra spin and Mark entered a lot more."}, {"pred": "your dinosaur fixed one full pain and Roger fixed a lot more.", "target": "your dinosaur fixed one full pain and Roger fixed a lot more."}, {"pred": "your wolf entered one flat circle and Mark entered several.", "target": "your wolf entered one flat circle and Mark entered several."}, {"pred": "her wolf married one poor car and Alexander married more.", "target": "her wolf married one poor car and Alexander married more."}, {"pred": "Sarah entered one white pattern and Alexander entered a lot more.", "target": "Sarah entered one white pattern and Alexander entered a lot more."}, {"pred": "Alexander entered one wrong bath and Roger entered two.", "target": "Alexander entered one wrong bath and Roger entered two."}, {"pred": "that slave moved one personal fire and Sarah moved three.", "target": "that slave moved one personal fire and Sarah moved three."}, {"pred": "the wolf entered one little fire and Alexander entered two.", "target": "the wolf entered one little fire and Alexander entered two."}, {"pred": "your wolf visited one white ear and Alexander visited several.", "target": "your wolf visited one white ear and Alexander visited several."}, {"pred": "a pig moved one canal and Mark moved three extra.", "target": "a pig moved one extra canal and Mark moved three."}, {"pred": "her boat managed one silly sign and Sarah managed more.", "target": "her boat managed one silly sign and Sarah managed more."}, {"pred": "a dinosaur managed one next bible and Roger managed three.", "target": "a dinosaur managed one next bible and Roger managed three."}, {"pred": "this dinosaur entered one little mail and Roger entered two.", "target": "this dinosaur entered one little mail and Roger entered two."}, {"pred": "the pig fixed one nice protection and Mark fixed three.", "target": "the pig fixed one nice protection and Mark fixed three."}, {"pred": "your slave married one god and Mark married three electronic.", "target": "your slave married one electronic god and Mark married three."}, {"pred": "his duke started one evening and Sarah started a lot more poor.", "target": "his duke started one poor evening and Sarah started a lot more."}, {"pred": "Mark broke one positive duck and Alexander broke several.", "target": "Mark broke one positive duck and Alexander broke several."}, {"pred": "Roger broke one college and Sarah broke several early.", "target": "Roger broke one early college and Sarah broke several."}, {"pred": "Mark started one essay and Sarah started three top.", "target": "Mark started one top essay and Sarah started three."}, {"pred": "Mark moved one complete electricity and Alexander moved two.", "target": "Mark moved one complete electricity and Alexander moved two."}, {"pred": "this pig carried one tall bet and Roger carried several.", "target": "this pig carried one tall bet and Roger carried several."}, {"pred": "the wolf moved one white distance and Alexander moved more.", "target": "the wolf moved one white distance and Alexander moved more."}, {"pred": "his boat entered one silly girl and Roger entered a lot more.", "target": "his boat entered one silly girl and Roger entered a lot more."}, {"pred": "Alexander visited one tall sign and Roger visited several.", "target": "Alexander visited one tall sign and Roger visited several."}, {"pred": "his boat visited one duck and Sarah visited three top.", "target": "his boat visited one top duck and Sarah visited three."}, {"pred": "your duke fixed one good gate and Mark fixed two.", "target": "your duke fixed one good gate and Mark fixed two."}, {"pred": "her doctor managed one personal leg and Mark managed three.", "target": "her doctor managed one personal leg and Mark managed three."}, {"pred": "his wolf entered one simple gate and Alexander entered a lot more.", "target": "his wolf entered one simple gate and Alexander entered a lot more."}, {"pred": "your doctor entered one bus and Sarah entered three worn.", "target": "your doctor entered one worn bus and Sarah entered three."}, {"pred": "that slave married one parent and Mark married several ready.", "target": "that slave married one ready parent and Mark married several."}, {"pred": "Sarah moved one discussion and Alexander moved a lot more forced.", "target": "Sarah moved one forced discussion and Alexander moved a lot more."}, {"pred": "this boat managed one duck and Sarah managed a lot more carbon.", "target": "this boat managed one carbon duck and Sarah managed a lot more."}, {"pred": "this wolf started one healthy dance and Sarah started more.", "target": "this wolf started one healthy dance and Sarah started more."}, {"pred": "her dinosaur moved one speak and Roger moved three tall.", "target": "her dinosaur moved one tall speak and Roger moved three."}, {"pred": "some doctor married one floor and Alexander married three fixed.", "target": "some doctor married one fixed floor and Alexander married three."}, {"pred": "Mark got one little medicine and Mark got more.", "target": "Mark got one little medicine and Mark got more."}, {"pred": "Mark managed one floor and Sarah managed a lot more fixed.", "target": "Mark managed one fixed floor and Sarah managed a lot more."}, {"pred": "your slave fixed one yellow distance and Alexander fixed several.", "target": "your slave fixed one yellow distance and Alexander fixed several."}, {"pred": "this doctor managed one spin and Alexander managed three english.", "target": "this doctor managed one english spin and Alexander managed three."}, {"pred": "his duke visited one carbon electricity and Sarah visited more.", "target": "his duke visited one carbon electricity and Sarah visited more."}, {"pred": "his wolf visited one quick pain and Sarah visited more.", "target": "his wolf visited one quick pain and Sarah visited more."}, {"pred": "Mark married one pain and Mark married more early.", "target": "Mark married one early pain and Mark married more."}, {"pred": "your doctor managed one bath and Alexander managed more purple.", "target": "your doctor managed one purple bath and Alexander managed more."}, {"pred": "Alexander entered one gate and Roger entered several early.", "target": "Alexander entered one early gate and Roger entered several."}, {"pred": "his wolf managed one bet and Roger managed two english.", "target": "his wolf managed one english bet and Roger managed two."}, {"pred": "Alexander got one medicine and Mark got several carbon.", "target": "Alexander got one carbon medicine and Mark got several."}, {"pred": "his doctor fixed one tall whale and Sarah fixed two.", "target": "his doctor fixed one tall whale and Sarah fixed two."}, {"pred": "a boat managed one evening and Sarah managed more healthy.", "target": "a boat managed one healthy evening and Sarah managed more."}, {"pred": "the wolf entered one parent and Mark entered more top.", "target": "the wolf entered one top parent and Mark entered more."}, {"pred": "his doctor got one last drawing and Roger got more.", "target": "his doctor got one last drawing and Roger got more."}, {"pred": "the dinosaur broke one bus and Roger broke two kind.", "target": "the dinosaur broke one kind bus and Roger broke two."}, {"pred": "a wolf broke one last dance and Roger broke more.", "target": "a wolf broke one last dance and Roger broke more."}, {"pred": "her doctor fixed one leg and Mark fixed several flat.", "target": "her doctor fixed one flat leg and Mark fixed several."}, {"pred": "the dinosaur got one heaven and Roger got two winning.", "target": "the dinosaur got one winning heaven and Roger got two."}, {"pred": "Alexander entered one parent and Roger entered several polar.", "target": "Alexander entered one polar parent and Roger entered several."}, {"pred": "the slave married one bus and Sarah married more healthy.", "target": "the slave married one healthy bus and Sarah married more."}, {"pred": "some duke visited one last dance and Alexander visited three.", "target": "some duke visited one last dance and Alexander visited three."}, {"pred": "a wolf started one electricity and Mark started more abandoned.", "target": "a wolf started one abandoned electricity and Mark started more."}, {"pred": "Alexander fixed one morning and Mark fixed several bad.", "target": "Alexander fixed one bad morning and Mark fixed several."}, {"pred": "this wolf broke one little medicine and Sarah broke more.", "target": "this wolf broke one little medicine and Sarah broke more."}, {"pred": "your pig married one hard tail and Mark married a lot more.", "target": "your pig married one hard tail and Mark married a lot more."}, {"pred": "your duke got one carbon fire and Roger got several.", "target": "your duke got one carbon fire and Roger got several."}, {"pred": "her boat broke one essay and Sarah broke three ready.", "target": "her boat broke one ready essay and Sarah broke three."}, {"pred": "a slave fixed one good discussion and Mark fixed three.", "target": "a slave fixed one good discussion and Mark fixed three."}, {"pred": "his boat got one duck and Alexander got more abandoned.", "target": "his boat got one abandoned duck and Alexander got more."}, {"pred": "Mark got one electricity and Mark got a lot more worn.", "target": "Mark got one worn electricity and Mark got a lot more."}, {"pred": "her sister got one clothing and Mark got three worn.", "target": "her sister got one worn clothing and Mark got three."}, {"pred": "Mark got one bible and Alexander got more ordered.", "target": "Mark got one ordered bible and Alexander got more."}, {"pred": "this pig got one discussion and Sarah got several tall.", "target": "this pig got one tall discussion and Sarah got several."}, {"pred": "this slave entered one college and Mark entered several polar.", "target": "this slave entered one polar college and Mark entered several."}, {"pred": "some wolf fixed one pattern and Roger fixed three polar.", "target": "some wolf fixed one polar pattern and Roger fixed three."}, {"pred": "Alexander visited one pain and Sarah visited three red.", "target": "Alexander visited one red pain and Sarah visited three."}, {"pred": "some dinosaur visited one tall sign and Roger visited several.", "target": "some dinosaur visited one tall sign and Roger visited several."}, {"pred": "her boat married one hole and Sarah married two full.", "target": "her boat married one full hole and Sarah married two."}, {"pred": "the dinosaur fixed one soft spin and Mark fixed more.", "target": "the dinosaur fixed one soft spin and Mark fixed more."}, {"pred": "a wolf started one simple dance and Alexander started three.", "target": "a wolf started one simple dance and Alexander started three."}, {"pred": "some sister got one little medicine and Mark got more.", "target": "some sister got one little medicine and Mark got more."}, {"pred": "his sister moved one hole and Mark moved two needed.", "target": "his sister moved one needed hole and Mark moved two."}, {"pred": "her pig started one change and Alexander started more winning.", "target": "her pig started one winning change and Alexander started more."}, {"pred": "his sister married one dog and Roger married several finished.", "target": "his sister married one finished dog and Roger married several."}, {"pred": "Sarah started one speak and Roger started a lot more personal.", "target": "Sarah started one personal speak and Roger started a lot more."}, {"pred": "Alexander married one flat hole and Sarah married more.", "target": "Alexander married one flat hole and Sarah married more."}, {"pred": "some boat married one issue and Mark married several finished.", "target": "some boat married one finished issue and Mark married several."}, {"pred": "your dinosaur moved one hard parent and Alexander moved more.", "target": "your dinosaur moved one hard parent and Alexander moved more."}, {"pred": "his boat broke one canal and Mark broke three expected.", "target": "his boat broke one expected canal and Mark broke three."}, {"pred": "some slave married one track and Roger married several early.", "target": "some slave married one early track and Roger married several."}, {"pred": "this slave visited one carbon fire and Roger visited three.", "target": "this slave visited one carbon fire and Roger visited three."}, {"pred": "Sarah broke one quick parent and Mark broke several.", "target": "Sarah broke one quick parent and Mark broke several."}, {"pred": "her sister started one white floor and Roger started more.", "target": "her sister started one white floor and Roger started more."}, {"pred": "his wolf managed one discussion and Roger managed two fixed.", "target": "his wolf managed one fixed discussion and Roger managed two."}, {"pred": "Mark got one wrong duck and Sarah got three.", "target": "Mark got one wrong duck and Sarah got three."}, {"pred": "Alexander carried one distance and Alexander carried three ready.", "target": "Alexander carried one ready distance and Alexander carried three."}, {"pred": "your boat broke one evening and Mark broke two rolling.", "target": "your boat broke one rolling evening and Mark broke two."}, {"pred": "Roger carried one evening and Roger carried several personal.", "target": "Roger carried one personal evening and Roger carried several."}, {"pred": "the pig started one speak and Roger started a lot more personal.", "target": "the pig started one personal speak and Roger started a lot more."}, {"pred": "her doctor married one poor gate and Sarah married a lot more.", "target": "her doctor married one poor gate and Sarah married a lot more."}, {"pred": "some doctor started one little track and Roger started three.", "target": "some doctor started one little track and Roger started three."}, {"pred": "Alexander visited one carbon electricity and Sarah visited more.", "target": "Alexander visited one carbon electricity and Sarah visited more."}, {"pred": "some slave married one hole and Sarah married a lot more forced.", "target": "some slave married one forced hole and Sarah married a lot more."}, {"pred": "this boat visited one full ear and Mark visited more.", "target": "this boat visited one full ear and Mark visited more."}, {"pred": "a pig married one full speak and Roger married three.", "target": "a pig married one full speak and Roger married three."}, {"pred": "his pig managed one gate and Mark managed more close.", "target": "his pig managed one close gate and Mark managed more."}, {"pred": "Sarah got one canal and Alexander got a lot more healthy.", "target": "Sarah got one healthy canal and Alexander got a lot more."}, {"pred": "his sister married one stand and Roger married three hard.", "target": "his sister married one hard stand and Roger married three."}, {"pred": "some sister broke one girl and Sarah broke three ready.", "target": "some sister broke one ready girl and Sarah broke three."}, {"pred": "Sarah married one essay and Sarah married a lot more expected.", "target": "Sarah married one expected essay and Sarah married a lot more."}, {"pred": "her dinosaur entered one issue and Sarah entered two close.", "target": "her dinosaur entered one close issue and Sarah entered two."}, {"pred": "your pig broke one morning and Alexander broke three soft.", "target": "your pig broke one soft morning and Alexander broke three."}, {"pred": "Roger broke one positive pool and Roger broke several.", "target": "Roger broke one positive pool and Roger broke several."}, {"pred": "Alexander broke one healthy telephone and Sarah broke two.", "target": "Alexander broke one healthy telephone and Sarah broke two."}, {"pred": "your boat managed one image and Sarah managed several electronic.", "target": "your boat managed one electronic image and Sarah managed several."}, {"pred": "some duke carried one flat speak and Roger carried three.", "target": "some duke carried one flat speak and Roger carried three."}, {"pred": "that sister entered one wrong protection and Alexander entered two.", "target": "that sister entered one wrong protection and Alexander entered two."}, {"pred": "this slave got one poor circle and Roger got two.", "target": "this slave got one poor circle and Roger got two."}, {"pred": "your sister got one protection and Sarah got several polar.", "target": "your sister got one polar protection and Sarah got several."}, {"pred": "that duke broke one sacred circle and Roger broke more.", "target": "that duke broke one sacred circle and Roger broke more."}, {"pred": "Mark entered one polar distance and Roger entered several.", "target": "Mark entered one polar distance and Roger entered several."}, {"pred": "a pig got one purple hole and Sarah got several.", "target": "a pig got one purple hole and Sarah got several."}, {"pred": "a boat married one extra clothing and Sarah married two.", "target": "a boat married one extra clothing and Sarah married two."}, {"pred": "a duke entered one wrong bath and Roger entered two.", "target": "a duke entered one wrong bath and Roger entered two."}, {"pred": "Mark married one hole and Sarah married two full.", "target": "Mark married one full hole and Sarah married two."}, {"pred": "the doctor entered one rolling pain and Roger entered three.", "target": "the doctor entered one rolling pain and Roger entered three."}, {"pred": "a slave moved one ear and Alexander moved a lot more healthy.", "target": "a slave moved one healthy ear and Alexander moved a lot more."}, {"pred": "some dinosaur married one morning and Roger married three white.", "target": "some dinosaur married one white morning and Roger married three."}, {"pred": "a doctor married one bible and Roger married a lot more early.", "target": "a doctor married one early bible and Roger married a lot more."}, {"pred": "the pig moved one dog and Mark moved several ordered.", "target": "the pig moved one ordered dog and Mark moved several."}, {"pred": "Alexander got one dog and Mark got two abandoned.", "target": "Alexander got one abandoned dog and Mark got two."}, {"pred": "his sister started one protection and Mark started two ready.", "target": "his sister started one ready protection and Mark started two."}, {"pred": "Roger carried one girl and Sarah carried several yellow.", "target": "Roger carried one yellow girl and Sarah carried several."}, {"pred": "the boat started one discussion and Mark started more quick.", "target": "the boat started one quick discussion and Mark started more."}, {"pred": "a dinosaur fixed one floor and Sarah fixed more early.", "target": "a dinosaur fixed one early floor and Sarah fixed more."}, {"pred": "her pig married one dance and Sarah married two filled.", "target": "her pig married one filled dance and Sarah married two."}, {"pred": "his wolf married one complete chicken and Mark married three.", "target": "his wolf married one complete chicken and Mark married three."}, {"pred": "Roger broke one white fire and Alexander broke two.", "target": "Roger broke one white fire and Alexander broke two."}, {"pred": "Mark moved one canal and Mark moved three extra.", "target": "Mark moved one extra canal and Mark moved three."}, {"pred": "his duke visited one ear and Alexander visited three fixed.", "target": "his duke visited one fixed ear and Alexander visited three."}, {"pred": "her pig started one little hole and Sarah started more.", "target": "her pig started one little hole and Sarah started more."}, {"pred": "Sarah fixed one flat clothing and Mark fixed a lot more.", "target": "Sarah fixed one flat clothing and Mark fixed a lot more."}, {"pred": "Mark married one stand and Roger married three hard.", "target": "Mark married one hard stand and Roger married three."}]}
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/filler_gap/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/irregular_forms/eval_results.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"eval_accuracy": 0.7577720207253886, "per_example_results": [{"pred": "Sarah spoke to me some time ago.", "target": "Sarah spoke to me some time ago."}, {"pred": "Sarah had drew a round circle over there.", "target": "Sarah had drawn a round circle over there."}, {"pred": "Sarah grown quickly this morning.", "target": "Sarah grew quickly this morning."}, {"pred": "Mark chose the good one some time ago.", "target": "Mark chose the good one some time ago."}, {"pred": "Sarah had written a story last night.", "target": "Sarah had written a story last night."}, {"pred": "Sarah knew she could do it over there.", "target": "Sarah knew she could do it over there."}, {"pred": "Alexander had become angry some time ago.", "target": "Alexander had become angry some time ago."}, {"pred": "Roger written into a book last night.", "target": "Roger wrote into a book last night."}, {"pred": "Sarah had given a book to a student last night.", "target": "Sarah had given a book to a student last night."}, {"pred": "Alexander had spoke without thinking this morning.", "target": "Alexander had spoken without thinking this morning."}, {"pred": "Roger had knew she could do it over there.", "target": "Roger had known she could do it over there."}, {"pred": "Alexander spoke about many things last night.", "target": "Alexander spoke about many things last night."}, {"pred": "Roger had given something sweet to the baby this morning.", "target": "Roger had given something sweet to the baby this morning."}, {"pred": "Sarah had come just in time this morning.", "target": "Sarah had come just in time this morning."}, {"pred": "Alexander had written with a large pen some time ago.", "target": "Alexander had written with a large pen some time ago."}, {"pred": "Mark had drew a picture some time ago.", "target": "Mark had drawn a picture some time ago."}, {"pred": "Alexander had become very different this morning.", "target": "Alexander had become very different this morning."}, {"pred": "Roger drew a picture last night.", "target": "Roger drew a picture last night."}, {"pred": "Alexander wrote a note at home.", "target": "Alexander wrote a note at home."}, {"pred": "Mark had taken some food some time ago.", "target": "Mark had taken some food some time ago."}, {"pred": "Mark had written into a book last night.", "target": "Mark had written into a book last night."}, {"pred": "Mark saw a bird this morning.", "target": "Mark saw a bird this morning."}, {"pred": "Alexander came too late some time ago.", "target": "Alexander came too late some time ago."}, {"pred": "Roger written into a book some time ago.", "target": "Roger wrote into a book some time ago."}, {"pred": "Alexander had spoke very fast last night.", "target": "Alexander had spoken very fast last night."}, {"pred": "Alexander had written a story at home.", "target": "Alexander had written a story at home."}, {"pred": "Roger had known a lot of things last night.", "target": "Roger had known a lot of things last night."}, {"pred": "Alexander spoke to me some time ago.", "target": "Alexander spoke to me some time ago."}, {"pred": "Roger knew she could do it some time ago.", "target": "Roger knew she could do it some time ago."}, {"pred": "Alexander saw a bird at home.", "target": "Alexander saw a bird at home."}, {"pred": "Sarah had taken a paper over there.", "target": "Sarah had taken a paper over there."}, {"pred": "Alexander took some food some time ago.", "target": "Alexander took some food some time ago."}, {"pred": "Roger drew a round circle some time ago.", "target": "Roger drew a round circle some time ago."}, {"pred": "Mark had drew a round circle this morning.", "target": "Mark had drawn a round circle this morning."}, {"pred": "Sarah had given something sweet to the baby some time ago.", "target": "Sarah had given something sweet to the baby some time ago."}, {"pred": "Sarah became very different last night.", "target": "Sarah became very different last night."}, {"pred": "Sarah had chose the good one this morning.", "target": "Sarah had chosen the good one this morning."}, {"pred": "Mark had taken a paper at home.", "target": "Mark had taken a paper at home."}, {"pred": "Mark had taken the bell some time ago.", "target": "Mark had taken the bell some time ago."}, {"pred": "Mark grown quickly over there.", "target": "Mark grew quickly over there."}, {"pred": "Alexander became very different this morning.", "target": "Alexander became very different this morning."}, {"pred": "Sarah took some food last night.", "target": "Sarah took some food last night."}, {"pred": "Mark had written with a large pen at home.", "target": "Mark had written with a large pen at home."}, {"pred": "Roger had drew a round circle last night.", "target": "Roger had drawn a round circle last night."}, {"pred": "Roger gave a book to a student last night.", "target": "Roger gave a book to a student last night."}, {"pred": "Mark come just in time this morning.", "target": "Mark came just in time this morning."}, {"pred": "Mark had seen a bird over there.", "target": "Mark had seen a bird over there."}, {"pred": "Roger chose the good one last night.", "target": "Roger chose the good one last night."}, {"pred": "Mark chose the best option some time ago.", "target": "Mark chose the best option some time ago."}, {"pred": "Sarah spoke without thinking at home.", "target": "Sarah spoke without thinking at home."}, {"pred": "Roger had become very different at home.", "target": "Roger had become very different at home."}, {"pred": "Sarah took it over there.", "target": "Sarah took it over there."}, {"pred": "Mark had spoke to me last night.", "target": "Mark had spoken to me last night."}, {"pred": "Mark had chose the good one this morning.", "target": "Mark had chosen the good one this morning."}, {"pred": "Mark knew a lot of things at home.", "target": "Mark knew a lot of things at home."}, {"pred": "Alexander came too late over there.", "target": "Alexander came too late over there."}, {"pred": "Roger chose the best option over there.", "target": "Roger chose the best option over there."}, {"pred": "Alexander had chosen the best option this morning.", "target": "Alexander had chosen the best option this morning."}, {"pred": "Roger had spoke without thinking over there.", "target": "Roger had spoken without thinking over there."}, {"pred": "Sarah wrote with a large pen over there.", "target": "Sarah wrote with a large pen over there."}, {"pred": "Roger saw something at home.", "target": "Roger saw something at home."}, {"pred": "Sarah took a paper some time ago.", "target": "Sarah took a paper some time ago."}, {"pred": "Sarah spoke very fast at home.", "target": "Sarah spoke very fast at home."}, {"pred": "Mark had become very different at home.", "target": "Mark had become very different at home."}, {"pred": "Mark had spoke about many things at home.", "target": "Mark had spoken about many things at home."}, {"pred": "Sarah had spoke very fast some time ago.", "target": "Sarah had spoken very fast some time ago."}, {"pred": "Alexander had taken some food at home.", "target": "Alexander had taken some food at home."}, {"pred": "Mark knew she could do it at home.", "target": "Mark knew she could do it at home."}, {"pred": "Alexander took some food this morning.", "target": "Alexander took some food this morning."}, {"pred": "Sarah drew a round circle some time ago.", "target": "Sarah drew a round circle some time ago."}, {"pred": "Alexander had written with a large pen last night.", "target": "Alexander had written with a large pen last night."}, {"pred": "Alexander became angry last night.", "target": "Alexander became angry last night."}, {"pred": "Alexander had given something sweet to the baby some time ago.", "target": "Alexander had given something sweet to the baby some time ago."}, {"pred": "Sarah spoke very fast some time ago.", "target": "Sarah spoke very fast some time ago."}, {"pred": "Mark wrote with a large pen over there.", "target": "Mark wrote with a large pen over there."}, {"pred": "Mark had seen a bird last night.", "target": "Mark had seen a bird last night."}, {"pred": "Mark had become angry at home.", "target": "Mark had become angry at home."}, {"pred": "Sarah chose the good one some time ago.", "target": "Sarah chose the good one some time ago."}, {"pred": "Mark had seen a bird this morning.", "target": "Mark had seen a bird this morning."}, {"pred": "Mark spoke about many things last night.", "target": "Mark spoke about many things last night."}, {"pred": "Alexander had become very different at home.", "target": "Alexander had become very different at home."}, {"pred": "Sarah come when we needed her this morning.", "target": "Sarah came when we needed her this morning."}, {"pred": "Roger written with a large pen some time ago.", "target": "Roger wrote with a large pen some time ago."}, {"pred": "Mark had spoke about many things this morning.", "target": "Mark had spoken about many things this morning."}, {"pred": "Roger had written with a large pen this morning.", "target": "Roger had written with a large pen this morning."}, {"pred": "Alexander had chose the best option over there.", "target": "Alexander had chosen the best option over there."}, {"pred": "Alexander had spoke without thinking over there.", "target": "Alexander had spoken without thinking over there."}, {"pred": "Alexander spoke without thinking over there.", "target": "Alexander spoke without thinking over there."}, {"pred": "Mark became someone else some time ago.", "target": "Mark became someone else some time ago."}, {"pred": "Roger drew a picture at home.", "target": "Roger drew a picture at home."}, {"pred": "Alexander had became someone else this morning.", "target": "Alexander had become someone else this morning."}, {"pred": "Sarah had become someone else some time ago.", "target": "Sarah had become someone else some time ago."}, {"pred": "Roger took a paper this morning.", "target": "Roger took a paper this morning."}, {"pred": "Alexander had given something sweet to the baby last night.", "target": "Alexander had given something sweet to the baby last night."}, {"pred": "Sarah became very different some time ago.", "target": "Sarah became very different some time ago."}, {"pred": "Sarah had knew she could do it last night.", "target": "Sarah had known she could do it last night."}, {"pred": "Mark came just in time over there.", "target": "Mark came just in time over there."}, {"pred": "Alexander come too late this morning.", "target": "Alexander came too late this morning."}, {"pred": "Sarah had taken some food at home.", "target": "Sarah had taken some food at home."}, {"pred": "Alexander took a paper at home.", "target": "Alexander took a paper at home."}, {"pred": "Roger drew a round circle last night.", "target": "Roger drew a round circle last night."}, {"pred": "Alexander had grown quickly this morning.", "target": "Alexander had grown quickly this morning."}, {"pred": "Sarah knew she could do it this morning.", "target": "Sarah knew she could do it this morning."}, {"pred": "Sarah spoke about many things over there.", "target": "Sarah spoke about many things over there."}, {"pred": "Mark knew a lot of things last night.", "target": "Mark knew a lot of things last night."}, {"pred": "Mark come when we needed her at home.", "target": "Mark came when we needed her at home."}, {"pred": "Roger came to the store last night.", "target": "Roger came to the store last night."}, {"pred": "Mark chose the best option over there.", "target": "Mark chose the best option over there."}, {"pred": "Roger took it last night.", "target": "Roger took it last night."}, {"pred": "Alexander drew a picture some time ago.", "target": "Alexander drew a picture some time ago."}, {"pred": "Roger knew a lot of things last night.", "target": "Roger knew a lot of things last night."}, {"pred": "Roger had taken them last night.", "target": "Roger had taken them last night."}, {"pred": "Alexander had drew a picture over there.", "target": "Alexander had drawn a picture over there."}, {"pred": "Sarah had come too late this morning.", "target": "Sarah had come too late this morning."}, {"pred": "Sarah gave money to the man last night.", "target": "Sarah gave money to the man last night."}, {"pred": "Roger had written a note some time ago.", "target": "Roger had written a note some time ago."}, {"pred": "Roger had drew a picture last night.", "target": "Roger had drawn a picture last night."}, {"pred": "Roger had seen a shape last night.", "target": "Roger had seen a shape last night."}, {"pred": "Roger gave a book to a student over there.", "target": "Roger gave a book to a student over there."}, {"pred": "Mark had known a lot of things over there.", "target": "Mark had known a lot of things over there."}, {"pred": "Roger came to the store over there.", "target": "Roger came to the store over there."}, {"pred": "Sarah wrote a note last night.", "target": "Sarah wrote a note last night."}, {"pred": "Alexander had came to the store last night.", "target": "Alexander had come to the store last night."}, {"pred": "Mark had come just in time over there.", "target": "Mark had come just in time over there."}, {"pred": "Mark come when we needed her last night.", "target": "Mark came when we needed her last night."}, {"pred": "Roger written with a large pen this morning.", "target": "Roger wrote with a large pen this morning."}, {"pred": "Mark had spoke without thinking over there.", "target": "Mark had spoken without thinking over there."}, {"pred": "Sarah came just in time last night.", "target": "Sarah came just in time last night."}, {"pred": "Alexander had chosen the best option some time ago.", "target": "Alexander had chosen the best option some time ago."}, {"pred": "Alexander had chosen the good one some time ago.", "target": "Alexander had chosen the good one some time ago."}, {"pred": "Alexander drew a map last night.", "target": "Alexander drew a map last night."}, {"pred": "Sarah become someone else at home.", "target": "Sarah became someone else at home."}, {"pred": "Sarah saw a bird over there.", "target": "Sarah saw a bird over there."}, {"pred": "Roger gave something sweet to the baby some time ago.", "target": "Roger gave something sweet to the baby some time ago."}, {"pred": "Mark had taken the bell at home.", "target": "Mark had taken the bell at home."}, {"pred": "Roger had given something sweet to the baby over there.", "target": "Roger had given something sweet to the baby over there."}, {"pred": "Sarah saw a bird at home.", "target": "Sarah saw a bird at home."}, {"pred": "Roger had spoke to me over there.", "target": "Roger had spoken to me over there."}, {"pred": "Mark became someone else over there.", "target": "Mark became someone else over there."}, {"pred": "Sarah wrote a note some time ago.", "target": "Sarah wrote a note some time ago."}, {"pred": "Alexander had known a lot of things some time ago.", "target": "Alexander had known a lot of things some time ago."}, {"pred": "Alexander gave money to the man some time ago.", "target": "Alexander gave money to the man some time ago."}, {"pred": "Alexander had given a book to a student some time ago.", "target": "Alexander had given a book to a student some time ago."}, {"pred": "Mark took some food some time ago.", "target": "Mark took some food some time ago."}, {"pred": "Roger took some food last night.", "target": "Roger took some food last night."}, {"pred": "Alexander had known a lot of things this morning.", "target": "Alexander had known a lot of things this morning."}, {"pred": "Alexander had given a book to a student over there.", "target": "Alexander had given a book to a student over there."}, {"pred": "Mark had come when we needed her at home.", "target": "Mark had come when we needed her at home."}, {"pred": "Alexander had taken some food some time ago.", "target": "Alexander had taken some food some time ago."}, {"pred": "Sarah had spoke without thinking at home.", "target": "Sarah had spoken without thinking at home."}, {"pred": "Alexander had given something sweet to the baby over there.", "target": "Alexander had given something sweet to the baby over there."}, {"pred": "Roger had given a book to a student some time ago.", "target": "Roger had given a book to a student some time ago."}, {"pred": "Sarah become someone else over there.", "target": "Sarah became someone else over there."}, {"pred": "Roger gave money to the man last night.", "target": "Roger gave money to the man last night."}, {"pred": "Alexander chose the good one this morning.", "target": "Alexander chose the good one this morning."}, {"pred": "Roger grew quickly last night.", "target": "Roger grew quickly last night."}, {"pred": "Roger become very different at home.", "target": "Roger became very different at home."}, {"pred": "Mark had knew she could do it some time ago.", "target": "Mark had known she could do it some time ago."}, {"pred": "Mark came to the store some time ago.", "target": "Mark came to the store some time ago."}, {"pred": "Alexander gave a book to a student last night.", "target": "Alexander gave a book to a student last night."}, {"pred": "Alexander had written a note at home.", "target": "Alexander had written a note at home."}, {"pred": "Alexander come too late last night.", "target": "Alexander came too late last night."}, {"pred": "Alexander knew she could do it this morning.", "target": "Alexander knew she could do it this morning."}, {"pred": "Roger come just in time last night.", "target": "Roger came just in time last night."}, {"pred": "Mark drew a round circle over there.", "target": "Mark drew a round circle over there."}, {"pred": "Mark had chose the good one last night.", "target": "Mark had chosen the good one last night."}, {"pred": "Sarah drew a picture at home.", "target": "Sarah drew a picture at home."}, {"pred": "Alexander spoke to me over there.", "target": "Alexander spoke to me over there."}, {"pred": "Sarah had become someone else at home.", "target": "Sarah had become someone else at home."}, {"pred": "Mark wrote with a large pen this morning.", "target": "Mark wrote with a large pen this morning."}, {"pred": "Alexander became someone else this morning.", "target": "Alexander became someone else this morning."}, {"pred": "Alexander had grown quickly over there.", "target": "Alexander had grown quickly over there."}, {"pred": "Alexander had spoke to me some time ago.", "target": "Alexander had spoken to me some time ago."}, {"pred": "Mark spoke very fast some time ago.", "target": "Mark spoke very fast some time ago."}, {"pred": "Sarah gave a book to a student at home.", "target": "Sarah gave a book to a student at home."}, {"pred": "Alexander written a story some time ago.", "target": "Alexander wrote a story some time ago."}, {"pred": "Sarah had come to the store some time ago.", "target": "Sarah had come to the store some time ago."}, {"pred": "Sarah had given money to the man over there.", "target": "Sarah had given money to the man over there."}, {"pred": "Roger had known a lot of things over there.", "target": "Roger had known a lot of things over there."}, {"pred": "Roger had chosen the good one this morning.", "target": "Roger had chosen the good one this morning."}, {"pred": "Mark had written with a large pen over there.", "target": "Mark had written with a large pen over there."}, {"pred": "Mark had knew a lot of things this morning.", "target": "Mark had known a lot of things this morning."}, {"pred": "Alexander had written into a book at home.", "target": "Alexander had written into a book at home."}, {"pred": "Alexander had taken some food this morning.", "target": "Alexander had taken some food this morning."}, {"pred": "Alexander came when we needed her last night.", "target": "Alexander came when we needed her last night."}, {"pred": "Roger drew a map last night.", "target": "Roger drew a map last night."}, {"pred": "Sarah took them over there.", "target": "Sarah took them over there."}, {"pred": "Sarah saw a shape over there.", "target": "Sarah saw a shape over there."}, {"pred": "Sarah gave something sweet to the baby some time ago.", "target": "Sarah gave something sweet to the baby some time ago."}, {"pred": "Alexander took the bell some time ago.", "target": "Alexander took the bell some time ago."}, {"pred": "Sarah saw something this morning.", "target": "Sarah saw something this morning."}, {"pred": "Sarah become angry last night.", "target": "Sarah became angry last night."}, {"pred": "Mark had come just in time last night.", "target": "Mark had come just in time last night."}, {"pred": "Mark came just in time last night.", "target": "Mark came just in time last night."}, {"pred": "Mark written into a book at home.", "target": "Mark wrote into a book at home."}, {"pred": "Mark had knew she could do it at home.", "target": "Mark had known she could do it at home."}, {"pred": "Sarah chose the best option over there.", "target": "Sarah chose the best option over there."}, {"pred": "Sarah had written with a large pen over there.", "target": "Sarah had written with a large pen over there."}, {"pred": "Sarah came to the store last night.", "target": "Sarah came to the store last night."}, {"pred": "Alexander chose the best option last night.", "target": "Alexander chose the best option last night."}, {"pred": "Mark had grown quickly at home.", "target": "Mark had grown quickly at home."}, {"pred": "Mark saw something last night.", "target": "Mark saw something last night."}, {"pred": "Alexander gave something sweet to the baby some time ago.", "target": "Alexander gave something sweet to the baby some time ago."}, {"pred": "Alexander had become angry this morning.", "target": "Alexander had become angry this morning."}, {"pred": "Roger became very different last night.", "target": "Roger became very different last night."}, {"pred": "Sarah had written a note some time ago.", "target": "Sarah had written a note some time ago."}, {"pred": "Roger became someone else over there.", "target": "Roger became someone else over there."}, {"pred": "Alexander had spoke about many things last night.", "target": "Alexander had spoken about many things last night."}, {"pred": "Roger spoke about many things over there.", "target": "Roger spoke about many things over there."}, {"pred": "Mark spoke to me over there.", "target": "Mark spoke to me over there."}, {"pred": "Sarah had grown quickly this morning.", "target": "Sarah had grown quickly this morning."}, {"pred": "Sarah wrote with a large pen this morning.", "target": "Sarah wrote with a large pen this morning."}, {"pred": "Mark chose the best option last night.", "target": "Mark chose the best option last night."}, {"pred": "Mark had given something sweet to the baby last night.", "target": "Mark had given something sweet to the baby last night."}, {"pred": "Roger written with a large pen over there.", "target": "Roger wrote with a large pen over there."}, {"pred": "Alexander had given a book to a student last night.", "target": "Alexander had given a book to a student last night."}, {"pred": "Mark had come when we needed her this morning.", "target": "Mark had come when we needed her this morning."}, {"pred": "Alexander had taken a paper at home.", "target": "Alexander had taken a paper at home."}, {"pred": "Roger had knew she could do it this morning.", "target": "Roger had known she could do it this morning."}, {"pred": "Alexander chose the best option over there.", "target": "Alexander chose the best option over there."}, {"pred": "Mark had chose the best option this morning.", "target": "Mark had chosen the best option this morning."}, {"pred": "Sarah chose the good one at home.", "target": "Sarah chose the good one at home."}, {"pred": "Sarah drew a round circle at home.", "target": "Sarah drew a round circle at home."}, {"pred": "Mark had chose the best option last night.", "target": "Mark had chosen the best option last night."}, {"pred": "Sarah gave money to the man at home.", "target": "Sarah gave money to the man at home."}, {"pred": "Alexander had written with a large pen over there.", "target": "Alexander had written with a large pen over there."}, {"pred": "Mark had grown quickly some time ago.", "target": "Mark had grown quickly some time ago."}, {"pred": "Mark had spoke very fast last night.", "target": "Mark had spoken very fast last night."}, {"pred": "Alexander chose the best option this morning.", "target": "Alexander chose the best option this morning."}, {"pred": "Alexander had given something sweet to the baby this morning.", "target": "Alexander had given something sweet to the baby this morning."}, {"pred": "Sarah had seen something last night.", "target": "Sarah had seen something last night."}, {"pred": "Mark had spoke very fast over there.", "target": "Mark had spoken very fast over there."}, {"pred": "Alexander written with a large pen last night.", "target": "Alexander wrote with a large pen last night."}, {"pred": "Mark had come when we needed her last night.", "target": "Mark had come when we needed her last night."}, {"pred": "Roger become angry some time ago.", "target": "Roger became angry some time ago."}, {"pred": "Roger had taken some food this morning.", "target": "Roger had taken some food this morning."}, {"pred": "Roger had become angry some time ago.", "target": "Roger had become angry some time ago."}, {"pred": "Mark became someone else last night.", "target": "Mark became someone else last night."}, {"pred": "Mark had became someone else some time ago.", "target": "Mark had become someone else some time ago."}, {"pred": "Mark saw a bird last night.", "target": "Mark saw a bird last night."}, {"pred": "Mark took a paper at home.", "target": "Mark took a paper at home."}, {"pred": "Roger had seen something at home.", "target": "Roger had seen something at home."}, {"pred": "Roger had drew a map last night.", "target": "Roger had drawn a map last night."}, {"pred": "Roger become angry at home.", "target": "Roger became angry at home."}, {"pred": "Mark knew she could do it over there.", "target": "Mark knew she could do it over there."}, {"pred": "Roger had written with a large pen some time ago.", "target": "Roger had written with a large pen some time ago."}, {"pred": "Sarah had seen a bird last night.", "target": "Sarah had seen a bird last night."}, {"pred": "Sarah had known a lot of things over there.", "target": "Sarah had known a lot of things over there."}, {"pred": "Sarah wrote with a large pen at home.", "target": "Sarah wrote with a large pen at home."}, {"pred": "Roger had became very different this morning.", "target": "Roger had become very different this morning."}, {"pred": "Roger took a paper over there.", "target": "Roger took a paper over there."}, {"pred": "Roger gave something sweet to the baby at home.", "target": "Roger gave something sweet to the baby at home."}, {"pred": "Roger had taken the bell some time ago.", "target": "Roger had taken the bell some time ago."}, {"pred": "Mark spoke about many things this morning.", "target": "Mark spoke about many things this morning."}, {"pred": "Roger chose the best option some time ago.", "target": "Roger chose the best option some time ago."}, {"pred": "Alexander become very different at home.", "target": "Alexander became very different at home."}, {"pred": "Roger had come just in time some time ago.", "target": "Roger had come just in time some time ago."}, {"pred": "Roger spoke to me last night.", "target": "Roger spoke to me last night."}, {"pred": "Alexander took a paper this morning.", "target": "Alexander took a paper this morning."}, {"pred": "Mark had became very different some time ago.", "target": "Mark had become very different some time ago."}, {"pred": "Roger gave money to the man this morning.", "target": "Roger gave money to the man this morning."}, {"pred": "Roger drew a picture some time ago.", "target": "Roger drew a picture some time ago."}, {"pred": "Alexander had chosen the best option last night.", "target": "Alexander had chosen the best option last night."}, {"pred": "Sarah had taken it at home.", "target": "Sarah had taken it at home."}, {"pred": "Roger had written into a book over there.", "target": "Roger had written into a book over there."}, {"pred": "Roger had chosen the good one some time ago.", "target": "Roger had chosen the good one some time ago."}, {"pred": "Sarah had given a book to a student some time ago.", "target": "Sarah had given a book to a student some time ago."}, {"pred": "Mark had written into a book at home.", "target": "Mark had written into a book at home."}, {"pred": "Sarah had known a lot of things last night.", "target": "Sarah had known a lot of things last night."}, {"pred": "Sarah had taken them over there.", "target": "Sarah had taken them over there."}, {"pred": "Alexander saw something this morning.", "target": "Alexander saw something this morning."}, {"pred": "Roger saw a shape last night.", "target": "Roger saw a shape last night."}, {"pred": "Alexander knew she could do it some time ago.", "target": "Alexander knew she could do it some time ago."}, {"pred": "Sarah come just in time this morning.", "target": "Sarah came just in time this morning."}, {"pred": "Sarah had given money to the man at home.", "target": "Sarah had given money to the man at home."}, {"pred": "Roger had spoke very fast some time ago.", "target": "Roger had spoken very fast some time ago."}, {"pred": "Mark grew quickly some time ago.", "target": "Mark grew quickly some time ago."}, {"pred": "Roger had taken a paper some time ago.", "target": "Roger had taken a paper some time ago."}, {"pred": "Alexander came to the store over there.", "target": "Alexander came to the store over there."}, {"pred": "Mark drew a round circle this morning.", "target": "Mark drew a round circle this morning."}, {"pred": "Roger drew a round circle over there.", "target": "Roger drew a round circle over there."}, {"pred": "Roger come just in time over there.", "target": "Roger came just in time over there."}, {"pred": "Alexander took it at home.", "target": "Alexander took it at home."}, {"pred": "Alexander saw a bird over there.", "target": "Alexander saw a bird over there."}, {"pred": "Roger knew she could do it this morning.", "target": "Roger knew she could do it this morning."}, {"pred": "Alexander knew a lot of things some time ago.", "target": "Alexander knew a lot of things some time ago."}, {"pred": "Sarah had spoke about many things over there.", "target": "Sarah had spoken about many things over there."}, {"pred": "Sarah come when we needed her last night.", "target": "Sarah came when we needed her last night."}, {"pred": "Mark spoke very fast at home.", "target": "Mark spoke very fast at home."}, {"pred": "Roger had drew a picture some time ago.", "target": "Roger had drawn a picture some time ago."}, {"pred": "Mark had come when we needed her over there.", "target": "Mark had come when we needed her over there."}, {"pred": "Mark had come to the store some time ago.", "target": "Mark had come to the store some time ago."}, {"pred": "Mark had written a note over there.", "target": "Mark had written a note over there."}, {"pred": "Sarah come just in time some time ago.", "target": "Sarah came just in time some time ago."}, {"pred": "Roger had come too late some time ago.", "target": "Roger had come too late some time ago."}, {"pred": "Alexander took them over there.", "target": "Alexander took them over there."}, {"pred": "Roger had come to the store some time ago.", "target": "Roger had come to the store some time ago."}, {"pred": "Alexander become angry some time ago.", "target": "Alexander became angry some time ago."}, {"pred": "Mark had drew a round circle some time ago.", "target": "Mark had drawn a round circle some time ago."}, {"pred": "Sarah had become very different at home.", "target": "Sarah had become very different at home."}, {"pred": "Sarah had became very different last night.", "target": "Sarah had become very different last night."}, {"pred": "Roger had seen something this morning.", "target": "Roger had seen something this morning."}, {"pred": "Alexander saw something some time ago.", "target": "Alexander saw something some time ago."}, {"pred": "Mark drew a picture some time ago.", "target": "Mark drew a picture some time ago."}, {"pred": "Mark became very different some time ago.", "target": "Mark became very different some time ago."}, {"pred": "Roger had grown quickly at home.", "target": "Roger had grown quickly at home."}, {"pred": "Roger had grown quickly some time ago.", "target": "Roger had grown quickly some time ago."}, {"pred": "Roger had spoke to me this morning.", "target": "Roger had spoken to me this morning."}, {"pred": "Sarah had seen something this morning.", "target": "Sarah had seen something this morning."}, {"pred": "Sarah wrote with a large pen last night.", "target": "Sarah wrote with a large pen last night."}, {"pred": "Sarah become angry some time ago.", "target": "Sarah became angry some time ago."}, {"pred": "Mark had knew a lot of things at home.", "target": "Mark had known a lot of things at home."}, {"pred": "Mark took a paper over there.", "target": "Mark took a paper over there."}, {"pred": "Alexander spoke without thinking some time ago.", "target": "Alexander spoke without thinking some time ago."}, {"pred": "Alexander had written a note last night.", "target": "Alexander had written a note last night."}, {"pred": "Sarah had seen something over there.", "target": "Sarah had seen something over there."}, {"pred": "Sarah had seen a shape at home.", "target": "Sarah had seen a shape at home."}, {"pred": "Sarah had written into a book last night.", "target": "Sarah had written into a book last night."}, {"pred": "Alexander had spoke about many things over there.", "target": "Alexander had spoken about many things over there."}, {"pred": "Mark chose the good one at home.", "target": "Mark chose the good one at home."}, {"pred": "Alexander had grown quickly some time ago.", "target": "Alexander had grown quickly some time ago."}, {"pred": "Roger took the bell last night.", "target": "Roger took the bell last night."}, {"pred": "Roger written into a book at home.", "target": "Roger wrote into a book at home."}, {"pred": "Mark had chose the good one over there.", "target": "Mark had chosen the good one over there."}, {"pred": "Roger gave a book to a student some time ago.", "target": "Roger gave a book to a student some time ago."}, {"pred": "Sarah gave a book to a student last night.", "target": "Sarah gave a book to a student last night."}, {"pred": "Sarah had drew a picture last night.", "target": "Sarah had drawn a picture last night."}, {"pred": "Roger took some food this morning.", "target": "Roger took some food this morning."}, {"pred": "Roger had come just in time over there.", "target": "Roger had come just in time over there."}, {"pred": "Roger had came to the store over there.", "target": "Roger had come to the store over there."}, {"pred": "Roger chose the good one over there.", "target": "Roger chose the good one over there."}, {"pred": "Mark came to the store last night.", "target": "Mark came to the store last night."}, {"pred": "Alexander had drew a picture some time ago.", "target": "Alexander had drawn a picture some time ago."}, {"pred": "Roger written a note at home.", "target": "Roger wrote a note at home."}, {"pred": "Mark chose the best option at home.", "target": "Mark chose the best option at home."}, {"pred": "Mark had become very different over there.", "target": "Mark had become very different over there."}, {"pred": "Mark knew a lot of things over there.", "target": "Mark knew a lot of things over there."}, {"pred": "Roger had taken a paper over there.", "target": "Roger had taken a paper over there."}, {"pred": "Roger had taken a paper this morning.", "target": "Roger had taken a paper this morning."}, {"pred": "Alexander grew quickly this morning.", "target": "Alexander grew quickly this morning."}, {"pred": "Alexander had drew a picture this morning.", "target": "Alexander had drawn a picture this morning."}, {"pred": "Mark saw a shape at home.", "target": "Mark saw a shape at home."}, {"pred": "Alexander spoke very fast at home.", "target": "Alexander spoke very fast at home."}, {"pred": "Roger taken a paper some time ago.", "target": "Roger took a paper some time ago."}, {"pred": "Mark gave a book to a student last night.", "target": "Mark gave a book to a student last night."}, {"pred": "Sarah took the bell over there.", "target": "Sarah took the bell over there."}, {"pred": "Alexander wrote a note last night.", "target": "Alexander wrote a note last night."}, {"pred": "Alexander had come too late over there.", "target": "Alexander had come too late over there."}, {"pred": "Sarah took some food this morning.", "target": "Sarah took some food this morning."}, {"pred": "Sarah had come to the store at home.", "target": "Sarah had come to the store at home."}, {"pred": "Sarah came too late this morning.", "target": "Sarah came too late this morning."}, {"pred": "Mark knew a lot of things some time ago.", "target": "Mark knew a lot of things some time ago."}, {"pred": "Mark had became someone else last night.", "target": "Mark had become someone else last night."}, {"pred": "Sarah had taken some food last night.", "target": "Sarah had taken some food last night."}, {"pred": "Roger had chosen the best option over there.", "target": "Roger had chosen the best option over there."}, {"pred": "Alexander took the bell this morning.", "target": "Alexander took the bell this morning."}, {"pred": "Alexander gave something sweet to the baby over there.", "target": "Alexander gave something sweet to the baby over there."}, {"pred": "Alexander had chosen the good one at home.", "target": "Alexander had chosen the good one at home."}, {"pred": "Sarah had taken the bell some time ago.", "target": "Sarah had taken the bell some time ago."}, {"pred": "Roger had seen a shape at home.", "target": "Roger had seen a shape at home."}, {"pred": "Sarah written into a book over there.", "target": "Sarah wrote into a book over there."}, {"pred": "Sarah took the bell some time ago.", "target": "Sarah took the bell some time ago."}, {"pred": "Mark had come just in time this morning.", "target": "Mark had come just in time this morning."}, {"pred": "Sarah had taken them at home.", "target": "Sarah had taken them at home."}, {"pred": "Roger chose the good one some time ago.", "target": "Roger chose the good one some time ago."}, {"pred": "Alexander had known a lot of things over there.", "target": "Alexander had known a lot of things over there."}, {"pred": "Mark chose the good one last night.", "target": "Mark chose the good one last night."}, {"pred": "Roger had known a lot of things this morning.", "target": "Roger had known a lot of things this morning."}, {"pred": "Sarah had taken a paper this morning.", "target": "Sarah had taken a paper this morning."}, {"pred": "Sarah knew a lot of things over there.", "target": "Sarah knew a lot of things over there."}, {"pred": "Roger spoke to me this morning.", "target": "Roger spoke to me this morning."}, {"pred": "Roger had became very different last night.", "target": "Roger had become very different last night."}, {"pred": "Sarah had written with a large pen this morning.", "target": "Sarah had written with a large pen this morning."}, {"pred": "Sarah had come when we needed her last night.", "target": "Sarah had come when we needed her last night."}, {"pred": "Sarah had chose the good one at home.", "target": "Sarah had chosen the good one at home."}, {"pred": "Alexander had taken them some time ago.", "target": "Alexander had taken them some time ago."}, {"pred": "Alexander came to the store last night.", "target": "Alexander came to the store last night."}, {"pred": "Sarah had come just in time some time ago.", "target": "Sarah had come just in time some time ago."}, {"pred": "Alexander gave something sweet to the baby this morning.", "target": "Alexander gave something sweet to the baby this morning."}, {"pred": "Roger had chosen the good one last night.", "target": "Roger had chosen the good one last night."}, {"pred": "Alexander had knew she could do it this morning.", "target": "Alexander had known she could do it this morning."}, {"pred": "Mark had spoke to me some time ago.", "target": "Mark had spoken to me some time ago."}, {"pred": "Roger had spoke without thinking this morning.", "target": "Roger had spoken without thinking this morning."}, {"pred": "Mark had taken a paper over there.", "target": "Mark had taken a paper over there."}, {"pred": "Roger had spoke about many things last night.", "target": "Roger had spoken about many things last night."}, {"pred": "Alexander spoke without thinking this morning.", "target": "Alexander spoke without thinking this morning."}, {"pred": "Alexander had given money to the man over there.", "target": "Alexander had given money to the man over there."}, {"pred": "Alexander had come too late some time ago.", "target": "Alexander had come too late some time ago."}, {"pred": "Sarah grown quickly over there.", "target": "Sarah grew quickly over there."}, {"pred": "Sarah took the bell this morning.", "target": "Sarah took the bell this morning."}, {"pred": "Mark gave a book to a student this morning.", "target": "Mark gave a book to a student this morning."}, {"pred": "Sarah grew quickly at home.", "target": "Sarah grew quickly at home."}, {"pred": "Mark had chosen the best option some time ago.", "target": "Mark had chosen the best option some time ago."}, {"pred": "Mark had seen something last night.", "target": "Mark had seen something last night."}, {"pred": "Roger took them last night.", "target": "Roger took them last night."}, {"pred": "Roger spoke about many things last night.", "target": "Roger spoke about many things last night."}, {"pred": "Sarah had become someone else over there.", "target": "Sarah had become someone else over there."}, {"pred": "Sarah had spoken without thinking over there.", "target": "Sarah had spoken without thinking over there."}, {"pred": "Alexander had knew she could do it some time ago.", "target": "Alexander had known she could do it some time ago."}, {"pred": "Sarah had written with a large pen last night.", "target": "Sarah had written with a large pen last night."}, {"pred": "Mark had written into a book some time ago.", "target": "Mark had written into a book some time ago."}, {"pred": "Sarah had chose the best option over there.", "target": "Sarah had chosen the best option over there."}, {"pred": "Mark gave a book to a student at home.", "target": "Mark gave a book to a student at home."}, {"pred": "Sarah had taken some food this morning.", "target": "Sarah had taken some food this morning."}, {"pred": "Mark had chosen the good one at home.", "target": "Mark had chosen the good one at home."}, {"pred": "Roger grown quickly over there.", "target": "Roger grew quickly over there."}, {"pred": "Mark drew a round circle some time ago.", "target": "Mark drew a round circle some time ago."}, {"pred": "Roger had become angry at home.", "target": "Roger had become angry at home."}, {"pred": "Roger had given money to the man at home.", "target": "Roger had given money to the man at home."}, {"pred": "Roger had come to the store this morning.", "target": "Roger had come to the store this morning."}, {"pred": "Roger written a note last night.", "target": "Roger wrote a note last night."}, {"pred": "Sarah had knew she could do it some time ago.", "target": "Sarah had known she could do it some time ago."}, {"pred": "Sarah had given money to the man some time ago.", "target": "Sarah had given money to the man some time ago."}, {"pred": "Mark had grown quickly over there.", "target": "Mark had grown quickly over there."}, {"pred": "Mark had given a book to a student at home.", "target": "Mark had given a book to a student at home."}, {"pred": "Mark had drew a picture last night.", "target": "Mark had drawn a picture last night."}, {"pred": "Mark became very different at home.", "target": "Mark became very different at home."}, {"pred": "Mark had become angry over there.", "target": "Mark had become angry over there."}, {"pred": "Alexander drew a round circle some time ago.", "target": "Alexander drew a round circle some time ago."}, {"pred": "Alexander gave a book to a student this morning.", "target": "Alexander gave a book to a student this morning."}, {"pred": "Sarah had taken a paper some time ago.", "target": "Sarah had taken a paper some time ago."}, {"pred": "Alexander gave a book to a student over there.", "target": "Alexander gave a book to a student over there."}, {"pred": "Roger had taken it over there.", "target": "Roger had taken it over there."}, {"pred": "Sarah had written into a book some time ago.", "target": "Sarah had written into a book some time ago."}, {"pred": "Roger had drew a map some time ago.", "target": "Roger had drawn a map some time ago."}, {"pred": "Sarah had chose the good one over there.", "target": "Sarah had chosen the good one over there."}, {"pred": "Mark knew a lot of things this morning.", "target": "Mark knew a lot of things this morning."}, {"pred": "Mark gave a book to a student some time ago.", "target": "Mark gave a book to a student some time ago."}, {"pred": "Alexander had given a book to a student this morning.", "target": "Alexander had given a book to a student this morning."}, {"pred": "Roger had written with a large pen over there.", "target": "Roger had written with a large pen over there."}, {"pred": "Sarah came when we needed her some time ago.", "target": "Sarah came when we needed her some time ago."}, {"pred": "Sarah had taken the bell over there.", "target": "Sarah had taken the bell over there."}, {"pred": "Roger had taken some food last night.", "target": "Roger had taken some food last night."}, {"pred": "Roger had given something sweet to the baby at home.", "target": "Roger had given something sweet to the baby at home."}, {"pred": "Roger spoke very fast at home.", "target": "Roger spoke very fast at home."}, {"pred": "Alexander had become angry last night.", "target": "Alexander had become angry last night."}, {"pred": "Sarah had written with a large pen at home.", "target": "Sarah had written with a large pen at home."}, {"pred": "Roger had become angry this morning.", "target": "Roger had become angry this morning."}, {"pred": "Sarah had grown quickly at home.", "target": "Sarah had grown quickly at home."}, {"pred": "Roger gave something sweet to the baby over there.", "target": "Roger gave something sweet to the baby over there."}, {"pred": "Alexander written into a book at home.", "target": "Alexander wrote into a book at home."}, {"pred": "Mark had given something sweet to the baby this morning.", "target": "Mark had given something sweet to the baby this morning."}, {"pred": "Sarah saw something over there.", "target": "Sarah saw something over there."}, {"pred": "Roger had knew she could do it at home.", "target": "Roger had known she could do it at home."}, {"pred": "Alexander had taken the bell some time ago.", "target": "Alexander had taken the bell some time ago."}, {"pred": "Roger saw something this morning.", "target": "Roger saw something this morning."}, {"pred": "Roger had known a lot of things at home.", "target": "Roger had known a lot of things at home."}, {"pred": "Alexander had drew a picture last night.", "target": "Alexander had drawn a picture last night."}, {"pred": "Sarah had come just in time last night.", "target": "Sarah had come just in time last night."}, {"pred": "Alexander took the bell at home.", "target": "Alexander took the bell at home."}, {"pred": "Sarah had come when we needed her some time ago.", "target": "Sarah had come when we needed her some time ago."}, {"pred": "Alexander had written into a book some time ago.", "target": "Alexander had written into a book some time ago."}, {"pred": "Roger had given money to the man last night.", "target": "Roger had given money to the man last night."}, {"pred": "Sarah had written a story some time ago.", "target": "Sarah had written a story some time ago."}, {"pred": "Mark become angry at home.", "target": "Mark became angry at home."}, {"pred": "Sarah written into a book this morning.", "target": "Sarah wrote into a book this morning."}, {"pred": "Roger took the bell this morning.", "target": "Roger took the bell this morning."}, {"pred": "Sarah wrote a story last night.", "target": "Sarah wrote a story last night."}, {"pred": "Sarah had seen a bird over there.", "target": "Sarah had seen a bird over there."}, {"pred": "Sarah saw something some time ago.", "target": "Sarah saw something some time ago."}, {"pred": "Alexander had taken a paper this morning.", "target": "Alexander had taken a paper this morning."}, {"pred": "Sarah had drew a picture at home.", "target": "Sarah had drawn a picture at home."}, {"pred": "Sarah had spoke very fast at home.", "target": "Sarah had spoken very fast at home."}, {"pred": "Sarah saw a shape last night.", "target": "Sarah saw a shape last night."}, {"pred": "Roger written a note this morning.", "target": "Roger wrote a note this morning."}, {"pred": "Roger saw a shape at home.", "target": "Roger saw a shape at home."}, {"pred": "Sarah knew she could do it at home.", "target": "Sarah knew she could do it at home."}, {"pred": "Mark took the bell some time ago.", "target": "Mark took the bell some time ago."}, {"pred": "Roger grown quickly at home.", "target": "Roger grew quickly at home."}, {"pred": "Mark gave something sweet to the baby last night.", "target": "Mark gave something sweet to the baby last night."}, {"pred": "Roger grew quickly some time ago.", "target": "Roger grew quickly some time ago."}, {"pred": "Alexander had come just in time last night.", "target": "Alexander had come just in time last night."}, {"pred": "Roger spoke to me over there.", "target": "Roger spoke to me over there."}, {"pred": "Roger had drew a round circle over there.", "target": "Roger had drawn a round circle over there."}, {"pred": "Sarah had written into a book this morning.", "target": "Sarah had written into a book this morning."}, {"pred": "Alexander had given money to the man some time ago.", "target": "Alexander had given money to the man some time ago."}, {"pred": "Roger knew she could do it at home.", "target": "Roger knew she could do it at home."}, {"pred": "Sarah become very different at home.", "target": "Sarah became very different at home."}, {"pred": "Alexander wrote a note this morning.", "target": "Alexander wrote a note this morning."}, {"pred": "Alexander written with a large pen this morning.", "target": "Alexander wrote with a large pen this morning."}, {"pred": "Roger had come when we needed her this morning.", "target": "Roger had come when we needed her this morning."}, {"pred": "Alexander had taken them over there.", "target": "Alexander had taken them over there."}, {"pred": "Alexander had come when we needed her some time ago.", "target": "Alexander had come when we needed her some time ago."}, {"pred": "Sarah had drew a round circle this morning.", "target": "Sarah had drawn a round circle this morning."}, {"pred": "Mark had come too late last night.", "target": "Mark had come too late last night."}, {"pred": "Alexander drew a round circle at home.", "target": "Alexander drew a round circle at home."}, {"pred": "Alexander had drew a round circle some time ago.", "target": "Alexander had drawn a round circle some time ago."}, {"pred": "Alexander had given a book to a student at home.", "target": "Alexander had given a book to a student at home."}, {"pred": "Roger had come just in time last night.", "target": "Roger had come just in time last night."}, {"pred": "Mark had given a book to a student some time ago.", "target": "Mark had given a book to a student some time ago."}, {"pred": "Sarah gave money to the man over there.", "target": "Sarah gave money to the man over there."}, {"pred": "Sarah had taken it over there.", "target": "Sarah had taken it over there."}, {"pred": "Roger had spoke about many things over there.", "target": "Roger had spoken about many things over there."}, {"pred": "Alexander had seen something last night.", "target": "Alexander had seen something last night."}, {"pred": "Roger had written a note this morning.", "target": "Roger had written a note this morning."}, {"pred": "Sarah written into a book last night.", "target": "Sarah wrote into a book last night."}, {"pred": "Sarah spoke very fast this morning.", "target": "Sarah spoke very fast this morning."}, {"pred": "Roger had spoke without thinking last night.", "target": "Roger had spoken without thinking last night."}, {"pred": "Sarah saw a bird last night.", "target": "Sarah saw a bird last night."}, {"pred": "Mark chose the good one over there.", "target": "Mark chose the good one over there."}, {"pred": "Alexander drew a map over there.", "target": "Alexander drew a map over there."}, {"pred": "Alexander had seen something this morning.", "target": "Alexander had seen something this morning."}, {"pred": "Mark took the bell this morning.", "target": "Mark took the bell this morning."}, {"pred": "Sarah knew a lot of things at home.", "target": "Sarah knew a lot of things at home."}, {"pred": "Mark had become angry some time ago.", "target": "Mark had become angry some time ago."}, {"pred": "Alexander grew quickly over there.", "target": "Alexander grew quickly over there."}, {"pred": "Alexander gave money to the man last night.", "target": "Alexander gave money to the man last night."}, {"pred": "Alexander saw a shape over there.", "target": "Alexander saw a shape over there."}, {"pred": "Mark came too late over there.", "target": "Mark came too late over there."}, {"pred": "Sarah took a paper this morning.", "target": "Sarah took a paper this morning."}, {"pred": "Alexander spoke very fast last night.", "target": "Alexander spoke very fast last night."}, {"pred": "Alexander had came to the store over there.", "target": "Alexander had come to the store over there."}, {"pred": "Mark had seen a shape at home.", "target": "Mark had seen a shape at home."}, {"pred": "Alexander came when we needed her some time ago.", "target": "Alexander came when we needed her some time ago."}, {"pred": "Sarah had became someone else this morning.", "target": "Sarah had become someone else this morning."}, {"pred": "Sarah drew a round circle this morning.", "target": "Sarah drew a round circle this morning."}, {"pred": "Mark had spoke very fast at home.", "target": "Mark had spoken very fast at home."}, {"pred": "Mark had knew she could do it this morning.", "target": "Mark had known she could do it this morning."}, {"pred": "Mark had became angry last night.", "target": "Mark had become angry last night."}, {"pred": "Roger had knew she could do it some time ago.", "target": "Roger had known she could do it some time ago."}, {"pred": "Alexander written with a large pen over there.", "target": "Alexander wrote with a large pen over there."}, {"pred": "Sarah come to the store some time ago.", "target": "Sarah came to the store some time ago."}, {"pred": "Alexander knew a lot of things last night.", "target": "Alexander knew a lot of things last night."}, {"pred": "Roger came to the store this morning.", "target": "Roger came to the store this morning."}, {"pred": "Mark had written a story at home.", "target": "Mark had written a story at home."}, {"pred": "Alexander written into a book some time ago.", "target": "Alexander wrote into a book some time ago."}, {"pred": "Roger drew a map some time ago.", "target": "Roger drew a map some time ago."}, {"pred": "Alexander had taken the bell this morning.", "target": "Alexander had taken the bell this morning."}, {"pred": "Roger had taken the bell last night.", "target": "Roger had taken the bell last night."}, {"pred": "Roger came to the store some time ago.", "target": "Roger came to the store some time ago."}, {"pred": "Sarah had become very different some time ago.", "target": "Sarah had become very different some time ago."}, {"pred": "Mark written into a book some time ago.", "target": "Mark wrote into a book some time ago."}, {"pred": "Mark come too late last night.", "target": "Mark came too late last night."}, {"pred": "Sarah took them at home.", "target": "Sarah took them at home."}, {"pred": "Sarah had written a note this morning.", "target": "Sarah had written a note this morning."}, {"pred": "Mark had became someone else over there.", "target": "Mark had become someone else over there."}, {"pred": "Roger had spoke very fast at home.", "target": "Roger had spoken very fast at home."}, {"pred": "Roger saw something last night.", "target": "Roger saw something last night."}, {"pred": "Mark spoke to me last night.", "target": "Mark spoke to me last night."}, {"pred": "Mark saw a shape some time ago.", "target": "Mark saw a shape some time ago."}, {"pred": "Alexander drew a picture last night.", "target": "Alexander drew a picture last night."}, {"pred": "Mark saw a bird over there.", "target": "Mark saw a bird over there."}, {"pred": "Mark grown quickly this morning.", "target": "Mark grew quickly this morning."}, {"pred": "Roger had given a book to a student over there.", "target": "Roger had given a book to a student over there."}, {"pred": "Roger had taken it last night.", "target": "Roger had taken it last night."}, {"pred": "Roger had came to the store last night.", "target": "Roger had come to the store last night."}, {"pred": "Roger knew a lot of things at home.", "target": "Roger knew a lot of things at home."}, {"pred": "Mark had given a book to a student last night.", "target": "Mark had given a book to a student last night."}, {"pred": "Alexander had written a note this morning.", "target": "Alexander had written a note this morning."}, {"pred": "Sarah took it at home.", "target": "Sarah took it at home."}, {"pred": "Roger took it over there.", "target": "Roger took it over there."}, {"pred": "Mark had chosen the good one some time ago.", "target": "Mark had chosen the good one some time ago."}, {"pred": "Roger had drew a picture this morning.", "target": "Roger had drawn a picture this morning."}, {"pred": "Sarah had chosen the good one some time ago.", "target": "Sarah had chosen the good one some time ago."}, {"pred": "Alexander written with a large pen some time ago.", "target": "Alexander wrote with a large pen some time ago."}, {"pred": "Mark grown quickly at home.", "target": "Mark grew quickly at home."}, {"pred": "Sarah had come to the store last night.", "target": "Sarah had come to the store last night."}, {"pred": "Mark wrote with a large pen at home.", "target": "Mark wrote with a large pen at home."}, {"pred": "Roger knew she could do it over there.", "target": "Roger knew she could do it over there."}, {"pred": "Sarah took a paper over there.", "target": "Sarah took a paper over there."}, {"pred": "Alexander knew a lot of things over there.", "target": "Alexander knew a lot of things over there."}, {"pred": "Sarah wrote a note this morning.", "target": "Sarah wrote a note this morning."}, {"pred": "Roger became someone else at home.", "target": "Roger became someone else at home."}, {"pred": "Alexander grew quickly at home.", "target": "Alexander grew quickly at home."}, {"pred": "Mark had seen a shape some time ago.", "target": "Mark had seen a shape some time ago."}, {"pred": "Alexander had spoke without thinking some time ago.", "target": "Alexander had spoken without thinking some time ago."}, {"pred": "Mark became angry some time ago.", "target": "Mark became angry some time ago."}, {"pred": "Roger spoke without thinking over there.", "target": "Roger spoke without thinking over there."}, {"pred": "Roger become angry this morning.", "target": "Roger became angry this morning."}, {"pred": "Mark had grown quickly this morning.", "target": "Mark had grown quickly this morning."}, {"pred": "Sarah had become angry some time ago.", "target": "Sarah had become angry some time ago."}, {"pred": "Alexander had became someone else last night.", "target": "Alexander had become someone else last night."}, {"pred": "Mark had spoke about many things last night.", "target": "Mark had spoken about many things last night."}, {"pred": "Sarah had became someone else last night.", "target": "Sarah had become someone else last night."}, {"pred": "Mark spoke to me some time ago.", "target": "Mark spoke to me some time ago."}, {"pred": "Alexander chose the best option at home.", "target": "Alexander chose the best option at home."}, {"pred": "Sarah had known a lot of things this morning.", "target": "Sarah had known a lot of things this morning."}, {"pred": "Sarah had knew she could do it this morning.", "target": "Sarah had known she could do it this morning."}, {"pred": "Sarah had given a book to a student at home.", "target": "Sarah had given a book to a student at home."}, {"pred": "Alexander had come when we needed her last night.", "target": "Alexander had come when we needed her last night."}, {"pred": "Sarah had grown quickly last night.", "target": "Sarah had grown quickly last night."}, {"pred": "Roger had given money to the man this morning.", "target": "Roger had given money to the man this morning."}, {"pred": "Alexander had taken it at home.", "target": "Alexander had taken it at home."}, {"pred": "Mark drew a picture last night.", "target": "Mark drew a picture last night."}, {"pred": "Alexander had spoke very fast some time ago.", "target": "Alexander had spoken very fast some time ago."}, {"pred": "Alexander had chose the good one this morning.", "target": "Alexander had chosen the good one this morning."}, {"pred": "Roger had taken them this morning.", "target": "Roger had taken them this morning."}, {"pred": "Sarah had seen a shape this morning.", "target": "Sarah had seen a shape this morning."}, {"pred": "Roger had drew a round circle some time ago.", "target": "Roger had drawn a round circle some time ago."}, {"pred": "Mark had knew she could do it over there.", "target": "Mark had known she could do it over there."}, {"pred": "Alexander spoke about many things over there.", "target": "Alexander spoke about many things over there."}, {"pred": "Sarah saw a shape at home.", "target": "Sarah saw a shape at home."}, {"pred": "Sarah knew she could do it last night.", "target": "Sarah knew she could do it last night."}, {"pred": "Sarah gave money to the man some time ago.", "target": "Sarah gave money to the man some time ago."}, {"pred": "Sarah took some food at home.", "target": "Sarah took some food at home."}, {"pred": "Mark come when we needed her this morning.", "target": "Mark came when we needed her this morning."}, {"pred": "Mark spoke very fast over there.", "target": "Mark spoke very fast over there."}, {"pred": "Mark became very different over there.", "target": "Mark became very different over there."}, {"pred": "Alexander had given money to the man last night.", "target": "Alexander had given money to the man last night."}, {"pred": "Mark had written with a large pen this morning.", "target": "Mark had written with a large pen this morning."}, {"pred": "Roger written a note some time ago.", "target": "Roger wrote a note some time ago."}, {"pred": "Alexander had written with a large pen this morning.", "target": "Alexander had written with a large pen this morning."}, {"pred": "Sarah had knew she could do it at home.", "target": "Sarah had known she could do it at home."}, {"pred": "Sarah had taken the bell this morning.", "target": "Sarah had taken the bell this morning."}, {"pred": "Sarah drew a round circle over there.", "target": "Sarah drew a round circle over there."}, {"pred": "Alexander grew quickly some time ago.", "target": "Alexander grew quickly some time ago."}, {"pred": "Sarah had written a note over there.", "target": "Sarah had written a note over there."}, {"pred": "Sarah had seen a shape over there.", "target": "Sarah had seen a shape over there."}, {"pred": "Roger had written a story at home.", "target": "Roger had written a story at home."}, {"pred": "Sarah had spoke to me this morning.", "target": "Sarah had spoken to me this morning."}, {"pred": "Alexander had chosen the best option at home.", "target": "Alexander had chosen the best option at home."}, {"pred": "Mark became angry last night.", "target": "Mark became angry last night."}, {"pred": "Alexander spoke very fast some time ago.", "target": "Alexander spoke very fast some time ago."}, {"pred": "Roger had spoke to me last night.", "target": "Roger had spoken to me last night."}, {"pred": "Roger had grown quickly over there.", "target": "Roger had grown quickly over there."}, {"pred": "Mark had taken the bell this morning.", "target": "Mark had taken the bell this morning."}, {"pred": "Mark come too late this morning.", "target": "Mark came too late this morning."}, {"pred": "Sarah drew a map some time ago.", "target": "Sarah drew a map some time ago."}, {"pred": "Mark written into a book last night.", "target": "Mark wrote into a book last night."}, {"pred": "Alexander became someone else last night.", "target": "Alexander became someone else last night."}, {"pred": "Roger had seen a bird some time ago.", "target": "Roger had seen a bird some time ago."}, {"pred": "Mark had drew a round circle over there.", "target": "Mark had drawn a round circle over there."}, {"pred": "Sarah had written a note last night.", "target": "Sarah had written a note last night."}, {"pred": "Sarah wrote a story some time ago.", "target": "Sarah wrote a story some time ago."}, {"pred": "Alexander chose the good one some time ago.", "target": "Alexander chose the good one some time ago."}, {"pred": "Mark had chose the best option over there.", "target": "Mark had chosen the best option over there."}, {"pred": "Roger wrote a story at home.", "target": "Roger wrote a story at home."}, {"pred": "Sarah came to the store at home.", "target": "Sarah came to the store at home."}, {"pred": "Alexander become angry this morning.", "target": "Alexander became angry this morning."}, {"pred": "Sarah drew a picture last night.", "target": "Sarah drew a picture last night."}, {"pred": "Alexander drew a picture this morning.", "target": "Alexander drew a picture this morning."}, {"pred": "Alexander had seen a bird over there.", "target": "Alexander had seen a bird over there."}, {"pred": "Roger drew a picture this morning.", "target": "Roger drew a picture this morning."}, {"pred": "Sarah had grown quickly over there.", "target": "Sarah had grown quickly over there."}, {"pred": "Roger had taken a paper at home.", "target": "Roger had taken a paper at home."}, {"pred": "Roger had written into a book some time ago.", "target": "Roger had written into a book some time ago."}, {"pred": "Sarah knew she could do it some time ago.", "target": "Sarah knew she could do it some time ago."}, {"pred": "Mark had come too late over there.", "target": "Mark had come too late over there."}, {"pred": "Alexander had taken the bell at home.", "target": "Alexander had taken the bell at home."}, {"pred": "Roger come when we needed her this morning.", "target": "Roger came when we needed her this morning."}, {"pred": "Roger had given something sweet to the baby some time ago.", "target": "Roger had given something sweet to the baby some time ago."}, {"pred": "Alexander had seen something some time ago.", "target": "Alexander had seen something some time ago."}, {"pred": "Mark wrote a note over there.", "target": "Mark wrote a note over there."}, {"pred": "Alexander took them some time ago.", "target": "Alexander took them some time ago."}, {"pred": "Sarah knew a lot of things last night.", "target": "Sarah knew a lot of things last night."}, {"pred": "Alexander chose the best option some time ago.", "target": "Alexander chose the best option some time ago."}, {"pred": "Mark had seen a shape this morning.", "target": "Mark had seen a shape this morning."}, {"pred": "Alexander saw something last night.", "target": "Alexander saw something last night."}, {"pred": "Alexander had come too late this morning.", "target": "Alexander had come too late this morning."}, {"pred": "Sarah grew quickly last night.", "target": "Sarah grew quickly last night."}, {"pred": "Roger had chosen the best option some time ago.", "target": "Roger had chosen the best option some time ago."}, {"pred": "Mark become angry over there.", "target": "Mark became angry over there."}, {"pred": "Alexander had grown quickly at home.", "target": "Alexander had grown quickly at home."}, {"pred": "Sarah chose the good one over there.", "target": "Sarah chose the good one over there."}, {"pred": "Roger saw a shape some time ago.", "target": "Roger saw a shape some time ago."}, {"pred": "Alexander knew a lot of things this morning.", "target": "Alexander knew a lot of things this morning."}, {"pred": "Roger knew a lot of things this morning.", "target": "Roger knew a lot of things this morning."}, {"pred": "Mark had taken it over there.", "target": "Mark had taken it over there."}, {"pred": "Alexander gave a book to a student at home.", "target": "Alexander gave a book to a student at home."}, {"pred": "Alexander had seen a shape over there.", "target": "Alexander had seen a shape over there."}, {"pred": "Sarah had grown quickly some time ago.", "target": "Sarah had grown quickly some time ago."}, {"pred": "Alexander wrote a story at home.", "target": "Alexander wrote a story at home."}, {"pred": "Roger came too late some time ago.", "target": "Roger came too late some time ago."}, {"pred": "Sarah had spoke to me some time ago.", "target": "Sarah had spoken to me some time ago."}, {"pred": "Roger come just in time some time ago.", "target": "Roger came just in time some time ago."}, {"pred": "Alexander had drew a map last night.", "target": "Alexander had drawn a map last night."}, {"pred": "Alexander drew a picture over there.", "target": "Alexander drew a picture over there."}, {"pred": "Mark knew she could do it this morning.", "target": "Mark knew she could do it this morning."}, {"pred": "Mark had come too late this morning.", "target": "Mark had come too late this morning."}, {"pred": "Mark took the bell at home.", "target": "Mark took the bell at home."}, {"pred": "Sarah had given money to the man last night.", "target": "Sarah had given money to the man last night."}, {"pred": "Roger had written into a book last night.", "target": "Roger had written into a book last night."}, {"pred": "Alexander had spoke to me over there.", "target": "Alexander had spoken to me over there."}, {"pred": "Roger had taken the bell this morning.", "target": "Roger had taken the bell this morning."}, {"pred": "Mark had spoke to me over there.", "target": "Mark had spoken to me over there."}, {"pred": "Roger grown quickly this morning.", "target": "Roger grew quickly this morning."}, {"pred": "Alexander had written a story some time ago.", "target": "Alexander had written a story some time ago."}, {"pred": "Sarah had knew a lot of things at home.", "target": "Sarah had known a lot of things at home."}, {"pred": "Roger had chosen the best option this morning.", "target": "Roger had chosen the best option this morning."}, {"pred": "Alexander had come too late last night.", "target": "Alexander had come too late last night."}, {"pred": "Alexander had seen a bird at home.", "target": "Alexander had seen a bird at home."}, {"pred": "Mark wrote a note this morning.", "target": "Mark wrote a note this morning."}, {"pred": "Roger had drew a picture at home.", "target": "Roger had drawn a picture at home."}, {"pred": "Sarah had come when we needed her this morning.", "target": "Sarah had come when we needed her this morning."}, {"pred": "Sarah gave a book to a student some time ago.", "target": "Sarah gave a book to a student some time ago."}, {"pred": "Mark wrote a story at home.", "target": "Mark wrote a story at home."}, {"pred": "Alexander written with a large pen at home.", "target": "Alexander wrote with a large pen at home."}, {"pred": "Mark had written a note this morning.", "target": "Mark had written a note this morning."}, {"pred": "Mark chose the best option this morning.", "target": "Mark chose the best option this morning."}, {"pred": "Roger had given a book to a student last night.", "target": "Roger had given a book to a student last night."}, {"pred": "Roger knew a lot of things over there.", "target": "Roger knew a lot of things over there."}, {"pred": "Sarah had seen a shape last night.", "target": "Sarah had seen a shape last night."}, {"pred": "Roger gave money to the man at home.", "target": "Roger gave money to the man at home."}, {"pred": "Mark had seen something at home.", "target": "Mark had seen something at home."}, {"pred": "Alexander had known a lot of things last night.", "target": "Alexander had known a lot of things last night."}, {"pred": "Roger gave something sweet to the baby this morning.", "target": "Roger gave something sweet to the baby this morning."}, {"pred": "Sarah had seen something some time ago.", "target": "Sarah had seen something some time ago."}, {"pred": "Sarah became someone else this morning.", "target": "Sarah became someone else this morning."}, {"pred": "Mark had spoke very fast some time ago.", "target": "Mark had spoken very fast some time ago."}, {"pred": "Roger had seen something last night.", "target": "Roger had seen something last night."}, {"pred": "Sarah had written a story this morning.", "target": "Sarah had written a story this morning."}, {"pred": "Sarah had spoke very fast this morning.", "target": "Sarah had spoken very fast this morning."}, {"pred": "Roger had written into a book at home.", "target": "Roger had written into a book at home."}, {"pred": "Alexander had drew a map over there.", "target": "Alexander had drawn a map over there."}, {"pred": "Alexander had drew a round circle at home.", "target": "Alexander had drawn a round circle at home."}, {"pred": "Alexander had written with a large pen at home.", "target": "Alexander had written with a large pen at home."}, {"pred": "Roger had written a note last night.", "target": "Roger had written a note last night."}, {"pred": "Sarah had drew a round circle at home.", "target": "Sarah had drawn a round circle at home."}, {"pred": "Alexander gave money to the man over there.", "target": "Alexander gave money to the man over there."}, {"pred": "Roger spoke without thinking this morning.", "target": "Roger spoke without thinking this morning."}, {"pred": "Sarah spoke without thinking over there.", "target": "Sarah spoke without thinking over there."}, {"pred": "Roger had grown quickly this morning.", "target": "Roger had grown quickly this morning."}, {"pred": "Roger had written a note at home.", "target": "Roger had written a note at home."}, {"pred": "Roger spoke without thinking last night.", "target": "Roger spoke without thinking last night."}, {"pred": "Sarah had become angry last night.", "target": "Sarah had become angry last night."}, {"pred": "Mark gave something sweet to the baby this morning.", "target": "Mark gave something sweet to the baby this morning."}, {"pred": "Sarah spoke to me this morning.", "target": "Sarah spoke to me this morning."}, {"pred": "Sarah had given a book to a student this morning.", "target": "Sarah had given a book to a student this morning."}, {"pred": "Mark had known a lot of things some time ago.", "target": "Mark had known a lot of things some time ago."}, {"pred": "Mark had knew a lot of things last night.", "target": "Mark had known a lot of things last night."}, {"pred": "Roger took them this morning.", "target": "Roger took them this morning."}, {"pred": "Mark drew a map last night.", "target": "Mark drew a map last night."}, {"pred": "Sarah had chose the best option this morning.", "target": "Sarah had chosen the best option this morning."}, {"pred": "Alexander took some food at home.", "target": "Alexander took some food at home."}, {"pred": "Sarah became someone else some time ago.", "target": "Sarah became someone else some time ago."}, {"pred": "Alexander gave a book to a student some time ago.", "target": "Alexander gave a book to a student some time ago."}, {"pred": "Roger took the bell some time ago.", "target": "Roger took the bell some time ago."}, {"pred": "Sarah had drew a map some time ago.", "target": "Sarah had drawn a map some time ago."}, {"pred": "Roger became very different this morning.", "target": "Roger became very different this morning."}, {"pred": "Mark took it over there.", "target": "Mark took it over there."}, {"pred": "Roger had chosen the good one over there.", "target": "Roger had chosen the good one over there."}, {"pred": "Sarah saw something last night.", "target": "Sarah saw something last night."}, {"pred": "Mark had come to the store last night.", "target": "Mark had come to the store last night."}, {"pred": "Sarah had drew a round circle some time ago.", "target": "Sarah had drawn a round circle some time ago."}, {"pred": "Mark chose the good one this morning.", "target": "Mark chose the good one this morning."}, {"pred": "Mark spoke very fast last night.", "target": "Mark spoke very fast last night."}, {"pred": "Roger had became someone else at home.", "target": "Roger had become someone else at home."}, {"pred": "Roger had grown quickly last night.", "target": "Roger had grown quickly last night."}, {"pred": "Mark had given a book to a student this morning.", "target": "Mark had given a book to a student this morning."}, {"pred": "Alexander had spoke very fast at home.", "target": "Alexander had spoken very fast at home."}, {"pred": "Roger chose the best option this morning.", "target": "Roger chose the best option this morning."}, {"pred": "Roger had seen a shape some time ago.", "target": "Roger had seen a shape some time ago."}, {"pred": "Mark spoke about many things at home.", "target": "Mark spoke about many things at home."}, {"pred": "Roger written into a book over there.", "target": "Roger wrote into a book over there."}, {"pred": "Sarah wrote a note over there.", "target": "Sarah wrote a note over there."}, {"pred": "Sarah grown quickly some time ago.", "target": "Sarah grew quickly some time ago."}, {"pred": "Roger had became someone else over there.", "target": "Roger had become someone else over there."}, {"pred": "Mark spoke without thinking over there.", "target": "Mark spoke without thinking over there."}, {"pred": "Sarah became someone else last night.", "target": "Sarah became someone else last night."}, {"pred": "Sarah knew a lot of things this morning.", "target": "Sarah knew a lot of things this morning."}, {"pred": "Sarah had knew she could do it over there.", "target": "Sarah had known she could do it over there."}, {"pred": "Mark had drew a map last night.", "target": "Mark had drawn a map last night."}, {"pred": "Sarah chose the good one this morning.", "target": "Sarah chose the good one this morning."}, {"pred": "Sarah wrote a story this morning.", "target": "Sarah wrote a story this morning."}, {"pred": "Sarah had written into a book over there.", "target": "Sarah had written into a book over there."}, {"pred": "Roger took a paper at home.", "target": "Roger took a paper at home."}, {"pred": "Mark had chose the best option at home.", "target": "Mark had chosen the best option at home."}, {"pred": "Mark saw a shape this morning.", "target": "Mark saw a shape this morning."}, {"pred": "Roger spoke very fast some time ago.", "target": "Roger spoke very fast some time ago."}, {"pred": "Mark saw something at home.", "target": "Mark saw something at home."}, {"pred": "Alexander come just in time last night.", "target": "Alexander came just in time last night."}, {"pred": "Sarah gave a book to a student this morning.", "target": "Sarah gave a book to a student this morning."}, {"pred": "Alexander chose the good one at home.", "target": "Alexander chose the good one at home."}, {"pred": "Roger saw a bird some time ago.", "target": "Roger saw a bird some time ago."}, {"pred": "Sarah written into a book some time ago.", "target": "Sarah wrote into a book some time ago."}, {"pred": "Alexander gave something sweet to the baby last night.", "target": "Alexander gave something sweet to the baby last night."}, {"pred": "Sarah had seen a bird at home.", "target": "Sarah had seen a bird at home."}, {"pred": "Sarah saw a shape this morning.", "target": "Sarah saw a shape this morning."}, {"pred": "Roger chose the good one this morning.", "target": "Roger chose the good one this morning."}, {"pred": "Mark came when we needed her over there.", "target": "Mark came when we needed her over there."}, {"pred": "Mark knew she could do it some time ago.", "target": "Mark knew she could do it some time ago."}, {"pred": "Sarah chose the best option this morning.", "target": "Sarah chose the best option this morning."}]}
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/island_effects/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/local_attractor/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/npi_licensing/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/quantifiers/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
baseline_random_split/seed_42/zeroshot_zorro_OFFICIAL/subject_verb_agreement/eval_results.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|