| --- |
| license: apache-2.0 |
| --- |
| # Implementation of ACL 2024 findings "Improving Grammatical Error Correction via Contextual Data Augmentation" |
|
|
| [github link](https://github.com/wyxstriker/CDA4GEC) |
|
|
| # Model Weights |
| We release the model weights of each training stage. |
| Our model is trained based on the Fairseq framework, details of the weights and links to them are below. |
|
|
| |Name|Data Info|Download Link| |
| |:--:|--|--| |
| |Stage1|Pre-training on [C4 synthetic data](https://github.com/google-research-datasets/C4_200M-synthetic-dataset-for-grammatical-error-correction) with 200M scale|[CDA4GEC](https://huggingface.co/DecoderImmortal/CDA4GEC)/tree/main/stage1_checkpoint_best.pt| |
| |Stage2+|Fine-tuning on the augmented Lang8, NUCLE, FCE and W&I+L datasets|[CDA4GEC](https://huggingface.co/DecoderImmortal/CDA4GEC)/tree/main/stage2_checkpoint_best.pt| |
| |Stage3+|Continue fine-tuning on the augmented W&I+L dataset|[CDA4GEC](https://huggingface.co/DecoderImmortal/CDA4GEC)/tree/main/stage3_checkpoint_best.pt| |
|
|
| # Synthetic Data |
| > We only release the synthetic pseudo-data, please follow the official process to apply for the original annotated data. |
|
|
|
|
| |DataInfo|Amount|Source|Path| |
| |:--:|:--:|:--:|:--:| |
| |stage2+|2M|Lang-8 & NUCLE & FCE & W&I+L|[CDA4GEC](https://huggingface.co/DecoderImmortal/CDA4GEC)/tree/main/pseudo/stage2| |
| |stage3+|200K|W&I+L|[CDA4GEC](https://huggingface.co/DecoderImmortal/CDA4GEC)/tree/main/pseudo/stage3| |
|
|
| # Citation |
| If you find this work is useful for your research, please cite our paper: |
|
|
| ``` |
| @inproceedings{wang-etal-2024-improving-grammatical, |
| title = "Improving Grammatical Error Correction via Contextual Data Augmentation", |
| author = "Wang, Yixuan and |
| Wang, Baoxin and |
| Liu, Yijun and |
| Zhu, Qingfu and |
| Wu, Dayong and |
| Che, Wanxiang", |
| editor = "Ku, Lun-Wei and |
| Martins, Andre and |
| Srikumar, Vivek", |
| booktitle = "Findings of the Association for Computational Linguistics ACL 2024", |
| month = aug, |
| year = "2024", |
| address = "Bangkok, Thailand and virtual meeting", |
| publisher = "Association for Computational Linguistics", |
| url = "https://aclanthology.org/2024.findings-acl.647", |
| pages = "10898--10910", |
| } |
| ``` |
|
|
