Chinese Grammatical Correction Using BERT-based Pre-trained Model

Distributed representations of words and phrases and their compositionality

Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013 · 2013

Earlier work this paper cites.

The CoNLL-2013 shared task on grammatical error correction

Hwee Tou Ng, Siew Mei Wu, Yuanbin Wu, Christian Hadiwinoto, and Joel Tetreault. 2013 · 2013

Earlier work this paper cites.

The CoNLL-2014 shared task on grammatical error correction

Hwee Tou Ng, Siew Mei Wu, Ted Briscoe, Christian Hadiwinoto, Raymond Hendy Susanto, and Christopher Bryant. 2014 · 2014

Earlier work this paper cites.

Phrase structure annotation and parsing for learner English

Ryo Nagata and Keisuke Sakaguchi. 2016 · 2016

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

A multilayer convolutional encoder-decoder neural network for grammatical error correction

Shamil Chollampatt and Hwee Tou Ng. 2018 · 2018

Earlier work this paper cites.

Youdao’s winning solution to the NLPCC-2018 task 2 challenge: A neural machine translation approach to Chinese grammatical error correction

Kai Fu, Jun Huang, and Yitao Duan. 2018 · 2018

Earlier work this paper cites.

Approaching neural grammatical error correction as a low-resource machine translation task

Marcin Junczys-Dowmunt, Roman Grundkiewicz, Shubha Guha, and Kenneth Heafield. 2018 · 2018

Cited alongside, same era.

A sequence to sequence learning for Chinese grammatical error correction

Hongkai Ren, Liner Yang, and Endong Xun. 2018 · 2018

Cited alongside, same era.

Overview of the NLPCC 2018 shared task: Grammatical error correction

Yuanyuan Zhao, Nan Jiang, Weiwei Sun, and Xiaojun Wan. 2018 · 2018

Cited alongside, same era.

Chinese grammatical error correction using statistical and neural models

Junpei Zhou, Chen Li, Hengyou Liu, Zuyi Bao, Guangwei Xu, and Linlin Li. 2018 · 2018

Cited alongside, same era.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

Learning to combine grammatical error corrections

RoBERTa: A robustly optimized BERT pretraining approach

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke S. Zettlemoyer, and Veselin Stoyanov. 2019 · 2019

Later among the works it cites.

ERNIE: Enhanced language representation with informative entities

Zhengyan Zhang, Xu Han, Zhiyuan Liu, Xin Jiang, Maosong Sun, and Qun Liu. 2019 · 2019

Later among the works it cites.

Revisiting pre-trained models for Chinese natural language processing

Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Shijin Wang, and Guoping Hu. 2020 · 2020

Closest in time.

Encoder-decoder models can benefit from pre-trained masked language models in grammatical error correction

Masahiro Kaneko, Masato Mita, Shun Kiyono, Jun Suzuki, and Kentaro Inui. 2020 · 2020

Closest in time.

MaskGEC: Improving neural grammatical error correction via dynamic masking

Zewei Zhao and Houfeng Wang. 2020 · 2020

Closest in time.