Fetching the paper…
Reading the bibliography…
In this paper, we investigate improvements to the GEC sequence tagging architecture with a focus on ensembling of recent cutting-edge Transformer-based encoders in Large configurations.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
Huggingface’s transformers: State-of-the-art natural language processing
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. 2019 · 1910
Earlier work this paper cites.
Effects of age and gender on blogging
Jonathan Schler, Moshe Koppel, Shlomo Argamon, and James W. Pennebaker. 2005 · 2005
Earlier work this paper cites.
Deberta: Decoding-enhanced bert with disentangled attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2020 · 2006
Earlier work this paper cites.
A new dataset and method for automatically grading esol texts
Helen Yannakoudakis, Ted Briscoe, and Ben Medlock. 2011 · 2011
Earlier work this paper cites.
Tense and aspect error correction for esl learners using global context
Toshikazu Tajiri, Mamoru Komachi, and Yuji Matsumoto. 2012 · 2012
Earlier work this paper cites.
One billion word benchmark for measuring progress in statistical language modeling
Ciprian Chelba, Tomás Mikolov, Mike Schuster, Qi Ge, Thorsten Brants, and Phillipp Koehn. 2013 · 2013
Earlier work this paper cites.
Building a large annotated corpus of learner english: The nus corpus of learner english
Daniel Dahlmeier, Hwee Tou Ng, and Siew Mei Wu. 2013 · 2013
Earlier work this paper cites.
Constrained grammatical error correction using statistical machine translation
Zheng Yuan and Mariano Felice. 2013 · 2013
Earlier work this paper cites.
Adam (2014), a method for stochastic optimization
Diederik P Kingma and Jimmy Ba. 2015 · 2014
Earlier work this paper cites.
Distilling the knowledge in a neural network
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015 · 2015
Earlier work this paper cites.
Sequence-level knowledge distillation
Yoon Kim and Alexander M. Rush. 2016 · 2016
Earlier work this paper cites.
Neural machine translation of rare words with subword units
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016 · 2016
Earlier work this paper cites.
Grammatical error correction using neural machine translation
Zheng Yuan and Ted Briscoe. 2016 · 2016
Cited alongside, same era.
Automatic annotation and evaluation of error types for grammatical error correction
Christopher Bryant, Mariano Felice, and Ted Briscoe. 2017 · 2017
Cited alongside, same era.
Allennlp: A deep semantic natural language processing platform
Matt Gardner, Joel Grus, Mark Neumann, Oyvind Tafjord, Pradeep Dasigi, Nelson F. Liu, Matthew Peters, Michael Schmitz, and Luke S. Zettlemoyer. 2017 · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Cited alongside, same era.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2018 · 2018
Cited alongside, same era.
Parallel iterative edit models for local sequence transduction
An empirical study of incorporating pseudo data into grammatical error correction
Shun Kiyono, Jun Suzuki, Masato Mita, Tomoya Mizumoto, and Kentaro Inui. 2019 · 2019
Later among the works it cites.
Corpora generation for grammatical error correction
Jared Lichtarge, Christopher Alberti, Shankar Kumar, Noam Shazeer, Niki Parmar, and Simon Tong. 2019 · 2019
Later among the works it cites.
Encode, tag, realize: High-precision text editing
Eric Malmi, Sebastian Krause, Sascha Rothe, Daniil Mirylenka, and Aliaksei Severyn. 2019 · 2019
Later among the works it cites.
Xlnet: Generalized autoregressive pretraining for language understanding
Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, and Quoc V. Le. 2019 · 2019
Later among the works it cites.
Encoder-decoder models can benefit from pre-trained masked language models in grammatical error correction
Masahiro Kaneko, Masato Mita, Shun Kiyono, Jun Suzuki, and Kentaro Inui. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Abhijeet Awasthi, Sunita Sarawagi, Rasna Goyal, Sabyasachi Ghosh, and Vihari Piratla. 2019 · 2019
Cited alongside, same era.
Parallel iterative edit models for local sequence transduction
Abhijeet Awasthi, Sunita Sarawagi, Rasna Goyal, Sabyasachi Ghosh, and Vihari Piratla. 2019 · 2019
Cited alongside, same era.
The BEA-2019 shared task on grammatical error correction
Christopher Bryant, Mariano Felice, Øistein E. Andersen, and Ted Briscoe. 2019 · 2019
Cited alongside, same era.
The bea-2019 shared task on grammatical error correction
Christopher Bryant, Mariano Felice, Øistein E. Andersen, and Ted Briscoe. 2019 · 2019
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina N. Toutanova. 2018 · 2019
Cited alongside, same era.
Neural grammatical error correction systems with unsupervised pre-training on synthetic data
Roman Grundkiewicz, Marcin Junczys-Dowmunt, and Kenneth Heafield. 2019 · 2019
Cited alongside, same era.
An empirical study of incorporating pseudo data into grammatical error correction
Shun Kiyono, Jun Suzuki, Masato Mita, Tomoya Mizumoto, and Kentaro Inui. 2019 · 2019
Cited alongside, same era.
Albert: A lite bert for self-supervised learning of language representations
Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2020 · 2020
Later among the works it cites.
Bert enhanced neural machine translation and sequence tagging model for chinese grammatical error diagnosis
Deng Liang, Chen Zheng, Lei Guo, Xin Cui, Xiuzhang Xiong, Hengqiao Rong, and Jinpeng Dong. 2020 · 2020
Later among the works it cites.
Gector – grammatical error correction: Tag, not rewrite
Kostiantyn Omelianchuk, Vitaliy Atrasevych, Artem N. Chernodub, and Oleksandr Skurzhanskyi. 2020 · 2020
Later among the works it cites.
A Simple Recipe for Multilingual Grammatical Error Correction
Sascha Rothe, Jonathan Mallinson, Eric Malmi, Sebastian Krause, and Aliaksei Severyn. 2021 · 2021
Later among the works it cites.
Synthetic data generation for grammatical error correction with tagged corruption models
Felix Stahlberg and Shankar Kumar. 2021 · 2021
Later among the works it cites.
Improving sequence tagging for grammatical error correction
Maksym Tarnavskyi. 2021 · 2021
Later among the works it cites.
mT5: A massively multilingual pre-trained text-to-text transformer
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, and Colin Raffel. 2021 · 2021
Later among the works it cites.