2019

Tree-Transformer: A Transformer-Based Method for Correction of Tree-Structured Data

Harer, Jacob, Reale, Chris, Chin, Peter

Understand

Many common sequential data sources, such as source code and natural language, have a natural tree-structured representation.

These trees can be generated by fitting a sequence to a grammar, yielding a hierarchical ordering of the tokens in the sequence.
This structure encodes a high degree of syntactic information, making it ideal for problems such as grammar correction.
However, little work has been done to develop neural networks that can operate on and exploit tree-structured data.

Built on

Learning task-dependent distributed representations by backpropagation through structure
C. Goller and A. Kuchler · 1996
Earlier work this paper cites.
Accurate unlexicalized parsing
D. Klein and C. Manning · 2003
Earlier work this paper cites.
LLVM - A Compilation Framework for Lifelong Program Analysis & Transformation
C. Lattner and V. S. Adve · 2004
Earlier work this paper cites.
Parsing Natural Scenes and Natural Language with Recursive Neural Networks
R. Socher, C. C.-Y. Lin, A. Y. Ng, and C. D. Manning · 2011
Earlier work this paper cites.
clang.llvm.org , 2011
Clang library · 2011
Earlier work this paper cites.
Building a Large Annotated Corpus of Learner English - The NUS Corpus of Learner English
D. Dahlmeier, H. T. Ng, and S. M. Wu · 2013
Earlier work this paper cites.
Report on the static analysis tool exposition (sate) iv
V. Okun, A. Delaitre, and P. Black · 2013
Earlier work this paper cites.
Parsing with compositional vector grammars
R. Socher, J. Bauer, and A. Y. Manning, Christopher D.and Ng · 2013
Earlier work this paper cites.
https://github.com/nusnlp/m2scorer/releases , 2014
Offical scorer for conll 2014 shared task · 2014
Earlier work this paper cites.
A fast and accurate dependency parser using neural networks
D. Chen and C. D. Manning · 2014
Earlier work this paper cites.
https://nlp.stanford.edu/software/srparser.html , 2014
Shift-reduce constituency parser · 2014
Earlier work this paper cites.
The conll-2014 shared task on grammatical error correction
H. Ng, S. Wu, T. Briscoe, C. Hadiwinoto, R. Susanto, and C. Bryant · 2014
Earlier work this paper cites.
Neural Machine Translation by Jointly Learning to Align and Translate
D. Bahdanau, K. Cho, and Y. Bengio · 2015
Earlier work this paper cites.
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
K. S. Tai, R. Socher, and C. D. Manning · 2015
Earlier work this paper cites.
Long Short-Term Memory Over Tree Structures
X. Zhu, P. Sobhani, and H. Guo · 2015
Earlier work this paper cites.
Grammar as a Foreign Language
O. Vinyals, L. Kaiser, T. Koo, S. Petrov, I. Sutskever, and G. Hinton · 2015
Earlier work this paper cites.

Similar

https://pypi.org/project/apted/ , 2015
Apted python library · 2015
Cited alongside, same era.
Efficient computation of the tree edit distance
M. Pawlik and N. Augsten · 2015
Cited alongside, same era.
Neural Language Correction with Character-Based Attention
Z. Xie, A. Avati, N. Arivazhagan, D. Jurafsky, and A. Y. Ng · 2016
Cited alongside, same era.
Grammatical error correction using neural machine translation
Z. Yuan and T. Briscoe · 2016
Cited alongside, same era.
Tree-to-Sequence Attentional Neural Machine Translation
A. Eriguchi, K. Hashimoto, and Y. Tsuruoka · 2016
Cited alongside, same era.
Language to Logical Form with Neural Attention
L. Dong and M. Lapata · 2016
Cited alongside, same era.
Top-down Tree Long Short-Term Memory Networks
X. Zhang, L. Lu, and M. Lapata · 2016
Cited alongside, same era.
History driven program repair
X. B. D. Le, D. Lo, and C. Le Goues · 2016
Cited alongside, same era.
Automatic patch generation by learning correct code
F. Long and M. Rinard · 2016
Cited alongside, same era.
Phrase-based Machine Translation is State-of-the-Art for Automatic Grammatical Error Correction
M. Junczys-Dowmunt and R. Grundkiewicz · 2016
Cited alongside, same era.
https://web.archive.org/web/20130517134339/http://bulba.sdsu.edu/jeanette/thesis/PennTags.html , 2016
Penn treebank ii tags · 2016
Cited alongside, same era.
A report on the automatic evaluation of scientific writing shared task
V. Daudaravicius, R. Banchs, E. Volodine, and C. Napoles · 2016
Cited alongside, same era.

Then

Tree-structured decoding with doubly-recurrent neural networks
D. A.-M. . T. S. Jaakkola · 2017
Later among the works it cites.
Towards String-to-Tree Neural Machine Translation
R. Aharoni and Y. Goldberg · 2017
Later among the works it cites.
Abstract Syntax Networks for Code Generation and Semantic Parsing
M. Rabinovich, M. Stern, and D. Klein · 2017
Later among the works it cites.
Neuro-Symbolic Program Synthesis
E. Parisotto, A.-r. Mohamed, R. Singh, L. Li, D. Zhou, and P. Kohli · 2017
Later among the works it cites.
A Syntactic Neural Model for General-Purpose Code Generation
P. Yin and G. Neubig · 2017
Later among the works it cites.
Semantic Code Repair using Neuro-Symbolic Transformation Networks
Original
Devlin, Jacob, Uesato, Jonathan, Singh, Rishabh, and Kohli, Pushmeet · 2017
Later among the works it cites.
Deepfix: Fixing common c language errors by deep learning
R. Gupta, S. Pal, A. Kanade, and S. Shevade · 2017
Later among the works it cites.
Connecting the Dots: Towards Human-Level Grammatical Error Correction
S. Chollampatt and H. T. Ng · 2017
Later among the works it cites.
A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction
S. Chollampatt and H. T. Ng · 2018
Later among the works it cites.
Approach neural grammatical error correction as a low-resource machine translation task
M. Junczys-Dowmunt, R. Grundkiewicz, S. Guha, and K. Heafield · 2018
Later among the works it cites.
Tree-to-tree Neural Networks for Program Translation
X. Chen, C. Liu, and D. Song · 2018
Later among the works it cites.
Tree2tree neural translation model for learning source code changes
S. Chakraborty, M. Allamanis, and B. Ray · 2018
Later among the works it cites.
Automatic software repair: A bibliography
M. Monperrus · 2018
Later among the works it cites.
Learning to Repair Software Vulnerabilities with Generative Adversarial Networks
J. Harer, O. Ozdemir, T. Lazovich, C. P. Reale, R. L. Russell, L. Y. Kim, and P. Chin · 2018
Later among the works it cites.
BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languages
B. Heinzerling and M. Strube · 2018
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…