2021

Exploring Dynamic Selection of Branch Expansion Orders for Code Generation

Jiang, Hui, Zhou, Chulun, Meng, Fandong et al.

Understand

Due to the great potential in facilitating software development, code generation has attracted increasing attention recently.

Generally, dominant models are Seq2Tree models, which convert the input natural language description into a sequence of tree-construction actions corresponding to the pre-order traversal of an Abstract Syntax Tree (AST).
However, such a traversal order may not be suitable for handling all multi-branch nodes.
In this paper, we propose to equip the Seq2Tree model with a context-based Branch Selector, which is able to dynamically determine optimal expansion orders of branches for multi-branch nodes.

Built on

Simple statistical gradient-following algorithms for connectionist reinforcement learning
Ronald J. Williams. 1992 · 1992
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Original
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015
Earlier work this paper cites.
Learning to generate pseudo-code from source code using statistical machine translation
Yusuke Oda, Hiroyuki Fudaba, Graham Neubig, Hideaki Hata, Sakriani Sakti, Tomoki Toda, and Satoshi Nakamura. 2015 · 2015
Earlier work this paper cites.
Language to logical form with neural attention
Li Dong and Mirella Lapata. 2016 · 2016
Earlier work this paper cites.
Latent predictor networks for code generation
Wang Ling, Phil Blunsom, Edward Grefenstette, Karl Moritz Hermann, and Andrew Senior. 2016 · 2016
Earlier work this paper cites.
Tree-structured decoding with doubly-recurrent neural networks
David Alvarez-Melis and Tommi S. Jaakkola. 2017 · 2017
Earlier work this paper cites.
Abstract syntax networks for code generation and semantic parsing
Maxim Rabinovich, Mitchell Stern, and Dan Klein. 2017 · 2017
Earlier work this paper cites.
Self-critical sequence training for image captioning
Steven J. Rennie, Etienne Marcheret, Youssef Mroueh, Jerret Ross, and Vaibhava Goel. 2017 · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
A syntactic neural model for general-purpose code generation
Pengcheng Yin and Graham Neubig. 2017 · 2017
Earlier work this paper cites.

Similar

Coarse-to-fine decoding for neural semantic parsing
Li Dong and Mirella Lapata. 2018 · 2018
Cited alongside, same era.
Retrieval-based neural code generation
Shirley Anugrah Hayati, Raphael Olivier, Pravalika Avvaru, Pengcheng Yin, Anthony Tomasic, and Graham Neubig. 2018 · 2018
Cited alongside, same era.
Skipnet: Learning dynamic routing in convolutional networks
Xin Wang, Fisher Yu, Zi-Yi Dou, Trevor Darrell, and Joseph E. Gonzalez. 2018 · 2018
Cited alongside, same era.
Learning to mine aligned code and natural language pairs from stack overflow
Pengcheng Yin, Bowen Deng, Edgar Chen, Bogdan Vasilescu, and Graham Neubig. 2018 · 2018
Cited alongside, same era.
Tranx: A transition-based neural abstract syntax parser for semantic parsing and code generation
Pengcheng Yin and Graham Neubig. 2018 · 2018
Cited alongside, same era.
Asynchronous bidirectional decoding for neural machine translation
Xiangwen Zhang, Jinsong Su, Yue Qin, Yang Liu, Rongrong Ji, and Hongji Wang. 2018 · 2018
Cited alongside, same era.
Program synthesis and semantic parsing with learned code idioms
Eui Chul Shin, Miltiadis Allamanis, Marc Brockschmidt, and Alex Polozov. 2019 · 2019
Cited alongside, same era.
Insertion transformer: Flexible sequence generation via insertion operations
Mitchell Stern, William Chan, Jamie Kiros, and Jakob Uszkoreit. 2019 · 2019
Cited alongside, same era.
Exploiting reverse target-side contexts for neural machine translation via asynchronous bidirectional decoding
Jinsong Su, Xiangwen Zhang, Qian Lin, Yue Qin, Junfeng Yao, and Yang Liu. 2019 · 2019
Cited alongside, same era.
Insertion-based decoding with automatically inferred generation order
Jiatao Gu, Qi Liu, and Kyunghyun Cho. 2019a
Cited in the paper.
Levenshtein transformer
Jiatao Gu, Changhan Wang, and Junbo Zhao. 2019b
Cited in the paper.

Then

A grammar-based structural cnn decoder for code generation
Zeyu Sun, Qihao Zhu, Lili Mou, Yingfei Xiong, Ge Li, and Lu Zhang. 2019 · 2019
Later among the works it cites.
Code generation as a dual task of code summarization
Bolin Wei, Ge Li, Xin Xia, Zhiyi Fu, and Zhi Jin. 2019 · 2019
Later among the works it cites.
Non-monotonic sequential text generation
Sean Welleck, Kianté Brantley, Hal Daumé III, and Kyunghyun Cho. 2019 · 2019
Later among the works it cites.
Reranking for neural semantic parsing
Pengcheng Yin and Graham Neubig. 2019 · 2019
Later among the works it cites.
Future-aware knowledge distillation for neural machine translation
Biao Zhang, Deyi Xiong, Jinsong Su, and Jiebo Luo. 2019 · 2019
Later among the works it cites.
Dynamic context selection for document-level neural machine translation via reinforcement learning
Xiaomian Kang, Yang Zhao, Jiajun Zhang, and Chengqing Zong. 2020 · 2020
Later among the works it cites.
Treegen: A tree-based transformer architecture for code generation
Zeyu Sun, Qihao Zhu, Yingfei Xiong, Yican Sun, Lili Mou, and Lu Zhang. 2020 · 2020
Later among the works it cites.
Incorporating external knowledge through pre-training for natural language to code generation
Frank F. Xu, Zhengbao Jiang, Pengcheng Yin, Bogdan Vasilescu, and Graham Neubig. 2020 · 2020
Later among the works it cites.
Improving tree-structured decoder training for code generation via mutual learning
Original
Binbin Xie, Xiang Li, Yubin Ge, Jianwei Cui, Junfeng Yao, Bin Wang, and Jinsong Su. 2021 · 2021
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…