2019

On Learning Meaningful Code Changes via Neural Machine Translation

Tufano, Michele, Pantiuchina, Jevgenija, Watson, Cody et al.

Understand

Recent years have seen the rise of Deep Learning (DL) techniques applied to source code.

Researchers have exploited DL to automate several development and maintenance tasks, such as writing commit messages, generating comments and detecting vulnerabilities among others.
One of the long lasting dreams of applying DL to source code is the possibility to automate non-trivial coding activities.
While some steps in this direction have been taken (e.g., learning how to fix bugs), there is still a glaring lack of empirical evidence on the types of code changes that can be learned and automatically applied by DL.

Built on

S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput. , vol. 9, no. 8, pp. 1735–1780, Nov. 1997. [Online]. Available: http://dx.doi.org/10.1162/neco.1997.9.8.1735
1997
Earlier work this paper cites.
E. W. Høst and B. M. Østvold, “Debugging method names,” in ECOOP 2009 – Object-Oriented Programming , S. Drossopoulou, Ed. Berlin, Heidelberg: Springer Berlin Heidelberg, 2009, pp. 294–317
2009
Earlier work this paper cites.
N. Kalchbrenner and P. Blunsom, “Recurrent continuous translation models,” in Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing . Seattle, Washington, USA: Association for Computational Linguistics, October 2013, pp. 1700–1709. [Online]. Available: http://www.aclweb.org/anthology/D13-1176
2013
Earlier work this paper cites.
T. Parr, The Definitive ANTLR 4 Reference , 2nd ed. Pragmatic Bookshelf, 2013
2013
Earlier work this paper cites.
E. Wong, J. Yang, and L. Tan, “Autocomment: Mining question and answer sites for automatic comment generation,” in 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE) , Nov 2013, pp. 562–567
2013
Earlier work this paper cites.
D. Bahdanau, K. Cho, and Y. Bengio, “Neural machine translation by jointly learning to align and translate,” CoRR , vol. abs/1409.0473, 2014. [Online]. Available: http://arxiv.org/abs/1409.0473
Original
2014
Earlier work this paper cites.
K. Cho, B. van Merrienboer, Ç. Gülçehre, F. Bougares, H. Schwenk, and Y. Bengio, “Learning phrase representations using RNN encoder-decoder for statistical machine translation,” CoRR , vol. abs/1406.1078, 2014. [Online]. Available: http://arxiv.org/abs/1406.1078
Original
2014
Earlier work this paper cites.
J. Falleri, F. Morandat, X. Blanc, M. Martinez, and M. Monperrus, “Fine-grained and accurate source code differencing,” in ACM/IEEE International Conference on Automated Software Engineering, ASE ’14 , 2014, pp. 313–324
2014
Earlier work this paper cites.
V. Raychev, M. Vechev, and E. Yahav, “Code completion with statistical language models,” in Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation , ser. PLDI ’14. New York, NY, USA: ACM, 2014, pp. 419–428. [Online]. Available: http://doi.acm.org/10.1145/2594291.2594321
2014
Earlier work this paper cites.
I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to sequence learning with neural networks,” CoRR , vol. abs/1409.3215, 2014. [Online]. Available: http://arxiv.org/abs/1409.3215
Original
2014
Earlier work this paper cites.
M. Allamanis, E. T. Barr, C. Bird, and C. Sutton, “Suggesting accurate method and class names,” in Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering , ser. ESEC/FSE 2015. New York, NY, USA: ACM, 2015, pp. 38–49. [Online]. Available: http://doi.acm.org/10.1145/2786805.2786849
2015
Earlier work this paper cites.
——, “Suggesting accurate method and class names,” in Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering , ser. ESEC/FSE 2015. New York, NY, USA: ACM, 2015, pp. 38–49. [Online]. Available: http://doi.acm.org/10.1145/2786805.2786849
2015
Earlier work this paper cites.
C. S. Corley, K. Damevski, and N. A. Kraft, “Exploring the use of deep learning for feature location,” in 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME) , Sept 2015, pp. 556–560
2015
Earlier work this paper cites.
A. N. Lam, A. T. Nguyen, H. A. Nguyen, and T. N. Nguyen, “Combining deep learning with information retrieval to localize buggy files for bug reports (n),” in 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) , Nov 2015, pp. 476–481
2015
Earlier work this paper cites.
M. Luong, H. Pham, and C. D. Manning, “Effective approaches to attention-based neural machine translation,” CoRR , vol. abs/1508.04025, 2015. [Online]. Available: http://arxiv.org/abs/1508.04025
Original
2015
Earlier work this paper cites.
M. White, C. Vendome, M. Linares-Vásquez, and D. Poshyvanyk, “Toward deep learning software repositories,” in Proceedings of the 12th Working Conference on Mining Software Repositories , ser. MSR ’15. Piscataway, NJ, USA: IEEE Press, 2015, pp. 334–345. [Online]. Available: http://dl.acm.org/citation.cfm?id=2820518.2820559
2015
Earlier work this paper cites.

Similar

C. V. Alexandru, “Guided code synthesis using deep neural networks,” in Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering , ser. FSE 2016. New York, NY, USA: ACM, 2016, pp. 1068–1070. [Online]. Available: http://doi.acm.org/10.1145/2950290.2983951
2016
Cited alongside, same era.
M. Allamanis, H. Peng, and C. A. Sutton, “A convolutional attention network for extreme summarization of source code,” CoRR , vol. abs/1602.03001, 2016. [Online]. Available: http://arxiv.org/abs/1602.03001
Original
2016
Cited alongside, same era.
H. K. Dam, T. Tran, J. Grundy, and A. Ghose, “Deepsoft: A vision for a deep model of software,” in Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering , ser. FSE 2016. New York, NY, USA: ACM, 2016, pp. 944–947. [Online]. Available: http://doi.acm.org/10.1145/2950290.2983985
2016
Cited alongside, same era.
X. Gu, H. Zhang, D. Zhang, and S. Kim, “Deep api learning,” in Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering , ser. FSE 2016. New York, NY, USA: ACM, 2016, pp. 631–642. [Online]. Available: http://doi.acm.org/10.1145/2950290.2950334
2016
Cited alongside, same era.
H. Mi, Z. Wang, and A. Ittycheriah, “Vocabulary manipulation for neural machine translation,” CoRR , vol. abs/1605.03209, 2016. [Online]. Available: http://arxiv.org/abs/1605.03209
Original
2016
Cited alongside, same era.
S. Scalabrino, M. Linares-Vásquez, D. Poshyvanyk, and R. Oliveto, “Improving code readability models with textual features,” in 2016 IEEE 24th International Conference on Program Comprehension (ICPC) , May 2016
2016
Cited alongside, same era.
S. Wang, T. Liu, and L. Tan, “Automatically learning semantic features for defect prediction,” in Proceedings of the 38th International Conference on Software Engineering , ser. ICSE ’16. New York, NY, USA: ACM, 2016, pp. 297–308. [Online]. Available: http://doi.acm.org/10.1145/2884781.2884804
2016
Cited alongside, same era.
M. White, M. Tufano, C. Vendome, and D. Poshyvanyk, “Deep learning code fragments for code clone detection,” in Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering , ser. ASE 2016. New York, NY, USA: ACM, 2016, pp. 87–98. [Online]. Available: http://doi.acm.org/10.1145/2970276.2970326
2016
Cited alongside, same era.
Y. Wu, M. Schuster, Z. Chen, Q. V. Le, M. Norouzi, W. Macherey, M. Krikun, Y. Cao, Q. Gao, K. Macherey, J. Klingner, A. Shah, M. Johnson, X. Liu, L. Kaiser, S. Gouws, Y. Kato, T. Kudo, H. Kazawa, K. Stevens, G. Kurian, N. Patil, W. Wang, C. Young, J. Smith, J. Riesa, A. Rudnick, O. Vinyals, G. Corrado, M. Hughes, and J. Dean, “Google’s neural machine translation system: Bridging the gap between human and machine translation,” CoRR , vol. abs/1609.08144, 2016. [Online]. Available: http://arxiv.org/abs/1609.08144
Original
2016
Cited alongside, same era.
J. Berkman, “Machine learning vs. deep learning,” August 2018, [Online; posted 22-August-2017]. [Online]. Available: https://www.datascience.com/blog/machine-learning-and-deep-learning-what-is-the-difference
2017
Cited alongside, same era.
D. Britz, A. Goldie, M. Luong, and Q. V. Le, “Massive exploration of neural machine translation architectures,” CoRR , vol. abs/1703.03906, 2017. [Online]. Available: http://arxiv.org/abs/1703.03906
Original
2017
Cited alongside, same era.
J. Deshmukh, A. K. M, S. Podder, S. Sengupta, and N. Dubash, “Towards accurate duplicate bug retrieval using deep learning techniques,” in 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME) , Sept 2017, pp. 115–124
2017
Cited alongside, same era.

Then

Z. Han, X. Li, Z. Xing, H. Liu, and Z. Feng, “Learning to predict severity of software vulnerability using only vulnerability description,” in 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME) , Sept 2017, pp. 125–136
2017
Later among the works it cites.
S. Jiang, A. Armaly, and C. McMillan, “Automatically generating commit messages from diffs using neural machine translation,” in 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) , Oct 2017, pp. 135–146
2017
Later among the works it cites.
S.-R. Lee, M.-J. Heo, C.-G. Lee, M. Kim, and G. Jeong, “Applying deep learning based automatic bug triager to industrial projects,” in Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering , ser. ESEC/FSE 2017. New York, NY, USA: ACM, 2017, pp. 926–931. [Online]. Available: http://doi.acm.org/10.1145/3106237.3117776
2017
Later among the works it cites.
L. Li, H. Feng, W. Zhuang, N. Meng, and B. Ryder, “Cclearner: A deep learning-based clone detection approach,” in 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME) , Sept 2017, pp. 249–260
2017
Later among the works it cites.
S. Romansky, N. C. Borle, S. Chowdhury, A. Hindle, and R. Greiner, “Deep green: Modelling time-series of software energy consumption,” in 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME) , Sept 2017, pp. 273–283
2017
Later among the works it cites.
“Gerrit - Android. https://android-review.googlesource.com/
2018
Later among the works it cites.
“Gerrit - Google Source. https://gerrit-review.googlesource.com/
2018
Later among the works it cites.
“Gerrit - Ovirt. https://gerrit.ovirt.org/
2018
Later among the works it cites.
“Gerrit. https://www.gerritcodereview.com
2018
Later among the works it cites.
M. Choetkiertikul, H. K. Dam, T. Tran, T. T. M. Pham, A. Ghose, and T. Menzies, “A deep learning model for estimating story points,” IEEE Transactions on Software Engineering , pp. 1–1, 2018
2018
Later among the works it cites.
X. Gu, H. Zhang, and S. Kim, “Deep code search,” in Proceedings of the 40th International Conference on Software Engineering , ser. ICSE ’18. New York, NY, USA: ACM, 2018, pp. 933–944. [Online]. Available: http://doi.acm.org/10.1145/3180155.3180167
2018
Later among the works it cites.
K. Moran, C. Bernal-Cárdenas, M. Curcio, R. Bonett, and D. Poshyvanyk, “Machine learning-based prototyping of graphical user interfaces for mobile apps,” CoRR , vol. abs/1802.02312, 2018. [Online]. Available: http://arxiv.org/abs/1802.02312
Original
2018
Later among the works it cites.
Oxford, “How many words are there in the english language?” August 2018. [Online]. Available: https://en.oxforddictionaries.com/explore/how-many-words-are-there-in-the-english-language/
2018
Later among the works it cites.
M. Tufano, C. Watson, G. Bavota, M. Di Penta, M. White, and D. Poshyvanyk, “Deep learning similarities from different representations of source code,” in Proceedings of the 15th International Conference on Mining Software Repositories , ser. MSR ’18. New York, NY, USA: ACM, 2018, pp. 542–553. [Online]. Available: http://doi.acm.org/10.1145/3196398.3196431
2018
Later among the works it cites.
——, “An empirical investigation into learning bug-fixing patches in the wild via neural machine translation,” in Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering , ser. ASE 2018. New York, NY, USA: ACM, 2018, pp. 832–837. [Online]. Available: http://doi.acm.org/10.1145/3238147.3240732
2018
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…