2018

Deep Learning to Detect Redundant Method Comments

Louis, Annie, Dash, Santanu Kumar, Barr, Earl T. et al.

Understand

Comments in software are critical for maintenance and reuse.

But apart from prescriptive advice, there is little practical support or quantitative understanding of what makes a comment useful.
In this paper, we introduce the task of identifying comments which are uninformative about the code they are meant to document.
To address this problem, we introduce the notion of comment entailment from code, high entailment indicating that a comment's natural language semantics can be inferred directly from the code.

Built on

Literate programming
Donald E Knuth. 1984 · 1984
Earlier work this paper cites.
Literate programming
Donald E Knuth. 1992 · 1992
Earlier work this paper cites.
Building a Large Annotated Corpus of English: The Penn Treebank
Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993 · 1993
Earlier work this paper cites.
Long short-term memory
S. Hochreiter and J. Schmidhuber. 1997 · 1997
Earlier work this paper cites.
A runtime assertion checker for the Java Modeling Language (JML). In Proceedings Of The International Conference On Software Engineering Research And Practice (SERP ’02), Las Vegas
Yoonsik Cheon and Gary T. Leavens. 2002 · 2002
Earlier work this paper cites.
Visualization of test information to assist fault localization. In International Conference on Software Engineering (ICSE)
James A Jones, Mary Jean Harrold, and John Stasko. 2002 · 2002
Earlier work this paper cites.
Guide to the Software Engineering Body of Knowledge - SWEBOK
Alain Abran, Pierre Bourque, Robert Dupuis, James W. Moore, and Leonard L. Tripp. 2004 · 2004
Earlier work this paper cites.
Code complete
Steve McConnell. 2004 · 2004
Earlier work this paper cites.
Comments Are More Important Than Code
Jef Raskin. 2005 · 2005
Earlier work this paper cites.
An exploratory study of how developers seek, relate, and collect relevant information during software maintenance tasks
Andrew J Ko, Brad A Myers, Michael J Coblenz, and Htet Htet Aung. 2006 · 2006
Earlier work this paper cites.
Maintaining mental models: a study of developer work habits. In International Conference on Software Engineering (ICSE)
Thomas D LaToza, Gina Venolia, and Robert DeLine. 2006 · 2006
Earlier work this paper cites.
Design by Contract with JML
G. Leavens and Y. Cheon. 2006 · 2006
Earlier work this paper cites.
Do code and comments co-evolve? on the relation between source code and comment changes. In WCRE
Beat Fluri, Michael Würsch, and Harald C Gall. 2007 · 2007
Earlier work this paper cites.
/*Icomment: Bugs or Bad Comments?*/. In Proceedings of Twenty-first ACM SIGOPS Symposium on Operating Systems Principles
Lin Tan, Ding Yuan, Gopal Krishna, and Yuanyuan Zhou. 2007 · 2007
Earlier work this paper cites.
Listening to Programmers - Taxonomies and Characteristics of Comments in Operating System Code. In International Conference on Software Engineering (ICSE)
Yoann Padioleau, Lin Tan, and Yuanyuan Zhou. 2009 · 2009
Earlier work this paper cites.
Automatic Quality Assessment of Source Code Comments: The JavadocMiner. In Proceedings of the Natural Language Processing and Information Systems, and 15th International Conference on Applications of Natural Language to Information Systems
Ninus Khamis, René Witte, and Juergen Rilling. 2010 · 2010
Earlier work this paper cites.

Similar

Code Documentation
Diomidis Spinellis. 2010 · 2010
Cited alongside, same era.
Improving identifier informativeness using part of speech information. In MSR
Dave Binkley, Matthew Hearn, and Dawn Lawrie. 2011 · 2011
Cited alongside, same era.
aComment: mining annotations from comments and code to detect interrupt related concurrency bugs. In ICSE
Lin Tan, Yuanyuan Zhou, and Yoann Padioleau. 2011 · 2011
Cited alongside, same era.
Software and systems traceability
Jane Cleland-Huang, Orlena Gotel, and Andrea Zisman (Eds.). 2012 · 2012
Cited alongside, same era.
On the "Naturalness" of software
Abram Hindle, Earl Barr, Zhendong Su, Prem Devanbu, and Mark Gable. 2012 · 2012
Cited alongside, same era.
On the relationship between comment update practices and software bugs
Walid M Ibrahim, Nicolas Bettenburg, Bram Adams, and Ahmed E Hassan. 2012 · 2012
Cited alongside, same era.
@tComment: Testing Javadoc Comments to Detect Comment-Code Inconsistencies. In Software Testing, Verification and Validation (ICST), 2012 IEEE Fifth International Conference on
Shin Hwei Tan, D. Marinov, Lin Tan, and G.T. Leavens. 2012 · 2012
Cited alongside, same era.
Recognizing Textual Entailment: Models and Applications
Ido Dagan, Dan Roth, Mark Sammons, and Fabio Massimo Zanzotto. 2013 · 2013
Cited alongside, same era.
Part-of-speech tagging of program identifiers for improved text-based software engineering tools. In ICPC
Samir Gupta, Sana Malik, Lori Pollock, and K Vijay-Shanker. 2013 · 2013
Cited alongside, same era.
Natural Language Models for Predicting Programming Comments. In ACL
Dana Movshovitz-Attias and William W. Cohen. 2013 · 2013
Cited alongside, same era.
Quality Analysis of Source Code Comments. In Proceedings of the 21st IEEE Internation Conference on Program Comprehension (ICPC’13)
Daniela Steidl, Benjamin Hummel, and Elmar Juergens. 2013 · 2013
Cited alongside, same era.
Learning Natural Coding Conventions. In FSE
Miltiadis Allamanis, Earl T Barr, Christian Bird, and Charles Sutton. 2014 · 2014
Cited alongside, same era.

Then

On the Localness of Software. In Symposium on Foundations of Software Engineering (FSE)
Zhaopeng Tu, Zhendong Su, and Premkumar Devanbu. 2014 · 2014
Later among the works it cites.
Neural machine translation by jointly learning to align and translate. In ICLR
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015
Later among the works it cites.
Pseudogen: A Tool to Automatically Generate Pseudo-code from Source Code. In International Conference on Automated Software Engineering (ASE) Tool Demos
Hiroyuki Fudaba, Yusuke Oda, Koichi Akabe, Graham Neubig, Hideaki Hata, Sakriani Sakti, Tomoki Toda, and Satoshi Nakamura. 2015 · 2015
Later among the works it cites.
Learning to Generate Pseudo-code from Source Code using Statistical Machine Translation. In International Conference on Automated Software Engineering (ASE)
Yusuke Oda, Hiroyuki Fudaba, Graham Neubig, Hideaki Hata, Sakriani Sakti, Tomoki Toda, and Satoshi Nakamura. 2015 · 2015
Later among the works it cites.
Toward deep learning software repositories. In Working Conference on Mining Software Repositories
M. White, C. Vendome, M. Linares-Vásquez, and D. Poshyvanyk. 2015 · 2015
Later among the works it cites.
CloCom: Mining existing source code for automatic comment generation. In SANER
Edmund Wong, Taiyue Liu, and Lin Tan. 2015 · 2015
Later among the works it cites.
PHOG: Probabilistic Model for Code. In ICML
Pavol Bielik, Veselin Raychev, and Martin Vechev. 2016 · 2016
Later among the works it cites.
A deep language model for software code. In Workshop on Naturalness of Software, co-located with the 24th ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE)
Hoa Khanh Dam, Truyen Tran, and Trang Pham. 2016 · 2016
Later among the works it cites.
Deep Learning
Ian Goodfellow, Yoshua Bengio, and Aaron Courville. 2016 · 2016
Later among the works it cites.
Deep API Learning. In SIGSOFT International Symposium on Foundations of Software Engineering
Xiaodong Gu, Hongyu Zhang, Dongmei Zhang, and Sunghun Kim. 2016 · 2016
Later among the works it cites.
Probabilistic Model for Code with Decision Trees. In OOPSLA
Veselin Raychev, Pavol Bielik, and Martin Vechev. 2016 · 2016
Later among the works it cites.
Neural Attribute Machines for Program Generation
Original
Matthew Amodio, Swarat Chaudhuri, and Thomas W. Reps. 2017 · 2017
Later among the works it cites.
Program synthesis from natural language using recurrent neural networks
Xi Victoria Lin, Chenglong Wang, Deric Pang, Kevin Vu, Luke Zettlemoyer, and Michael D. Ernst. 2017 · 2017
Later among the works it cites.
On the State of the Art of Evaluation in Neural Language Models
G. Melis, C. Dyer, and P. Blunsom. 2017 · 2017
Later among the works it cites.
Classifying Code Comments in Java Open-source Software Systems. In Proceedings of the 14th International Conference on Mining Software Repositories
Luca Pascarella and Alberto Bacchelli. 2017 · 2017
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…