2020

TranS^3: A Transformer-based Framework for Unifying Code Summarization and Code Search

Wang, Wenhua, Zhang, Yuqun, Zeng, Zhengran et al.

Understand

Code summarization and code search have been widely adopted in sofwaredevelopmentandmaintenance.

However, fewstudieshave explored the efcacy of unifying them.
In this paper, we propose TranS^3 , a transformer-based framework to integrate code summarization with code search.
Specifcally, for code summarization,TranS^3 enables an actor-critic network, where in the actor network, we encode the collected code snippets via transformer- and tree-transformer-based encoder and decode the given code snippet to generate its comment.

Built on

M. Wu, H. Zhou, L. Zhang, C. Liu, and Y. Zhang, “Characterizing and detecting CUDA program bugs,” CoRR , vol. abs/1905.01833, 2019. [Online]. Available: http://arxiv.org/abs/1905.01833
Original
1905
Earlier work this paper cites.
B. P. Lientz and E. B. Swanson, “Software maintenance management,” IEE Proceedings E Computers and Digital Techniques Transactions on Software Engineering , vol. 127, no. 6, 1980
1980
Earlier work this paper cites.
R. J. Williams, “Simple statistical gradient-following algorithms for connectionist reinforcement learning,” in Reinforcement Learning . Springer, 1992, pp. 5–32
1992
Earlier work this paper cites.
C. J. Watkins and P. Dayan, “Q-learning,” Machine learning , vol. 8, no. 3-4, pp. 279–292, 1992
1992
Earlier work this paper cites.
R. S. Sutton and A. G. Barto, Introduction to reinforcement learning . MIT press Cambridge, 1998, vol. 135
1998
Earlier work this paper cites.
E. M. Voorhees, “The trec question answering track,” Natural Language Engineering , vol. 7, no. 4, pp. 361–378, 2001
2001
Earlier work this paper cites.
K. Papineni, S. Roukos, T. Ward, and W. J. Zhu, “Bleu: a method for automatic evaluation of machine translation,” in Proceedings of the 40th annual meeting on association for computational linguistics . Association for Computational Linguistics, 2002, pp. 311–318
2002
Earlier work this paper cites.
V. Konda, “Actor-critic algorithms,” Siam Journal on Control & Optimization , vol. 42, no. 4, pp. 1143–1166, 2003
2003
Earlier work this paper cites.
C. Y. Lin, “Rouge: A package for automatic evaluation of summaries,” Text Summarization Branches Out , 2004
2004
Earlier work this paper cites.
S. Thrun and M. L. Littman, “Reinforcement learning: An introduction,” IEEE Transactions on Neural Networks , vol. 16, no. 1, pp. 285–286, 2005
2005
Earlier work this paper cites.
S. Banerjee and A. Lavie, “Meteor: An automatic metric for mt evaluation with improved correlation with human judgments,” in Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization , vol. 29, 2005, pp. 65–72
2005
Earlier work this paper cites.
O. A. L. Lemos, S. K. Bajracharya, J. Ossher, R. S. Morla, P. C. Masiero, P. Baldi, and C. V. Lopes, “Codegenie: using test-cases to search and reuse source code.” Ase , pp. 525–526, 2007
2007
Earlier work this paper cites.
N. Craswell, “Mean reciprocal rank,” 2009
2009
Earlier work this paper cites.
G. Sridhara, E. Hill, D. Muppaneni, L. Pollock, and K. Vijay-Shanker, “Towards automatically generating summary comments for java methods,” in Proceedings of the IEEE/ACM international conference on Automated software engineering . ACM, 2010, pp. 43–52
2010
Earlier work this paper cites.
S. Haiduc, J. Aponte, L. Moreno, and A. Marcus, “On the use of automated text summarization techniques for summarizing source code,” in Reverse Engineering , 2010
2010
Earlier work this paper cites.
J. Duchi, E. Hazan, and Y. Singer, “Adaptive subgradient methods for online learning and stochastic optimization,” Journal of Machine Learning Research , vol. 12, no. Jul, pp. 2121–2159, 2011
2011
Earlier work this paper cites.
W. Takuya and H. Masuhara, “A spontaneous code recommendation tool based on associative search,” in Proceedings of the 3rd International Workshop on Search-Driven Development: Users, Infrastructure, Tools, and Evaluation . ACM, 2011, pp. 17–20
2011
Earlier work this paper cites.
D. Movshovitz-Attias and W. W. Cohen, “Natural language models for predicting programming comments,” in Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) , vol. 2, 2013, pp. 35–40
2013
Earlier work this paper cites.
E. Wong, J. Yang, and L. Tan, “Autocomment: Mining question and answer sites for automatic comment generation,” in Proceedings of the 28th IEEE/ACM International Conference on Automated Software Engineering . IEEE Press, 2013, pp. 562–567
2013
Earlier work this paper cites.
Z. Huang, G. Zweig, M. Levit, B. Dumoulin, B. Oguz, and S. Chang, “Accelerating recurrent neural network training via two stage classes and parallelization,” in 2013 IEEE Workshop on Automatic Speech Recognition and Understanding . IEEE, 2013, pp. 326–331
2013
Earlier work this paper cites.
T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” Computer Science , 2013
2013
Earlier work this paper cites.
Y. Wang, L. Wang, Y. Li, D. He, T. Y. Liu, and W. Chen, “A theoretical analysis of ndcg type ranking measures,” Journal of Machine Learning Research , vol. 30, pp. 25–54, 2013
2013
Earlier work this paper cites.
F. Scholer, H. E. Williams, and A. Turpin, “Query association surrogates for web search,” Journal of the American Society for Information Science & Technology , vol. 55, no. 7, pp. 637–650, 2014
2014
Earlier work this paper cites.
E. Hill, M. Roldanvega, J. A. Fails, and G. Mallet, NL-Based Query Refinement and Contextualized Code Search Results: A User Study , 2014
2014
Earlier work this paper cites.

Similar

F. Lv, H. Zhang, J.-g. Lou, S. Wang, D. Zhang, and J. Zhao, “Codehow: Effective code search based on api understanding and extended boolean model (e),” in 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 2015, pp. 260–270
2015
Cited alongside, same era.
M. Lu, X. Sun, S. Wang, D. Lo, and Y. Duan, “Query expansion via wordnet for effective code search,” in 2015 IEEE 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER) . IEEE, 2015, pp. 545–549
2015
Cited alongside, same era.
S. Bowman, G. Angeli, C. Potts, and C. Manning, “A large annotated corpus for learning natural language inference,” in EMNLP , 2015
2015
Cited alongside, same era.
R. Vedantam, C. Lawrence Zitnick, and D. Parikh, “Cider: Consensus-based image description evaluation,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2015, pp. 4566–4575
2015
Cited alongside, same era.
E. Wong, T. Liu, and L. Tan, “Clocom: Mining existing source code for automatic comment generation,” in 2015 IEEE 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER) . IEEE, 2015, pp. 380–389
2015
Cited alongside, same era.
Y. Lu, Y. Lou, S. Cheng, L. Zhang, D. Hao, Y. Zhou, and L. Zhang, “How does regression test prioritization perform in real-world software evolution?” in Proceedings of the 38th International Conference on Software Engineering, ICSE 2016, Austin, TX, USA, May 14-22, 2016 , 2016, pp. 535–546. [Online]. Available: https://doi.org/10.1145/2884781.2884874
2016
Cited alongside, same era.
J. Wang, L.-C. Yu, K. R. Lai, and X. Zhang, “Dimensional sentiment analysis using a regional cnn-lstm model,” in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) , 2016, pp. 225–230
2016
Cited alongside, same era.
S. Wang, D. Chollak, D. Movshovitz-Attias, and L. Tan, “Bugram: bug detection with n-gram language models,” in Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering . ACM, 2016, pp. 708–719
2016
Cited alongside, same era.
L. Xuan, Z. Wang, Q. Wang, S. Yan, X. Tao, and M. Hong, “Relationship-aware code search for javascript frameworks,” in Acm Sigsoft International Symposium on Foundations of Software Engineering , 2016
2016
Cited alongside, same era.
M. Raghothaman, Y. Wei, and Y. Hamadi, “Swim: Synthesizing what i mean-code search and idiomatic snippet synthesis,” in 2016 IEEE/ACM 38th International Conference on Software Engineering (ICSE) . IEEE, 2016, pp. 357–367
2016
Cited alongside, same era.
L. Moreno and A. Marcus, “Automatic software summarization: the state of the art,” in 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C) . IEEE, 2017, pp. 511–512
2017
Cited alongside, same era.
I. Yen, S. Zhang, F. Bastani, and Y. Zhang, “A framework for iot-based monitoring and diagnosis of manufacturing systems,” in 2017 IEEE Symposium on Service-Oriented System Engineering (SOSE) , April 2017, pp. 1–8
2017
Cited alongside, same era.

Then

Y. Keneshloo, T. Shi, C. K. Reddy, and N. Ramakrishnan, “Deep reinforcement learning for sequence to sequence models,” arXiv preprint arXiv:1805.09461 , 2018
Original
2018
Later among the works it cites.
Y. Wan, Z. Zhao, M. Yang, G. Xu, H. Ying, J. Wu, and P. S. Yu, “Improving automatic source code summarization via deep reinforcement learning,” in Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering . ACM, 2018, pp. 397–407
2018
Later among the works it cites.
S. Luan, D. Yang, K. Sen, and S. Chandra, “Aroma: Code recommendation via structural code search,” arXiv preprint arXiv:1812.01158 , 2018
Original
2018
Later among the works it cites.
A. LeClair, S. Jiang, and C. McMillan, “A neural model for generating natural language summaries of program subroutines,” in Proceedings of the 41st International Conference on Software Engineering . IEEE Press, 2019, pp. 795–806
2019
Later among the works it cites.
Z. Yao, J. R. Peddamail, and H. Sun, “Coacor: Code annotation for code retrieval with reinforcement learning,” in The World Wide Web Conference . ACM, 2019, pp. 2203–2214
2019
Later among the works it cites.
X. Li, W. Li, Y. Zhang, and L. Zhang, “Deepfl: integrating multiple fault diagnosis dimensions for deep fault localization,” in Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2019, Beijing, China, July 15-19, 2019 , 2019, pp. 169–180. [Online]. Available: https://doi.org/10.1145/3293882.3330574
2019
Later among the works it cites.
M. Zhang, Y. Li, X. Li, L. Chen, Y. Zhang, L. Zhang, and S. Khurshid, “An empirical study of boosting spectrum-based fault localization via pagerank,” IEEE Transactions on Software Engineering , pp. 1–1, 2019
2019
Later among the works it cites.
A. Ghanbari, S. Benton, and L. Zhang, “Practical program repair via bytecode mutation,” in Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2019, Beijing, China, July 15-19, 2019 , 2019, pp. 19–30. [Online]. Available: https://doi.org/10.1145/3293882.3330559
2019
Later among the works it cites.
Y. Lou, J. Chen, L. Zhang, D. Hao, and L. Zhang, “History-driven build failure fixing: how far are we?” in Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2019, Beijing, China, July 15-19, 2019 , 2019, pp. 43–54. [Online]. Available: https://doi.org/10.1145/3293882.3330578
2019
Later among the works it cites.
J. Hua, Y. Zhang, Y. Zhang, and S. Khurshid, “Edsketch: execution-driven sketching for java,” STTT , vol. 21, no. 3, pp. 249–265, 2019. [Online]. Available: https://doi.org/10.1007/s10009-019-00512-8
2019
Later among the works it cites.
M. Wu, L. Zhang, C. Liu, S. H. Tan, and Y. Zhang, “Automating cuda synchronization via program transformation,” in 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) , Nov 2019, pp. 748–759
2019
Later among the works it cites.
T. Zheng, X. Zheng, Y. Zhang, Y. Deng, E. Dong, R. Zhang, and X. Liu, “Smartvm: a sla-aware microservice deployment framework,” World Wide Web , vol. 22, no. 1, pp. 275–293, 2019. [Online]. Available: https://doi.org/10.1007/s11280-018-0562-5
2019
Later among the works it cites.
D. Yu, Y. Jin, Y. Zhang, and X. Zheng, “A survey on security issues in services communication of microservices-enabled fog applications,” Concurr. Comput. Pract. Exp. , vol. 31, no. 22, 2019. [Online]. Available: https://doi.org/10.1002/cpe.4436
2019
Later among the works it cites.
S. A. Akbar and A. C. Kak, “Scor: source code retrieval with semantics and order,” in Proceedings of the 16th International Conference on Mining Software Repositories . IEEE Press, 2019, pp. 1–12
2019
Later among the works it cites.
Y. Sun, S. Wang, Y. Li, S. Feng, X. Chen, H. Zhang, X. Tian, D. Zhu, H. Tian, and H. Wu, “Ernie: Enhanced representation through knowledge integration,” arXiv preprint arXiv:1904.09223 , 2019
Original
2019
Later among the works it cites.
Z. Yang, Z. Dai, Y. Yang, J. Carbonell, R. Salakhutdinov, and Q. V. Le, “Xlnet: Generalized autoregressive pretraining for language understanding,” arXiv preprint arXiv:1906.08237 , 2019
Original
2019
Later among the works it cites.
X. Hu, G. Li, X. Xia, D. Lo, and Z. Jin, “Deep code comment generation with hybrid lexical and syntactical information,” Empirical Software Engineering , pp. 1–39, 2019
2019
Later among the works it cites.
A. Sivaraman, T. Zhang, G. Van den Broeck, and M. Kim, “Active inductive logic programming for code search,” in Proceedings of the 41st International Conference on Software Engineering . IEEE Press, 2019, pp. 292–303
2019
Later among the works it cites.
H. Zhou, W. Li, Z. Kong, J. Guo, Y. Zhang, B. Yu, L. Zhang, and C. Liu, “Deepbillboard: Systematic physical-world testing of autonomous driving systems,” in Proceedings of the 42nd International Conference on Software Engineering, ICSE 2020, Seoul, Korea, May 23 - 29, 2020 , 2020
2020
Closest in time.
M. Wu, Y. Ouyang, H. Zhou, L. Zhang, C. Liu, and Y. Zhang, “Simulee: Detecting cuda synchronization bugs via memory-access modeling,” in Proceedings of the 42nd International Conference on Software Engineering, ICSE 2020, Seoul, Korea, May 23 - 29, 2020 , 2020
2020
Closest in time.
W. Wang, Y. Zhang, Y. Sui, Y. Wan, Z. Zhao, J. Wu, P. Yu, and G. Xu, “Reinforcement-learning-guided source code summarization using hierarchical attention,” IEEE Transactions on Software Engineering , pp. 1–1, 2020
2020
Closest in time.
S. Iyer, I. Konstas, A. Cheung, and L. Zettlemoyer, “Summarizing source code using a neural attention model.” in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (1) , 2016, pp. 2073–2083
2083
Closest in time.
M. Allamanis, H. Peng, and C. Sutton, “A convolutional attention network for extreme summarization of source code,” in International Conference on Machine Learning , 2016, pp. 2091–2100
2091
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…