Model-Agnostic Syntactical Information for Pre-Trained Programming Language Models

C.-Y. Lin and F. J. Och, “Orange: a method for evaluating automatic evaluation metrics for machine translation,” in COLING 2004: Proceedings of the 20th International Conference on Computational Linguistics , 2004, pp. 501–507

2004

Earlier work this paper cites.

I. Sutskever, O. Vinyals, and Q. V. Le, “Sequence to sequence learning with neural networks,” Advances in neural information processing systems , vol. 27, 2014

2014

Earlier work this paper cites.

D. Wendel and P. Medlock-Walton, “Thinking in blocks: Implications of using abstract syntax trees as the underlying program model,” in 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond) . IEEE, 2015, pp. 63–66

2015

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017

2017

Earlier work this paper cites.

X. Hu, G. Li, X. Xia, D. Lo, S. Lu, and Z. Jin, “Summarizing source code with transferred api knowledge,” 2018

2018

Earlier work this paper cites.

A. Kanade, P. Maniatis, G. Balakrishnan, and K. Shi, “Pre-trained contextual embedding of source code,” 2019

2019

Earlier work this paper cites.

L. Büch and A. Andrzejak, “Learning-based recursive aggregation of abstract syntax trees for code clone detection,” in 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER) . IEEE, 2019, pp. 95–104

2019

Earlier work this paper cites.

K. W. Nafi, T. S. Kar, B. Roy, C. K. Roy, and K. A. Schneider, “Clcdsa: cross language code clone detection using syntactical features and api documentation,” in 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 2019, pp. 1026–1037

2019

Earlier work this paper cites.

M. Tufano, C. Watson, G. Bavota, M. D. Penta, M. White, and D. Poshyvanyk, “An empirical study on learning bug-fixing patches in the wild via neural machine translation,” ACM Transactions on Software Engineering and Methodology (TOSEM) , vol. 28, no. 4, pp. 1–29, 2019

2019

Earlier work this paper cites.

N. Houlsby, A. Giurgiu, S. Jastrzebski, B. Morrone, Q. De Laroussilhe, A. Gesmundo, M. Attariyan, and S. Gelly, “Parameter-efficient transfer learning for nlp,” in International Conference on Machine Learning . PMLR, 2019, pp. 2790–2799

2019

Earlier work this paper cites.

H. Husain, H.-H. Wu, T. Gazit, M. Allamanis, and M. Brockschmidt, “Codesearchnet challenge: Evaluating the state of semantic code search,” arXiv preprint arXiv:1909.09436 , 2019

Original

2019

Earlier work this paper cites.

J. Zhang, X. Wang, H. Zhang, H. Sun, K. Wang, and X. Liu, “A novel neural source code representation based on abstract syntax tree,” in 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) . IEEE, 2019, pp. 783–794

2019

Earlier work this paper cites.

Z. Feng, D. Guo, D. Tang, N. Duan, X. Feng, M. Gong, L. Shou, B. Qin, T. Liu, D. Jiang et al. , “Codebert: A pre-trained model for programming and natural languages,” arXiv preprint arXiv:2002.08155 , 2020

Original

2020

Earlier work this paper cites.

D. Guo, S. Ren, S. Lu, Z. Feng, D. Tang, S. Liu, L. Zhou, N. Duan, A. Svyatkovskiy, S. Fu et al. , “Graphcodebert: Pre-training code representations with data flow,” arXiv preprint arXiv:2009.08366 , 2020

Original

2020

Earlier work this paper cites.

J. Ainslie, S. Ontanon, C. Alberti, V. Cvicek, Z. Fisher, P. Pham, A. Ravula, S. Sanghai, Q. Wang, and L. Yang, “Etc: Encoding long and structured inputs in transformers,” arXiv preprint arXiv:2004.08483 , 2020

Original

2020

Earlier work this paper cites.

J. Pfeiffer, I. Vulić, I. Gurevych, and S. Ruder, “Mad-x: An adapter-based framework for multi-task cross-lingual transfer,” arXiv preprint arXiv:2005.00052 , 2020

Original

2020

Earlier work this paper cites.

J. Pfeiffer, A. Kamath, A. Rücklé, K. Cho, and I. Gurevych, “Adapterfusion: Non-destructive task composition for transfer learning,” arXiv preprint arXiv:2005.00247 , 2020

Original

2020

Earlier work this paper cites.

Y. Tang, C. Tran, X. Li, P.-J. Chen, N. Goyal, V. Chaudhary, J. Gu, and A. Fan, “Multilingual translation with extensible multilingual pretraining and finetuning,” arXiv preprint arXiv:2008.00401 , 2020

Original

2020

Cited alongside, same era.

Y. Wang, W. Wang, S. Joty, and S. C. Hoi, “Codet5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , 2021, pp. 8696–8708

2021

Cited alongside, same era.

S. Lu, D. Guo, S. Ren, J. Huang, A. Svyatkovskiy, A. Blanco, C. Clement, D. Drain, D. Jiang, D. Tang et al. , “Codexglue: A machine learning benchmark dataset for code understanding and generation,” arXiv preprint arXiv:2102.04664 , 2021

Original

2021

Cited alongside, same era.

W. U. Ahmad, S. Chakraborty, B. Ray, and K.-W. Chang, “Unified pre-training for program understanding and generation,” arXiv preprint arXiv:2103.06333 , 2021

Original

2021

C. Zhang, J. Wang, Q. Zhou, T. Xu, K. Tang, H. Gui, and F. Liu, “A survey of automatic source code summarization,” Symmetry , vol. 14, no. 3, p. 471, 2022

2022

Later among the works it cites.

R. Wu, Y. Zhang, Q. Peng, L. Chen, and Z. Zheng, “A survey of deep learning models for structural code understanding,” arXiv preprint arXiv:2205.01293 , 2022

Original

2022

Later among the works it cites.

D. Goel, R. Grover, and F. H. Fard, “On the cross-modal transfer from natural language to code through adapter modules,” arXiv preprint arXiv:2204.08653 , 2022

Original

2022

Later among the works it cites.

W. Takerngsaksiri, C. Tantithamthavorn, and Y.-F. Li, “Syntax-aware on-the-fly code completion,” arXiv preprint arXiv:2211.04673 , 2022

Original

2022

Later among the works it cites.

R. Sharma, F. Chen, F. Fard, and D. Lo, “An exploratory study on code attention in bert,” arXiv preprint arXiv:2204.10200 , 2022