Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions

D. Zhang and J. J. Tsai, “Machine Learning and Software Engineering,” Software Quality Journal , vol. 11, no. 2, pp. 87–119, Jun. 2003. [Online]. Available: https://doi.org/10.1023/A:1023760326768

2003

Earlier work this paper cites.

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei, “Language Models are Few-Shot Learners,” arXiv:2005.14165 [cs] , Jul. 2020, arXiv: 2005.14165. [Online]. Available: http://arxiv.org/abs/2005.14165

Original

2005

Earlier work this paper cites.

R. Mihalcea, H. Liu, and H. Lieberman, “NLP (Natural Language Processing) for NLP (Natural Language Programming),” in Computational Linguistics and Intelligent Text Processing , A. Gelbukh, Ed. Springer Berlin Heidelberg, 2006, pp. 319–330

2006

Earlier work this paper cites.

R. Drechsler, I. G. Harris, and R. Wille, “Generating formal system models from natural language descriptions,” in IEEE Int. High Level Design Validation and Test Workshop (HLDVT) , 2012, pp. 164–165

2012

Earlier work this paper cites.

M. Sundermeyer, R. Schlüter, and H. Ney, “LSTM neural networks for language modeling,” in Conf. Int. Speech Communication Assoc. , 2012

2012

Earlier work this paper cites.

D. Zhang, Y. Wang, G. E. Suh, and A. C. Myers, “A Hardware Design Language for Timing-Sensitive Information-Flow Security,” in Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems . Istanbul Turkey: ACM, Mar. 2015, pp. 503–516. [Online]. Available: https://dl.acm.org/doi/10.1145/2694344.2694372

2015

Earlier work this paper cites.

C. B. Harris and I. G. Harris, “GLAsT: Learning formal grammars to translate natural language specifications into hardware assertions,” in Design, Automation Test in Europe Conf. Exhibition (DATE) , 2016, pp. 966–971

2016

Earlier work this paper cites.

P. Liu, X. Qiu, and X. Huang, “Recurrent Neural Network for Text Classification with Multi-Task Learning,” CoRR , vol. abs/1605.05101, 2016, _eprint: 1605.05101. [Online]. Available: http://arxiv.org/abs/1605.05101

Original

2016

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, \. Kaiser, and I. Polosukhin, “Attention is All you Need,” in Advances in Neural Information Processing Systems 30 , I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, Eds. Curran Associates, Inc., 2017, pp. 5998–6008

2017

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” CoRR , vol. abs/1810.04805, 2018, _eprint: 1810.04805. [Online]. Available: http://arxiv.org/abs/1810.04805

Original

2018

Cited alongside, same era.

J. Li, B. Zhao, and C. Zhang, “Fuzzing: a survey,” Cybersecurity , vol. 1, no. 1, p. 6, Dec. 2018. [Online]. Available: https://cybersecurity.springeropen.com/articles/10.1186/s42400-018-0002-y

2018

Cited alongside, same era.

K. M. T. H. Rahit, R. H. Nabil, and M. H. Huq, “Machine Translation from Natural Language to Code Using Long-Short Term Memory,” in Future Technologies Conf. (FTC) . Springer International Publishing, Oct. 2019, pp. 56–63, iSSN: 2194-5365

2019

Cited alongside, same era.

A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever, “Language Models are Unsupervised Multitask Learners,” p. 24, 2019. [Online]. Available: https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf

The MITRE Corporation (MITRE), “CWE - CWE-Compatible Products and Services,” Dec. 2020. [Online]. Available: https://cwe.mitre.org/compatible/compatible.html

2020

Later among the works it cites.

M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. d. O. Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, A. Paino, N. Tezak, J. Tang, I. Babuschkin, S. Balaji, S. Jain, W. Saunders, C. Hesse, A. N. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, and W. Zaremba, “Evaluating Large Language Models Trained on Code,” arXiv:2107.03374 [cs] , Jul. 2021, arXiv: 2107.03374. [Online]. Available: http://arxiv.org/abs/2107.03374

Original

2021

Closest in time.

J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le, and C. Sutton, “Program Synthesis with Large Language Models,” arXiv:2108.07732 [cs] , Aug. 2021, arXiv: 2108.07732. [Online]. Available: http://arxiv.org/abs/2108.07732

Original

2021

Closest in time.