Fetching the paper…
Reading the bibliography…
Large Language Models (LLMs) have achieved remarkable progress in code generation.
Real or fake? learning to discriminate machine from human generated text
Anton Bakhtin, Sam Gross, Myle Ott, Yuntian Deng, Marc’Aurelio Ranzato, and Arthur Szlam. 2019 · 1906
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907
Earlier work this paper cites.
Release strategies and the social impacts of language models
Irene Solaiman, Miles Brundage, Jack Clark, Amanda Askell, Ariel Herbert-Voss, Jeff Wu, Alec Radford, Gretchen Krueger, Jong Wook Kim, Sarah Kreps, et al. 2019 · 1908
Earlier work this paper cites.
CodeSearchNet challenge: Evaluating the state of semantic code search
Hamel Husain, Ho-Hsiang Wu, Tiferet Gazit, Miltiadis Allamanis, and Marc Brockschmidt. 2019 · 1909
Earlier work this paper cites.
The fortran automatic coding system
John W Backus, Robert J Beeber, Sheldon Best, Richard Goldberg, Lois M Haibt, Harlan L Herrick, Robert A Nelson, David Sayre, Peter B Sheridan, Harold Stern, et al. 1957 · 1957
Earlier work this paper cites.
Prow: A step toward automatic program writing
Richard J Waldinger and Richard CT Lee. 1969 · 1969
Earlier work this paper cites.
Compilers—principles, techniques, and tools
Alfred V Hoe, Ravi Sethi, and Jeffrey D Ullman. 1986 · 1986
Earlier work this paper cites.
Antlr: A predicated-ll (k) parser generator
Terence J. Parr and Russell W. Quong. 1995 · 1995
Earlier work this paper cites.
A maximum entropy approach to natural language processing
Adam L. Berger, Vincent J. Della Pietra, and Stephen A. Della Pietra. 1996 · 1996
Earlier work this paper cites.
Method and system for generating and auditing a signature for a computer program
Robert I Davidson and Nathan Myhrvold. 1996 · 1996
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Analysis of watermarking techniques for graph coloring problem
Gang Qu and Miodrag Potkonjak. 1998 · 1998
Earlier work this paper cites.
Digital watermarking: A tutorial review
Saraju P Mohanty. 1999 · 1999
Earlier work this paper cites.
A neural probabilistic language model
Yoshua Bengio, Réjean Ducharme, and Pascal Vincent. 2000 · 2000
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
Software watermarking through register allocation: Implementation, analysis, and attacks
Ginger Myles and Christian Collberg. 2004 · 2003
Earlier work this paper cites.
Reverse engineering configurations of neural text generation models
Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, and Andrew Tomkins. 2020 · 2004
Cited alongside, same era.
Recognition in software watermarking
William Zhu and Clark Thomborson. 2006 · 2006
Cited alongside, same era.
Codebleu: a method for automatic evaluation of code synthesis
Shuo Ren, Daya Guo, Shuai Lu, Long Zhou, Shujie Liu, Duyu Tang, Neel Sundaresan, Ming Zhou, Ambrosio Blanco, and Shuai Ma. 2020 · 2009
Cited alongside, same era.
Japanese and korean voice search
Mike Schuster and Kaisuke Nakajima. 2012 · 2012
Cited alongside, same era.
Neural machine translation of rare words with subword units
Rico Sennrich, Barry Haddow, and Alexandra Birch. 2015 · 2015
Cited alongside, same era.
Speculative futures on chatgpt and generative artificial intelligence (ai): A collective reflection from the educational landscape
Aras Bozkurt, Xiao Junhong, Sarah Lambert, Angelica Pazurek, Helen Crompton, Suzan Koseoglu, Robert Farrow, Melissa Bond, Chrissi Nerantzi, Sarah Honeychurch, et al. 2023 · 2023
Later among the works it cites.
A watermark for large language models
John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, and Tom Goldstein. 2023 · 2023
Later among the works it cites.
Who wrote this code? watermarking for code generation
Taehyun Lee, Seokhee Hong, Jaewoo Ahn, Ilgee Hong, Hwaran Lee, Sangdoo Yun, Jamin Shin, and Gunhee Kim. 2023 · 2023
Later among the works it cites.
Protecting intellectual property of large language model-based code generation apis via watermarks
Zongjie Li, Chaozheng Wang, Shuai Wang, and Cuiyun Gao. 2023b · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Cited alongside, same era.
code2seq: Generating sequences from structured representations of code
Uri Alon, Shaked Brody, Omer Levy, and Eran Yahav. 2018 · 2018
Cited alongside, same era.
Improving automatic source code summarization via deep reinforcement learning
Yao Wan, Zhou Zhao, Min Yang, Guandong Xu, Haochao Ying, Jian Wu, and Philip S. Yu. 2018 · 2018
Cited alongside, same era.
BERT: pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Multi-modal attention network learning for semantic source code retrieval
Yao Wan, Jingdong Shu, Yulei Sui, Guandong Xu, Zhou Zhao, Jian Wu, and Philip S. Yu. 2020 · 2020
Cited alongside, same era.
Program synthesis with large language models
Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, et al. 2021 · 2021
Cited alongside, same era.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. 2021 · 2021
Cited alongside, same era.
Baptiste Roziere, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Ellen Tan, Yossi Adi, Jingyu Liu, Tal Remez, Jérémy Rapin, et al. 2023 · 2023
Later among the works it cites.
Codemark: Imperceptible watermarking for code datasets against neural code completion models
Zhensu Sun, Xiaoning Du, Fu Song, and Li Li. 2023 · 2023
Later among the works it cites.
Codegeex: A pre-trained model for code generation with multilingual evaluations on humaneval-x
Qinkai Zheng, Xiao Xia, Xu Zou, Yuxiao Dong, Shan Wang, Yufei Xue, Zihan Wang, Lei Shen, Andi Wang, Yang Li, et al. 2023 · 2023
Later among the works it cites.
Iterative refinement of project-level code context for precise code generation with compiler feedback
Zhangqian Bi, Yao Wan, Zheng Wang, Hongyu Zhang, Batu Guan, Fangxin Lu, Zili Zhang, Yulei Sui, Hai Jin, and Xuanhua Shi. 2024b · 2024
Closest in time.
Ircoco: Immediate rewards-guided deep reinforcement learning for code completion
Bolun Li, Zhihong Sun, Tao Huang, Hongyu Zhang, Yao Wan, Ge Li, Zhi Jin, and Chen Lyu. 2024 · 2024
Closest in time.
Demystifying gpt-3 language model: A technical overview
Chuan Li. 2024 · 2024
Closest in time.
Microsoft Copilot
Microsoft. 2024 · 2024
Closest in time.
Enhancing code generation performance of smaller models by distilling the reasoning ability of llms
Zhihong Sun, Chen Lyu, Bolun Li, Yao Wan, Hongyu Zhang, Ge Li, and Zhi Jin. 2024a · 2024
Closest in time.
Towards codable watermarking for injecting multi-bits information to llms
Lean Wang, Wenkai Yang, Deli Chen, Hao Zhou, Yankai Lin, Fandong Meng, Jie Zhou, and Xu Sun. 2024 · 2024
Closest in time.
Srcmarker: Dual-channel source code watermarking via scalable code transformations
Borui Yang, Wei Li, Liyao Xiang, and Bo Li. 2024 · 2024
Closest in time.
Advancing beyond identification: Multi-bit watermark for large language models
KiYoon Yoo, Wonhyuk Ahn, and Nojun Kwak. 2024 · 2024
Closest in time.
LLM-as-a-coauthor: Can mixed human-written and machine-generated text be detected?
Qihui Zhang, Chujie Gao, Dongping Chen, Yue Huang, Yixin Huang, Zhenyang Sun, Shilin Zhang, Weiye Li, Zhengyan Fu, Yao Wan, and Lichao Sun. 2024 · 2024
Closest in time.