When to Stop? Towards Efficient Code Generation in LLMs with Excess Token Prevention

Answering the call for a standard reliability measure for coding data

Andrew F Hayes and Klaus Krippendorff. 2007 · 2007

Earlier work this paper cites.

Latent predictor networks for code generation. In ACL

Wang Ling, Edward Grefenstette, Karl Moritz Hermann, Tomáš Kočiskỳ, Andrew Senior, Fumin Wang, and Phil Blunsom. 2016 · 2016

Earlier work this paper cites.

Decoupled weight decay regularization

Original

Ilya Loshchilov and Frank Hutter. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Tree-to-tree neural networks for program translation

Xinyun Chen, Chang Liu, and Dawn Song. 2018 · 2018

Earlier work this paper cites.

Retrieval-based neural code generation. In EMNLP

Shirley Anugrah Hayati, Raphael Olivier, Pravalika Avvaru, Pengcheng Yin, Anthony Tomasic, and Graham Neubig. 2018 · 2018

Earlier work this paper cites.

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al · 2018

Earlier work this paper cites.

Deep learning for source code modeling and generation: Models, applications, and challenges

Triet HM Le, Hao Chen, and Muhammad Ali Babar. 2020 · 2020

Earlier work this paper cites.

Program synthesis with large language models

Original

Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, et al · 2021

Earlier work this paper cites.

Evaluating large language models trained on code

Original

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al · 2021

Earlier work this paper cites.

Exploring dynamic selection of branch expansion orders for code generation

Original

Hui Jiang, Chulun Zhou, Fandong Meng, Biao Zhang, Jie Zhou, Degen Huang, Qingqiang Wu, and Jinsong Su. 2021 · 2021

Earlier work this paper cites.

OpenAI Code

OpenAI. 2021 · 2021

Earlier work this paper cites.

Code completion by modeling flattened abstract syntax trees as graphs. In Proceedings of the AAAI conference on artificial intelligence , Vol. 35. 14015–14023

Yanlin Wang and Hui Li. 2021 · 2021

Earlier work this paper cites.

Multi-lingual Evaluation of Code Generation Models. In The Eleventh International Conference on Learning Representations

Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, Xiaopeng Li, Yuchen Tian, Ming Tan, Wasi Uddin Ahmad, Shiqi Wang, Qing Sun, Mingyue Shang, et al · 2022

Earlier work this paper cites.

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness. In Advances in Neural Information Processing Systems

Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, and Christopher Ré. 2022 · 2022

Earlier work this paper cites.

Accelerating Code Search with Deep Hashing and Code Classification. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . 2534–2544

Wenchao Gu, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, and Michael Lyu. 2022 · 2022

Earlier work this paper cites.

UniXcoder: Unified Cross-Modal Pre-training for Code Representation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . 7212–7225

Daya Guo, Shuai Lu, Nan Duan, Yanlin Wang, Ming Zhou, and Jian Yin. 2022 · 2022

Earlier work this paper cites.

Coderl: Mastering code generation through pretrained models and deep reinforcement learning

Hung Le, Yue Wang, Akhilesh Deepak Gotmare, Silvio Savarese, and Steven Chu Hong Hoi. 2022 · 2022

Earlier work this paper cites.

Guiding Language Models of Code with Global Context using Monitors

Original

Lakshya A Agrawal, Aditya Kanade, Navin Goyal, Shuvendu K Lahiri, and Sriram K Rajamani. 2023 · 2023

Earlier work this paper cites.

Improving code generation by training with natural language feedback

Original

Angelica Chen, Jérémy Scheurer, Tomasz Korbak, Jon Ander Campos, Jun Shern Chan, Samuel R Bowman, Kyunghyun Cho, and Ethan Perez. 2023 · 2023

Earlier work this paper cites.

FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

Tri Dao. 2023 · 2023

Earlier work this paper cites.

Classeval: A manually-crafted benchmark for evaluating llms on class-level code generation

Original

Xueying Du, Mingwei Liu, Kaixin Wang, Hanlin Wang, Junwei Liu, Yixuan Chen, Jiayi Feng, Chaofeng Sha, Xin Peng, and Yiling Lou. 2023 · 2023

Cited alongside, same era.

bfloat16: The secret to high performance on Cloud TPUs

Google Cloud. 2020 · 2023

Cited alongside, same era.

Enhancing Large Language Models in Coding Through Multi-Perspective Self-Consistency

Original

Baizhou Huang, Shuai Lu, Weizhu Chen, Xiaojun Wan, and Nan Duan. 2023 · 2023

Cited alongside, same era.

LLM-Assisted Code Cleaning For Training Accurate Code Generators

Original

Naman Jain, Tianjun Zhang, Wei-Lin Chiang, Joseph E Gonzalez, Koushik Sen, and Ion Stoica. 2023 · 2023

Cited alongside, same era.

Efficient Memory Management for Large Language Model Serving with PagedAttention. In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023

Later among the works it cites.

Magicoder: Source code is all you need. In International Conference on Machine Learning

Yuxiang Wei, Zhe Wang, Jiawei Liu, Yifeng Ding, and Lingming Zhang. 2023 · 2023

Later among the works it cites.

FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing . 14520–14535

Ruixuan Xiao, Yiwen Dong, Junbo Zhao, Runze Wu, Minmin Lin, Gang Chen, and Haobo Wang. 2023 · 2023

Later among the works it cites.

Exploring continual learning for code generation models

Original

Prateek Yadav, Qing Sun, Hantian Ding, Xiaopeng Li, Dejiao Zhang, Ming Tan, Xiaofei Ma, Parminder Bhatia, Ramesh Nallapati, Murali Krishna Ramanathan, et al · 2023

Later among the works it cites.