Constrained Decoding for Fill-in-the-Middle Code Language Models via Efficient Left and Right Quotienting of Context-Sensitive Grammars

J. Earley, “An efficient context-free parsing algorithm,” Communications of the ACM , vol. 13, no. 2, pp. 94–102, Feb. 1970

1970

Earlier work this paper cites.

P. Linz, An Introduction to Formal Languages and Automata , 5th ed. Sudbury, MA: Jones & Bartlett Learning, 2012

2012

Earlier work this paper cites.

J. Li, Y. Wang, M. R. Lyu, and I. King, “Code Completion with Neural Attention and Pointer Networks,” in Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, IJCAI-18 . Stockholm, Sweden: International Joint Conferences on Artificial Intelligence Organization, Jul. 2018, pp. 4159–4165

2018

Earlier work this paper cites.

A. Svyatkovskiy, Y. Zhao, S. Fu, and N. Sundaresan, “Pythia: AI-assisted Code Completion System,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining , ser. KDD ’19. New York, NY, USA: Association for Computing Machinery, Jul. 2019, pp. 2727–2735

2019

Earlier work this paper cites.

J. E. Hu, H. Khayrallah, R. Culkin, P. Xia, T. Chen, M. Post, and B. Van Durme, “Improved Lexically Constrained Decoding for Translation and Monolingual Rewriting,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) . Minneapolis, Minnesota: Association for Computational Linguistics, Jun. 2019, pp. 839–850

2019

Earlier work this paper cites.

M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. d. O. Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, A. Paino, N. Tezak, J. Tang, I. Babuschkin, S. Balaji, S. Jain, W. Saunders, C. Hesse, A. N. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, and W. Zaremba, “Evaluating Large Language Models Trained on Code,” Jul. 2021

2021

Earlier work this paper cites.

R. Mukherjee, Y. Wen, D. Chaudhari, T. Reps, S. Chaudhuri, and C. Jermaine, “Neural Program Generation Modulo Static Analysis,” in Advances in Neural Information Processing Systems , vol. 34. Virtual: Curran Associates, Inc., 2021, pp. 18 984–18 996

2021

Earlier work this paper cites.

S. Kim, J. Zhao, Y. Tian, and S. Chandra, “Code Prediction by Feeding Trees to Transformers,” in 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) , ser. ISCE ’21. Madrid, Spain: IEEE Press, May 2021, pp. 150–162

2021

Earlier work this paper cites.

M. Bavarian, H. Jun, N. Tezak, J. Schulman, C. McLeavey, J. Tworek, and M. Chen, “Efficient Training of Language Models to Fill in the Middle,” Jul. 2022

2022

Earlier work this paper cites.

F. Liu, G. Li, B. Wei, X. Xia, Z. Fu, and Z. Jin, “A unified multi-task learning model for AST-level and token-level code completion,” Empirical Software Engineering , vol. 27, no. 4, p. 91, Apr. 2022

2022

Earlier work this paper cites.

P. S. Foundation, “Lexical analysis,” https://docs.python.org/3/reference/lexical\_analysis.html

2022

Earlier work this paper cites.

D. Kocetkov, R. Li, L. B. Allal, J. Li, C. Mou, C. M. Ferrandis, Y. Jernite, M. Mitchell, S. Hughes, T. Wolf, D. Bahdanau, L. von Werra, and H. de Vries, “The Stack: 3 TB of permissively licensed source code,” Nov. 2022

2022

Cited alongside, same era.

Github, Inc., “GitHub Copilot ⋅ \cdot Your AI pair programmer,” https://github.com/features/copilot, 2023

2023

Cited alongside, same era.

R. Li, L. B. Allal, Y. Zi, N. Muennighoff, D. Kocetkov, C. Mou, M. Marone, C. Akiki, J. Li, J. Chim, Q. Liu, E. Zheltonozhskii, T. Y. Zhuo, T. Wang, O. Dehaene, M. Davaadorj, J. Lamy-Poirier, J. Monteiro, O. Shliazhko, N. Gontier, N. Meade, A. Zebaze, M.-H. Yee, L. K. Umapathi, J. Zhu, B. Lipkin, M. Oblokulov, Z. Wang, R. Murthy, J. Stillerman, S. S. Patel, D. Abulkhanov, M. Zocca, M. Dey, Z. Zhang, N. Fahmy, U. Bhattacharyya, W. Yu, S. Singh, S. Luccioni, P. Villegas, M. Kunakov, F. Zhdanov, M. Romero, T. Lee, N. Timor, J. Ding, C. Schlesinger, H. Schoelkopf, J. Ebert, T. Dao, M. Mishra, A. Gu, J. Robinson, C. J. Anderson, B. Dolan-Gavitt, D. Contractor, S. Reddy, D. Fried, D. Bahdanau, Y. Jernite, C. M. Ferrandis, S. Hughes, T. Wolf, A. Guha, L. von Werra, and H. de Vries, “StarCoder: May the source be with you!” May 2023

SRI, “LQML,” SRI Lab, ETH Zurich, Aug. 2023

2023

Later among the works it cites.

B. T. Willard and R. Louf, “Efficient guided generation for large language models,” 2023

2023

Later among the works it cites.

E. Shinan, “Lark - A Parsing Toolkit for Python,” 2023

2023

Later among the works it cites.

L. B. Allal, R. Li, D. Kocetkov, C. Mou, C. Akiki, C. M. Ferrandis, N. Muennighoff, M. Mishra, A. Gu, M. Dey, L. K. Umapathi, C. J. Anderson, Y. Zi, J. L. Poirier, H. Schoelkopf, S. Troshin, D. Abulkhanov, M. Romero, M. Lappert, F. De Toni, B. G. del Río, Q. Liu, S. Bose, U. Bhattacharyya, T. Y. Zhuo, I. Yu, P. Villegas, M. Zocca, S. Mangrulkar, D. Lansky, H. Nguyen, D. Contractor, L. Villa, J. Li, D. Bahdanau, Y. Jernite, S. Hughes, D. Fried, A. Guha, H. de Vries, and L. von Werra, “SantaCoder: Don’t reach for the stars!” Feb. 2023

2023

Later among the works it cites.