Fetching the paper…
Reading the bibliography…
Transformer-based pre-trained models have recently achieved great results in solving many software engineering tasks including automatic code completion which is a staple in a developer's toolkit.
“Language models are few-shot learners”
Tom Brown et al · 1901
Earlier work this paper cites.
“Cloze-driven Pretraining of Self-attention Networks”
Alexei Baevski et al · 1903
Earlier work this paper cites.
“RoBERTa: A Robustly Optimized BERT Pretraining Approach”
Yinhan Liu et al · 1907
Earlier work this paper cites.
“Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer”
Colin Raffel et al · 1910
Earlier work this paper cites.
“A stochastic approximation method”
Herbert Robbins and Sutton Monro · 1951
Earlier work this paper cites.
“CodeBERT: A Pre-Trained Model for Programming and Natural Languages”, 2020
Zhangyin Feng et al · 2002
Earlier work this paper cites.
“Bleu: A Method for Automatic Evaluation of Machine Translation”
Kishore Papineni, Salim Roukos, Todd Ward and Wei-Jing Zhu · 2002
Earlier work this paper cites.
“ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation”
Chin-Yew Lin and Franz Och · 2004
Earlier work this paper cites.
“ROUGE: A Package for Automatic Evaluation of Summaries”
Chin-Yew Lin · 2004
Earlier work this paper cites.
“The significance of recall in automatic metrics for MT Evaluation”
Alon Lavie, Kenji Sagae and Shyamsundar Jayaraman · 2004
Earlier work this paper cites.
“LambdaNet: Probabilistic Type Inference using Graph Neural Networks”
Jiayi Wei, Maruth Goyal, Greg Durrett and Isil Dillig · 2005
Earlier work this paper cites.
“METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments”
Satanjeev Banerjee and Alon Lavie · 2005
Earlier work this paper cites.
“On the naturalness of software”
Abram Hindle et al · 2016
Earlier work this paper cites.
“A study of visual studio usage in practice”
Sven Amann, Sebastian Proksch, Sarah Nadi and Mira Mezini · 2016
Earlier work this paper cites.
Ashish Vaswani et al · 2017
Earlier work this paper cites.
“A language model for statements of software code”
Yixiao Yang et al · 2017
Earlier work this paper cites.
“BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”
Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova · 2018
Cited alongside, same era.
“Deep Learning Type Inference”, ESEC/FSE 2018
Vincent. Hellendoorn, Christian Bird, Earl. Barr and Miltiadis Allamanis · 2018
Cited alongside, same era.
“Improving Language Understanding by Generative Pre-Training”, 2018
Alec Radford, Karthik Narasimhan, Tim Salimans and Ilya Sutskever · 2018
Cited alongside, same era.
“A Call for Clarity in Reporting BLEU Scores”
Matt Post · 2018
Cited alongside, same era.
“Language Models are Unsupervised Multitask Learners”, 2019
Alec Radford et al · 2019
Cited alongside, same era.
“Combining program analysis and statistical language model for code statement completion”
“An Empirical Study on Code Comment Completion”
Antonio Mastropaolo, Emad Aghajani, Luca Pascarella and Gabriele Bavota · 2021
Later among the works it cites.
“An Empirical Study on the Usage of Transformer Models for Code Completion”
Matteo Ciniselli et al · 2021
Later among the works it cites.
“An Empirical Study on the Usage of BERT Models for Code Completion”
Matteo Ciniselli et al · 2021
Later among the works it cites.
“Empirical study of transformers for source code”
Nadezhda Chirkova and Sergey Troshin · 2021
Later among the works it cites.
“Topic recommendation for software repositories using multi-label classification algorithms”
Maliheh Izadi, Abbas Heydarnoori and Georgios Gousios · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Son Nguyen, Tien Nguyen, Yi Li and Shaohua Wang · 2019
Cited alongside, same era.
“NL2Type: Inferring JavaScript Function Types from Natural Language Information”
Rabee Malik, Jibesh Patra and Michael Pradel · 2019
Cited alongside, same era.
“CodeSearchNet challenge: Evaluating the state of semantic code search”
Hamel Husain et al · 2019
Cited alongside, same era.
“The adverse effects of code duplication in machine learning models of code”
Miltiadis Allamanis · 2019
Cited alongside, same era.
“A neural model for generating natural language summaries of program subroutines”
Alexander LeClair, Siyuan Jiang and Collin McMillan · 2019
Cited alongside, same era.
“Intellicode compose: Code generation using transformer”
Alexey Svyatkovskiy, Shao Deng, Shengyu Fu and Neel Sundaresan · 2020
Cited alongside, same era.
“A theory of dual channel constraints”
Casey Casalnuovo et al · 2020
Cited alongside, same era.
Maliheh Izadi, Pooya Mazrae, Tom Mens and Arie van Deursen · 2022
Later among the works it cites.
“Catiss: An intelligent tool for categorizing issues reports using transformers”
Maliheh Izadi · 2022
Later among the works it cites.
“UniXcoder: Unified Cross-Modal Pre-training for Code Representation”
Daya Guo et al · 2022
Later among the works it cites.
“Incoder: A generative model for code infilling and synthesis”
Daniel Fried et al · 2022
Later among the works it cites.
“CodeFill: Multi-token Code Completion by Jointly Learning from Structure and Naming Sequences”
Maliheh Izadi, Roberta Gismondi and Georgios Gousios · 2022
Later among the works it cites.
“Cm3: A causal masked multimodal model of the internet”
Armen Aghajanyan et al · 2022
Later among the works it cites.
“Predicting the objective and priority of issue reports in software repositories”
Maliheh Izadi, Kiana Akbari and Abbas Heydarnoori · 2022
Later among the works it cites.
“On the evaluation of nlp-based models for software engineering”
Maliheh Izadi and Matin Ahmadabadi · 2022
Later among the works it cites.
“12 ECMAScript Language: Lexical Grammar”
Shu-yu Guo, Michael Ficarra and Kevin Gibbons · 2022
Later among the works it cites.
“STACC: Code Comment Classification using SentenceTransformers”
Ali Al-Kaswan, Maliheh Izadi and Arie van Deursen · 2023
Closest in time.
“Extending Source Code Pre-Trained Language Models to Summarise Decompiled Binaries”
Ali Al-Kaswan et al · 2023
Closest in time.