2022

TSSB-3M: Mining single statement bugs at massive scale

Richter, Cedric, Wehrheim, Heike

Understand

Single statement bugs are one of the most important ingredients in the evaluation of modern bug detection and automatic program repair methods.

By affecting only a single statement, single statement bugs represent a type of bug often overlooked by developers, while still being small enough to be detected and fixed by automatic methods.
With the rise of data-driven automatic repair the availability of single statement bugs at the scale of millionth of examples is more important than ever; not only for testing these methods but also for providing sufficient real world examples for training.
To provide access to bug fix datasets of this scale, we are releasing two datasets called SSB-9M and TSSB-3M.

Built on

Étude comparative de la distribution florale dans une portion des Alpes et des Jura
Paul Jaccard. 1901 · 1901
Earlier work this paper cites.
Neural Program Repair by Jointly Learning to Localize and Repair
Original
Marko Vasic, Aditya Kanade, Petros Maniatis, David Bieber, and Rishabh Singh. 2019 · 1904
Earlier work this paper cites.
An Improved Error Model for Noisy Channel Spelling Correction. In Proceedings of the 38th Annual Meeting on Association for Computational Linguistics (Hong Kong) (ACL ’00) . Association for Computational Linguistics, USA, 286–293
Eric Brill and Robert C. Moore. 2000 · 2000
Earlier work this paper cites.
Using static analysis to find bugs
Nathaniel Ayewah, William Pugh, David Hovemeyer, J David Morgenthaler, and John Penix. 2008 · 2008
Earlier work this paper cites.
The unreasonable effectiveness of data
Alon Halevy, Peter Norvig, and Fernando Pereira. 2009 · 2009
Earlier work this paper cites.
The impact of tangled code changes. In 2013 10th Working Conference on Mining Software Repositories (MSR) . IEEE, 121–130
Kim Herzig and Andreas Zeller. 2013 · 2013
Earlier work this paper cites.
Fine-grained and accurate source code differencing. In ACM/IEEE International Conference on Automated Software Engineering, ASE ’14, Vasteras, Sweden - September 15 - 19, 2014 . 313–324
Jean-Rémy Falleri, Floréal Morandat, Xavier Blanc, Matias Martinez, and Martin Monperrus. 2014 · 2014
Earlier work this paper cites.
Tricorder: Building a program analysis ecosystem. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering , Vol. 1. IEEE, 598–608
Caitlin Sadowski, Jeffrey Van Gogh, Ciera Jaspan, Emma Soderberg, and Collin Winter. 2015 · 2015
Earlier work this paper cites.
Incorporating copying mechanism in sequence-to-sequence learning
Original
Jiatao Gu, Zhengdong Lu, Hang Li, and Victor OK Li. 2016 · 2016
Earlier work this paper cites.

Similar

Revisiting unreasonable effectiveness of data in deep learning era. In Proceedings of the IEEE international conference on computer vision . 843–852
Chen Sun, Abhinav Shrivastava, Saurabh Singh, and Abhinav Gupta. 2017 · 2017
Cited alongside, same era.
Learning to Represent Programs with Graphs. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings . OpenReview.net
Miltiadis Allamanis, Marc Brockschmidt, and Mahmoud Khademi. 2018 · 2018
Cited alongside, same era.
Deepbugs: A learning approach to name-based bug detection
Michael Pradel and Koushik Sen. 2018 · 2018
Cited alongside, same era.
Getafix: Learning to fix bugs automatically
Johannes Bader, Andrew Scott, Michael Pradel, and Satish Chandra. 2019 · 2019
Cited alongside, same era.
Sequencer: Sequence-to-sequence learning for end-to-end program repair
Zimin Chen, Steve James Kommrusch, Michele Tufano, Louis-Noël Pouchet, Denys Poshyvanyk, and Martin Monperrus. 2019 · 2019
Cited alongside, same era.
Global relational models of source code. In International conference on learning representations
Vincent J Hellendoorn, Charles Sutton, Rishabh Singh, Petros Maniatis, and David Bieber. 2019 · 2019
Cited alongside, same era.
An empirical study on learning bug-fixing patches in the wild via neural machine translation
Michele Tufano, Cody Watson, Gabriele Bavota, Massimiliano Di Penta, Martin White, and Denys Poshyvanyk. 2019 · 2019
Cited alongside, same era.
How often do single-statement bugs occur? the manysstubs4j dataset. In Proceedings of the 17th International Conference on Mining Software Repositories . 573–577
Rafael-Michael Karampatsis and Charles Sutton. 2020 · 2020
Cited alongside, same era.

Then

Libraries.io Open Source Repository and Dependency Metadata
Jeremy Katz. 2020 · 2020
Later among the works it cites.
Coconut: combining context-aware neural translation models using ensemble for program repair. In Proceedings of the 29th ACM SIGSOFT international symposium on software testing and analysis . 101–114
Thibaud Lutellier, Hung Viet Pham, Lawrence Pang, Yitong Li, Moshi Wei, and Lin Tan. 2020 · 2020
Later among the works it cites.
Towards a Benchmark Set for Program Repair Based on Partial Fixes
Original
Dirk Beyer, Lars Grunske, Thomas Lemberger, and Minxing Tang. 2021 · 2021
Later among the works it cites.
PySStuBs: Characterizing Single-Statement Bugs in Popular Open-Source Python Projects. In 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR) . IEEE, 520–524
Arthur V Kamienski, Luisa Palechor, Cor-Paul Bezemer, and Abram Hindle. 2021 · 2021
Later among the works it cites.
Applying CodeBERT for Automated Program Repair of Java Simple Bugs. In 18th IEEE/ACM International Conference on Mining Software Repositories, MSR 2021, Madrid, Spain, May 17-19, 2021 . IEEE, 505–509
Ehsan Mashhadi and Hadi Hemmati. 2021 · 2021
Later among the works it cites.
DeepMutants: Training neural bug detectors with contextual mutations
Original
Cedric Richter and Heike Wehrheim. 2021 · 2021
Later among the works it cites.
Neural software analysis
Michael Pradel and Satish Chandra. 2022 · 2022
Closest in time.
Learning Realistic Mutations: Bug Creation for Neural Bug Detectors
Cedric Richter and Heike Wehrheim. 2022 · 2022
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…