BugSwarm: Mining and Continuously Growing a Dataset of Reproducible Failures and Fixes

Experiments of the Effectiveness of Dataflow- and Controlflow-Based Test Adequacy Criteria

M. Hutchins, H. Foster, T. Goradia, and T. J. Ostrand · 1994

Earlier work this paper cites.

Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact

H. Do, S. G. Elbaum, and G. Rothermel · 2005

Earlier work this paper cites.

Bugbench: Benchmarks for Evaluating Bug Detection Tools

S. Lu, Z. Li, F. Qin, L. Tan, P. Zhou, and Y. Zhou · 2005

Earlier work this paper cites.

Extraction of Bug Localization Benchmarks from History

V. Dallmeier and T. Zimmermann · 2007

Earlier work this paper cites.

BegBunch: Benchmarking for C Bug Detection Tools

C. Cifuentes, C. Hoermann, N. Keynes, L. Li, S. Long, E. Mealy, M. Mounteney, and B. Scholz · 2009

Earlier work this paper cites.

Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs

R. Just, D. Jalali, and M. D. Ernst · 2014

Earlier work this paper cites.

An Empirical Analysis of Flaky Tests

Q. Luo, F. Hariri, L. Eloussi, and D. Marinov · 2014

Earlier work this paper cites.

Work Practices and Challenges in Pull-Based Development: The Integrator’s Perspective

G. Gousios, A. Zaidman, M. D. Storey, and A. van Deursen · 2015

Earlier work this paper cites.

The ManyBugs and IntroClass Benchmarks for Automated Repair of C Programs

C. Le Goues, N. Holtschulte, E. K. Smith, Y. Brun, P. T. Devanbu, S. Forrest, and W. Weimer · 2015

Earlier work this paper cites.

Quality and Productivity Outcomes Relating to Continuous Integration in GitHub

B. Vasilescu, Y. Yu, H. Wang, P. T. Devanbu, and V. Filkov · 2015

Earlier work this paper cites.

TravisTorrent: Synthesizing Travis CI and GitHub for Full-Stack Research on Continuous Integration

M. Beller, G. Gousios, and A. Zaidman · 2017

Cited alongside, same era.

Bugs.jar: A Large-Scale, Diverse Dataset of Real-World Java Bugs

R. K. Saha, Y. Lyu, W. Lam, H. Yoshida, and M. R. Prasad · 2018

Cited alongside, same era.

BugZoo: A Platform for Studying Software Bugs

C. S. Timperley, S. Stepney, and C. Le Goues · 2018

Cited alongside, same era.

Bugs in the Wild: Examining the Effectiveness of Static Analyzers at Finding Real-World Bugs

D. A. Tomassi · 2018

Cited alongside, same era.

How to Design a Program Repair Bot?: Insights from the Repairnator Project

S. Urli, Z. Yu, L. Seinturier, and M. Monperrus · 2018

Cited alongside, same era.

http://ant.apache.org , Accessed 2019

Apache Ant · 2019

https://github.com/google/error-prone , Accessed 2019

Error Prone · 2019

Closest in time.

https://gradle.org , Accessed 2019

Gradle Build Tool · 2019

Closest in time.

https://junit.org/junit5 , Accessed 2019

JUnit Test Framework · 2019

Closest in time.

https://maven.apache.org , Accessed 2019

Apache Maven Project · 2019

Closest in time.

http://nose.readthedocs.io/en/latest , Accessed 2019

Test Framework nose · 2019

Closest in time.

https://docs.pytest.org/en/latest , Accessed 2019

Test Framework pytest · 2019

Closest in time.

https://spotbugs.readthedocs.io/en/latest/bugDescriptions.html , Accessed 2019

SpotBugs Bug Descriptions · 2019