Fetching the paper…
Reading the bibliography…
AI-based systems are software systems with functionalities enabled by at least one AI component (e.g., for image- and speech-recognition, and autonomous driving).
Taejoon Byun, Vaibhav Sharma, Abhishek Vijayakumar, Sanjai Rayadurgam, and Darren Cofer. 2019 · 1901
Earlier work this paper cites.
Towards testing of deep learning systems with training set reduction
Helge Spieker and Arnaud Gotlieb. 2019 · 1901
Earlier work this paper cites.
DeepFault: Fault Localization for Deep Neural Networks
Hasan Ferit Eniser, Simos Gerasimou, and Alper Sen. 2019 · 1902
Earlier work this paper cites.
Paracosm: A language and tool for testing autonomous driving systems
Rupak Majumdar, Aman Mathur, Marcus Pirron, Laura Stegner, and Damien Zufferey. 2019 · 1902
Earlier work this paper cites.
Yang Feng, Qingkai Shi, Xinyu Gao, Jun Wan, Chunrong Fang, and Zhenyu Chen. 2020 · 1903
Earlier work this paper cites.
Open Problems in Engineering Machine Learning Systems and the Quality Model
Hiroshi Kuwajima, Hirotoshi Yasuoka, and Toshihiro Nakae. 2019 · 1904
Earlier work this paper cites.
Engineering problems in machine learning systems
Hiroshi Kuwajima, Hirotoshi Yasuoka, and Toshihiro Nakae. 2020 · 1904
Earlier work this paper cites.
Harald Foidl, Michael Felderer, and Stefan Biffl. 2019 · 1905
Earlier work this paper cites.
What do developers ask about ML libraries? A large-scale study using stack overflow
Md Johirul Islam, Hoan Anh Nguyen, Rangeet Pan, and Hridesh Rajan. 2019b · 1906
Earlier work this paper cites.
Machine learning software engineering in practice: An industrial case study
Saidur Rahman, Emilio River, Foutse Khomh, Yann Gal Guhneuc, and Bernd Lehnert. 2019 · 1906
Earlier work this paper cites.
Hiroshi Kuwajima and Fuyuki Ishikawa. 2019 · 1908
Earlier work this paper cites.
Andreas Vogelsang and Markus Borg. 2019 · 1908
Earlier work this paper cites.
Qianyu Guo, Sen Chen, Xiaofei Xie, Lei Ma, Qiang Hu, Hongtao Liu, Yang Liu, Jianjun Zhao, and Xiaohong Li. 2019 · 1909
Earlier work this paper cites.
Engineering reliable deep learning systems
P. Santhanam, Eitan Farchi, and Victor Pankratius. 2019 · 1910
Earlier work this paper cites.
Software engineering practice in the development of deep learning applications
Xufan Zhang, Yilin Yang, Yang Feng, and Zhenyu Chen. 2019b · 1910
Earlier work this paper cites.
Counterexample-guided synthesis of perception models and control
Shromona Ghosh, Hadi Ravanbakhsh, and Sanjit A. Seshia. 2019 · 1911
Earlier work this paper cites.
Applying deep learning to airbnb search
Malay Haldar, Mustafa Abdool, Prashant Ramanathan, Tao Xu, Shulin Yang, Huizhong Duan, Qing Zhang, Nick Barrow-Williams, Bradley C. Turnbull, Brendan M. Collins, and Thomas Legrand. 2018 · 1935
Earlier work this paper cites.
Software engineering : report on a conference sponsored by the NATO Science Committee, Garmisch, Germany, 7th to 11th October 1968 . Scientific Affairs Division, NATO
Peter. Naur, Brian Randell, Friedrich Ludwig Bauer, and NATO Science Committee. (Eds.). 1969 · 1968
Earlier work this paper cites.
Does AI have a methodology which is different from software engineering?
D. Partridge and Y. Wilks. 1987 · 1987
Earlier work this paper cites.
The Goal Question Metric Approach. In Encyclopedia of Software Engineering , Vol. 2. John Wiley & Sons, 528––532
V. Basili, G. Caldiera, and H. D. Rombach. 1994 · 1994
Earlier work this paper cites.
Benchmarking Kappa: Interrater Agreement in Software Process Assessments
Khaled El Emam. 1999 · 1999
Earlier work this paper cites.
Engineering AI Systems: A Research Agenda
Jan Bosch, Ivica Crnkovic, and Helena Holmström Olsson. 2020 · 2001
Earlier work this paper cites.
Christian Kästner and Eunsuk Kang. 2020 · 2001
Earlier work this paper cites.
Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, and Parker Barnes. 2020 · 2001
Earlier work this paper cites.
Simos Gerasimou, Hasan Ferit Eniser, Alper Sen, and Alper Cakan. 2020 · 2002
Earlier work this paper cites.
Trustworthy AI in the age of pervasive computing and big data
Abhishek Kumar, Tristan Braud, Sasu Tarkoma, and Pan Hui. 2020 · 2002
Earlier work this paper cites.
Youcheng Sun, Yifan Zhou, Simon Maskell, James Sharp, and Xiaowei Huang. 2020 · 2002
Earlier work this paper cites.
Daniel J. Fremont, Edward Kim, Yash Vardhan Pant, Sanjit A. Seshia, Atul Acharya, Xantha Bruso, Paul Wells, Steve Lemke, Qiang Lu, and Shalin Mehta. 2020 · 2003
Earlier work this paper cites.
Silverio Martínez-Fernández, Xavier Franch, Andreas Jedlitschka, Marc Oriol, and Adam Trendowicz. 2020 · 2003
Earlier work this paper cites.
End-to-end robustness for sensing-reasoning machine learning pipelines
Zhuolin Yang, Zhikuan Zhao, Hengzhi Pei, Boxin Wang, Bojan Karlas, Ji Liu, Heng Guo, Bo Li, and Ce Zhang. 2020 · 2003
Earlier work this paper cites.
Procedures for performing systematic reviews
Barbara Kitchenham. 2004 · 2004
Earlier work this paper cites.
Lessons from applying the systematic literature review process within the software engineering domain
Pearl Brereton, Barbara A. Kitchenham, David Budgen, Mark Turner, and Mohamed Khalil. 2007 · 2006
Earlier work this paper cites.
Guidelines for performing systematic literature reviews in software engineering
Barbara Kitchenham and Stuart Charters. 2007 · 2007
Earlier work this paper cites.
Systematic Mapping Studies in Software Engineering. In Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering . BCS Learning & Development, 68–77
Kai Petersen, Robert Feldt, Shahid Mujtaba, and Michael Mattsson. 2008 · 2008
Earlier work this paper cites.
Stress Testing an AI Based Web Service: A Case Study. In 2010 Seventh International Conference on Information Technology: New Generations . IEEE, 1004–1008
Anand Chakravarty. 2010 · 2010
Earlier work this paper cites.
A method for evaluating rigor and industrial relevance of technology evaluations
Martin Ivarsson and Tony Gorschek. 2010 · 2010
Earlier work this paper cites.
Lowering the barrier to applying machine learning. In Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology - UIST '10 . ACM Press, 355–358
Kayur Patel. 2010 · 2010
Earlier work this paper cites.
An abstraction-refinement approach to verification of artificial neural networks
Luca Pulina and Armando Tacchella. 2010 · 2010
Earlier work this paper cites.
Empirical Standards for Software Engineering Research
Paul Ralph, Nauman bin Ali, Sebastian Baltes, Domenico Bianculli, Jessica Diaz, Yvonne Dittrich, Neil Ernst, Michael Felderer, Robert Feldt, Antonio Filieri, Breno Bernard Nicolau de França, Carlo Alberto Furia, Greg Gay, Nicolas Gold, Daniel Graziotin, Pinjia He, Rashina Hoda, Natalia Juristo, Barbara Kitchenham, Valentina Lenarduzzi, Jorge Martínez, Jorge Melegati, Daniel Mendez, Tim Menzies, Jefferson Molleri, Dietmar Pfahl, Romain Robbes, Daniel Russo, Nyyti Saarimäki, Federica Sarro, Davide Taibi, Janet Siegmund, Diomidis Spinellis, Miroslaw Staron, Klaas Stol, Margaret-Anne Storey, Davide Taibi, Damian Tamburri, Marco Torchiano, Christoph Treude, Burak Turhan, Xiaofeng Wang, and Sira Vegas. 2021 · 2010
Earlier work this paper cites.
Recommended steps for thematic synthesis in software engineering. In 2011 international symposium on empirical software engineering and measurement . IEEE, 275–284
Daniela S Cruzes and Tore Dyba. 2011 · 2011
Earlier work this paper cites.
Human model evaluation in interactive supervised learning. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11 . ACM Press, 147–156
Rebecca Fiebrink, Perry R. Cook, and Dan Trueman. 2011 · 2011
Earlier work this paper cites.
ISO/IEC 25010 - Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - System and software quality models
International Organization For Standardization. 2011 · 2011
Earlier work this paper cites.
An Empirical Study of Bugs in Machine Learning Systems. In 2012 IEEE 23rd International Symposium on Software Reliability Engineering . IEEE, 271–280
Ferdian Thung, Shaowei Wang, David Lo, and Lingxiao Jiang. 2012 · 2012
Earlier work this paper cites.
On the reliability of mapping studies in software engineering
Claes Wohlin, Per Runeson, Paulo Anselmo da Mota Silveira Neto, Emelie Engström, Ivan do Carmo Machado, and Eduardo Santana de Almeida. 2013 · 2013
Earlier work this paper cites.
Swebok Version 3.0
Pierre Bourque and E Richard. 2014 · 2014
Earlier work this paper cites.
Research Directions for Engineering Big Data Analytics Software
Carlos E. Otero and Adrian Peter. 2015 · 2014
Earlier work this paper cites.
Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering - EASE '14 . ACM Press, New York, NY, USA, Article 38
Claes Wohlin. 2014 · 2014
Earlier work this paper cites.
Principles of Explanatory Debugging to Personalize Interactive Machine Learning. In Proceedings of the 20th International Conference on Intelligent User Interfaces . ACM, 126–137
Todd Kulesza, Margaret Burnett, Weng-Keen Wong, and Simone Stumpf. 2015 · 2015
Earlier work this paper cites.
Guidelines for conducting systematic mapping studies in software engineering: An update
Kai Petersen, Sairam Vakkalanka, and Ludwik Kuzniarz. 2015 · 2015
Earlier work this paper cites.
Hidden technical debt in machine learning systems
D. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean François Crespo, and Dan Dennison. 2015 · 2015
Earlier work this paper cites.
Concrete Problems in AI Safety
Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, and Dan Mané. 2016 · 2016
Earlier work this paper cites.
TensorFlow Debugger: Debugging Dataflow Graphs for Machine Learning. In Proceedings of the Reliable Machine Learning in the Wild - NIPS 2016 Workshop (2016)
Shanqing Cai, Eric Breck, Eric Nielsen, Michael Salib, and D Sculley. 2016 · 2016
Earlier work this paper cites.
Debugging Machine Learning Tasks
Aleksandar Chakarov, Aditya Nori, Sriram Rajamani, Shayak Sen, and Deepak Vijaykeerthy. 2016 · 2016
Earlier work this paper cites.
Trials and tribulations of developers of intelligent systems: A field study. In 2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) . IEEE, 162–170
Charles Hill, Rachel Bellamy, Thomas Erickson, and Margaret Burnett. 2016 · 2016
Earlier work this paper cites.
Challenges in Autonomous Vehicle Testing and Validation
Philip Koopman and Michael Wagner. 2016 · 2016
Earlier work this paper cites.
Learning with safety requirements: State of the art and open questions
Francesco Leofante, Luca Pulina, and Armando Tacchella. 2016 · 2016
Earlier work this paper cites.
Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016 · 2016
Earlier work this paper cites.
Towards Verified Artificial Intelligence
Sanjit A. Seshia, Dorsa Sadigh, and S. Shankar Sastry. 2016 · 2016
Earlier work this paper cites.
Stealing Machine Learning Models via Prediction APIs. In 25th USENIX Security Symposium (USENIX Security 16)
Florian Tramèr, Fan Zhang, Ari Juels, Michael K. Reiter, and Thomas Ristenpart. 2016 · 2016
Earlier work this paper cites.
Kush R. Varshney. 2016 · 2016
Earlier work this paper cites.
On the Safety of Machine Learning: Cyber-Physical Systems, Decision Sciences, and Data Products
Kush R. Varshney and Homa Alemzadeh. 2017 · 2016
Earlier work this paper cites.
Artificial intelligence poised to ride a new wave
Gary Anthes. 2017 · 2017
Earlier work this paper cites.
Infrastructure for usable machine learning: The stanford DAWN project
Peter Bailis, Kunle Olukotun, Christopher Ré, and Matei Zaharia. 2017 · 2017
Earlier work this paper cites.
TFX: A TensorFlow-Based Production-Scale Machine Learning Platform. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . ACM, 1387–1395
Denis Baylor, Eric Breck, Heng-Tze Cheng, Noah Fiedel, Chuan Yu Foo, Zakaria Haque, Salem Haykal, Mustafa Ispir, Vihan Jain, Levent Koc, Chiu Yuen Koo, Lukasz Lew, Clemens Mewald, Akshay Naresh Modi, Neoklis Polyzotis, Sukriti Ramesh, Sudip Roy, Steven Euijong Whang, Martin Wicke, Jarek Wilkiewicz, Xin Zhang, and Martin Zinkevich. 2017 · 2017
Earlier work this paper cites.
The ML test score: A rubric for ML production readiness and technical debt reduction. In 2017 IEEE International Conference on Big Data (Big Data) . IEEE, 1123–1132
Eric Breck, Shanqing Cai, Eric Nielsen, Michael Salib, and D. Sculley. 2017 · 2017
Earlier work this paper cites.
Standardizing Ethical Design for Artificial Intelligence and Autonomous Systems
Joanna Bryson and Alan Winfield. 2017 · 2017
Earlier work this paper cites.
Making the Case for Safety of Machine Learning in Highly Automated Driving
Simon Burton, Lydia Gauerhof, and Christian Heinzemann. 2017 · 2017
Earlier work this paper cites.
Clipper: A low-latency online prediction serving system
Daniel Crankshaw, Xin Wang, Giulio Zhou, Michael J. Franklin, Joseph E. Gonzalez, and Ion Stoica. 2017 · 2017
Earlier work this paper cites.
Robust Physical-World Attacks on Deep Learning Models
Kevin Eykholt, Ivan Evtimov, Earlence Fernandes, Bo Li, Amir Rahmati, Chaowei Xiao, Atul Prakash, Tadayoshi Kohno, and Dawn Song. 2017 · 2017
Earlier work this paper cites.
A Conceptual Safety Supervisor Definition and Evaluation Framework for Autonomous Systems
Patrik Feth, Daniel Schneider, and Rasmus Adler. 2017 · 2017
Earlier work this paper cites.
Beyond the technical challenges for deploying Machine Learning solutions in a software company
Ilias Flaounas. 2017 · 2017
Earlier work this paper cites.
Open source software ecosystems: A Systematic mapping
Oscar Franco-Bedoya, David Ameller, Dolors Costal, and Xavier Franch. 2017 · 2017
Earlier work this paper cites.
DeepSafe: A Data-driven Approach for Checking Adversarial Robustness in Neural Networks
Divya Gopinath, Guy Katz, Corina S. Pasareanu, and Clark Barrett. 2017 · 2017
Earlier work this paper cites.
Ethical Challenges in Data-Driven Dialogue Systems
Peter Henderson, Koustuv Sinha, Nicolas Angelard-Gontier, Nan Rosemary Ke, Genevieve Fried, Ryan Lowe, and Joelle Pineau. 2017 · 2017
Earlier work this paper cites.
Safety Verification of Deep Neural Networks
Xiaowei Huang, Marta Kwiatkowska, Sen Wang, and Min Wu. 2017 · 2017
Earlier work this paper cites.
Safety assessment of automated vehicle functions by simulation-based fault injection. In 2017 IEEE International Conference on Vehicular Electronics and Safety (ICVES) . IEEE, 214–219
Garazi Juez, Estibaliz Amparan, Ray Lattarulo, Joshue Perez Rastelli, Alejandra Ruiz, and Huascar Espinoza. 2017 · 2017
Earlier work this paper cites.
Data Scientists in Software Teams: State of the Art and Challenges
Miryung Kim, Thomas Zimmermann, Robert DeLine, and Andrew Begel. 2018 · 2017
Earlier work this paper cites.
On the pragmatic design of literature studies in software engineering: an experience-based guideline
Marco Kuhrmann, Daniel Méndez Fernández, and Maya Daneva. 2017 · 2017
Cited alongside, same era.
Related Pins at Pinterest. In Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion . ACM Press, 583–592
David C. Liu, Stephanie Rogers, Raymond Shiau, Dmitry Kislyuk, Kevin C. Ma, Zhigang Zhong, Jenny Liu, and Yushi Jing. 2017 · 2017
Cited alongside, same era.
Assuring Fully Autonomous Vehicles Safety by Design: The Autonomous Vehicle Control (AVC) Module Strategy. In 2017 47th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W) . IEEE, 16–21
Caroline Bianca Santos Tancredi Molina, Jorge Rady de Almeida, Lucio F. Vismari, Rodrigo Ignacio R. Gonzalez, Jamil K. Naufal, and Joao Batista Camargo. 2017 · 2017
Cited alongside, same era.
An Analysis of ISO 26262: Using Machine Learning Safely in Automotive Software
Rick Salay, Rodrigo Queiroz, and Krzysztof Czarnecki. 2017 · 2017
Cited alongside, same era.
Towards corner case detection for autonomous driving
Jan Aike Bolte, Andreas Bär, Daniel Lipinski, and Tim Fingscheidt. 2019 · 2019
Later among the works it cites.
Data Validation for Machine Learning
Eric Breck, Neoklis Polyzotis, Sudip Roy, Steven Euijong Whang, and Martin Zinkevich. 2019 · 2019
Later among the works it cites.
An instrument to evaluate the maturity of bias governance capability in artificial intelligence projects
D. L. Coates and A. Martin. 2019 · 2019
Later among the works it cites.
Towards a Software Engineering Framework for the Design, Construction and Deployment of Machine Learning-Based Solutions in Digitalization Processes
Ricardo Colomo-Palacios. 2019 · 2019
Later among the works it cites.
Understanding Development Process of Machine Learning Systems: Challenges and Solutions. In 2019 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) . IEEE, 1–6
Elizamary de Souza Nascimento, Iftekhar Ahmed, Edson Oliveira, Marcio Piedade Palheta, Igor Steinmacher, and Tayana Conte. 2019 · 2019
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
On a Formal Model of Safe and Scalable Self-driving Cars
Shai Shalev-Shwartz, Shaked Shammah, and Amnon Shashua. 2017 · 2017
Cited alongside, same era.
Machine teaching a new paradigm for building machine learning systems
Patrice Y. Simard, Saleema Amershi, David M. Chickering, Alicia Edelman Pelton, Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, and John Wernsing. 2017 · 2017
Cited alongside, same era.
An Empirical Study on Real Bugs for Machine Learning Programs. In 2017 24th Asia-Pacific Software Engineering Conference (APSEC) . IEEE, 348–357
Xiaobing Sun, Tianchi Zhou, Gengjie Li, Jiajun Hu, Hui Yang, and Bin Li. 2017 · 2017
Cited alongside, same era.
Versioning for End-to-End Machine Learning Pipelines. In Proceedings of the 1st Workshop on Data Management for End-to-End Machine Learning . ACM
Tom van der Weide, Dimitris Papadopoulos, Oleg Smirnov, Michal Zielinski, and Tim van Kasteren. 2017 · 2017
Cited alongside, same era.
Bottester. In Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems . ACM, 1–4
Marisa Vasconcelos, Heloisa Candello, Claudio Pinhanez, and Thiago dos Santos. 2017 · 2017
Cited alongside, same era.
Observation Based Creation of Minimal Test Suites for Autonomous Vehicles. In 2017 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) . IEEE, 294–301
Christian Wolschke, Thomas Kuhn, Dieter Rombach, and Peter Liggesmeyer. 2017 · 2017
Cited alongside, same era.
The role of design in creating machine-learning-enhanced user experience
Qian Yang. 2017 · 2017
Cited alongside, same era.
Testing vision-based control systems using learnable evolutionary algorithms. In Proceedings of the 40th International Conference on Software Engineering . ACM, New York, NY, USA, 1016–1026
Raja Ben Abdessalem, Shiva Nejati, Lionel C. Briand, and Thomas Stifter. 2018 · 2018
Cited alongside, same era.
Later among the works it cites.
Ankush Desai, Shromona Ghosh, Sanjit A. Seshia, Natarajan Shankar, and Ashish Tiwari. 2019 · 2019
Later among the works it cites.
VerifAI: A Toolkit for the Formal Design and Analysis of Artificial Intelligence-Based Systems. In Computer Aided Verification , Isil Dillig and Serdar Tasiran (Eds.). Springer International Publishing, Cham, 432–442
Tommaso Dreossi, Daniel J. Fremont, Shromona Ghosh, Edward Kim, Hadi Ravanbakhsh, Marcell Vazquez-Chanlatte, and Sanjit A. Seshia. 2019 · 2019
Later among the works it cites.
DeepStellar: model-based quantitative analysis of stateful deep learning systems. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . ACM, 477–487
Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Yang Liu, and Jianjun Zhao. 2019a · 2019
Later among the works it cites.
A Quantitative Analysis Framework for Recurrent Neural Network. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 1062–1065
Xiaoning Du, Xiaofei Xie, Yi Li, Lei Ma, Yang Liu, and Jianjun Zhao. 2019b · 2019
Later among the works it cites.
Automatically testing self-driving cars with search-based procedural content generation. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis . ACM, 273–283
Alessio Gambi, Marc Mueller, and Gordon Fraser. 2019 · 2019
Later among the works it cites.
Invited Paper: What is AI Software Testing? and Why. In 2019 IEEE International Conference on Service-Oriented System Engineering (SOSE) . IEEE, 27–36
Jerry Gao, Chuanqi Tao, Dou Jie, and Shengqiang Lu. 2019 · 2019
Later among the works it cites.
Reusability in artificial neural networks. In Proceedings of the 23rd International Systems and Software Product Line Conference volume B - SPLC '19 . ACM Press
Javad Ghofrani, Ehsan Kozegar, Arezoo Bozorgmehr, and Mohammad Divband Soorati. 2019 · 2019
Later among the works it cites.
Model-based design for CPS with learning-enabled components. In Proceedings of the Workshop on Design Automation for CPS and IoT - DESTION '19 . ACM Press, 1–9
Charles Hartsell, Nagabhushan Mahadevan, Shreyas Ramakrishna, Abhishek Dubey, Theodore Bapty, Taylor Johnson, Xenofon Koutsoukos, Janos Sztipanovits, and Gabor Karsai. 2019 · 2019
Later among the works it cites.
Did We Test All Scenarios for Automated and Autonomous Driving Systems?. In 2019 IEEE Intelligent Transportation Systems Conference (ITSC) . IEEE, 2950–2955
Florian Hauer, Tabea Schmidt, Bernd Holzmuller, and Alexander Pretschner. 2019 · 2019
Later among the works it cites.
Non-Functional Requirements for Machine Learning: Challenges and New Directions. In 2019 IEEE 27th International Requirements Engineering Conference (RE) . IEEE, 386–391
Jennifer Horkoff. 2019 · 2019
Later among the works it cites.
ModelOps: Cloud-Based Lifecycle Management for Reliable and Trusted AI. In 2019 IEEE International Conference on Cloud Engineering (IC2E) . IEEE, 113–120
Waldemar Hummer, Vinod Muthusamy, Thomas Rausch, Parijat Dube, Kaoutar El Maghraoui, Anupama Murthi, and Punleuk Oum. 2019 · 2019
Later among the works it cites.
Recent Trends in Formal Validation and Verification of Autonomous Robots Software. In 2019 Third IEEE International Conference on Robotic Computing (IRC) . IEEE, 321–328
Felix Ingrand. 2019 · 2019
Later among the works it cites.
How Do Engineers Perceive Difficulties in Engineering of Machine-Learning Systems? - Questionnaire Survey. In 2019 IEEE/ACM Joint 7th International Workshop on Conducting Empirical Studies in Industry (CESI) and 6th International Workshop on Software Engineering Research and Industrial Practice (SER&IP) . IEEE, 2–9
Fuyuki Ishikawa and Nobukazu Yoshioka. 2019 · 2019
Later among the works it cites.
A comprehensive study on deep learning bug characteristics
Md Johirul Islam, Giang Nguyen, Rangeet Pan, and Hridesh Rajan. 2019a · 2019
Later among the works it cites.
Don't Forget Your Roots! Using Provenance Data for Transparent and Explainable Development of Machine Learning Models. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW) . IEEE, 37–40
Sophie F. Jentzsch and Nico Hochgeschwender. 2019 · 2019
Later among the works it cites.
Efficient Autonomy Validation in Simulation with Adaptive Stress Testing
Mark Koren and Mykel J. Kochenderfer. 2019 · 2019
Later among the works it cites.
Realization of a Machine Learning Domain Specific Modeling Language: A Baseball Analytics Case Study. In Proceedings of the 7th International Conference on Model-Driven Engineering and Software Development . SCITEPRESS - Science and Technology Publications, 13–24
Kaan Koseler, Kelsea McGraw, and Matthew Stephan. 2019 · 2019
Later among the works it cites.
Machine Learning in Artificial Intelligence: Towards a Common Understanding. In 52nd Hawaii International Conference on System Sciences, HICSS 2019, Grand Wailea, Maui, Hawaii, USA, January 8-11, 2019 , Tung Bui (Ed.). ScholarSpace, 1–10
Niklas Kühl, Marc Goutier, Robin Hirt, and Gerhard Satzger. 2019 · 2019
Later among the works it cites.
Sofware engneering challenges for machine learning applications: A literature review
Fumihiro Kumeno. 2019 · 2019
Later among the works it cites.
How do implementation bugs affect the results of machine learning algorithms?. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing . ACM, 1304–1313
Maurizio Leotta, Dario Olianas, Filippo Ricca, and Nicoletta Noceti. 2019 · 2019
Later among the works it cites.
A Taxonomy of Software Engineering Challenges for Machine Learning Systems: An Empirical Investigation
Lucy Ellen Lwakatare, Aiswarya Raj, Jan Bosch, Helena Holmström Olsson, and Ivica Crnkovic. 2019 · 2019
Later among the works it cites.
N-Version Machine Learning Models for Safety Critical Systems. In 2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W) . IEEE, 48–51
Fumio Machida. 2019a · 2019
Later among the works it cites.
On the Diversity of Machine Learning Models for System Reliability. In 2019 IEEE 24th Pacific Rim International Symposium on Dependable Computing (PRDC) . IEEE, 276–285
Fumio Machida. 2019b · 2019
Later among the works it cites.
Leveraging Business Transformation with Machine Learning Experiments
David Issa Mattos, Jan Bosch, and Helena Holmström Olsson. 2019 · 2019
Later among the works it cites.
Towards a framework for safety assurance of autonomous systems
John McDermid, Yan Jia, and Ibrahim Habli. 2019 · 2019
Later among the works it cites.
The Five Laws of SE for AI
Tim Menzies. 2020 · 2019
Later among the works it cites.
Data Management Challenges for Deep Learning. In 2019 45th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) . IEEE, 140–147
Aiswarya Munappy, Jan Bosch, Helena Holmstrom Olsson, Anders Arpteg, and Bjorn Brinne. 2019 · 2019
Later among the works it cites.
Quality Evaluation Assurance Levels for Deep Neural Networks Software. In 2019 International Conference on Technologies and Applications of Artificial Intelligence (TAAI) . IEEE
Shin Nakajima. 2019b · 2019
Later among the works it cites.
Solution Patterns for Machine Learning
Soroosh Nalchigar, Eric Yu, Yazan Obeidi, Sebastian Carbajales, John Green, and Allen Chan. 2019 · 2019
Later among the works it cites.
Safe-by-Design Development Method for Artificial Intelligent Based Systems. In Proceedings of the 31st International Conference on Software Engineering and Knowledge Engineering . KSI Research Inc. and Knowledge Systems Institute Graduate School, 391–397
Gabriel Pedroza and Adedjouma Morayo. 2019 · 2019
Later among the works it cites.
Intelligent software engineering in the context of agile software development: A systematic literature review
Mirko Perkusich, Lenardo Chaves e Silva, Alexandre Costa, Felipe Ramos, Renata Saraiva, Arthur Freire, Ednaldo Dilorenzo, Emanuel Dantas, Danilo Santos, Kyller Gorgônio, Hyggo Almeida, and Angelo Perkusich. 2020 · 2019
Later among the works it cites.
Toward Requirements Specification for Machine-Learned Components. In 2019 IEEE 27th International Requirements Engineering Conference Workshops (REW) . IEEE, 241–244
Mona Rahimi, Jin L.C. Guo, Sahar Kokaly, and Marsha Chechik. 2019 · 2019
Later among the works it cites.
Cognitive Modeling Approach for Dealing with Challenges in Cyber-Physical Systems
R.A. Rill, , and A. Lőrincz and. 2019 · 2019
Later among the works it cites.
Improving ML Safety with Partial Specifications
Rick Salay and Krzysztof Czarnecki. 2019 · 2019
Later among the works it cites.
Realizing the Promise of Artificial Intelligence for Unmanned Aircraft Systems through Behavior Bounded Assurance. In 2019 IEEE/AIAA 38th Digital Avionics Systems Conference (DASC) . IEEE
Prakash Sarathy, Sanjoy Baruah, Stephen Cook, and Marilyn Wolf. 2019 · 2019
Later among the works it cites.
Designing Safety Critical Software Systems to Manage Inherent Uncertainty. In 2019 IEEE International Conference on Software Architecture Companion (ICSA-C) . IEEE, 246–249
Alexandru Constantin Serban. 2019 · 2019
Later among the works it cites.
DeepConcolic: Testing and Debugging Deep Neural Networks. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) . IEEE, 111–114
Youcheng Sun, Xiaowei Huang, Daniel Kroening, James Sharp, Matthew Hill, and Rob Ashmore. 2019a · 2019
Later among the works it cites.
Structural Test Coverage Criteria for Deep Neural Networks
Youcheng Sun, Xiaowei Huang, Daniel Kroening, James Sharp, Matthew Hill, and Rob Ashmore. 2019b · 2019
Later among the works it cites.
Requirements-Driven Test Generation for Autonomous Vehicles With Machine Learning Components
Cumhur Erkan Tuncali, Georgios Fainekos, Danil Prokhorov, Hisahiro Ito, and James Kapinski. 2020 · 2019
Later among the works it cites.
How does Machine Learning Change Software Development Practices?
Zhiyuan Wan, Xin Xia, David Lo, and Gail C. Murphy. 2020 · 2019
Later among the works it cites.
Studying software engineering patterns for designing machine learning systems. In 2019 10th International Workshop on Empirical Software Engineering in Practice (IWESEP) . IEEE, 49–495
Hironori Washizaki, Hiromu Uchida, Foutse Khomh, and Yann-Gaël Guéhéneuc. 2019 · 2019
Later among the works it cites.
Deep Validation: Toward Detecting Real-World Corner Cases for Deep Neural Networks. In 2019 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN) . IEEE, 125–137
Weibin Wu, Hui Xu, Sanqiang Zhong, Michael R. Lyu, and Irwin King. 2019 · 2019
Later among the works it cites.
DiffChaser: Detecting Disagreements for Deep Neural Networks. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence . International Joint Conferences on Artificial Intelligence Organization, 5772–5778
Xiaofei Xie, Lei Ma, Haijun Wang, Yuekang Li, Yang Liu, and Xiaohong Li. 2019b · 2019
Later among the works it cites.
Machine Learning System Architectural Pattern for Improving Operational Stability. In 2019 IEEE International Conference on Software Architecture Companion (ICSA-C) . IEEE, 267–274
Haruki Yokoyama. 2019 · 2019
Later among the works it cites.
An Empirical Study of Common Challenges in Developing Deep Learning Applications. In 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE) . IEEE, 104–115
Tianyi Zhang, Cuiyun Gao, Lei Ma, Michael Lyu, and Miryung Kim. 2019a · 2019
Later among the works it cites.
Wujie Zheng, Wenyu Wang, Dian Liu, Changrong Zhang, Qinsong Zeng, Yuetang Deng, Wei Yang, Pinjia He, and Tao Xie. 2019 · 2019
Later among the works it cites.
Management of quality requirements in agile and rapid software development: A systematic mapping study
Woubshet Behutiye, Pertti Karhapää, Lidia López, Xavier Burgués, Silverio Martínez-Fernández, Anna Maria Vollmer, Pilar Rodríguez, Xavier Franch, and Markku Oivo. 2020 · 2020
Later among the works it cites.
On testing machine learning programs
Houssem Ben Braiek and Foutse Khomh. 2020 · 2020
Later among the works it cites.
A Cloud-Based Framework for Machine Learning Workloads and Applications
Alvaro Lopez Garcia, Jesus Marco De Lucas, Marica Antonacci, Wolfgang Zu Castell, Mario David, Marcus Hardt, Lara Lloret Iglesias, Germen Molto, Marcin Plociennik, Viet Tran, Andy S. Alic, Miguel Caballer, Isabel Campos Plasencia, Alessandro Costantini, Stefan Dlugolinsky, Doina Cristina Duma, Giacinto Donvito, Jorge Gomes, Ignacio Heredia Cacha, Keiichi Ito, Valentin Y. Kozlov, Giang Nguyen, Pablo Orviz Fernandez, Zdenek Sustr, and Pawel Wolniewicz. 2020 · 2020
Later among the works it cites.
Identifying Challenges to the Certification of Machine Learning for Safety Critical Systems. In Proceedings of the 10th European Congress on Embedded Real Time Systems (ERTS) . 10
Eric Jenn, Alexandre Albore, Franck Mamalet, Grégory Flandin, Christophe Gabreau, Hervé Delseny, Adrien Gauffriau, Hugues Bonnin, Lucian Alecu, Jérémy Pirard, Baptiste Lefevre, Jean-Marc Gabriel, Cyril Cappi, Laurent Gardès, Sylvaine Picard, Gilles Dulon, Brice Beltran, Jean-Christophe Bianic, Mathieu Damour, Kevin Delmas, and Claire Pagetti. 2020 · 2020
Later among the works it cites.
Testing Machine Learning Classifiers based on Compositional Metamorphic Relations
Minghua Jia, Xiaodong Wang, Yue Xu, Zhanqi Cui, and Ruilin Xie. 2020 · 2020
Later among the works it cites.
On the interplay between requirements, engineering, and artificial intelligence
Blagovesta Kostova, Seda Gürses, and Alain Wegmann. 2020 · 2020
Later among the works it cites.
Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions
Lucy Ellen Lwakatare, Aiswarya Raj, Ivica Crnkovic, Jan Bosch, and Helena Holmström Olsson. 2020 · 2020
Later among the works it cites.
Corrections to “A Novel Software Engineering Approach Toward Using Machine Learning for Improving the Efficiency of Health Systems“
Mohammed Moreb, Tareq Abed Mohammed, Oguz Bayat, and Oguz Ata. 2020 · 2020
Later among the works it cites.
On the performance of hybrid search strategies for systematic literature reviews in software engineering
Erica Mourão, João Felipe Pimentel, Leonardo Murta, Marcos Kalinowski, Emilia Mendes, and Claes Wohlin. 2020 · 2020
Later among the works it cites.
Elizamary Nascimento, Anh Nguyen-Duc, Ingrid Sundbø, and Tayana Conte. 2020 · 2020
Later among the works it cites.
What Is Really Different in Engineering AI-Enabled Systems?
Ipek Ozkaya. 2020 · 2020
Later among the works it cites.
Testing machine learning based systems: a systematic mapping
Vincenzo Riccio, Gunel Jahangirova, Andrea Stocco, Nargiz Humbatova, Michael Weiss, and Paolo Tonella. 2020 · 2020
Later among the works it cites.
Adoption and effects of software engineering best practices in machine learning. In Proceedings of the 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) . 1–12
Alex Serban, Koen van der Blom, Holger Hoos, and Joost Visser. 2020 · 2020
Later among the works it cites.
Synergy between Machine/Deep Learning and Software Engineering: How Far Are We?
Simin Wang, Liguo Huang, Jidong Ge, Tengfei Zhang, Haitao Feng, Ming Li, He Zhang, and Vincent Ng. 2020 · 2020
Later among the works it cites.
Sensemaking Practices in the Everyday Work of AI/ML Software Engineering. In Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops . ACM, 86–92
Christine T. Wolf and Drew Paine. 2020 · 2020
Later among the works it cites.
Machine learning testing: Survey, landscapes and horizons
Jie M Zhang, Mark Harman, Lei Ma, and Yang Liu. 2020 · 2020
Later among the works it cites.
Husheng Zhou, Wei Li, Zelun Kong, Junfeng Guo, Yuqun Zhang, Bei Yu, Lingming Zhang, and Cong Liu. 2020 · 2020
Later among the works it cites.
How Tertiary Studies perform Quality Assessment of Secondary Studies in Software Engineering. In 2021 Proceedings of 24th Iberoamerican Conference on Software Engineering (CIbSE 2021), ESELAW track
Dolors Costal, Carles Farré, Xavier Franch, and Carme Quer. 2021 · 2021
Closest in time.
A software engineering perspective on engineering machine learning systems: State of the art and challenges
Görkem Giray. 2021 · 2021
Closest in time.
Giuliano Lorenzoni, Paulo Alencar, Nathalia Nascimento, and Donald Cowan. 2021 · 2021
Closest in time.
Artificial intelligence: A modern approach (fourth edition ed.)
Stuart J. Russell and Peter Norvig. 2021 · 2021
Closest in time.
An Empirical Study of Software Architecture for Machine Learning
Alex Serban and Joost Visser. 2021 · 2021
Closest in time.
A bibliometric assessment of software engineering themes, scholars and institutions (2013–2020)
W. Eric Wong, Nikolaos Mittas, Elvira Maria Arvanitou, and Yihao Li. 2021 · 2021
Closest in time.
An Architecture for Agile Machine Learning in Real-Time Applications. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . ACM, 2059–2068
Johann Schleier-Smith. 2015 · 2068
Closest in time.
Trial without error: Towards safe reinforcement learning via human intervention
William Saunders, Andreas Stuhlmüller, Girish Sastry, and Owain Evans. 2018 · 2069
Closest in time.