Fetching the paper…
Reading the bibliography…
Deep Learning (DL) frameworks are now widely used, simplifying the creation of complex models as well as their integration to various applications even to non DL experts.
KENDALL MG (1938) A NEW MEASURE OF RANK CORRELATION. Biometrika 30(1-2):81–93, DOI 10.1093/biomet/30.1-2.81
1938
Earlier work this paper cites.
Cohen J (1960) A coefficient of agreement for nominal scales. Educational and psychological measurement 20(1):37–46
1960
Earlier work this paper cites.
Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psychological Bulletin 76:378–382
1971
Earlier work this paper cites.
Altman DG (1991) Practical statistics for medical research. London: Chapman and Hall
1991
Earlier work this paper cites.
Seaman CB (1999) Qualitative methods in empirical studies of software engineering. IEEE Transactions on software engineering 25(4):557–572
1999
Earlier work this paper cites.
Oppenheim AN (2000) Questionnaire design, interviewing and attitude measurement. Bloomsbury Publishing
2000
Earlier work this paper cites.
Weimer W, Nguyen T, Le Goues C, Forrest S (2009) Automatically finding patches using genetic programming. In: 2009 IEEE 31st International Conference on Software Engineering, pp 364–374, DOI 10.1109/ICSE.2009.5070536
2009
Earlier work this paper cites.
Groce A, Kulesza T, Zhang C, Shamasunder S, Burnett M, Wong WK, Stumpf S, Das S, Shinsel A, Bice F, et al. (2013) You are the only possible oracle: Effective test selection for end users of interactive machine learning systems. IEEE Transactions on Software Engineering 40(3):307–323
2013
Earlier work this paper cites.
Kouwe EVD, Giuffrida C, Tanenbaum AS (2014) On the soundness of silence: Investigating silent failures using fault injection experiments. In: 2014 Tenth European Dependable Computing Conference, pp 118–129, DOI 10.1109/EDCC.2014.16
2014
Earlier work this paper cites.
Le V, Afshari M, Su Z (2014) Compiler validation via equivalence modulo inputs. In: Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation, Association for Computing Machinery, New York, NY, USA, PLDI ’14, p 216–226, DOI 10.1145/2594291.2594334
2014
Earlier work this paper cites.
Vahabzadeh A, Fard AM, Mesbah A (2015) An empirical study of bugs in test code. In: 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp 101–110, DOI 10.1109/ICSM.2015.7332456
2015
Earlier work this paper cites.
Wang W, Poo-Caamaño G, Wilde E, German DM (2015) What is the gist? understanding the use of public gists on github. In: 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories, IEEE, pp 314–323
2015
Earlier work this paper cites.
Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, et al. (2016) Tensorflow: A system for large-scale machine learning. In: 12th { \{ USENIX } \} symposium on operating systems design and implementation ( { \{ OSDI } \} 16), pp 265–283
2016
Earlier work this paper cites.
Long F, Rinard M (2016) Automatic patch generation by learning correct code. In: Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, Association for Computing Machinery, New York, NY, USA, POPL ’16, p 298–312, DOI 10.1145/2837614.2837617
2016
Earlier work this paper cites.
Sun C, Le V, Su Z (2016) Finding compiler bugs via live code mutation. SIGPLAN Not 51(10):849–863, DOI 10.1145/3022671.2984038
2016
Earlier work this paper cites.
Di Franco A, Guo H, Rubio-González C (2017) A comprehensive study of real-world numerical bug characteristics. In: 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE), pp 509–519, DOI 10.1109/ASE.2017.8115662
2017
Earlier work this paper cites.
Papadakis M, Shin D, Yoo S, Bae DH (2018) Are mutation scores correlated with real fault detection? a large scale empirical study on the relationship between mutants and real faults. In: Proceedings of the 40th International Conference on Software Engineering, Association for Computing Machinery, New York, NY, USA, ICSE ’18, p 537–548, DOI 10.1145/3180155.3180183
2018
Earlier work this paper cites.
Islam MJ, Nguyen G, Pan R, Rajan H (2019) A comprehensive study on deep learning bug characteristics. In: Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp 510–520
2019
Earlier work this paper cites.
Nguyen G, Dlugolinsky S, Bobák M, Tran V, López García Á, Heredia I, Malík P, Hluchỳ L (2019) Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey. Artificial Intelligence Review 52:77–124
2019
Earlier work this paper cites.
Pham HV, Lutellier T, Qi W, Tan L (2019) Cradle: Cross-backend validation to detect and localize bugs in deep learning libraries. In: 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE), pp 1027–1038, DOI 10.1109/ICSE.2019.00107
2019
Cited alongside, same era.
Zhang JM, Harman M, Ma L, Liu Y (2022) Machine learning testing: Survey, landscapes and horizons. IEEE Transactions on Software Engineering 48(1):1–36, DOI 10.1109/TSE.2019.2962027
2019
Cited alongside, same era.
(2020) Keras releases. https://github.com/keras-team/keras/releases/tag/2.4.0
2020
Cited alongside, same era.
(2020) TenforFlow implementation. https://github.com/tensorflow/tensorflow/tree/master/tensorflow/python/keras
2020
Cited alongside, same era.
(2020) tf.keras API. https://www.tensorflow.org/api_docs/python/tf/keras
2020
Cited alongside, same era.
(2022) TensorFlow repository. https://github.com/tensorflow/tensorflow
2022
Closest in time.
Du X, Sui Y, Liu Z, Ai J (2022) An empirical study of fault triggers in deep learning frameworks. IEEE Transactions on Dependable and Secure Computing
2022
Closest in time.
githubREST (2022) Github REST API. https://docs.github.com/en/rest
2022
Closest in time.
GitSearchAPI (2022) Github search api. URL https://docs.github.com/en/rest/reference/search
2022
Closest in time.
googleForm (2022) Google forms. https://www.google.ca/forms/about/
2022
Closest in time.
issue1 (2022) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/42459
2022
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Du X, Xiao G, Sui Y (2020) Fault triggers in the tensorflow framework: An experience report. In: 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE), IEEE, pp 1–12
2020
Cited alongside, same era.
fix-example (2020) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/commit/15f6c30d7977c92ba452eb5c1873b8c9f0968a5f
2020
Cited alongside, same era.
Humbatova N, Jahangirova G, Bavota G, Riccio V, Stocco A, Tonella P (2020) Taxonomy of real faults in deep learning systems. In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering, pp 1110–1121
2020
Cited alongside, same era.
issue8 (2020) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/38197
2020
Cited alongside, same era.
Jia L, Zhong H, Wang X, Huang L, Lu X (2020) An empirical study on bugs inside tensorflow. In: International Conference on Database Systems for Advanced Applications, Springer, pp 604–620
2020
Cited alongside, same era.
Wang Z, Yan M, Chen J, Liu S, Zhang D (2020) Deep learning library testing via effective model generation. In: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp 788–799
2020
Cited alongside, same era.
(2021) DL Frameworks in 2021. https://towardsdatascience.com/top-5-deep-learning-frameworks-to-watch-in-2021-and-why-tensorflow-98d8d6667351
2021
Cited alongside, same era.
issue2 (2022) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/32476
2022
Closest in time.
issue3 (2022) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/32286
2022
Closest in time.
issue4 (2022) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/31324
2022
Closest in time.
issue5 (2022) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/32420
2022
Closest in time.
issue6 (2022) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/30486
2022
Closest in time.
issue7 (2022) TensorFlow/Keras Issue. https://github.com/tensorflow/tensorflow/issues/38596
2022
Closest in time.
jax (2022) JAX. https://jax.readthedocs.io/en/latest/
2022
Closest in time.
Jia L, Zhong H, Wang X, Huang L, Li Z (2022) How do injected bugs affect deep learning? In: 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), pp 793–804, DOI 10.1109/SANER53432.2022.00097
2022
Closest in time.
MLlib-Spark (2022) MLlib-Spark. https://spark.apache.org/mllib/
2022
Closest in time.
reddit (2022) Reddit. https://www.reddit.com/
2022
Closest in time.
Chen J, Liang Y, Shen Q, Jiang J, Li S (2023) Toward understanding deep learning framework bugs. ACM Trans Softw Eng Methodol DOI 10.1145/3587155
2023
Closest in time.
Li M, Cao J, Tian Y, Li TO, Wen* M, Cheung* SC (2023) Comet: Coverage-guided model generation for deep learning library testing. ACM Trans Softw Eng Methodol DOI 10.1145/3583566
2023
Closest in time.