Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?

An iterative procedure for the polygonal approximation of plane curves

Urs Ramer. 1972 · 1972

Earlier work this paper cites.

Topological structural analysis of digitized binary images by border following

Satoshi Suzuki and KeiichiA be. 1985 · 1985

Earlier work this paper cites.

A Computational Approach to Edge Detection

J. Canny. 1986 · 1986

Earlier work this paper cites.

Efficient component labeling of images of arbitrary dimension represented by linear bintrees

H. Samet and M. Tamminen. 1988 · 1988

Earlier work this paper cites.

Digital image processing

Rafael C. Gonzalez and Richard E. Woods. 1993 · 1993

Earlier work this paper cites.

An overview of the Tesseract OCR engine. In Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) , Vol. 2. IEEE, 629–633

Ray Smith. 2007 · 2007

Earlier work this paper cites.

The Pascal Visual Object Classes (VOC) Challenge

Mark Everingham, Luc Van Gool, Christopher K. I. Williams, John Winn, and Andrew Zisserman. 2009 · 2009

Earlier work this paper cites.

Sikuli: using GUI screenshots for search and automation. In Proceedings of the 22nd annual ACM symposium on User interface software and technology . 183–192

Tom Yeh, Tsung-Hsiang Chang, and Robert C Miller. 2009 · 2009

Earlier work this paper cites.

Prefab: implementing advanced behaviors using pixel-based reverse engineering of interface structure. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . 1525–1534

Morgan Dixon and James Fogarty. 2010 · 2010

Earlier work this paper cites.

The pascal visual object classes (voc) challenge

Mark Everingham, Luc Van Gool, Christopher KI Williams, John Winn, and Andrew Zisserman. 2010 · 2010

Earlier work this paper cites.

Pause-and-play: automatically linking screencast video tutorials with applications. In Proceedings of the 24th annual ACM symposium on User interface software and technology . 135–144

Suporn Pongnumkul, Mira Dontcheva, Wilmot Li, Jue Wang, Lubomir Bourdev, Shai Avidan, and Michael F Cohen. 2011 · 2011

Earlier work this paper cites.

Waken: reverse engineering usage information and interface structure from software videos. In Proceedings of the 25th annual ACM symposium on User interface software and technology . 83–92

Nikola Banovic, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2012 · 2012

Earlier work this paper cites.

Digital image processing

Rafael C. Gonzalez and Richard E. Woods. 2014 · 2014

Earlier work this paper cites.

Microsoft coco: Common objects in context. In European conference on computer vision . Springer, 740–755

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014 · 2014

Earlier work this paper cites.

scvRipper: video scraping tool for modeling developers’ behavior using interaction data. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering , Vol. 2. IEEE, 673–676

Lingfeng Bao, Jing Li, Zhenchang Xing, Xinyu Wang, and Bo Zhou. 2015a · 2015

Earlier work this paper cites.

Activityspace: a remembrance framework to support interapplication information needs. In 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 864–869

Lingfeng Bao, Deheng Ye, Zhenchang Xing, Xin Xia, and Xinyu Wang. 2015b · 2015

Earlier work this paper cites.

Reverse engineering mobile application user interfaces with remaui (t). In 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 248–259

Tuan Anh Nguyen and Christoph Csallner. 2015 · 2015

Earlier work this paper cites.

Faster r-cnn: Towards real-time object detection with region proposal networks. In Advances in neural information processing systems . 91–99

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015 · 2015

Earlier work this paper cites.

Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition . 770–778

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016 · 2016

Cited alongside, same era.

Sensing from the bottom: Smart insole enabled patient handling activity recognition through manifold learning. In 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE) . IEEE, 254–263

Feng Lin, Chen Song, Xiaowei Xu, Lora Cavuoto, and Wenyao Xu. 2016 · 2016

Cited alongside, same era.

Applied computer science

Shane Torbert. 2016 · 2016

Cited alongside, same era.

Rico: A mobile app dataset for building data-driven design applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology . 845–854

Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017 · 2017

Cited alongside, same era.

Swire: Sketch-based user interface retrieval. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems . 1–10

Forrest Huang, John F Canny, and Jeffrey Nichols. 2019 · 2019

Later among the works it cites.

Humanoid: A Deep Learning-Based Approach to Automated Black-box Android App Testing. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 1070–1073

Yuanchun Li, Ziyue Yang, Yao Guo, and Xiangqun Chen. 2019 · 2019

Later among the works it cites.

Introducing Spy++

Microsoft. 2016 · 2019

Later among the works it cites.

Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems . 1–11

Amanda Swearngin and Yang Li. 2019 · 2019

Later among the works it cites.

Improving random GUI testing with image-based widget detection. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis . 307–317