Fetching the paper…
Reading the bibliography…
Graphical User Interface (GUI) is not merely a collection of individual and unrelated widgets, but rather partitions discrete widgets into groups by various visual cues, thus forming higher-order perceptual units such as tab, menu, card or list.
A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (Portland, Oregon) (KDD’96) . AAAI Press, 226–231
Martin Ester, Hans-Peter Kriegel, Jörg Sander, and Xiaowei Xu. 1996 · 1996
Earlier work this paper cites.
Cognitive Psychology Third Edition
Sternberg and Robert. 2003 · 2003
Earlier work this paper cites.
Graph Density-Aware Losses for Novel Compositions in Scene Graph Generation
Boris Knyazev, Harm de Vries, Cătălina Cangea, Graham W. Taylor, Aaron Courville, and Eugene Belilovsky. 2020 · 2005
Earlier work this paper cites.
"Gestalt psychology". Britannica concise encyclopedia
2006 · 2006
Earlier work this paper cites.
Gestalt Principles of Perception - 3: Proximity, Uniform Connectedness, and Good Continuation
Andy Rutledge. 2009 · 2009
Earlier work this paper cites.
Selective Search for Object Recognition
J. R. R. Uijlings, K. E. A. van de Sande, T. Gevers, and A. W. M. Smeulders. 2013 · 2013
Earlier work this paper cites.
Fast R-CNN. In The IEEE International Conference on Computer Vision (ICCV)
Ross Girshick. 2015 · 2015
Earlier work this paper cites.
Deep learning
Yann Lecun, Yoshua Bengio, and Geoffrey Hinton. 2015 · 2015
Earlier work this paper cites.
Reverse Engineering Mobile Application User Interfaces with REMAUI. In Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering (Lincoln, Nebraska) (ASE ’15) . IEEE Press, 248–259
Tuan Anh Nguyen and Christoph Csallner. 2015 · 2015
Earlier work this paper cites.
Show and Tell: A Neural Image Caption Generator
Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. 2015 · 2015
Earlier work this paper cites.
Rico: A Mobile App Dataset for Building Data-Driven Design Applications. In Proceedings of the 30th Annual Symposium on User Interface Software and Technology (UIST ’17)
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017 · 2017
Earlier work this paper cites.
EAST: an efficient and accurate scene text detector. 5551–5560
Xinyu Zhou, Cong Yao, He Wen, Yuzhi Wang, Shuchang Zhou, Weiran He, and Jiajun Liang. 2017 · 2017
Earlier work this paper cites.
Generating Reusable Web Components from Mockups. In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering (Montpellier, France) (ASE 2018) . New York, NY, USA, 601–611
Mohammad Bajammal, Davood Mazinanian, and Ali Mesbah. 2018 · 2018
Earlier work this paper cites.
pix2code: Generating code from a graphical user interface screenshot. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems . 1–6
Tony Beltramelli. 2018 · 2018
Earlier work this paper cites.
Robust Relational Layout Synthesis from Examples for Android
Pavol Bielik, Marc Fischer, and Martin Vechev. 2018 · 2018
Earlier work this paper cites.
From UI Design Image to GUI Skeleton: A Neural Machine Translator to Bootstrap Mobile GUI Implementation. In Proceedings of the 40th International Conference on Software Engineering (Gothenburg, Sweden) (ICSE ’18) . Association for Computing Machinery, New York, NY, USA, 665–676
Chunyang Chen, Ting Su, Guozhu Meng, Zhenchang Xing, and Yang Liu. 2018 · 2018
Earlier work this paper cites.
Fundamentals of Cognition
Michael W. Eysenck and Marc Brysbaert. 2018 · 2018
Cited alongside, same era.
Learning Design Semantics for Mobile Apps. In The 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18) . ACM, New York, NY, USA, 569–579
Thomas F. Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018 · 2018
Cited alongside, same era.
Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps
Kevin Moran, Carlos Bernal-Cárdenas, Michael Curcio, Richard Bonett, and Denys Poshyvanyk. 2020 · 2018
Cited alongside, same era.
YOLOv3: An Incremental Improvement
Joseph Redmon and Ali Farhadi. 2018 · 2018
Cited alongside, same era.
Graph R-CNN for Scene Graph Generation
Jianwei Yang, Jiasen Lu, Stefan Lee, Dhruv Batra, and Devi Parikh. 2018 · 2018
Wireframe-based UI Design Search through Image Autoencoder
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang. 2020a · 2020
Later among the works it cites.
Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning. In 2020 IEEE/ACM 42nd International Conference on Software Engineering (ICSE) . 322–334
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu, Liming Zhut, Guoqiang Li, and Jinshui Wang. 2020b · 2020
Later among the works it cites.
Object detection for graphical user interface: old fashioned or deep learning or a combination?
Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu, and Guoqiang Li. 2020d · 2020
Later among the works it cites.
RoScript: A Visual Script Driven Truly Non-Intrusive Robotic Testing System for Touch Screen Applications. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering (Seoul, South Korea) (ICSE ’20) . Association for Computing Machinery, New York, NY, USA, 297–308
Ju Qian, Zhengyu Shang, Shuoyan Yan, Yan Wang, and Lin Chen. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Neural Motifs: Scene Graph Parsing with Global Context
Rowan Zellers, Mark Yatskar, Sam Thomson, and Yejin Choi. 2018 · 2018
Cited alongside, same era.
Gallery D.C.: Design Search and Knowledge Discovery through Auto-Created GUI Component Gallery
Chunyang Chen, Sidong Feng, Zhenchang Xing, Linda Liu, Shengdong Zhao, and Jinshui Wang. 2019 · 2019
Cited alongside, same era.
Learning User Interface Element Interactions. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (Beijing, China) (ISSTA 2019) . Association for Computing Machinery, New York, NY, USA, 296–306
Christian Degott, Nataniel P. Borges Jr., and Andreas Zeller. 2019 · 2019
Cited alongside, same era.
SARA: self-replay augmented record and replay for Android in industrial cases. In Proceedings of the 28th acm sigsoft international symposium on software testing and analysis . 90–100
Jiaqi Guo, Shuyue Li, Jian-Guang Lou, Zijiang Yang, and Ting Liu. 2019 · 2019
Cited alongside, same era.
Humanoid: A Deep Learning-Based Approach to Automated Black-box Android App Testing. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . 1070–1073
Yuanchun Li, Ziyue Yang, Yao Guo, and Xiangqun Chen. 2019 · 2019
Cited alongside, same era.
Randr: Record and replay for android applications via targeted runtime instrumentation. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 128–138
Onur Sahin, Assel Aliyeva, Hariharan Mathavan, Ayse Coskun, and Manuel Egele. 2019 · 2019
Cited alongside, same era.
Ui Design in practice: Gestalt principles
Thalion. 2020 · 2019
Cited alongside, same era.
UIED: a hybrid tool for GUI element detection. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 1655–1659
Mulong Xie, Sidong Feng, Zhenchang Xing, Jieshan Chen, and Chunyang Chen. 2020 · 2020
Later among the works it cites.
Near-Duplicate Detection in Web App Model Inference. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering (Seoul, South Korea) (ICSE ’20) . Association for Computing Machinery, New York, NY, USA, 186–197
Rahulkrishna Yandrapally, Andrea Stocco, and Ali Mesbah. 2020 · 2020
Later among the works it cites.
Accessibility - Vision
2021 · 2021
Later among the works it cites.
Gestalt psychology
2021 · 2021
Later among the works it cites.
https://developer.android.com/training/testing/ui-automator
UIAutomator, 2021 · 2021
Later among the works it cites.
Auto-icon: An automated code generation tool for icon designs assisting in ui development. In 26th International Conference on Intelligent User Interfaces . 59–69
Sidong Feng, Suyu Ma, Jinzhong Yu, Chunyang Chen, TingTing Zhou, and Yankun Zhen. 2021 · 2021
Later among the works it cites.
Apply crap to design: S1T2 blog
S1T2. 2021 · 2021
Later among the works it cites.
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels
Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White, Kyle Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, Aaron Everitt, and Jeffrey P. Bigham. 2021 · 2021
Later among the works it cites.
Extracting Replayable Interactions from Videos of Mobile App Usage
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols, and Xiaoyi Zhang. 2022a · 2022
Closest in time.
GIFdroid: An Automated Light-weight Tool for Replaying Visual Bug Reports
Sidong Feng and Chunyang Chen. 2022a · 2022
Closest in time.
Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development
Sidong Feng, Minmin Jiang, Tingting Zhou, Yankun Zhen, and Chunyang Chen. 2022 · 2022
Closest in time.