Fetching the paper…
Reading the bibliography…
With the fast-growing GUI development workload in the Internet industry, some work on intelligent methods attempted to generate maintainable front-end code from UI screenshots.
Mmdetection: Open mmlab detection toolbox and benchmark
Kai Chen, Jiaqi Wang, Jiangmiao Pang, Yuhang Cao, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jiarui Xu, Zheng Zhang, Dazhi Cheng, Chenchen Zhu, Tianheng Cheng, Qijie Zhao, Buyu Li, Xin Lu, Rui Zhu, Yue Wu, Jifeng Dai, Jingdong Wang, Jianping Shi, Wanli Ouyang, Chen Change Loy, and Dahua Lin · 1906
Earlier work this paper cites.
Sketch2code: Transformation of sketches to UI in real-time using deep neural network
Vanita Jain, Piyush Agrawal, Subham Banga, Rishabh Kapoor, and Shashwat Gulyani · 1910
Earlier work this paper cites.
Wilcoxon-mann-whitney or t-test? on assumptions for hypothesis tests and multiple interpretations of decision rules
Michael P Fay and Michael A Proschan · 2010
Earlier work this paper cites.
Microsoft COCO: common objects in context
Tsung-Yi Lin, Michael Maire, Serge J. Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick · 2014
Earlier work this paper cites.
A novel approach to html page creation using neural network
Aparna Halbe and Abhijit R. Joshi · 2015
Earlier work this paper cites.
Reverse engineering mobile application user interfaces with REMAUI (T)
Tuan Anh Nguyen and Christoph Csallner · 2015
Earlier work this paper cites.
Faster R-CNN: towards real-time object detection with region proposal networks
Shaoqing Ren, Kaiming He, Ross B. Girshick, and Jian Sun · 2016
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2016
Earlier work this paper cites.
Rico: A mobile app dataset for building data-driven design applications
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar · 2017
Earlier work this paper cites.
Deep image matting
Ning Xu, Brian L. Price, Scott Cohen, and Thomas S. Huang · 2017
Earlier work this paper cites.
Feature pyramid networks for object detection
Tsung-Yi Lin, Piotr Dollár, Ross B. Girshick, Kaiming He, Bharath Hariharan, and Serge J. Belongie · 2017
Cited alongside, same era.
pix2code: Generating code from a graphical user interface screenshot
Tony Beltramelli · 2018
Cited alongside, same era.
Guifetch: supporting app design and development through GUI search
Farnaz Behrang, Steven P. Reiss, and Alessandro Orso · 2018
Cited alongside, same era.
From UI design image to GUI skeleton: a neural machine translator to bootstrap mobile GUI implementation
Chunyang Chen, Ting Su, Guozhu Meng, Zhenchang Xing, and Yang Liu · 2018
Cited alongside, same era.
Machine learning-based prototyping of graphical user interfaces for mobile apps
Kevin Moran, Carlos Bernal-Cárdenas, Michael Curcio, Richard Bonett, and Denys Poshyvanyk · 2018
Cited alongside, same era.
Cascade R-CNN: delving into high quality object detection
Improving random GUI testing with image-based widget detection
Thomas D. White, Gordon Fraser, and Guy J. Brown · 2019
Later among the works it cites.
Cascade RPN: delving into high-quality region proposal network with adaptive convolution
Thang Vu, Hyunjun Jang, Trung X. Pham, and Chang Dong Yoo · 2019
Later among the works it cites.
Object detection for graphical user interface: old fashioned or deep learning or a combination?
Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu, and Guoqiang Li · 2020
Later among the works it cites.
Owl eyes: Spotting UI display issues via visual understanding
Zhe Liu, Chunyang Chen, Junjie Wang, Yuekai Huang, Jun Hu, and Qing Wang · 2020
Later among the works it cites.
Auto-icon: An automated code generation tool for icon designs assisting in UI development
Sidong Feng, Suyu Ma, Jinzhong Yu, Chunyang Chen, Tingting Zhou, and Yankun Zhen · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Zhaowei Cai and Nuno Vasconcelos · 2018
Cited alongside, same era.
Eve: A sketch-based software prototyping workbench
Sarah Suleri, Vinoth Pandian Sermuga Pandian, Svetlana Shishkovets, and Matthias Jarke · 2019
Cited alongside, same era.
Automatic html code generation from mock-up images using machine learning techniques
Batuhan Aşıroğlu, Büşta Rümeysa Mete, Eyyüp Yıldız, Yağız Nalçakan, Alper Sezen, Mustafa Dağtekin, and Tolga Ensari · 2019
Cited alongside, same era.
Android GUI search using hand-drawn sketches
Xiaofei Ge · 2019
Cited alongside, same era.
Automated cross-platform gui code generation for mobile apps
Sen Chen, Lingling Fan, Ting Su, Lei Ma, Yang Liu, and Lihua Xu · 2019
Cited alongside, same era.
Gallery dc: Design search and knowledge discovery through auto-created gui component gallery
Chunyang Chen, Sidong Feng, Zhenchang Xing, Linda Liu, Shengdong Zhao, and Jinshui Wang
Cited in the paper.
Screen recognition: Creating accessibility metadata for mobile applications from pixels
Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White, Kyle I. Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, Aaron Everitt, and Jeffrey P. Bigha · 2021
Later among the works it cites.
VINS: visual search for mobile user interface design
Sara Bunian, Kai Li, Chaima Jemmali, Casper Harteveld, Yun Fu, and Magy Seif El-Nasr · 2021
Later among the works it cites.
GUIGAN: learning to generate GUI designs using generative adversarial networks
Tianming Zhao, Chunyang Chen, Yuanning Liu, and Xiaodong Zhu · 2021
Later among the works it cites.
Nighthawk: Fully automated localizing ui display issues via visual understanding
Zhe Liu, Chunyang Chen, Junjie Wang, Yuekai Huang, Jun Hu, and Qing Wang · 2022
Closest in time.
Learning to denoise raw mobile UI layouts for improving datasets at scale
Gang Li, Gilles Baechler, Manuel Tragut, and Yang Li · 2022
Closest in time.