Bridging Design and Development with Automated Declarative UI Code Generation

Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Network

Original

Vanita Jain, Piyush Agrawal, Subham Banga, Rishabh Kapoor, and Shashwat Gulyani. 2019 · 1910

Earlier work this paper cites.

Image quality assessment: from error visibility to structural similarity

Zhou Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli. 2004 · 2003

Earlier work this paper cites.

pix2code: Generating Code from a Graphical User Interface Screenshot

Original

Tony Beltramelli. 2017 · 2017

Earlier work this paper cites.

DroidBot: a lightweight UI-guided test input generator for Android. In Proceedings of the 39th International Conference on Software Engineering Companion (Buenos Aires, Argentina) (ICSE-C ’17) . IEEE Press, 23–26

Yuanchun Li, Ziyue Yang, Yao Guo, and Xiangqun Chen. 2017 · 2017

Earlier work this paper cites.

From UI design image to GUI skeleton: a neural machine translator to bootstrap mobile GUI implementation. In Proceedings of the 40th International Conference on Software Engineering (Gothenburg, Sweden) (ICSE ’18) . Association for Computing Machinery, New York, NY, USA, 665–676

Chunyang Chen, Ting Su, Guozhu Meng, Zhenchang Xing, and Yang Liu. 2018 · 2018

Earlier work this paper cites.

Object detection for graphical user interface: old fashioned or deep learning or a combination?. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE ’20) . ACM

Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu, and Guoqiang Li. 2020 · 2020

Earlier work this paper cites.

Recent Progress in Automated Code Generation from GUI Images Using Machine Learning Techniques

Daniel de Souza Baulé, Christiane Gresse von Wangenheim, Aldo von Wangenheim, and Jean Carlo Rossa Hauck. 2020 · 2020

Earlier work this paper cites.

Code generation from a graphical user interface via attention-based encoder–decoder model

Wen-Yin Chen, Pavol Podstreleny, Wen-Huang Cheng, Yung-Yao Chen, and Kai-Lung Hua. 2021a · 2021

Earlier work this paper cites.

CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Original

Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong, Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, and Shujie Liu. 2021 · 2021

Earlier work this paper cites.

A Survey on Multimodal Deep Learning for Image Synthesis: Applications, methods, datasets, evaluation metrics, and results comparison

Sanbi Luo. 2021 · 2021

Earlier work this paper cites.

Zero-Shot Text-to-Image Generation

Original

Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021 · 2021

Earlier work this paper cites.

Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21) . Association for Computing Machinery, New York, NY, USA, 470–483

Jason Wu, Xiaoyi Zhang, Jeff Nichols, and Jeffrey P Bigham. 2021 · 2021

Earlier work this paper cites.

Towards Complete Icon Labeling in Mobile Applications. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22) . Association for Computing Machinery, New York, NY, USA, Article 387, 14 pages

Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols, and Xiaoyi Zhang. 2022b · 2022

Earlier work this paper cites.

Assemble Foundation Models for Automatic Code Summarization

Original

Jian Gu, Pasquale Salza, and Harald C. Gall. 2022 · 2022

Earlier work this paper cites.

UI Layers Merger: Merging UI layers via Visual Learning and Boundary Prior

Original

Yun nong Chen, Yan kun Zhen, Chu ning Shi, Jia zhi Li, Liu qing Chen, Ze jian Li, Ling yun Sun, Ting ting Zhou, and Yan fang Chang. 2022 · 2022

Earlier work this paper cites.

Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding

Original

Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, and Mohammad Norouzi. 2022 · 2022

Earlier work this paper cites.

Exploring Distributional Shifts in Large Language Models for Code Analysis

Original

Shushan Arakelyan, Rocktim Jyoti Das, Yi Mao, and Xiang Ren. 2023 · 2023

Earlier work this paper cites.

A novel code generator for graphical user interfaces

Bo Cai, Jian Luo, and Zhen Feng. 2023 · 2023

Earlier work this paper cites.

Statistical inferences for complex dependence of multimodal imaging data

Original

Jinyuan Chang, Jing He, Jian Kang, and Mingcong Wu. 2023 · 2023

Cited alongside, same era.

Constructing Effective In-Context Demonstration for Code Intelligence Tasks: An Empirical Study

Original

Shuzheng Gao, Xinjie Wen, Cuiyun Gao, Wenxuan Wang, and Michael R. Lyu. 2023 · 2023

Cited alongside, same era.

Neural Machine Translation for Code Generation

Original

Dharma KC and Clayton T. Morrison. 2023 · 2023

Cited alongside, same era.

Segment Anything

Original

Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollár, and Ross Girshick. 2023 · 2023

Cited alongside, same era.

Amazon Shopping

Google Play Store. 2024a · 2024

Closest in time.

Google Play Store: Apps Section

Google Play Store. 2024b · 2024

Closest in time.

Lazada - Online Shopping App

Google Play Store. 2024c · 2024

Closest in time.

VISION2UI: A Real-World Dataset with Layout for Code Generation from UI Designs

Original

Yi Gui, Zhen Li, Yao Wan, Yemin Shi, Hongyu Zhang, Yi Su, Shaoling Dong, Xing Zhou, and Wenbin Jiang. 2024 · 2024

Closest in time.

ArkUI Overview: HarmonyOS

Huawei. 2024 · 2024

Closest in time.

The Shift to Declarative UI

Increment. 2024 · 2024

Closest in time.

A Survey on Large Language Models for Code Generation