Fetching the paper…
Reading the bibliography…
Wireframing is a critical step in the UI design process.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 1901
Earlier work this paper cites.
The dialectics of sketching
Gabriela Goldschmidt. 1991 · 1991
Earlier work this paper cites.
DENIM: Finding a tighter fit between tools and practice for web site design. In Proceedings of the SIGCHI conference on Human factors in computing systems . 510–517
James Lin, Mark W Newman, Jason I Hong, and James A Landay. 2000 · 2000
Earlier work this paper cites.
Sketching interfaces: Toward more human interface design
James A Landay and Brad A Myers. 2001 · 2001
Earlier work this paper cites.
How designers think
Bryan Lawson. 2006 · 2006
Earlier work this paper cites.
The essential guide to user interface design: an introduction to GUI design principles and techniques
Wilbert O Galitz. 2007 · 2007
Earlier work this paper cites.
Getting inspired! Understanding how and why examples are used in creative design practice. In Proceedings of the SIGCHI conference on human factors in computing systems . 87–96
Scarlett R Herring, Chia-Chen Chang, Jesse Krantzler, and Brian P Bailey. 2009 · 2009
Earlier work this paper cites.
Card sorting: Designing usable categories
Donna Spencer. 2009 · 2009
Earlier work this paper cites.
Leakage in data mining: Formulation, detection, and avoidance
Shachar Kaufman, Saharon Rosset, Claudia Perlich, and Ori Stitelman. 2012 · 2012
Earlier work this paper cites.
Interrater reliability: the kappa statistic
Mary L McHugh. 2012 · 2012
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P Kingma and Max Welling. 2013 · 2013
Earlier work this paper cites.
Mobile design pattern gallery: UI patterns for smartphone apps
Theresa Neil. 2014 · 2014
Earlier work this paper cites.
Android User Interface Design: Implementing Material Design for Developers
Ian G Clifton. 2015 · 2015
Earlier work this paper cites.
Deep learning
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015 · 2015
Earlier work this paper cites.
Automatic generation of visual-textual presentation layout
Xuyong Yang, Tao Mei, Ying-Qing Xu, Yong Rui, and Shipeng Li. 2016 · 2016
Earlier work this paper cites.
Rico: A mobile app dataset for building data-driven design applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology . 845–854
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017 · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Earlier work this paper cites.
Gallery dc: Design search and knowledge discovery through auto-created gui component gallery
Chunyang Chen, Sidong Feng, Zhenchang Xing, Linda Liu, Shengdong Zhao, and Jinshui Wang. 2019 · 2019
Earlier work this paper cites.
Swire: Sketch-based user interface retrieval. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems . 1–10
Forrest Huang, John F Canny, and Jeffrey Nichols. 2019 · 2019
Earlier work this paper cites.
Layoutgan: Generating graphic layouts with wireframe discriminators
Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang, and Tingfa Xu. 2019 · 2019
Earlier work this paper cites.
Roberta: A robustly optimized bert pretraining approach
Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 2019
Earlier work this paper cites.
From lost to found: Discover missing ui design semantics through recovering missing tags
Chunyang Chen, Sidong Feng, Zhengyang Liu, Zhenchang Xing, and Shengdong Zhao. 2020b · 2020
Earlier work this paper cites.
Wireframe-based UI design search through image autoencoder
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang. 2020a · 2020
Earlier work this paper cites.
Generative adversarial networks
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020 · 2020
Cited alongside, same era.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020 · 2020
Cited alongside, same era.
Enrico: A dataset for topic modeling of mobile UI designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services . 1–4
Luis A Leiva, Asutosh Hota, and Antti Oulasvirta. 2020 · 2020
Cited alongside, same era.
Syn: Synthetic Dataset for Training UI Element Detector From Lo-Fi Sketches. In Proceedings of the 25th International Conference on Intelligent User Interfaces Companion . 79–80
Vinoth Pandian Sermuga Pandian, Sarah Suleri, and Matthias Jarke. 2020 · 2020
Cited alongside, same era.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020
EmoBalloon-Conveying Emotional Arousal in Text Chats with Speech Balloons. In CHI Conference on Human Factors in Computing Systems . 1–16
Toshiki Aoki, Rintaro Chujo, Katsufumi Matsui, Saemi Choi, and Ari Hautasaari. 2022 · 2022
Later among the works it cites.
Towards Complete Icon Labeling in Mobile Applications. In CHI Conference on Human Factors in Computing Systems . 1–14
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols, and Xiaoyi Zhang. 2022 · 2022
Later among the works it cites.
Palm: Scaling language modeling with pathways
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al · 2022
Later among the works it cites.
Scaling instruction-finetuned language models
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
SketchingInterfaces: A Tool for Automatically Generating High-Fidelity User Interface Mockups from Hand-Drawn Sketches. In Proceedings of the 32nd Australian Conference on Human-Computer Interaction . 538–545
Christoph Wimmer, Alex Untertrifaller, and Thomas Grechenig. 2020 · 2020
Cited alongside, same era.
UIED: a hybrid tool for GUI element detection. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 1655–1659
Mulong Xie, Sidong Feng, Zhenchang Xing, Jieshan Chen, and Chunyang Chen. 2020 · 2020
Cited alongside, same era.
Variational transformer networks for layout generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 13642–13652
Diego Martin Arroyo, Janis Postels, and Federico Tombari. 2021 · 2021
Cited alongside, same era.
Vins: Visual search for mobile user interface design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems . 1–14
Sara Bunian, Kai Li, Chaima Jemmali, Casper Harteveld, Yun Fu, and Magy Seif Seif El-Nasr. 2021 · 2021
Cited alongside, same era.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al · 2021
Cited alongside, same era.
Auto-icon: An automated code generation tool for icon designs assisting in ui development. In 26th International Conference on Intelligent User Interfaces . 59–69
Sidong Feng, Suyu Ma, Jinzhong Yu, Chunyang Chen, TingTing Zhou, and Yankun Zhen. 2021 · 2021
Cited alongside, same era.
Layouttransformer: Layout generation and completion with self-attention. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 1004–1014
Kamal Gupta, Justin Lazarow, Alessandro Achille, Larry S Davis, Vijay Mahadevan, and Abhinav Shrivastava. 2021 · 2021
Cited alongside, same era.
GIFdroid: an automated light-weight tool for replaying visual bug reports. In Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings . 95–99
Sidong Feng and Chunyang Chen. 2022 · 2022
Later among the works it cites.
Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development
Sidong Feng, Minmin Jiang, Tingting Zhou, Yankun Zhen, and Chunyang Chen. 2022b · 2022
Later among the works it cites.
Efficiency Matters: Speeding Up Automated Testing with GUI Rendering Inference
Sidong Feng, Mulong Xie, and Chunyang Chen. 2022c · 2022
Later among the works it cites.
Bridging the Gap Between UX Practitioners’ Work Practices and AI-Enabled Design Support Tools. In CHI Conference on Human Factors in Computing Systems Extended Abstracts . 1–7
Yuwen Lu, Chengzhi Zhang, Iris Zhang, and Toby Jia-Jun Li. 2022 · 2022
Later among the works it cites.
On the Importance of Data Size in Probing Fine-tuned Models
Houman Mehrafarin, Sara Rajaee, and Mohammad Taher Pilehvar. 2022 · 2022
Later among the works it cites.
Training language models to follow instructions with human feedback
Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022
Later among the works it cites.
Hierarchical text-conditional image generation with clip latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022 · 2022
Later among the works it cites.
High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 10684–10695
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022 · 2022
Later among the works it cites.
LoFi Sketch: A Large Scale Dataset of Smartphone Low Fidelity Sketches. In CHI Conference on Human Factors in Computing Systems Extended Abstracts . 1–5
Vinoth Pandian Sermuga Pandian, Abdullah Shams, Sarah Suleri, and Prof Dr Matthias Jarke. 2022 · 2022
Later among the works it cites.
Enabling Conversational Interaction with Mobile UI using Large Language Models
Bryan Wang, Gang Li, and Yang Li. 2022 · 2022
Later among the works it cites.
Psychologically-inspired, unsupervised inference of perceptual groups of GUI widgets from GUI images. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 332–343
Mulong Xie, Zhenchang Xing, Sidong Feng, Xiwei Xu, Liming Zhu, and Chunyang Chen. 2022 · 2022
Later among the works it cites.
An empirical study of gpt-3 for few-shot knowledge-based vqa. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 36. 3081–3089
Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, and Lijuan Wang. 2022 · 2022
Later among the works it cites.
Mingyu Zong and Bhaskar Krishnamachari. 2022a · 2022
Later among the works it cites.
Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . 1–20
Jieshan Chen, Jiamou Sun, Sidong Feng, Zhenchang Xing, Qinghua Lu, Xiwei Xu, and Chunyang Chen. 2023 · 2023
Closest in time.
Prompting Is All Your Need: Automated Android Bug Replay with Large Language Models
Sidong Feng and Chunyang Chen. 2023 · 2023
Closest in time.
Read It, Don’t Watch It: Captioning Bug Recordings Automatically
Sidong Feng, Mulong Xie, Yinxing Xue, and Chunyang Chen. 2023b · 2023
Closest in time.
Material Icons
Google. 2023 · 2023
Closest in time.
Design Language
IBM. 2023 · 2023
Closest in time.
Llama 2: Open foundation and fine-tuned chat models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023
Closest in time.