Fetching the paper…
Reading the bibliography…
Many recent AI-powered UX design tools focus on generating individual static UI screens from natural language.
An optimal foraging approach to information seeking and use
Pamela Effrein Sandstrom. 1994 · 1994
Earlier work this paper cites.
Structure mapping in analogy and similarity
Dedre Gentner and Arthur B Markman. 1997 · 1997
Earlier work this paper cites.
The Definition of User Experience
Don Norman and Jakob Nielsen. 1998 · 1998
Earlier work this paper cites.
Information foraging
Peter Pirolli and Stuart Card. 1999 · 1999
Earlier work this paper cites.
Snap-together visualization: a user interface for coordinating visualizations via relational schemata. In Proceedings of the working conference on Advanced visual interfaces . 128–135
Chris North and Ben Shneiderman. 2000 · 2000
Earlier work this paper cites.
Amanda Swearngin, Chenglong Wang, Alannah Oleson, James Fogarty, and Amy J. Ko. 2020 · 2001
Earlier work this paper cites.
The influence and value of analogical thinking during new product ideation
Darren W Dahl and Page Moreau. 2002 · 2002
Earlier work this paper cites.
The elements of user experience: user-centered design for the Web
Mary Deaton. 2003 · 2003
Earlier work this paper cites.
Opening up the solution space: The role of analogical thinking for breakthrough product innovation
Oliver Gassmann and Marco Zeschky. 2008 · 2008
Earlier work this paper cites.
How programmers debug, revisited: An information foraging theory perspective
Joseph Lawrance, Christopher Bogart, Margaret Burnett, Rachel Bellamy, Kyle Rector, and Scott D Fleming. 2010 · 2010
Earlier work this paper cites.
Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements
Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, and Zhiwei Guan. 2020 · 2010
Earlier work this paper cites.
Designing interfaces: Patterns for effective interaction design
Jenifer Tidwell. 2010 · 2010
Earlier work this paper cites.
The application of foraging theory to the information searching behaviour of general practitioners
Mai Dwairy, Anthony C Dowell, and Jean-Claude Stahl. 2011 · 2011
Earlier work this paper cites.
Foraging for inspiration: understanding and supporting the online information seeking practices of biologically inspired designers. In International Design Engineering Technical Conferences and Computers and Information in Engineering Conference , Vol. 54860. 177–186
Swaroop S Vattam and Ashok K Goel. 2011 · 2011
Earlier work this paper cites.
Cognitive, collaborative, conceptual and creative—four characteristics of the next generation of knowledge-based CAD systems: a study in biologically inspired design
Ashok K Goel, Swaroop Vattam, Bryan Wiltgen, and Michael Helms. 2012 · 2012
Earlier work this paper cites.
Exploring think-alouds in usability testing: An international survey
Sharon McDonald, Helen M Edwards, and Tingting Zhao. 2012 · 2012
Earlier work this paper cites.
The design of everyday things: Revised and expanded edition
Don Norman. 2013 · 2013
Earlier work this paper cites.
Cognitive strategies of analogical reasoning in design: Differences between expert and novice designers
Ozgu Ozkan and Fehmi Dogan. 2013 · 2013
Earlier work this paper cites.
Challenging information foraging theory: Screen reader users are not always driven by information scent. In Proceedings of the 24th acm conference on hypertext and social media . 60–68
Markel Vigo and Simon Harper. 2013 · 2013
Earlier work this paper cites.
Mobile design pattern gallery: UI patterns for smartphone apps
Theresa Neil. 2014 · 2014
Earlier work this paper cites.
Looking back: Retrospective study methods for HCI
Daniel M Russell and Ed H Chi. 2014 · 2014
Earlier work this paper cites.
ERICA: Interaction Mining Mobile Apps. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16) . Association for Computing Machinery, New York, NY, USA, 767–776
Biplab Deka, Zifeng Huang, and Ranjitha Kumar. 2016 · 2016
Earlier work this paper cites.
Atomic Design
Brad Frost. 2016 · 2016
Earlier work this paper cites.
"It’s More of a Mindset Than a Method": UX Practitioners’ Conception of Design Methods. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16) . Association for Computing Machinery, New York, NY, USA, 4044–4055
Colin M. Gray. 2016 · 2016
Earlier work this paper cites.
Rico: A Mobile App Dataset for Building Data-Driven Design Applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology . ACM, Québec City QC Canada, 845–854
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017 · 2017
Earlier work this paper cites.
Do the best design ideas (really) come from conceptually distant sources of inspiration?
Joel Chan, Steven P Dow, and Christian D Schunn. 2018 · 2018
Cited alongside, same era.
Deep learning UI design patterns of mobile apps. In Proceedings of the 40th International Conference on Software Engineering: New Ideas and Emerging Results . 65–68
Tam The Nguyen, Phong Minh Vu, Hung Viet Pham, and Tung Thanh Nguyen. 2018 · 2018
Cited alongside, same era.
Affinity Diagramming: Collaboratively Sort UX Findings & Design Ideas
Kara Pernice. 2018 · 2018
Cited alongside, same era.
Rewire: Interface Design Assistance from Examples. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18) . Association for Computing Machinery, 1–12
Amanda Swearngin, Mira Dontcheva, Wilmot Li, Joel Brandt, Morgan Dixon, and Amy J. Ko. 2018 · 2018
Cited alongside, same era.
Scaling UX with design systems
Elizabeth F Churchill. 2019 · 2019
Cited alongside, same era.
Ai chains: Transparent and controllable human-ai interaction by chaining large language model prompts. In Proceedings of the 2022 CHI conference on human factors in computing systems . 1–22
Tongshuang Wu, Michael Terry, and Carrie Jun Cai. 2022 · 2022
Later among the works it cites.
Promptify: Text-to-image generation through interactive prompt exploration with large language models. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . 1–14
Stephen Brade, Bryan Wang, Mauricio Sousa, Sageev Oore, and Tovi Grossman. 2023 · 2023
Later among the works it cites.
Understanding Collaborative Practices and Tools of Professional UX Practitioners in Software Organizations. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23) . Association for Computing Machinery, New York, NY, USA, 1–20
K. J. Kevin Feng, Tony W Li, and Amy X. Zhang. 2023a · 2023
Later among the works it cites.
Ideas are dimes a dozen: Large language models for idea generation in innovation
Karan Girotra, Lennart Meincke, Christian Terwiesch, and Karl T Ulrich. 2023 · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Swire: Sketch-based User Interface Retrieval. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19) . Association for Computing Machinery, New York, NY, USA, 1–10
Forrest Huang, John F. Canny, and Jeffrey Nichols. 2019 · 2019
Cited alongside, same era.
May AI? Design Ideation with Cooperative Contextual Bandits. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19) . Association for Computing Machinery, New York, NY, USA, 1–12
Janin Koch, Andrés Lucero, Lena Hegemann, and Antti Oulasvirta. 2019 · 2019
Cited alongside, same era.
Artificial intelligence (AI) or intelligence augmentation (IA): what is the future?
Hossein Hassani, Emmanuel Sirimal Silva, Stephane Unger, Maedeh TajMazinani, and Stephen Mac Feely. 2020 · 2020
Cited alongside, same era.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020 · 2020
Cited alongside, same era.
Retrieval-augmented generation for knowledge-intensive nlp tasks
Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al · 2020
Cited alongside, same era.
Diffusion models beat gans on image synthesis
Prafulla Dhariwal and Alexander Nichol. 2021 · 2021
Cited alongside, same era.
GUIS2Code: A Computer Vision Tool to Generate Code Automatically from Graphical User Interface Sketches. In Artificial Neural Networks and Machine Learning – ICANN 2021 (Lecture Notes in Computer Science) , Igor Farkaš, Paolo Masulli, Sebastian Otte, and Stefan Wermter (Eds.). Springer International Publishing, Cham, 53–65
Zhen Feng, Jiaqi Fang, Bo Cai, and Yingtao Zhang. 2021 · 2021
Cited alongside, same era.
Later among the works it cites.
User Journeys vs. User Flows
Kate Kaplan. 2023 · 2023
Later among the works it cites.
The effect of AI-based inspiration on human design ideation
Jingoog Kim and Mary Lou Maher. 2023 · 2023
Later among the works it cites.
Cells, generators, and lenses: Design framework for object-oriented interaction with large language models. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology . 1–18
Tae Soo Kim, Yoonjoo Lee, Minsuk Chang, and Juho Kim. 2023 · 2023
Later among the works it cites.
Segment anything. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 4015–4026
Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al · 2023
Later among the works it cites.
Large-scale text-to-image generation models for visual artists’ creative works. In Proceedings of the 28th international conference on intelligent user interfaces . 919–933
Hyung-Kwon Ko, Gwanmo Park, Hyeon Jeon, Jaemin Jo, Juho Kim, and Jinwook Seo. 2023 · 2023
Later among the works it cites.
Text-to-image AI as a tool for the designer’s ideation process
Radovan Lamac. 2023 · 2023
Later among the works it cites.
Spotlight: Mobile UI Understanding using Vision-Language Models with a Focus
Gang Li and Yang Li. 2023 · 2023
Later among the works it cites.
UI Layout Generation with LLMs Guided by UI Grammar
Yuwen Lu, Ziang Tong, Qinyi Zhao, Chengzhi Zhang, and Toby Jia-Jun Li. 2023 · 2023
Later among the works it cites.
Using text-to-image generation for architectural design ideation
Ville Paananen, Jonas Oppenlaender, and Aku Visuri. 2023 · 2023
Later among the works it cites.
SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation
Zhiyu Qu, Tao Xiang, and Yi-Zhe Song. 2023 · 2023
Later among the works it cites.
Sangho Suh, Meng Chen, Bryan Min, Toby Jia-Jun Li, and Haijun Xia. 2023 · 2023
Later among the works it cites.
Enabling Conversational Interaction with Mobile UI using Large Language Models
Bryan Wang, Gang Li, and Yang Li. 2023 · 2023
Later among the works it cites.
Boosting gui prototyping with diffusion models. In 2023 IEEE 31st International Requirements Engineering Conference (RE) . IEEE, 275–280
Jialiang Wei, Anne-Lise Courbis, Thomas Lambolais, Binbin Xu, Pierre Louis Bernard, and Gérard Dray. 2023 · 2023
Later among the works it cites.
WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics
Jason Wu, Siyan Wang, Siman Shen, Yi-Hao Peng, Jeffrey Nichols, and Jeffrey P. Bigham. 2023 · 2023
Later among the works it cites.
Gpt-4v in wonderland: Large multimodal models for zero-shot smartphone gui navigation
An Yan, Zhengyuan Yang, Wanrong Zhu, Kevin Lin, Linjie Li, Jianfeng Wang, Jianwei Yang, Yiwu Zhong, Julian McAuley, Jianfeng Gao, et al · 2023
Later among the works it cites.
Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V
Jianwei Yang, Hao Zhang, Feng Li, Xueyan Zou, Chunyuan Li, and Jianfeng Gao. 2023 · 2023
Later among the works it cites.
Collaborative Canvas: A Tool for Exploring LLM Use in Group Ideation Tasks. In ACM International Conference on Intelligent User Interfaces
Gabriel Enrique Gonzalez, Dario Andres Silva Moran, Stephanie Houde, Jessica He, Steven Ross, Michael Muller, Siya Kunde, and Justin Weisz. 2024 · 2024
Closest in time.
AI Assistance for UX: A Literature Review Through Human-Centered AI
Yuwen Lu, Yuewen Yang, Qinyi Zhao, Chengzhi Zhang, and Toby Jia-Jun Li. 2024 · 2024
Closest in time.
AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
Orit Shaer, Angelora Cooper, Osnat Mokryn, Andrew L Kun, and Hagit Ben Shoshan. 2024 · 2024
Closest in time.
Jamplate: Exploring LLM-Enhanced Templates for Idea Reflection
JIAYU YIN, CATHERINE GU, JENNY MAR, SYDNEY ZHANG, and STEVEN P DOW. 2024 · 2024
Closest in time.