Fetching the paper…
Reading the bibliography…
Usability testing is a fundamental yet challenging (e.g., inflexible to iterate the study design flaws and hard to recruit study participants) research method for user experience (UX) researchers to evaluate a web design.
Human-AI Collaboration in Data Science: Exploring Data Scientists’ Perceptions of Automated AI
Dakuo Wang, Justin D. Weisz, Michael Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla Tausczik, Horst Samulowitz, and Alexander Gray. 2019 · 1909
Earlier work this paper cites.
Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
Debora Shaw. 1996 · 1996
Earlier work this paper cites.
The Evaluator Effect: A Chilling Fact About Usability Evaluation Methods
Morten Hertzum and Niels Ebbe Jacobsen. 2003 · 2003
Earlier work this paper cites.
What Do Usability Evaluators Do in Practice? An Explorative Study of Think-Aloud Testing. In Proceedings of the 6th Conference on Designing Interactive Systems (DIS ’06) . Association for Computing Machinery, New York, NY, USA, 209–218
Mie Nørgaard and Kasper Hornbæk. 2006 · 2006
Earlier work this paper cites.
A General Inductive Approach for Analyzing Qualitative Evaluation Data
David R. Thomas. 2006 · 2006
Earlier work this paper cites.
Usability Testing: A Review of Some Methodological and Technical Aspects of the Method
J.M. Christian Bastien. 2010 · 2008
Earlier work this paper cites.
Thinking, fast and slow
Daniel Kahneman. 2011 · 2011
Earlier work this paper cites.
Method Madness: A Usability Testing Pilot Research Case Study
Heidi Decker-Maurer. 2012 · 2012
Earlier work this paper cites.
Analysis in Practical Usability Evaluation: A Survey Study. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12) . Association for Computing Machinery, New York, NY, USA, 2127–2136
Asbjørn Følstad, Effie Law, and Kasper Hornbæk. 2012 · 2012
Earlier work this paper cites.
Usability Testing
James R Lewis. 2012 · 2012
Earlier work this paper cites.
Agent based modeling to inform the design of multiuser systems
Yuqing Ren and Robert E Kraut. 2014 · 2014
Earlier work this paper cites.
Artificial Playfulness: A Tool for Automated Agent-Based Playtesting. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19) . Association for Computing Machinery, New York, NY, USA, 1–6
Samantha . Stahlke, Atiya Nova, and Pejman Mirza-Babaei. 2019 · 2019
Earlier work this paper cites.
Usability Testing Essentials: Ready, Set… Test!
Carol M Barnum. 2020 · 2020
Earlier work this paper cites.
Automating GUI Testing with Image-Based Deep Reinforcement Learning. In 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS) . 160–167
Juha Eskonen, Julen Kahles, and Joel Reijonen. 2020 · 2020
Cited alongside, same era.
Agents for Automated User Experience Testing. In 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) . 247–253
Pedro M. Fernandes, Manuel Lopes, and Rui Prada. 2021 · 2021
Cited alongside, same era.
“Merging Results Is No Easy Task”: An International Survey Study of Collaborative Data Analysis Practices Among UX Practitioners. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22) . Association for Computing Machinery, New York, NY, USA, 1–16
Emily Kuang, Xiaofu Jin, and Mingming Fan. 2022 · 2022
Cited alongside, same era.
WebGPT: Browser-assisted Question-Answering with Human Feedback
Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, Xu Jiang, Karl Cobbe, Tyna Eloundou, Gretchen Krueger, Kevin Button, Matthew Knight, Benjamin Chess, and John Schulman. 2022 · 2022
Generative Agent Simulations of 1,000 People
Joon Sung Park, Carolyn Q. Zou, Aaron Shaw, Benjamin Mako Hill, Carrie Cai, Meredith Ringel Morris, Robb Willer, Percy Liang, and Michael S. Bernstein. 2024 · 2024
Later among the works it cites.
ChatDev: Communicative Agents for Software Development
Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, Juyuan Xu, Dahai Li, Zhiyuan Liu, and Maosong Sun. 2024 · 2024
Later among the works it cites.
AgentClinic: A Multimodal Agent Benchmark to Evaluate AI in Simulated Clinical Environments
Samuel Schmidgall, Rojin Ziaei, Carl Harris, Eduardo Reis, Jeffrey Jopling, and Michael Moor. 2024 · 2024
Later among the works it cites.
Simulating the Human in HCD with ChatGPT: Redesigning Interaction Design with AI
Albrecht Schmidt, Passant Elagroudy, Fiona Draxler, Frauke Kreuter, and Robin Welsch. 2024 · 2024
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents. In Advances in Neural Information Processing Systems
Shunyu Yao, Howard Chen, John Yang, and Karthik R. Narasimhan. 2022 · 2022
Cited alongside, same era.
A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis. In The Twelfth International Conference on Learning Representations
Izzeddin Gur, Hiroki Furuta, Austin V. Huang, Mustafa Safdari, Yutaka Matsuo, Douglas Eck, and Aleksandra Faust. 2023 · 2023
Cited alongside, same era.
Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask Them (Voice vs. Text). In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23) . Association for Computing Machinery, New York, NY, USA, 1–15
Emily Kuang, Ehsan Jahangirzadeh Soure, Mingming Fan, Jian Zhao, and Kristen Shinohara. 2023 · 2023
Cited alongside, same era.
Generative Agents: Interactive Simulacra of Human Behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23) . Association for Computing Machinery, New York, NY, USA, 1–22
Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023 · 2023
Cited alongside, same era.
Privacy in the Time of Language Models. In Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining (WSDM ’23) . Association for Computing Machinery, New York, NY, USA, 1291–1292
Charith Peris, Christophe Dupuy, Jimit Majmudar, Rahil Parikh, Sami Smaili, Richard Zemel, and Rahul Gupta. 2023 · 2023
Cited alongside, same era.
An Empathy-Based Sandbox Approach to Bridge the Privacy Gap among Attitudes, Goals, Knowledge, and Behaviors. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24) . Association for Computing Machinery, New York, NY, USA, 1–28
Chaoran Chen, Weijun Li, Wenxin Song, Yanfang Ye, Yaxing Yao, and Toby Jia-Jun Li. 2024 · 2024
Cited alongside, same era.
Can AI Replace Human Subjects? A Large-Scale Replication of Psychological Experiments with LLMs
Ziyan Cui, Ning Li, and Huaikang Zhou. 2024 · 2024
Cited alongside, same era.
LLM-Augmented Agent-Based Modelling for Social Simulations: Challenges and Opportunities
Onder Gurcan. 2024 · 2024
Cited alongside, same era.
Yijia Shao, Tianshi Li, Weiyan Shi, Yanchen Liu, and Diyi Yang. 2024 · 2024
Later among the works it cites.
Learn-by-Interact: A Data-Centric Framework For Self-Adaptive Agents in Realistic Environments. In The Thirteenth International Conference on Learning Representations
Hongjin Su, Ruoxi Sun, Jinsung Yoon, Pengcheng Yin, Tao Yu, and Sercan O. Arik. 2024 · 2024
Later among the works it cites.
AXNav: Replaying Accessibility Tests from Natural Language. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI ’24) . Association for Computing Machinery, New York, NY, USA, 1–16
Maryam Taeb, Amanda Swearngin, Eldon Schoop, Ruijia Cheng, Yue Jiang, and Jeffrey Nichols. 2024 · 2024
Later among the works it cites.
A Survey on Large Language Model Based Autonomous Agents
Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, and Ji-Rong Wen. 2024 · 2024
Later among the works it cites.
AgentOccam: A Simple Yet Strong Baseline for LLM-Based Web Agents
Ke Yang, Yao Liu, Sapana Chaudhary, Rasool Fakoor, Pratik Chaudhari, George Karypis, and Huzefa Rangwala. 2024 · 2024
Later among the works it cites.
WebArena: A Realistic Web Environment for Building Autonomous Agents
Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig. 2024 · 2024
Later among the works it cites.
Chaoran Chen, Bingsheng Yao, Ruishi Zou, Wenyue Hua, Weimin Lyu, Toby Jia-Jun Li, and Dakuo Wang. 2025 · 2025
Closest in time.
Zhiping Zhang, Bingcan Guo, and Tianshi Li. 2025 · 2025
Closest in time.