Fetching the paper…
Reading the bibliography…
Voice command interfaces (VCIs) have gained increasing importance, enabling hands-free and eyes-free interaction with digital devices.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 1901
Earlier work this paper cites.
Automation of VUIto GUI Mapping. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA ’13) . Association for Computing Machinery, New York, NY, USA, 1941–1944
Amber Wagner. 2013 · 1944
Earlier work this paper cites.
Visual programming, programming by example, and program visualization: a taxonomy
Brad A Myers. 1986 · 1986
Earlier work this paper cites.
Watch what I do: programming by demonstration
Allen Cypher and Daniel Conrad Halbert. 1993 · 1993
Earlier work this paper cites.
Recent improvements in the CMU spoken language understanding system. In Human Language Technology: Proceedings of a Workshop held at Plainsboro, New Jersey, March 8-11, 1994
Wayne Ward and Sunil Issar. 1994 · 1994
Earlier work this paper cites.
Designing SpeechActs: Issues in speech user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems . 369–376
Nicole Yankelovich, Gina-Anne Levow, and Matt Marx. 1995 · 1995
Earlier work this paper cites.
Reinforcement learning: A survey
Leslie Pack Kaelbling, Michael L Littman, and Andrew W Moore. 1996 · 1996
Earlier work this paper cites.
Simplifying macro definition in programming by demonstration. In Proceedings of the 9th annual ACM symposium on User interface software and technology . 173–182
Atsushi Sugiura and Yoshiyuki Koseki. 1996 · 1996
Earlier work this paper cites.
How do users know what to say?
Nicole Yankelovich. 1996 · 1996
Earlier work this paper cites.
a CAPpella: programming by demonstration of context-aware applications. In Proceedings of the SIGCHI conference on Human factors in computing systems . 33–40
Anind K Dey, Raffay Hamid, Chris Beckmann, Ian Li, and Daniel Hsu. 2004 · 2004
Earlier work this paper cites.
Error handling in the RavenClaw dialog management architecture. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing . 225–232
Dan Bohus and Alexander Rudnicky. 2005 · 2005
Earlier work this paper cites.
Active preference learning for personalized calendar scheduling assistance. In Proceedings of the 10th international conference on Intelligent user interfaces . 90–97
Melinda T Gervasio, Michael D Moffitt, Martha E Pollack, Joseph M Taylor, and Tomas E Uribe. 2005 · 2005
Earlier work this paper cites.
Plow: A collaborative task learning agent. In AAAI , Vol. 7. 1514–1519
James Allen, Nathanael Chambers, George Ferguson, Lucian Galescu, Hyuckchul Jung, Mary Swift, and William Taysom. 2007 · 2007
Earlier work this paper cites.
Koala: capture, share, automate, personalize business processes on the web. In Proceedings of the SIGCHI conference on Human factors in computing systems . 943–946
Greg Little, Tessa A Lau, Allen Cypher, James Lin, Eben M Haber, and Eser Kandogan. 2007 · 2007
Earlier work this paper cites.
CoScripter: automating & sharing how-to knowledge in the enterprise. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . 1719–1728
Gilly Leshed, Eben M Haber, Tara Matthews, and Tessa Lau. 2008 · 2008
Earlier work this paper cites.
Reading between the lines: Learning to map high-level instructions to commands. In Proceedings of the 48th annual meeting of the association for computational linguistics . 1268–1277
SRK Branavan, Luke Zettlemoyer, and Regina Barzilay. 2010 · 2010
Earlier work this paper cites.
A conversational interface to web automation. In Proceedings of the 23nd annual ACM symposium on User interface software and technology . 229–238
Tessa Lau, Julian Cerruti, Guillermo Manzato, Mateo Bengualid, Jeffrey P Bigham, and Jeffrey Nichols. 2010 · 2010
Earlier work this paper cites.
RoutineMaker: Towards end-user automation of daily routines using smartphones. In 2012 IEEE International Conference on Pervasive Computing and Communications Workshops . IEEE, 399–402
Ville Antila, Jussi Polet, Arttu Lämsä, and Jussi Liikka. 2012 · 2012
Earlier work this paper cites.
Code in the air: simplifying sensing and coordination tasks on smartphones. In Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications . 1–6
Lenin Ravindranath, Arvind Thiagarajan, Hari Balakrishnan, and Samuel Madden. 2012 · 2012
Earlier work this paper cites.
How do users respond to voice input errors? Lexical and phonetic query reformulation in voice search. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval . 143–152
Jiepu Jiang, Wei Jeng, and Daqing He. 2013 · 2013
Earlier work this paper cites.
Hands free-care free: elderly people taking advantage of speech-only interaction. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational . 203–206
Linda Wulf, Markus Garschall, Julia Himmelsbach, and Manfred Tscheligi. 2014 · 2014
Earlier work this paper cites.
JustSpeak: enabling universal voice control on Android. In Proceedings of the 11th Web for All Conference . 1–4
Yu Zhong, TV Raman, Casey Burkhardt, Fadi Biadsy, and Jeffrey P Bigham. 2014 · 2014
Earlier work this paper cites.
Capti-speak: a speech-enabled web screen reader. In Proceedings of the 12th International Web for All Conference . 1–10
Vikas Ashok, Yevgen Borodin, Yury Puzis, and IV Ramakrishnan. 2015 · 2015
Earlier work this paper cites.
Datatone: Managing ambiguity in natural language interfaces for data visualization. In Proceedings of the 28th annual acm symposium on user interface software & technology . 489–500
Tong Gao, Mira Dontcheva, Eytan Adar, Zhicheng Liu, and Karrie G Karahalios. 2015 · 2015
Earlier work this paper cites.
Learning to interpret natural language commands through human-robot dialog. In Twenty-Fourth International Joint Conference on Artificial Intelligence
Jesse Thomason, Shiqi Zhang, Raymond J Mooney, and Peter Stone. 2015 · 2015
Earlier work this paper cites.
Ye Zhang and Byron Wallace. 2015 · 2015
Earlier work this paper cites.
Instructable intelligent personal agent. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 30
Amos Azaria, Jayant Krishnamurthy, and Tom Mitchell. 2016 · 2016
Earlier work this paper cites.
What can I say? addressing user experience challenges of a mobile voice user interface for accessibility. In Proceedings of the 18th international conference on human-computer interaction with mobile devices and services . 72–82
Eric Corbett and Astrid Weber. 2016 · 2016
Earlier work this paper cites.
"Like Having a Really Bad PA" The Gulf between User Expectation and Experience of Conversational Agents. In Proceedings of the 2016 CHI conference on human factors in computing systems . 5286–5297
Ewa Luger and Abigail Sellen. 2016 · 2016
Earlier work this paper cites.
Why that nao? how humans adapt to a conventional humanoid robot in taking turns-at-talk. In Proceedings of the 2016 CHI conference on human factors in computing systems . 4921–4932
Hannah RM Pelikan and Mathias Broth. 2016 · 2016
Earlier work this paper cites.
Productivity decomposed: Getting big things done with little microtasks. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems . 3500–3507
Jaime Teevan, Shamsi T Iqbal, Carrie J Cai, Jeffrey P Bigham, Michael S Bernstein, and Elizabeth M Gerber. 2016 · 2016
Earlier work this paper cites.
Web screen reading automation assistance using semantic abstraction. In Proceedings of the 22nd International Conference on Intelligent User Interfaces . 407–418
Vikas Ashok, Yury Puzis, Yevgen Borodin, and IV Ramakrishnan. 2017 · 2017
Earlier work this paper cites.
" What can i help you with?" infrequent users’ experiences of intelligent personal assistants. In Proceedings of the 19th international conference on human-computer interaction with mobile devices and services . 1–12
Benjamin R Cowan, Nadia Pantidi, David Coyle, Kellie Morrissey, Peter Clarke, Sara Al-Shehri, David Earley, and Natasha Bandeira. 2017 · 2017
Earlier work this paper cites.
Accessible touchscreen technology for people with visual impairments: a survey
William Grussenmeyer and Eelke Folmer. 2017 · 2017
Cited alongside, same era.
SUGILITE: creating multimodal smartphone automation by demonstration. In Proceedings of the 2017 CHI conference on human factors in computing systems . 6038–6049
Toby Jia-Jun Li, Amos Azaria, and Brad A Myers. 2017 · 2017
Cited alongside, same era.
Learning user preferences by observing user-items interactions in an IoT augmented space. In Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization . 35–40
David Massimo, Mehdi Elahi, and Francesco Ricci. 2017 · 2017
Cited alongside, same era.
I’m sorry, dave, i’m afraid i can’t do that: Chatbot perception and expectations. In Proceedings of the 5th international conference on human agent interaction . 253–260
Jennifer Zamora. 2017 · 2017
Cited alongside, same era.
Deep reinforcement learning for autonomous driving: A survey
B Ravi Kiran, Ibrahim Sobh, Victor Talpaert, Patrick Mannion, Ahmad A Al Sallab, Senthil Yogamani, and Patrick Pérez. 2021 · 2021
Later among the works it cites.
FLUID-XP: Flexible User Interface Distribution for Cross-Platform Experience. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking (New Orleans, Louisiana) (MobiCom ’21) . Association for Computing Machinery, New York, NY, USA, 762–774
Sunjae Lee, Hayeon Lee, Hoyoung Kim, Sangmin Lee, Jeong Woon Choi, Yuseung Lee, Seono Lee, Ahyeon Kim, Jean Young Song, Sangeun Oh, Steven Y. Ko, and Insik Shin. 2021 · 2021
Later among the works it cites.
AppBuddy: Learning to Accomplish Tasks in Mobile Apps via Reinforcement Learning.. In Canadian Conference on AI
Maayan Shvo, Zhiming Hu, Rodrigo Toro Icarte, Iqbal Mohomed, Allan D Jepson, and Sheila A McIlraith. 2021 · 2021
Later among the works it cites.
TaleBrush: Sketching stories with generative pretrained language models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems . 1–19
John Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee, Eytan Adar, and Minsuk Chang. 2022 · 2022
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Xiaoyi Zhang, Anne Spencer Ross, Anat Caspi, James Fogarty, and Jacob O Wobbrock. 2017 · 2017
Cited alongside, same era.
From ui design image to gui skeleton: a neural machine translator to bootstrap mobile gui implementation. In Proceedings of the 40th International Conference on Software Engineering . 665–676
Chunyang Chen, Ting Su, Guozhu Meng, Zhenchang Xing, and Yang Liu. 2018 · 2018
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Cited alongside, same era.
Iris: A conversational agent for complex tasks. In Proceedings of the 2018 CHI conference on human factors in computing systems . 1–12
Ethan Fast, Binbin Chen, Julia Mendelsohn, Jonathan Bassen, and Michael S Bernstein. 2018 · 2018
Cited alongside, same era.
Evaluating and informing the design of chatbots. In Proceedings of the 2018 designing interactive systems conference . 895–906
Mohit Jain, Pratyush Kumar, Ramachandra Kota, and Shwetak N Patel. 2018 · 2018
Cited alongside, same era.
Appinite: A multi-modal interface for specifying data descriptions in programming by demonstration using natural language instructions. In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) . IEEE, 105–114
Toby Jia-Jun Li, Igor Labutov, Xiaohan Nancy Li, Xiaoyi Zhang, Wenze Shi, Wanling Ding, Tom M Mitchell, and Brad A Myers. 2018 · 2018
Cited alongside, same era.
KITE: Building conversational bots from mobile apps. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services . 96–109
Toby Jia-Jun Li and Oriana Riva. 2018 · 2018
Cited alongside, same era.
Learning Design Semantics for Mobile Apps. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18) . Association for Computing Machinery, New York, NY, USA, 569–579
Thomas F. Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018 · 2018
Cited alongside, same era.
Hai Dang, Lukas Mecke, Florian Lehmann, Sven Goller, and Daniel Buschek. 2022 · 2022
Later among the works it cites.
Rlprompt: Optimizing discrete text prompts with reinforcement learning
Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric P Xing, and Zhiting Hu. 2022 · 2022
Later among the works it cites.
Promptmaker: Prompt-based prototyping with large language models. In CHI Conference on Human Factors in Computing Systems Extended Abstracts . 1–8
Ellen Jiang, Kristen Olson, Edwin Toh, Alejandra Molina, Aaron Donsbach, Michael Terry, and Carrie J Cai. 2022 · 2022
Later among the works it cites.
Training language models to follow instructions with human feedback
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al · 2022
Later among the works it cites.
Automatically generating and improving voice command interface from operation sequences on smartphones. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems . 1–21
Lihang Pan, Chun Yu, JiaHui Li, Tian Huang, Xiaojun Bi, and Yuanchun Shi. 2022 · 2022
Later among the works it cites.
Learning to repair: Repairing model output errors after deployment using a dynamic memory of feedback. In Findings of the Association for Computational Linguistics: NAACL 2022 , Marine Carpuat, Marie-Catherine de Marneffe, and Ivan Vladimir Meza Ruiz (Eds.). Association for Computational Linguistics, Seattle, United States, 339–352
Niket Tandon, Aman Madaan, Peter Clark, and Yiming Yang. 2022 · 2022
Later among the works it cites.
UGIF: UI Grounded Instruction Following
Sagar Gubbi Venkatesh, Partha Talukdar, and Srini Narayanan. 2022 · 2022
Later among the works it cites.
A survey of human-in-the-loop for machine learning
Xingjiao Wu, Luwei Xiao, Yixuan Sun, Junhang Zhang, Tianlong Ma, and Liang He. 2022 · 2022
Later among the works it cites.
React: Synergizing reasoning and acting in language models
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022 · 2022
Later among the works it cites.
Do as i can, not as i say: Grounding language in robotic affordances. In Conference on Robot Learning . PMLR, 287–318
Anthony Brohan, Yevgen Chebotar, Chelsea Finn, Karol Hausman, Alexander Herzog, Daniel Ho, Julian Ibarz, Alex Irpan, Eric Jang, Ryan Julian, et al · 2023
Closest in time.
Palm-e: An embodied multimodal language model
Danny Driess, Fei Xia, Mehdi SM Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, et al · 2023
Closest in time.
Large Language Models for Software Engineering: Survey and Open Problems
Angela Fan, Beliz Gokkaya, Mark Harman, Mitya Lyubarskiy, Shubho Sengupta, Shin Yoo, and Jie M Zhang. 2023 · 2023
Closest in time.
Programming without a Programming Language: Challenges and Opportunities for Designing Developer Tools for Prompt Programming. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems . 1–7
Alexander J Fiannaca, Chinmay Kulkarni, Carrie J Cai, and Michael Terry. 2023 · 2023
Closest in time.
Interaction Proxy Manager: Semantic Model Generation and Run-Time Support for Reconstructing Ubiquitous User Interfaces of Mobile Services
Tian Huang, Chun Yu, Weinan Shi, Bowen Wang, David Yang, Yihao Zhu, Zhaoheng Li, and Yuanchun Shi. 2023 · 2023
Closest in time.
A Zero-Shot Language Agent for Computer Control with Structured Reflection
Tao Li, Gang Li, Zhiwei Deng, Bryan Wang, and Yang Li. 2023 · 2023
Closest in time.
“What It Wants Me To Say”: Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1–31
Michael Xieyang Liu, Advait Sarkar, Carina Negreanu, Benjamin Zorn, Jack Williams, Neil Toronto, and Andrew D Gordon. 2023a · 2023
Closest in time.
Agentbench: Evaluating llms as agents
Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, et al · 2023
Closest in time.
Improving multiparty interactions with a robot using large language models. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems . 1–8
Prasanth Murali, Ian Steenstra, Hye Sun Yun, Ameneh Shamekhi, and Timothy Bickmore. 2023 · 2023
Closest in time.
OpenAI. 2023 · 2023
Closest in time.
A Human-Computer Collaborative Editing Tool for Conceptual Diagrams. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1–29
Lihang Pan, Chun Yu, Zhe He, and Yuanchun Shi. 2023 · 2023
Closest in time.
Android in the wild: A large-scale dataset for android device control
Christopher Rawles, Alice Li, Daniel Rodriguez, Oriana Riva, and Timothy Lillicrap. 2023 · 2023
Closest in time.
The programmer’s assistant: Conversational interaction with a large language model for software development. In Proceedings of the 28th International Conference on Intelligent User Interfaces . 491–514
Steven I Ross, Fernando Martinez, Stephanie Houde, Michael Muller, and Justin D Weisz. 2023 · 2023
Closest in time.
Reflexion: Language agents with verbal reinforcement learning. In Thirty-seventh Conference on Neural Information Processing Systems
Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik R Narasimhan, and Shunyu Yao. 2023 · 2023
Closest in time.
Voicify Your UI: Towards Android App Control with Voice Commands
Minh Duc Vu, Han Wang, Zhuang Li, Gholamreza Haffari, Zhenchang Xing, and Chunyang Chen. 2023 · 2023
Closest in time.
Enabling conversational interaction with mobile ui using large language models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1–17
Bryan Wang, Gang Li, and Yang Li. 2023a · 2023
Closest in time.
RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1–29
Yunlong Wang, Shuyuan Shen, and Brian Y Lim. 2023b · 2023
Closest in time.
Auto-GPT for Online Decision Making: Benchmarks and Additional Opinions
Hui Yang, Sifu Yue, and Yunzhong He. 2023 · 2023
Closest in time.
Towards an understanding of large language models in software engineering tasks
Zibin Zheng, Kaiwen Ning, Jiachi Chen, Yanlin Wang, Wenqing Chen, Lianghong Guo, and Weicheng Wang. 2023 · 2023
Closest in time.