Fetching the paper…
Reading the bibliography…
We present a new problem: grounding natural language instructions to mobile user interface actions, and create three new datasets for it.
Text chunking using transformation-based learning
Lance Ramshaw and Mitch Marcus. 1995 · 1995
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Reinforcement learning for mapping instructions to actions
S. R. K. Branavan, Harr Chen, Luke S. Zettlemoyer, and Regina Barzilay. 2009 · 2009
Earlier work this paper cites.
Reading between the lines: Learning to map high-level instructions to commands
S.R.K. Branavan, Luke Zettlemoyer, and Regina Barzilay. 2010 · 2010
Earlier work this paper cites.
Computer Vision: Algorithms and Applications , 1st edition
Richard Szeliski. 2010 · 2010
Earlier work this paper cites.
Learning to interpret natural language navigation instructions from observations
David L. Chen and Raymond J. Mooney. 2011 · 2011
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014
Earlier work this paper cites.
Natural language for human robot interaction
Huda Khayrallah, Sean Trott, and Jerome Feldman. 2015 · 2015
Earlier work this paper cites.
Effective approaches to attention-based neural machine translation
Thang Luong, Hieu Pham, and Christopher D. Manning. 2015 · 2015
Earlier work this paper cites.
Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015 · 2015
Earlier work this paper cites.
Learning recurrent span representations for extractive question answering
Kenton Lee, Tom Kwiatkowski, Ankur P. Parikh, and Dipanjan Das. 2016 · 2016
Cited alongside, same era.
Listen, attend, and walk: Neural mapping of navigational instructions to action sequences
Hongyuan Mei, Mohit Bansal, and Matthew R. Walter. 2016 · 2016
Cited alongside, same era.
Rico: A mobile app dataset for building data-driven design applications
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017 · 2017
Cited alongside, same era.
End-to-end neural coreference resolution
Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. 2017 · 2017
Cited alongside, same era.
Mapping instructions and visual observations to actions with reinforcement learning
Dipendra Misra, John Langford, and Yoav Artzi. 2017 · 2017
Cited alongside, same era.
Edit me: A corpus and a framework for understanding natural language image editing
Ramesh Manuvinakurike, Jacqueline Brixey, Trung Bui, Walter Chang, Doo Soon Kim, Ron Artstein, and Kallirroi Georgila. 2018 · 2018
Later among the works it cites.
Image transformer
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, and Dustin Tran. 2018 · 2018
Later among the works it cites.
Situational impairments during mobile interaction
Zhanna Sarsenbayeva. 2018 · 2018
Later among the works it cites.
Learning to map context-dependent sentences to executable formal queries
Alane Suhr, Srinivasan Iyer, and Yoav Artzi. 2018 · 2018
Later among the works it cites.
Touchdown: Natural language navigation and spatial reasoning in visual street environments
Howard Chen, Alane Suhr, Dipendra Misra, and Yoav Artzi. 2019 · 2019
Later among the works it cites.
Learning to navigate the web
Izzeddin Gur, Ulrich Rueckert, Aleksandra Faust, and Dilek Hakkani-Tur. 2019 · 2019
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Cited alongside, same era.
Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments
Peter Anderson, Qi Wu, Damien Teney, Jake Bruce, Mark Johnson, Niko Sünderhauf, Ian Reid, Stephen Gould, and Anton van den Hengel. 2018 · 2018
Cited alongside, same era.
Jointly predicting predicates and arguments in neural semantic role labeling
Luheng He, Kenton Lee, Omer Levy, and Luke Zettlemoyer. 2018 · 2018
Cited alongside, same era.
Reinforcement learning on web interfaces using workflow-guided exploration
E. Z. Liu, K. Guu, P. Pasupat, T. Shi, and P. Liang. 2018 · 2018
Cited alongside, same era.
Later among the works it cites.
Multi-input multi-output sequence labeling for joint extraction of fact and condition tuples from scientific text
Tianwen Jiang, Tong Zhao, Bing Qin, Ting Liu, Nitesh Chawla, and Meng Jiang. 2019 · 2019
Later among the works it cites.
Area attention
Yang Li, Lukasz Kaiser, Samy Bengio, and Si Si. 2019 · 2019
Later among the works it cites.
Learning convolutional neural networks for graphs
Mathias Niepert, Mohamed Ahmed, and Konstantin Kutzkov. 2016 · 2023
Closest in time.