Fetching the paper…
Reading the bibliography…
Representing the semantics of GUI screens and components is crucial to data-driven computational methods for modeling user-GUI interactions and mining GUI designs.
Nils Reimers and Iryna Gurevych. 2019 · 1908
Earlier work this paper cites.
Dynamic Programming
Richard Bellman. 1966 · 1966
Earlier work this paper cites.
Learning deep architectures for AI
Yoshua Bengio. 2009 · 2009
Earlier work this paper cites.
Trailblazer: Enabling Blind Users to Blaze Trails through the Web. In Proceedings of the 14th International Conference on Intelligent User Interfaces (Sanibel Island, Florida, USA) (IUI ’09) . ACM, New York, NY, USA, 177–186
Jeffrey P. Bigham, Tessa Lau, and Jeffrey Nichols. 2009 · 2009
Earlier work this paper cites.
Sikuli: Using GUI Screenshots for Search and Automation. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST ’09) . ACM, New York, NY, USA, 183–192
Tom Yeh, Tsung-Hsiang Chang, and Robert C. Miller. 2009 · 2009
Earlier work this paper cites.
Rectified Linear Units Improve Restricted Boltzmann Machines. In Proceedings of the 27th International Conference on International Conference on Machine Learning (Haifa, Israel) (ICML’10) . Omnipress, Madison, WI, USA, 807–814
Vinod Nair and Geoffrey E. Hinton. 2010 · 2010
Earlier work this paper cites.
Word Representations: A Simple and General Method for Semi-Supervised Learning. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (Uppsala, Sweden) (ACL ’10) . ACL, USA, 384–394
Joseph Turian, Lev Ratinov, and Yoshua Bengio. 2010 · 2010
Earlier work this paper cites.
Webzeitgeist: Design Mining the Web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13) . ACM, New York, NY, USA, 3083–3092
Ranjitha Kumar, Arvind Satyanarayan, Cesar Torres, Maxine Lim, Salman Ahmad, Scott R. Klemmer, and Jerry O. Talton. 2013 · 2013
Earlier work this paper cites.
Efficient Estimation of Word Representations in Vector Space
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013a · 2013
Earlier work this paper cites.
CommandSpace: Modeling the Relationships Between Tasks, Descriptions and Features. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST ’14) . ACM, New York, NY, USA, 167–176
Eytan Adar, Mira Dontcheva, and Gierad Laput. 2014 · 2014
Earlier work this paper cites.
Leveraging Advances in Natural Language Processing to Better Understand Tobler’s First Law of Geography. In Proceedings of the 22Nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL ’14) . ACM, New York, NY, USA, 513–516
Toby Jia-Jun Li, Shilad Sen, and Brent Hecht. 2014 · 2014
Earlier work this paper cites.
GloVe: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP ’14) . ACL, Doha, Qatar, 1532–1543
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014 · 2014
Earlier work this paper cites.
A large annotated corpus for learning natural language inference. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing . ACL, Lisbon, Portugal, 632–642
Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015 · 2015
Earlier work this paper cites.
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
uLink: Enabling User-Defined Deep Linking to App Content. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys ’16) . ACM, New York, NY, USA, 305–318
Tanzirul Azim, Oriana Riva, and Suman Nath. 2016 · 2016
Earlier work this paper cites.
ERICA: Interaction Mining Mobile Apps. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16) . ACM, New York, NY, USA, 767–776
Biplab Deka, Zifeng Huang, and Ranjitha Kumar. 2016 · 2016
Cited alongside, same era.
Appstract: On-the-fly App Content Semantics with Better Privacy. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (MobiCom ’16) . ACM, New York, NY, USA, 361–374
Earlence Fernandes, Oriana Riva, and Suman Nath. 2016 · 2016
Cited alongside, same era.
Rico: A Mobile App Dataset for Building Data-Driven Design Applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17) . ACM, New York, NY, USA, 845–854
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017 · 2017
Cited alongside, same era.
SUGILITE: Creating Multimodal Smartphone Automation by Demonstration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17) . ACM, New York, NY, USA, 6038–6049
Toby Jia-Jun Li, Amos Azaria, and Brad A. Myers. 2017 · 2017
MessageOnTap: A Suggestive Interface to Facilitate Messaging-Related Tasks. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19) . ACM, New York, NY, USA, Article 575, 14 pages
Fanglin Chen, Kewei Xia, Karan Dhabalia, and Jason I. Hong. 2019 · 2019
Later among the works it cites.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) . ACL, Minneapolis, Minnesota, 4171–4186
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Later among the works it cites.
Swire: Sketch-Based User Interface Retrieval. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19) . ACM, New York, NY, USA, 1–10
Forrest Huang, John F. Canny, and Jeffrey Nichols. 2019 · 2019
Later among the works it cites.
HILC: Domain-Independent PbD System Via Computer Vision and Follow-Up Questions
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Making End User Development More Natural
Brad A. Myers, Amy J. Ko, Chris Scaffidi, Stephen Oney, YoungSeok Yoon, Kerry Chang, Mary Beth Kery, and Toby Jia-Jun Li. 2017 · 2017
Cited alongside, same era.
Exploring API Embedding for API Usages and Applications. In Proceedings of the 39th International Conference on Software Engineering (Buenos Aires, Argentina) (ICSE ’17) . IEEE, 438–449
Trong Duc Nguyen, Anh Tuan Nguyen, Hung Dang Phan, and Tien N. Nguyen. 2017 · 2017
Cited alongside, same era.
Interaction Proxies for Runtime Repair and Enhancement of Mobile Application Accessibility. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17) . ACM, New York, NY, USA, 6024–6037
Xiaoyi Zhang, Anne Spencer Ross, Anat Caspi, James Fogarty, and Jacob O. Wobbrock. 2017 · 2017
Cited alongside, same era.
APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Verbal Instructions. In Proceedings of the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2018)
Toby Jia-Jun Li, Igor Labutov, Xiaohan Nancy Li, Xiaoyi Zhang, Wenze Shi, Tom M. Mitchell, and Brad A. Myers. 2018 · 2018
Cited alongside, same era.
KITE: Building conversational bots from mobile apps. In Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys 2018) . ACM
Toby Jia-Jun Li and Oriana Riva. 2018 · 2018
Cited alongside, same era.
Learning Design Semantics for Mobile Apps. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18) . ACM, New York, NY, USA, 569–579
Thomas F. Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018 · 2018
Cited alongside, same era.
Mapping natural language commands to web elements. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP ’18) . ACL, Brussels, Belgium, 4970–4976
Panupong Pasupat, Tian-Shun Jiang, Evan Liu, Kelvin Guu, and Percy Liang. 2018 · 2018
Cited alongside, same era.
Deep Contextualized Word Representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) (NAACL ’18) . ACL, New Orleans, Louisiana, 2227–2237
Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018 · 2018
Cited alongside, same era.
Thanapong Intharah, Daniyar Turmukhambetov, and Gabriel J. Brostow. 2019 · 2019
Later among the works it cites.
LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks
Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang, and Tingfa Xu. 2019 · 2019
Later among the works it cites.
PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST 2019) . ACM
Toby Jia-Jun Li, Marissa Radensky, Justin Jia, Kirielle Singarajah, Tom M. Mitchell, and Brad A. Myers. 2019 · 2019
Later among the works it cites.
Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning. In Proceedings of the 42nd International Conference on Software Engineering (ICSE ’20)
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu, Liming Zhu, Guoqiang Li, and Jinshui Wang. 2020 · 2020
Later among the works it cites.
GUIComp: A GUI Design Assistant with Real-Time, Multi-Faceted Feedback. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20) . ACM, New York, NY, USA, 1–13
Chunggi Lee, Sanghoon Kim, Dongyun Han, Hongjun Yang, Young-Woo Park, Bum Chul Kwon, and Sungahn Ko. 2020a · 2020
Later among the works it cites.
Neural Design Network: Graphic Layout Generation with Constraints
Hsin-Ying Lee, Weilong Yang, Lu Jiang, Madison Le, Irfan Essa, Haifeng Gong, and Ming-Hsuan Yang. 2020b · 2020
Later among the works it cites.
Privacy-Preserving Script Sharing in GUI-Based Programming-by-Demonstration Systems
Toby Jia-Jun Li, Jingya Chen, Brandon Canfield, and Brad A. Myers. 2020a · 2020
Later among the works it cites.
Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST 2020) . ACM
Toby Jia-Jun Li, Jingya Chen, Haijun Xia, Tom M. Mitchell, and Brad A. Myers. 2020b · 2020
Later among the works it cites.
Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations . ACL, Online, 215–223
Toby Jia-Jun Li, Tom Mitchell, and Brad Myers. 2020e · 2020
Later among the works it cites.
Mapping Natural Language Instructions to Mobile UI Action Sequences. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics . ACL, Online, 8198–8210
Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge. 2020c · 2020
Later among the works it cites.
Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) . ACL, Online, 5495–5510
Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, and Zhiwei Guan. 2020d · 2020
Later among the works it cites.
VASTA: a vision and language-assisted smartphone task automation system. In Proceedings of the 25th International Conference on Intelligent User Interfaces (IUI ’20) . 22–32
Alborz Rezazadeh Sereshkeh, Gary Leung, Krish Perumal, Caleb Phillips, Minfan Zhang, Afsaneh Fazly, and Iqbal Mohomed. 2020 · 2020
Later among the works it cites.