Fetching the paper…
Reading the bibliography…
Understanding user interface (UI) functionality is a useful yet challenging task for both machines and people.
The Hungarian method for the assignment problem
Harold W Kuhn. 1955 · 1955
Earlier work this paper cites.
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography
Martin A Fischler and Robert C Bolles. 1981 · 1981
Earlier work this paper cites.
Determining optical flow
Berthold KP Horn and Brian G Schunck. 1981 · 1981
Earlier work this paper cites.
Image analogies. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques . 327–340
Aaron Hertzmann, Charles E Jacobs, Nuria Oliver, Brian Curless, and David H Salesin. 2001 · 2001
Earlier work this paper cites.
Multiple view geometry in computer vision
Richard Hartley and Andrew Zisserman. 2003 · 2003
Earlier work this paper cites.
Constructing a language: A usage-based theory of language acquisition
Michael Tomasello. 2005 · 2005
Earlier work this paper cites.
An overview of the Tesseract OCR engine. In Ninth international conference on document analysis and recognition (ICDAR 2007) , Vol. 2. IEEE, 629–633
Ray Smith. 2007 · 2007
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition . Ieee, 248–255
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009 · 2009
Earlier work this paper cites.
GUI testing using computer vision. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . 1535–1544
Tsung-Hsiang Chang, Tom Yeh, and Robert C Miller. 2010 · 2010
Earlier work this paper cites.
Sift flow: Dense correspondence across scenes and its applications
Ce Liu, Jenny Yuen, and Antonio Torralba. 2010 · 2010
Earlier work this paper cites.
Bricolage: example-based retargeting for web design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems . 2197–2206
Ranjitha Kumar, Jerry O Talton, Salman Ahmad, and Scott R Klemmer. 2011 · 2011
Earlier work this paper cites.
ShowMeHow: translating user interface instructions between applications. In Proceedings of the 24th annual ACM symposium on User interface software and technology . 127–134
Vidya Ramesh, Charlie Hsu, Maneesh Agrawala, and Björn Hartmann. 2011 · 2011
Earlier work this paper cites.
ORB: An efficient alternative to SIFT or SURF. In 2011 International conference on computer vision . Ieee, 2564–2571
Ethan Rublee, Vincent Rabaud, Kurt Konolige, and Gary Bradski. 2011 · 2011
Earlier work this paper cites.
Creating contextual help for GUIs using screenshots. In Proceedings of the 24th annual ACM symposium on User interface software and technology . 145–154
Tom Yeh, Tsung-Hsiang Chang, Bo Xie, Greg Walsh, Ivan Watkins, Krist Wongsuphasawat, Man Huang, Larry S Davis, and Benjamin B Bederson. 2011 · 2011
Earlier work this paper cites.
The winograd schema challenge. In Thirteenth international conference on the principles of knowledge representation and reasoning
Hector Levesque, Ernest Davis, and Leora Morgenstern. 2012 · 2012
Earlier work this paper cites.
A simple, fast, and effective reparameterization of ibm model 2. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies . 644–648
Chris Dyer, Victor Chahuneau, and Noah A Smith. 2013 · 2013
Earlier work this paper cites.
Cluster-based co-saliency detection
Huazhu Fu, Xiaochun Cao, and Zhuowen Tu. 2013 · 2013
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition
Karen Simonyan and Andrew Zisserman. 2014 · 2014
Earlier work this paper cites.
Faster r-cnn: Towards real-time object detection with region proposal networks
Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015 · 2015
Earlier work this paper cites.
Analogy-based detection of morphological and semantic relations with word embeddings: what works and what doesn’t.. In Proceedings of the NAACL Student Research Workshop . 8–15
Anna Gladkova, Aleksandr Drozd, and Satoshi Matsuoka. 2016 · 2016
Earlier work this paper cites.
Matching networks for one shot learning
Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Daan Wierstra, et al · 2016
Earlier work this paper cites.
Rico: A mobile app dataset for building data-driven design applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology . 845–854
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. 2017 · 2017
Earlier work this paper cites.
SUGILITE: creating multimodal smartphone automation by demonstration. In Proceedings of the 2017 CHI conference on human factors in computing systems . 6038–6049
Toby Jia-Jun Li, Amos Azaria, and Brad A Myers. 2017 · 2017
Cited alongside, same era.
Get to the point: Summarization with pointer-generator networks
Abigail See, Peter J Liu, and Christopher D Manning. 2017 · 2017
Cited alongside, same era.
Interaction proxies for runtime repair and enhancement of mobile application accessibility. In Proceedings of the 2017 CHI conference on human factors in computing systems . 6024–6037
Xiaoyi Zhang, Anne Spencer Ross, Anat Caspi, James Fogarty, and Jacob O Wobbrock. 2017 · 2017
Cited alongside, same era.
Neural best-buddies: Sparse cross-domain correspondence
Kfir Aberman, Jing Liao, Mingyi Shi, Dani Lischinski, Baoquan Chen, and Daniel Cohen-Or. 2018 · 2018
Cited alongside, same era.
Solvent: A mixed initiative system for finding analogies between research papers
ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces
Zecheng He, Srinivas Sunkara, Xiaoxue Zang, Ying Xu, Lijuan Liu, Nevan Wichers, Gabriel Schubiner, Ruby Lee, Jindong Chen, and Blaise Aguera y Arcas. 2020b · 2020
Later among the works it cites.
Enrico: A dataset for topic modeling of mobile ui designs. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services . 1–4
Luis A Leiva, Asutosh Hota, and Antti Oulasvirta. 2020 · 2020
Later among the works it cites.
Mapping natural language instructions to mobile UI action sequences
Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, and Jason Baldridge. 2020a · 2020
Later among the works it cites.
Widget captioning: Generating natural language description for mobile user interface elements
Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, and Zhiwei Guan. 2020b · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Joel Chan, Joseph Chee Chang, Tom Hope, Dafna Shahaf, and Aniket Kittur. 2018 · 2018
Cited alongside, same era.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018
Cited alongside, same era.
Generating sentences by editing prototypes
Kelvin Guu, Tatsunori B Hashimoto, Yonatan Oren, and Percy Liang. 2018 · 2018
Cited alongside, same era.
Click sequence prediction in Android mobile applications
Seokjun Lee, Rhan Ha, and Hojung Cha. 2018 · 2018
Cited alongside, same era.
Learning design semantics for mobile apps. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology . 569–579
Thomas F Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018 · 2018
Cited alongside, same era.
Self-attention with relative position representations
Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. 2018 · 2018
Cited alongside, same era.
Robust annotation of mobile application interfaces in methods for accessibility repair and enhancement. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology . 609–621
Xiaoyi Zhang, Anne Spencer Ross, and James Fogarty. 2018 · 2018
Cited alongside, same era.
Storydroid: Automated generation of storyboard for Android apps. In 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) . IEEE, 596–607
Sen Chen, Lingling Fan, Chunyang Chen, Ting Su, Wenhe Li, Yang Liu, and Lihua Xu. 2019 · 2019
Cited alongside, same era.
Masoud Jalili Sabet, Philipp Dufter, François Yvon, and Hinrich Schütze. 2020 · 2020
Later among the works it cites.
Near-duplicate detection in web app model inference. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering . 186–197
Rahulkrishna Yandrapally, Andrea Stocco, and Ali Mesbah. 2020 · 2020
Later among the works it cites.
“Maps are hard for me”: Identifying How Older Adults Struggle with Mobile Maps. In the 22nd international ACM SIGACCESS conference on computers and accessibility . 1–8
Ja Eun Yu and Debaleena Chattopadhyay. 2020 · 2020
Later among the works it cites.
VINS: Visual Search for Mobile User Interface Design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems . 1–14
Sara Bunian, Kai Li, Chaima Jemmali, Casper Harteveld, Yun Fu, and Magy Seif Seif El-Nasr. 2021 · 2021
Later among the works it cites.
Towards Complete Icon Labeling in Mobile Applications. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems . 1–14
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols, and Xiaoyi Zhang. 2022 · 2021
Later among the works it cites.
Auto-icon: An automated code generation tool for icon designs assisting in ui development. In 26th International Conference on Intelligent User Interfaces . 59–69
Sidong Feng, Suyu Ma, Jinzhong Yu, Chunyang Chen, TingTing Zhou, and Yankun Zhen. 2021 · 2021
Later among the works it cites.
Understanding Mobile GUI: from Pixel-Words to Screen-Sentences
Jingwen Fu, Xiaoyi Zhang, Yuwang Wang, Wenjun Zeng, Sam Yang, and Grayson Hilliard. 2021 · 2021
Later among the works it cites.
Cotr: Correspondence transformer for matching across images. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 6207–6217
Wei Jiang, Eduard Trulls, Jan Hosang, Andrea Tagliasacchi, and Kwang Moo Yi. 2021 · 2021
Later among the works it cites.
Screen2Vec: Semantic Embedding of GUI Screens and GUI Components. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems . 1–15
Toby Jia-Jun Li, Lindsay Popowski, Tom Mitchell, and Brad A Myers. 2021 · 2021
Later among the works it cites.
Data-driven accessibility repair revisited: on the effectiveness of generating labels for icons in Android apps. In Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 107–118
Forough Mehralian, Navid Salehnamadi, and Sam Malek. 2021 · 2021
Later among the works it cites.
Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction
Ming Shen, Pratyay Banerjee, and Chitta Baral. 2021 · 2021
Later among the works it cites.
Phrase-bert: Improved phrase embeddings from bert with an application to corpus exploration
Shufan Wang, Laure Thompson, and Mohit Iyyer. 2021b · 2021
Later among the works it cites.
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots. In The 34th Annual ACM Symposium on User Interface Software and Technology . 470–483
Jason Wu, Xiaoyi Zhang, Jeff Nichols, and Jeffrey P Bigham. 2021 · 2021
Later among the works it cites.
Multimodal Icon Annotation For Mobile Applications. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction . 1–11
Xiaoxue Zang, Ying Xu, and Jindong Chen. 2021 · 2021
Later among the works it cites.
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems . 1–15
Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White, Kyle Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, et al · 2021
Later among the works it cites.
HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions. In The 34th Annual ACM Symposium on User Interface Software and Technology . 1144–1153
Mingyuan Zhong, Gang Li, Peggy Chi, and Yang Li. 2021 · 2021
Later among the works it cites.
Large-Scale Modeling of Mobile User Click Behaviors Using Deep Learning. In Fifteenth ACM Conference on Recommender Systems . 473–483
Xin Zhou and Yang Li. 2021 · 2021
Later among the works it cites.
Understanding Screen Relationships from Screenshots of Smartphone Applications. In Proceedings of the 27th Annual Conference on Intelligent User Interfaces . 1–12
Shirin Feiz, Jason Wu, Xiaoyi Zhang, Amanda Swearngin, Titus Barik, and Jeffrey Nichols. 2022 · 2022
Later among the works it cites.