Fetching the paper…
Reading the bibliography…
Automatically constructing GUI groups of different granularities constitutes a critical intelligent step towards automating GUI design and implementation tasks.
Gori, M., Monfardini, G., Scarselli, F.: A new model for learning in graph domains. In: Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005., vol. 2, pp. 729–734 (2005). IEEE
2005
Earlier work this paper cites.
Bruna, J., Zaremba, W., Szlam, A., LeCun, Y.: Spectral networks and deep locally connected networks on graphs. In: 2nd International Conference on Learning Representations, ICLR 2014 (2014)
2014
Earlier work this paper cites.
Figma. https://www.figma.com/ (2015)
2015
Earlier work this paper cites.
Nguyen, T.A., Csallner, C.: Reverse engineering mobile application user interfaces with remaui (t). In: 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), pp. 248–259 (2015). https://doi.org/10.1109/ASE.2015.32
2015
Earlier work this paper cites.
Girshick, R.: Fast r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448 (2015)
2015
Earlier work this paper cites.
Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. Advances in neural information processing systems 29
2016
Earlier work this paper cites.
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
2016
Earlier work this paper cites.
Monti, F., Boscaini, D., Masci, J., Rodola, E., Svoboda, J., Bronstein, M.M.: Geometric deep learning on graphs and manifolds using mixture model cnns. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5115–5124 (2017)
2017
Earlier work this paper cites.
Hamilton, W.L., Ying, R., Leskovec, J.: Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 1025–1035 (2017)
2017
Earlier work this paper cites.
Qi, X., Liao, R., Jia, J., Fidler, S., Urtasun, R.: 3d graph neural networks for rgbd semantic segmentation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 5199–5208 (2017)
2017
Earlier work this paper cites.
Ross, T.-Y., Dollár, G.: Focal loss for dense object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2980–2988 (2017)
2017
Earlier work this paper cites.
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)
2017
Earlier work this paper cites.
Moran, K., Bernal-Cárdenas, C., Curcio, M., Bonett, R., Poshyvanyk, D.: Machine learning-based prototyping of graphical user interfaces for mobile apps. IEEE Transactions on Software Engineering 46
2018
Earlier work this paper cites.
Beltramelli, T.: pix2code: Generating code from a graphical user interface screenshot. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 1–6 (2018)
2018
Earlier work this paper cites.
Chen, C., Su, T., Meng, G., Xing, Z., Liu, Y.: From ui design image to gui skeleton: A neural machine translator to bootstrap mobile gui implementation. In: 2018 IEEE/ACM 40th International Conference on Software Engineering (ICSE), pp. 665–676 (2018). https://doi.org/10.1145/3180155.3180240
2018
Earlier work this paper cites.
Liu, T.F., Craft, M., Situ, J., Yumer, E., Mech, R., Kumar, R.: Learning design semantics for mobile apps. In: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, pp. 569–579 (2018)
2018
Earlier work this paper cites.
Bajammal, M., Mazinanian, D., Mesbah, A.: Generating reusable web components from mockups. In: 2018 33rd IEEE/ACM International Conference on Automated Software Engineering (ASE), pp. 601–611 (2018). https://doi.org/10.1145/3238147.3238194
2018
Earlier work this paper cites.
Bielik, P., Fischer, M., Vechev, M.: Robust relational layout synthesis from examples for android. Proc. ACM Program. Lang. 2
2018
Cited alongside, same era.
Xu, K., Hu, W., Leskovec, J., Jegelka, S.: How powerful are graph neural networks? In: International Conference on Learning Representations (2018)
2018
Cited alongside, same era.
Degott, C., Borges Jr, N.P., Zeller, A.: Learning user interface element interactions. In: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 296–306 (2019)
2019
Cited alongside, same era.
Li, Y., Yang, Z., Guo, Y., Chen, X.: Humanoid: A deep learning-based approach to automated black-box android app testing. In: 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE), pp. 1070–1073 (2019). https://doi.org/10.1109/ASE.2019.00104
2019
Cited alongside, same era.
He, Z., Sunkara, S., Zang, X., Xu, Y., Liu, L., Wichers, N., Schubiner, G., Lee, R., Chen, J.: Actionbert: Leveraging user actions for semantic understanding of user interfaces. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 5931–5938 (2021)
2021
Later among the works it cites.
Zang, X., Xu, Y., Chen, J.: Multimodal icon annotation for mobile applications. In: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction, pp. 1–11 (2021)
2021
Later among the works it cites.
Zhang, X., Greef, L., Swearngin, A., White, S., Murray, K., Yu, L., Shan, Q., Nichols, J., Wu, J., Fleizach, C., Everitt, A., Bigham, J.P.: Screen recognition: Creating accessibility metadata for mobile applications from pixels. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. CHI ’21. Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3411764.3445186 . https://doi.org/10.1145/3411764.3445186
2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Zheng, S., Hu, Z., Ma, Y.: Faceoff: Assisting the manifestation design of web graphical user interface. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining. WSDM ’19, pp. 774–777. Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3289600.3290610 . https://doi.org/10.1145/3289600.3290610
2019
Cited alongside, same era.
Li, G., Muller, M., Thabet, A., Ghanem, B.: Deepgcns: Can gcns go as deep as cnns? In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9267–9276 (2019)
2019
Cited alongside, same era.
Wen, Y.-H., Gao, L., Fu, H., Zhang, F.-L., Xia, S.: Graph cnns with motif and variable temporal block for skeleton-based action recognition. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 8989–8996 (2019)
2019
Cited alongside, same era.
Mohian, S., Csallner, C.: Doodle2app: Native app code by freehand ui sketching. In: Proceedings of the IEEE/ACM 7th International Conference on Mobile Software Engineering and Systems, pp. 81–84 (2020)
2020
Cited alongside, same era.
Yandrapally, R., Stocco, A., Mesbah, A.: Near-duplicate detection in web app model inference. In: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering. ICSE ’20, pp. 186–197. Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3377811.3380416 . https://doi.org/10.1145/3377811.3380416
2020
Cited alongside, same era.
Ruiz, L., Gama, F., Ribeiro, A.: Gated graph recurrent neural networks. IEEE Transactions on Signal Processing 68
2020
Cited alongside, same era.
Chen, M., Wei, Z., Huang, Z., Ding, B., Li, Y.: Simple and deep graph convolutional networks. In: International Conference on Machine Learning, pp. 1725–1735 (2020). PMLR
2020
Cited alongside, same era.
Shi, W., Rajkumar, R.: Point-gnn: Graph neural network for 3d object detection in a point cloud. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1711–1719 (2020)
2020
Cited alongside, same era.
Ying, C., Cai, T., Luo, S., Zheng, S., Ke, G., He, D., Shen, Y., Liu, T.-Y.: Do transformers really perform badly for graph representation? Advances in Neural Information Processing Systems 34
2021
Later among the works it cites.
Sketch Command-line interface. https://developer.sketch.com/cli/ (2022)
2022
Later among the works it cites.
Yunnong, C., Yankun, Z., Chuning, S., Jiazhi, L., Liuqing, C., Zejian, L., Lingyun, S., Tingting, Z., Yanfang, C.: Ui layers merger: merging ui layers via visual learning and boundary prior. Frontiers of Information Technology & Electronic Engineering (2022)
2022
Later among the works it cites.
Xie, M., Xing, Z., Feng, S., Xu, X., Zhu, L., Chen, C.: Psychologically-inspired, unsupervised inference of perceptual groups of gui widgets from gui images. In: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ESEC/FSE 2022, pp. 332–343. Association for Computing Machinery, New York, NY, USA (2022). https://doi.org/10.1145/3540250.3549138 . https://doi.org/10.1145/3540250.3549138
2022
Later among the works it cites.
Li, J., Zhou, T., Chen, Y., Chang, Y., Zhen, Y., Sun, L., Chen, L.: ULDGNN: A Fragmented UI Layer Detector Based on Graph Neural Networks (2022)
2022
Later among the works it cites.
Xiao, S., Zhou, T., Chen, Y., Zhang, D., Chen, L., Sun, L., Yue, S.: Ui layers group detector: Grouping ui layers via text fusion and box attention. In: CAAI International Conference on Artificial Intelligence, pp. 303–314 (2022). Springer
2022
Later among the works it cites.
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (2022)
2022
Later among the works it cites.
Rampášek, L., Galkin, M., Dwivedi, V.P., Luu, A.T., Wolf, G., Beaini, D.: Recipe for a general, powerful, scalable graph transformer. Advances in Neural Information Processing Systems 35
2022
Later among the works it cites.
Ang, G., Lim, E.P.: Learning user interface semantics from heterogeneous networks with multimodal and positional attributes. In: 27th International Conference on Intelligent User Interfaces. IUI ’22, pp. 433–446. Association for Computing Machinery, New York, NY, USA (2022). https://doi.org/10.1145/3490099.3511143 . https://doi.org/10.1145/3490099.3511143
2022
Later among the works it cites.
Li, G., Baechler, G., Tragut, M., Li, Y.: Learning to denoise raw mobile ui layouts for improving datasets at scale. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. CHI ’22. Association for Computing Machinery, New York, NY, USA (2022). https://doi.org/10.1145/3491102.3502042 . https://doi.org/10.1145/3491102.3502042
2022
Later among the works it cites.
2024
Closest in time.
Chen, L., Chen, Y., Xiao, S., Song, Y., Sun, L., Zhen, Y., Zhou, T., Chang, Y.: Egfe: End-to-end grouping of fragmented elements in ui designs with multimodal learning. In: Proceedings of the 46th IEEE/ACM International Conference on Software Engineering, pp. 1–12 (2024)
2024
Closest in time.
Xiao, S., Chen, Y., Song, Y., Chen, L., Sun, L., Zhen, Y., Chang, Y., Zhou, T.: Ui semantic component group detection: Grouping ui elements with similar semantics in mobile graphical user interface. Displays 83
2024
Closest in time.