Graphic Design with Large Multimodal Model

Jobling, P., Crowley, D.: Graphic design: reproduction and representation since 1800. Manchester University Press (1996)

1996

Earlier work this paper cites.

Shibata, T., Kurohashi, S.: Automatic slide generation based on discourse structure analysis. In: ICON. pp. 754–766. Springer (2005)

2005

Earlier work this paper cites.

Bauerly, M., Liu, Y.: Computational modeling and experimental investigation of effects of compositional elements on interface and design aesthetics. International journal of human-computer studies 64

2006

Earlier work this paper cites.

Hurst, N., Li, W., Marriott, K.: Review of automatic document formatting. In: Proceedings of the 9th ACM symposium on Document engineering. pp. 99–108 (2009)

2009

Earlier work this paper cites.

Jahanian, A., Liu, J., Lin, Q., Tretter, D., O’Brien-Strain, E., Lee, S.C., Lyons, N., Allebach, J.: Recommendation system for automatic design of magazine covers. In: Proceedings of the 2013 international conference on Intelligent user interfaces. pp. 95–106 (2013)

2013

Earlier work this paper cites.

Yin, W., Mei, T., Chen, C.W.: Automatic generation of social media snippets for mobile browsing. In: Proceedings of the 21st ACM international conference on Multimedia. pp. 927–936 (2013)

2013

Earlier work this paper cites.

Hu, Y., Wan, X.: Ppsgen: Learning-based presentation slides generation for academic papers. IEEE transactions on knowledge and data engineering 27

2014

Earlier work this paper cites.

Plummer, B.A., Wang, L., Cervantes, C.M., Caicedo, J.C., Hockenmaier, J., Lazebnik, S.: Flickr30k entities: Collecting region-to-phrase correspondences for richer image-to-sentence models. In: ICCV. pp. 2641–2649 (2015)

2015

Earlier work this paper cites.

Yang, X., Mei, T., Xu, Y.Q., Rui, Y., Li, S.: Automatic generation of visual-textual presentation layout. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12

2016

Earlier work this paper cites.

Deka, B., Huang, Z., Franzen, C., Hibschman, J., Afergan, D., Li, Y., Nichols, J., Kumar, R.: Rico: A mobile app dataset for building data-driven design applications. In: Proceedings of the 30th annual ACM symposium on user interface software and technology. pp. 845–854 (2017)

2017

Earlier work this paper cites.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. Advances in neural information processing systems 30

2017

Earlier work this paper cites.

Beltramelli, T.: pix2code: Generating code from a graphical user interface screenshot. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems. pp. 1–6 (2018)

2018

Earlier work this paper cites.

Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)

Original

2018

Earlier work this paper cites.

Li, J., Yang, J., Hertzmann, A., Zhang, J., Xu, T.: Layoutgan: Generating graphic layouts with wireframe discriminators. arXiv preprint arXiv:1901.06767 (2019)

Original

2019

Earlier work this paper cites.

Zheng, X., Qiao, X., Cao, Y., Lau, R.W.: Content-aware generative modeling of graphic design layouts. ACM Transactions on Graphics (TOG) 38

2019

Earlier work this paper cites.

Zhong, X., Tang, J., Yepes, A.J.: Publaynet: largest dataset ever for document layout analysis. In: 2019 International Conference on Document Analysis and Recognition (ICDAR). pp. 1015–1022. IEEE (2019)

2019

Earlier work this paper cites.

Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al.: Language models are few-shot learners. Advances in neural information processing systems 33

2020

Earlier work this paper cites.

Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., Zagoruyko, S.: End-to-end object detection with transformers. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16. pp. 213–229. Springer (2020)

2020

Earlier work this paper cites.

Carlier, A., Danelljan, M., Alahi, A., Timofte, R.: Deepsvg: A hierarchical generative network for vector graphics animation. Advances in Neural Information Processing Systems 33

2020

Earlier work this paper cites.

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al.: An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)

Original

2020

Earlier work this paper cites.

Kaplan, J., McCandlish, S., Henighan, T., Brown, T.B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., Amodei, D.: Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020)

Original

2020

Earlier work this paper cites.

Lee, H.Y., Jiang, L., Essa, I., Le, P.B., Gong, H., Yang, M.H., Yang, W.: Neural design network: Graphic layout generation with constraints. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part III 16. pp. 491–506. Springer (2020)

2020

Earlier work this paper cites.

Li, J., Yang, J., Zhang, J., Liu, C., Wang, C., Xu, T.: Attribute-conditioned layout gan for automatic graphic design. IEEE Transactions on Visualization and Computer Graphics 27

2020

Earlier work this paper cites.

Arroyo, D.M., Postels, J., Tombari, F.: Variational transformer networks for layout generation. In: CVPR. pp. 13642–13652 (2021)

2021

Earlier work this paper cites.

Chen, T., Saxena, S., Li, L., Fleet, D.J., Hinton, G.: Pix2seq: A language modeling framework for object detection. arXiv preprint arXiv:2109.10852 (2021)

Original

2021

Earlier work this paper cites.

Ganin, Y., Bartunov, S., Li, Y., Keller, E., Saliceti, S.: Computer-aided design as language. Advances in Neural Information Processing Systems 34

2021

Earlier work this paper cites.

Para, W., Bhat, S., Guerrero, P., Kelly, T., Mitra, N., Guibas, L.J., Wonka, P.: Sketchgen: Generating constrained cad sketches. Advances in Neural Information Processing Systems 34

2021

Earlier work this paper cites.

Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al.: Learning transferable visual models from natural language supervision. In: ICML. pp. 8748–8763. PMLR (2021)

2021

Earlier work this paper cites.

Yamaguchi, K.: Canvasvae: Learning to generate vector graphic documents. In: ICCV. pp. 5481–5489 (2021)

2021

Earlier work this paper cites.

Alayrac, J.B., Donahue, J., Luc, P., Miech, A., Barr, I., Hasson, Y., Lenc, K., Mensch, A., Millican, K., Reynolds, M., et al.: Flamingo: a visual language model for few-shot learning. Advances in Neural Information Processing Systems 35

2022

Earlier work this paper cites.

Feng, S., Jiang, M., Zhou, T., Zhen, Y., Chen, C.: Auto-icon+: An automated end-to-end code generation tool for icon designs in ui development. ACM Transactions on Interactive Intelligent Systems 12

2022

Earlier work this paper cites.

Fu, T.J., Wang, W.Y., McDuff, D., Song, Y.: DOC2PPT: automatic presentation slides generation from scientific documents. In: AAAI. pp. 634–642 (2022)

2022

Earlier work this paper cites.

Jiang, Z., Sun, S., Zhu, J., Lou, J.G., Zhang, D.: Coarse-to-fine generative modeling for graphic layouts. In: AAAI. pp. 1096–1103 (2022)

2022

Earlier work this paper cites.

Kong, X., Jiang, L., Chang, H., Zhang, H., Hao, Y., Gong, H., Essa, I.: Blt: bidirectional layout transformer for controllable layout generation. In: European Conference on Computer Vision. pp. 474–490. Springer (2022)

2022

Earlier work this paper cites.

Wang, P., Yang, A., Men, R., Lin, J., Bai, S., Li, Z., Ma, J., Zhou, C., Zhou, J., Yang, H.: Ofa: Unifying architectures, tasks, and modalities through a simple sequence-to-sequence learning framework. In: ICML. pp. 23318–23340. PMLR (2022)

2022

Earlier work this paper cites.

Yu, N., Chen, C.C., Chen, Z., Meng, R., Wu, G., Josel, P., Niebles, J.C., Xiong, C., Xu, R.: Layoutdetr: Detection transformer is a good multimodal layout designer. arXiv preprint arXiv:2212.09877 (2022)

Original

2022

Cited alongside, same era.

Zhou, M., Xu, C., Ma, Y., Ge, T., Jiang, Y., Xu, W.: Composition-aware graphic layout gan for visual-textual presentation designs. arXiv preprint arXiv:2205.00303 (2022)

Original

2022

Cited alongside, same era.

Zhou, M., Xu, C., Ma, Y., Ge, T., Jiang, Y., Xu, W.: Composition-aware graphic layout GAN for visual-textual presentation designs. In: IJCAI. pp. 4995–5001. ijcai.org (2022)

2022

Cited alongside, same era.

Bai, J., Bai, S., Chu, Y., Cui, Z., Dang, K., Deng, X., Fan, Y., Ge, W., Han, Y., Huang, F., Hui, B., Ji, L., Li, M., Lin, J., Lin, R., Liu, D., Liu, G., Lu, C., Lu, K., Ma, J., Men, R., Ren, X., Ren, X., Tan, C., Tan, S., Tu, J., Wang, P., Wang, S., Wang, W., Wu, S., Xu, B., Xu, J., Yang, A., Yang, H., Yang, J., Yang, S., Yao, Y., Yu, B., Yuan, H., Yuan, Z., Zhang, J., Zhang, X., Zhang, Y., Zhang, Z., Zhou, C., Zhou, J., Zhou, X., Zhu, T.: Qwen technical report. arXiv preprint arXiv:2309.16609 (2023)

Original

OpenAI: Gpt-4 technical report (2023)

2023

Later among the works it cites.

OpenAI: Gpt-4v(ision) system card (2023), https://openai.com/research/gpt-4v-system-card

2023

Later among the works it cites.

Peng, Z., Wang, W., Dong, L., Hao, Y., Huang, S., Ma, S., Wei, F.: Kosmos-2: Grounding multimodal large language models to the world. arXiv preprint arXiv:2306.14824 (2023)

Original

2023

Later among the works it cites.

Pi, R., Yao, L., Gao, J., Zhang, J., Zhang, T.: PerceptionGPT: Effectively fusing visual perception into llm. arXiv preprint arXiv:2311.06612 (2023)

Original

2023

Later among the works it cites.

Sun, Q., Yu, Q., Cui, Y., Zhang, F., Zhang, X., Wang, Y., Gao, H., Liu, J., Huang, T., Wang, X.: Generative pretraining in multimodality. arXiv preprint arXiv:2307.05222 (2023)

Original

2023