PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM

M. Hui, Z. Zhang, X. Zhang, W. Xie, Y. Wang, and Y. Lu, “Unifying layout generation with a decoupled diffusion model,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 1942–1951

1951

Earlier work this paper cites.

M. Rajasekharan, B. A. Peters, and T. Yang, “A genetic algorithm for facility layout design in flexible manufacturing systems,” International journal of Production research , vol. 36, no. 1, pp. 95–110, 1998

1998

Earlier work this paper cites.

A. Baykasoğlu and N. N. Gindy, “A simulated annealing algorithm for dynamic layout problem,” Computers & Operations Research , vol. 28, no. 14, pp. 1403–1426, 2001

2001

Earlier work this paper cites.

A. E. Elo and S. Sloan, The rating of chessplayers : past and present . Ishi Press International, 2008. [Online]. Available: https://cir.nii.ac.jp/crid/1130282270181653248

2008

Earlier work this paper cites.

W. Yin, T. Mei, and C. W. Chen, “Automatic generation of social media snippets for mobile browsing,” in Proceedings of the 21st ACM international conference on Multimedia , 2013, pp. 927–936

2013

Earlier work this paper cites.

S. Ma and C. W. Chen, “Automatic creation of magazine-page-like social media visual summary for mobile browsing,” in 2016 IEEE International Conference on Image Processing (ICIP) . IEEE, 2016, pp. 469–473

2016

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805 , 2018

Original

2018

Earlier work this paper cites.

A. A. Jyothi, T. Durand, J. He, L. Sigal, and G. Mori, “Layoutvae: Stochastic scene layout generation from a label set,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2019, pp. 9895–9904

2019

Earlier work this paper cites.

J. Li, J. Yang, A. Hertzmann, J. Zhang, and T. Xu, “Layoutgan: Generating graphic layouts with wireframe discriminators,” arXiv preprint arXiv:1901.06767 , 2019

Original

2019

Earlier work this paper cites.

X. Zheng, X. Qiao, Y. Cao, and R. W. Lau, “Content-aware generative modeling of graphic design layouts,” ACM Transactions on Graphics (TOG) , vol. 38, no. 4, pp. 1–15, 2019

2019

Earlier work this paper cites.

X. Qin, Z. Zhang, C. Huang, C. Gao, M. Dehghan, and M. Jagersand, “Basnet: Boundary-aware salient object detection,” in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2019

2019

Earlier work this paper cites.

N. Carion, F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko, “End-to-end object detection with transformers,” in European conference on computer vision . Springer, 2020, pp. 213–229

2020

Earlier work this paper cites.

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al. , “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929 , 2020

Original

2020

Earlier work this paper cites.

T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell et al. , “Language models are few-shot learners,” Advances in neural information processing systems , vol. 33, pp. 1877–1901, 2020

2020

Earlier work this paper cites.

B. Wang, Q. Chen, M. Zhou, Z. Zhang, X. Jin, and K. Gai, “Progressive feature polishing network for salient object detection,” in Proceedings of the AAAI conference on artificial intelligence , vol. 34, no. 07, 2020, pp. 12 128–12 135

2020

Earlier work this paper cites.

K. Kikuchi, E. Simo-Serra, M. Otani, and K. Yamaguchi, “Constrained graphic layout generation via latent optimization,” in Proceedings of the 29th ACM International Conference on Multimedia , 2021, pp. 88–96

2021

Earlier work this paper cites.

K. Gupta, J. Lazarow, A. Achille, L. S. Davis, V. Mahadevan, and A. Shrivastava, “Layouttransformer: Layout generation and completion with self-attention,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 1004–1014

2021

Earlier work this paper cites.

D. M. Arroyo, J. Postels, and F. Tombari, “Variational transformer networks for layout generation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2021, pp. 13 642–13 652

2021

Earlier work this paper cites.

K. Yamaguchi, “Canvasvae: Learning to generate vector graphic documents,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2021, pp. 5481–5489

2021

Earlier work this paper cites.

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark et al. , “Learning transferable visual models from natural language supervision,” in International conference on machine learning . PMLR, 2021, pp. 8748–8763

2021

Earlier work this paper cites.

R. Suvorov, E. Logacheva, A. Mashikhin, A. Remizova, A. Ashukha, A. Silvestrov, N. Kong, H. Goka, K. Park, and V. Lempitsky, “Resolution-robust large mask inpainting with fourier convolutions,” arXiv preprint arXiv:2109.07161 , 2021

Original

2021

Earlier work this paper cites.

X. Kong, L. Jiang, H. Chang, H. Zhang, Y. Hao, H. Gong, and I. Essa, “Blt: bidirectional layout transformer for controllable layout generation,” in European Conference on Computer Vision . Springer, 2022, pp. 474–490

2022

Earlier work this paper cites.

M. Zhou, C. Xu, Y. Ma, T. Ge, Y. Jiang, and W. Xu, “Composition-aware graphic layout gan for visual-textual presentation designs,” arXiv preprint arXiv:2205.00303 , 2022

Original

2022

Cited alongside, same era.

N. Yu, C.-C. Chen, Z. Chen, R. Meng, G. Wu, P. Josel, J. C. Niebles, C. Xiong, and R. Xu, “Layoutdetr: Detection transformer is a good multimodal layout designer,” arXiv preprint arXiv:2212.09877 , 2022

Original

2022

Cited alongside, same era.

Y. Cao, Y. Ma, M. Zhou, C. Liu, H. Xie, T. Ge, and Y. Jiang, “Geometry aligned variational transformer for image-conditioned layout generation,” in Proceedings of the 30th ACM International Conference on Multimedia , 2022, pp. 1561–1571

2022

Cited alongside, same era.

L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray et al. , “Training language models to follow instructions with human feedback,” Advances in Neural Information Processing Systems , vol. 35, pp. 27 730–27 744, 2022

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , “Gpt-4 technical report,” arXiv preprint arXiv:2303.08774 , 2023

Original

2023

Later among the works it cites.

Z. Tang, C. Wu, J. Li, and N. Duan, “Layoutnuwa: Revealing the hidden layout expertise of large language models,” arXiv preprint arXiv:2309.09506 , 2023

Original

2023

Later among the works it cites.

H. Touvron, T. Lavril, G. Izacard, X. Martinet, M.-A. Lachaux, T. Lacroix, B. Rozière, N. Goyal, E. Hambro, F. Azhar et al. , “Llama: Open and efficient foundation language models,” arXiv preprint arXiv:2302.13971 , 2023

Original

2023

Later among the works it cites.

B. Roziere, J. Gehring, F. Gloeckle, S. Sootla, I. Gat, X. E. Tan, Y. Adi, J. Liu, T. Remez, J. Rapin et al. , “Code llama: Open foundation models for code,” arXiv preprint arXiv:2308.12950 , 2023

Original

2023

Later among the works it cites.