Fetching the paper…
Reading the bibliography…
Although text-to-image (T2I) models exhibit remarkable generation capabilities, they frequently fail to accurately bind semantically related objects or attributes in the input prompts; a challenge termed semantic binding.
Tweedie’s formula and selection bias
Bradley Efron · 2011
Earlier work this paper cites.
Distributed representations of words and phrases and their compositionality
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean · 2013
Earlier work this paper cites.
spacy 2: Natural language understanding with bloom embeddings, convolutional neural networks and incremental parsing
Matthew Honnibal and Ines Montani · 2017
Earlier work this paper cites.
Mmdetection: Open mmlab detection toolbox and benchmark
Kai Chen, Jiaqi Wang, Jiangmiao Pang, Yuhang Cao, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jiarui Xu, et al · 2019
Earlier work this paper cites.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021
Earlier work this paper cites.
Blended diffusion for text-driven editing of natural images
Omri Avrahami, Dani Lischinski, and Ohad Fried · 2022
Earlier work this paper cites.
ediff-i: Text-to-image diffusion models with ensemble of expert denoisers
Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Qinsheng Zhang, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, Bryan Catanzaro, Tero Karras, and Ming-Yu Liu · 2022
Earlier work this paper cites.
Grounded language-image pre-training
Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, et al · 2022
Earlier work this paper cites.
Compositional visual generation with composable diffusion models
Nan Liu, Shuang Li, Yilun Du, Antonio Torralba, and Joshua B Tenenbaum · 2022
Earlier work this paper cites.
Hierarchical text-conditional image generation with clip latents
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen · 2022
Earlier work this paper cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Earlier work this paper cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Earlier work this paper cites.
Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023
Earlier work this paper cites.
A-star: Test-time attention segregation and retention for text-to-image synthesis
Aishwarya Agarwal, Srikrishna Karanam, KJ Joseph, Apoorv Saxena, Koustava Goswami, and Balaji Vasan Srinivasan · 2023
Earlier work this paper cites.
Universal guidance for diffusion models
Arpit Bansal, Hong-Min Chu, Avi Schwarzschild, Soumyadip Sengupta, Micah Goldblum, Jonas Geiping, and Tom Goldstein · 2023
Earlier work this paper cites.
Sega: Instructing text-to-image models using semantic guidance
Manuel Brack, Felix Friedrich, Dominik Hintersdorf, Lukas Struppek, Patrick Schramowski, and Kristian Kersting · 2023
Earlier work this paper cites.
Attend-and-excite: Attention-based semantic guidance for text-to-image diffusion models
Hila Chefer, Yuval Alaluf, Yael Vinker, Lior Wolf, and Daniel Cohen-Or · 2023
Earlier work this paper cites.
Pixart- α \alpha : Fast training of diffusion transformer for photorealistic text-to-image synthesis, 2023
Junsong Chen, Jincheng Yu, Chongjian Ge, Lewei Yao, Enze Xie, Yue Wu, Zhongdao Wang, James Kwok, Ping Luo, Huchuan Lu, and Zhenguo Li · 2023
Earlier work this paper cites.
Visual programming for text-to-image generation and evaluation
Jaemin Cho, Abhay Zala, and Mohit Bansal · 2023
Earlier work this paper cites.
Debiasing vision-language models via biased prompts
Ching-Yao Chuang, Varun Jampani, Yuanzhen Li, Antonio Torralba, and Stefanie Jegelka · 2023
Earlier work this paper cites.
Zero-shot spatial layout conditioning for text-to-image diffusion models
Guillaume Couairon, Marlène Careil, Matthieu Cord, Stéphane Lathuilière, and Jakob Verbeek · 2023
Earlier work this paper cites.
Diffusion self-guidance for controllable image generation
Dave Epstein, Allan Jabri, Ben Poole, Alexei Efros, and Aleksander Holynski · 2023
Earlier work this paper cites.
Training-free structured diffusion guidance for compositional text-to-image synthesis
Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun Reddy Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, and William Yang Wang · 2023
Earlier work this paper cites.
Ranni: Taming text-to-image diffusion for accurate instruction following
Yutong Feng, Biao Gong, Di Chen, Yujun Shen, Yu Liu, and Jingren Zhou · 2023
Earlier work this paper cites.
Erasing concepts from diffusion models
Rohit Gandikota, Joanna Materzynska, Jaden Fiotto-Kaufman, and David Bau · 2023
Earlier work this paper cites.
Expressive text-to-image generation with rich text
Songwei Ge, Taesung Park, Jun-Yan Zhu, and Jia-Bin Huang · 2023
Earlier work this paper cites.
Check, locate, rectify: A training-free layout calibration system for text-to-image generation
Biao Gong, Siteng Huang, Yutong Feng, Shiwei Zhang, Yuyuan Li, and Yu Liu · 2023
Earlier work this paper cites.
Prompt-to-prompt image editing with cross attention control
Amir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman, Yael Pritch, and Daniel Cohen-Or · 2023
Earlier work this paper cites.
T2i-compbench: A comprehensive benchmark for open-world compositional text-to-image generation
Kaiyi Huang, Kaiyue Sun, Enze Xie, Zhenguo Li, and Xihui Liu · 2023
Cited alongside, same era.
Shyamgopal Karthik, Karsten Roth, Massimiliano Mancini, and Zeynep Akata · 2023
Cited alongside, same era.
Dense text-to-image generation with attention modulation
Yunji Kim, Jiyoung Lee, Jin-Hwa Kim, Jung-Woo Ha, and Jun-Yan Zhu · 2023
Cited alongside, same era.
Stylediffusion: Prompt-embedding inversion for text-based editing, 2023
Senmao Li, Joost van de Weijer, Taihang Hu, Fahad Shahbaz Khan, Qibin Hou, Yaxing Wang, and Jian Yang · 2023
Cited alongside, same era.
Gligen: Open-set grounded text-to-image generation
Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jianwei Yang, Jianfeng Gao, Chunyuan Li, and Yong Jae Lee · 2023
Cited alongside, same era.
Llm blueprint: Enabling text-to-image generation with complex and detailed prompts
Hanan Gani, Shariq Farooq Bhat, Muzammal Naseer, Salman Khan, and Peter Wonka · 2024
Closest in time.
Initno: Boosting text-to-image diffusion models via initial noise optimization
Xiefan Guo, Jinlin Liu, Miaomiao Cui, Jiankai Li, Hongyu Yang, and Di Huang · 2024
Closest in time.
Ella: Equip diffusion models with llm for enhanced semantic alignment
Xiwei Hu, Rui Wang, Yixiao Fang, Bin Fu, Pei Cheng, and Gang Yu · 2024
Closest in time.
Composite diffusion: whole>= σ \sigma parts
Vikram Jamwal and S Ramaneswaran · 2024
Closest in time.
Divcon: Divide and conquer for progressive text-to-image generation
Yuhao Jia and Wenhan Tan · 2024
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Divide & bind your attention for improved generative semantic nursing
Yumeng Li, Margret Keuper, Dan Zhang, and Anna Khoreva · 2023
Cited alongside, same era.
Correcting diffusion generation through resampling
Yujian Liu, Yang Zhang, Tommi Jaakkola, and Shiyu Chang · 2023
Cited alongside, same era.
Conform: Contrast is all you need for high-fidelity text-to-image diffusion models
Tuna Han Salih Meral, Enis Simsar, Federico Tombari, and Pinar Yanardag · 2023
Cited alongside, same era.
Sdxl: improving latent diffusion models for high-resolution image synthesis
Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach · 2023
Cited alongside, same era.
Layered rendering diffusion model for zero-shot guided image synthesis
Zipeng Qi, Guoxi Huang, Zebin Huang, Qin Guo, Jinwen Chen, Junyu Han, Jian Wang, Gang Zhang, Lufei Liu, Errui Ding, et al · 2023
Cited alongside, same era.
Layoutllm-t2i: Eliciting layout guidance from llm for text-to-image generation
Leigang Qu, Shengqiong Wu, Hao Fei, Liqiang Nie, and Tat-Seng Chua · 2023
Cited alongside, same era.
Linguistic binding in diffusion models: Enhancing attribute correspondence through attention map alignment
Royi Rassin, Eran Hirsch, Daniel Glickman, Shauli Ravfogel, Yoav Goldberg, and Gal Chechik · 2023
Cited alongside, same era.
Dongzhi Jiang, Guanglu Song, Xiaoshi Wu, Renrui Zhang, Dazhong Shen, Zhuofan Zong, Yu Liu, and Hongsheng Li · 2024
Closest in time.
Mulan: Multimodal-llm agent for progressive multi-object diffusion
Sen Li, Ruochen Wang, Cho-Jui Hsieh, Minhao Cheng, and Tianyi Zhou · 2024
Closest in time.
Get what you want, not what you don’t: Image content suppression for text-to-image diffusion models
Senmao Li, Joost van de Weijer, Taihang Hu, Fahad Shahbaz Khan, Qibin Hou, Yaxing Wang, and Jian Yang · 2024
Closest in time.
Llm-grounded diffusion: Enhancing prompt understanding of text-to-image diffusion models with large language models
Long Lian, Boyi Li, Adam Yala, and Trevor Darrell · 2024
Closest in time.
Directed diffusion: Direct control of object placement through attention guidance
Wan-Duo Kurt Ma, Avisek Lahiri, JP Lewis, Thomas Leung, and W Bastiaan Kleijn · 2024
Closest in time.
T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models
Chong Mou, Xintao Wang, Liangbin Xie, Yanze Wu, Jian Zhang, Zhongang Qi, and Ying Shan · 2024
Closest in time.
Würstchen: An efficient architecture for large-scale text-to-image diffusion models
Pablo Pernias, Dominic Rampas, Mats Leon Richter, Christopher Pal, and Marc Aubreville · 2024
Closest in time.
Grounded text-to-image synthesis with attention refocusing
Quynh Phung, Songwei Ge, and Jia-Bin Huang · 2024
Closest in time.
Finetuning text-to-image diffusion models for fairness
Xudong Shen, Chao Du, Tianyu Pang, Min Lin, Yongkang Wong, and Mohan Kankanhalli · 2024
Closest in time.
Object-attribute binding in text-to-image generation: Evaluation and control
Maria Mihaela Trusca, Wolf Nuyts, Jonathan Thomm, Robert Honig, Thomas Hofmann, Tinne Tuytelaars, and Marie-Francine Moens · 2024
Closest in time.
Compositional text-to-image synthesis with attention map control of diffusion models
Ruichen Wang, Zekang Chen, Chen Chen, Jian Ma, Haonan Lu, and Xiaodong Lin · 2024
Closest in time.
Instancediffusion: Instance-level control for image generation
Xudong Wang, Trevor Darrell, Sai Saketh Rambhatla, Rohit Girdhar, and Ishan Misra · 2024
Closest in time.
Tokencompose: Grounding diffusion with token-level supervision
Zirui Wang, Zhizhou Sha, Zheng Ding, Yilin Wang, and Zhuowen Tu · 2024
Closest in time.
Paint by inpaint: Learning to add image objects by removing them first
Navve Wasserman, Noam Rotstein, Roy Ganz, and Ron Kimmel · 2024
Closest in time.
Relation rectification in diffusion model, 2024
Yinwei Wu, Xingyi Yang, and Xinchao Wang · 2024
Closest in time.
Imagereward: Learning and evaluating human preferences for text-to-image generation
Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, and Yuxiao Dong · 2024
Closest in time.
Mastering text-to-image diffusion: Recaptioning, planning, and generating with multimodal llms
Ling Yang, Zhaochen Yu, Chenlin Meng, Minkai Xu, Stefano Ermon, and Bin Cui · 2024
Closest in time.
Hidir Yesiltepe, Kiymet Akdemir, and Pinar Yanardag · 2024
Closest in time.
Xinchen Zhang, Ling Yang, Yaqi Cai, Zhaochen Yu, Jiake Xie, Ye Tian, Minkai Xu, Yong Tang, Yujiu Yang, and Bin Cui · 2024
Closest in time.
Enhancing semantic fidelity in text-to-image synthesis: Attention regulation in diffusion models
Yang Zhang, Teoh Tze Tzun, Lim Wei Hern, Tiviatis Sim, and Kenji Kawaguchi · 2024
Closest in time.
Object-conditioned energy-based attention map alignment in text-to-image diffusion models
Yasi Zhang, Peiyu Yu, and Ying Nian Wu · 2024
Closest in time.
Objectadd: Adding objects into image via a training-free diffusion modification fashion
Ziyue Zhang, Mingbao Lin, and Rongrong Ji · 2024
Closest in time.
Migc: Multi-instance generation controller for text-to-image synthesis
Dewei Zhou, You Li, Fan Ma, Zongxin Yang, and Yi Yang · 2024
Closest in time.