MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editing

Deep sparse rectifier neural networks. In Proceedings of the fourteenth international conference on artificial intelligence and statistics . JMLR Workshop and Conference Proceedings, 315–323

Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011 · 2011

Earlier work this paper cites.

Auto-encoding variational bayes

Original

Diederik P Kingma. 2013 · 2013

Earlier work this paper cites.

Decoupled weight decay regularization

Original

I Loshchilov. 2017 · 2017

Earlier work this paper cites.

Gradio: Hassle-Free Sharing and Testing of ML Models in the Wild

Original

Abubakar Abid, Ali Abdalla, Ali Abid, Dawood Khan, Abdulrahman Alfozan, and James Zou. 2019 · 2019

Earlier work this paper cites.

A benchmark and baseline for language-driven image editing. In Proceedings of the Asian Conference on Computer Vision

Jing Shi, Ning Xu, Trung Bui, Franck Dernoncourt, Zheng Wen, and Chenliang Xu. 2020 · 2020

Earlier work this paper cites.

Learning transferable visual models from natural language supervision. In International conference on machine learning . PMLR, 8748–8763

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021

Earlier work this paper cites.

High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 10684–10695

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022 · 2022

Earlier work this paper cites.

Resolution-robust large mask inpainting with fourier convolutions. In Proceedings of the IEEE/CVF winter conference on applications of computer vision . 2149–2159

Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin, Anastasia Remizova, Arsenii Ashukha, Aleksei Silvestrov, Naejin Kong, Harshith Goka, Kiwoong Park, and Victor Lempitsky. 2022 · 2022

Earlier work this paper cites.

Instructpix2pix: Learning to follow image editing instructions. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 18392–18402

Tim Brooks, Aleksander Holynski, and Alexei A Efros. 2023 · 2023

Earlier work this paper cites.

Pixart- α \alpha : Fast training of diffusion transformer for photorealistic text-to-image synthesis

Original

Junsong Chen, Jincheng Yu, Chongjian Ge, Lewei Yao, Enze Xie, Yue Wu, Zhongdao Wang, James Kwok, Ping Luo, Huchuan Lu, et al · 2023

Earlier work this paper cites.

Eva: Exploring the limits of masked visual representation learning at scale. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 19358–19369

Yuxin Fang, Wen Wang, Binhui Xie, Quan Sun, Ledell Wu, Xinggang Wang, Tiejun Huang, Xinlong Wang, and Yue Cao. 2023 · 2023

Earlier work this paper cites.

Guiding instruction-based image editing via multimodal large language models

Original

Tsu-Jui Fu, Wenze Hu, Xianzhi Du, William Yang Wang, Yinfei Yang, and Zhe Gan. 2023 · 2023

Earlier work this paper cites.

Segment anything. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 4015–4026

Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al · 2023

Earlier work this paper cites.

Dreamedit: Subject-driven image editing

Original

Tianle Li, Max Ku, Cong Wei, and Wenhu Chen. 2023a · 2023

Earlier work this paper cites.

Kosmos-g: Generating images in context with multimodal large language models

Original

Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, and Furu Wei. 2023 · 2023

Earlier work this paper cites.

Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 4195–4205

William Peebles and Saining Xie. 2023 · 2023

Earlier work this paper cites.

Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 22500–22510

Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. 2023 · 2023

Earlier work this paper cites.

Introducing mpt-7b: A new standard for open-source, commercially usable llms

MosaicML NLP Team et al · 2023

Earlier work this paper cites.

Paint by example: Exemplar-based image editing with diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 18381–18391

Binxin Yang, Shuyang Gu, Bo Zhang, Ting Zhang, Xuejin Chen, Xiaoyan Sun, Dong Chen, and Fang Wen. 2023 · 2023

Earlier work this paper cites.

Ip-adapter: Text compatible image prompt adapter for text-to-image diffusion models

Original

Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. 2023 · 2023

Earlier work this paper cites.

Inst-inpaint: Instructing to remove objects with diffusion models

Original

Ahmet Burak Yildirim, Vedat Baday, Erkut Erdem, Aykut Erdem, and Aysegul Dundar. 2023 · 2023

Earlier work this paper cites.

Zero-shot image editing with reference imitation

Xi Chen, Yutong Feng, Mengting Chen, Yiyang Wang, Shilong Zhang, Yu Liu, Yujun Shen, and Hengshuang Zhao. 2024a · 2024

Earlier work this paper cites.

UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics

Original

Xi Chen, Zhifei Zhang, He Zhang, Yuqian Zhou, Soo Ye Kim, Qing Liu, Yijun Li, Jianming Zhang, Nanxuan Zhao, Yilin Wang, et al · 2024

Earlier work this paper cites.

Improving Diffusion Models for Authentic Virtual Try-on in the Wild

Original

Yisol Choi, Sangkyung Kwak, Kyungmin Lee, Hyungwon Choi, and Jinwoo Shin. 2024 · 2024

Cited alongside, same era.

Scaling instruction-finetuned language models

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al · 2024

Cited alongside, same era.

Scaling rectified flow transformers for high-resolution image synthesis. In Forty-first International Conference on Machine Learning

Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al · 2024

Cited alongside, same era.

SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editing

Original

Yuying Ge, Sijie Zhao, Chen Li, Yixiao Ge, and Ying Shan. 2024 · 2024

Cited alongside, same era.

ACE: All-round Creator and Editor Following Instructions via Diffusion Transformer

Ominicontrol: Minimal and universal control for diffusion transformer

Original

Zhenxiong Tan, Songhua Liu, Xingyi Yang, Qiaochu Xue, and Xinchao Wang. 2024 · 2024

Later among the works it cites.

Do We Need to Design Specific Diffusion Models for Different Tasks? Try ONE-PIC

Original

Ming Tao, Bing-Kun Bao, Yaowei Wang, and Changsheng Xu. 2024 · 2024

Later among the works it cites.

Qwen2.5: A Party of Foundation Models

Qwen Team. 2024 · 2024

Later among the works it cites.

Qwen2-VL: Enhancing Vision-Language Model’s Perception of the World at Any Resolution

Original

Peng Wang, Shuai Bai, Sinan Tan, Shijie Wang, Zhihao Fan, Jinze Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Yang Fan, Kai Dang, Mengfei Du, Xuancheng Ren, Rui Men, Dayiheng Liu, Chang Zhou, Jingren Zhou, and Junyang Lin. 2024 · 2024

Later among the works it cites.

Omnigen: Unified image generation