InstructVid2Vid: Controllable Video Editing with Natural Language Instructions

B. K. P. Horn and B. G. Schunck, “Determining optical flow,” Artificial Intelligence , vol. 17, no. 1, pp. 185–203, 1981

1981

Earlier work this paper cites.

D. S. Turaga, Y. Chen, and J. Caviedes, “No reference psnr estimation for compressed pictures,” Signal Processing: Image Communication , vol. 19, no. 2, pp. 173–184, 2004

2004

Earlier work this paper cites.

O. Ronneberger, P. Fischer, and T. Brox, U-Net: Convolutional Networks for Biomedical Image Segmentation , ser. Lecture Notes in Computer Science, 2015, book section Chapter 28, pp. 234–241

2015

Earlier work this paper cites.

C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” 2016 Ieee Conference on Computer Vision and Pattern Recognition (Cvpr) , pp. 2818–2826, 2016

2016

Earlier work this paper cites.

M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “Gans trained by a two time-scale update rule converge to a local nash equilibrium,” in Proceedings of the 31st International Conference on Neural Information Processing Systems , ser. Series GANs trained by a two time-scale update rule converge to a local nash equilibrium. Curran Associates Inc., 2017 Published, Conference Paper, p. 6629–6640

2017

Earlier work this paper cites.

J. Song, C. Meng, and S. Ermon, “Denoising diffusion implicit models,” in International Conference on Learning Representations , 2021. [Online]. Available: https://openreview.net/forum?id=St1giarCHLP

2021

Earlier work this paper cites.

T. Brooks, A. Holynski, and A. A. Efros, “Instructpix2pix: Learning to follow image editing instructions,” arXiv e-prints , p. arXiv:2211.09800, 2022

Original

2022

Cited alongside, same era.

J. Zhangjie Wu, Y. Ge, X. Wang, W. Lei, Y. Gu, W. Hsu, Y. Shan, X. Qie, and M. Z. Shou, “Tune-a-video: One-shot tuning of image diffusion models for text-to-video generation,” arXiv e-prints , p. arXiv:2212.11565, 2022

Original

2022

Cited alongside, same era.

J. Li, D. Li, C. Xiong, and S. Hoi, “Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation,” in Proceedings of the 39th International Conference on Machine Learning , ser. Series BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation, C. Kamalika, J. Stefanie, S. Le, S. Csaba, N. Gang, and S. Sivan, Eds., vol. 162. PMLR, 2022 Published, Conference Paper, pp. 12 888–12 900

2022

Cited alongside, same era.

R. Zhang, X. Hu, B. Li, S. Huang, H. Deng, H. Li, Y. Qiao, and P. Gao, “Prompt, generate, then cache: Cascade of foundation models makes strong few-shot learners,” arXiv e-prints , p. arXiv:2303.02151, 2023

Original

2023

Closest in time.

W. Wang, K. Xie, Z. Liu, H. Chen, Y. Cao, X. Wang, and C. Shen, “Zero-shot video editing using off-the-shelf image diffusion models,” arXiv e-prints , p. arXiv:2303.17599, 2023

Original

2023

Closest in time.

C. Qi, X. Cun, Y. Zhang, C. Lei, X. Wang, Y. Shan, and Q. Chen, “Fatezero: Fusing attentions for zero-shot text-based video editing,” arXiv e-prints , p. arXiv:2303.09535, 2023

Original

2023

Closest in time.

C. Shin, H. Kim, C. H. Lee, S.-g. Lee, and S. Yoon, “Edit-a-video: Single video editing with object-aware consistency,” arXiv e-prints , p. arXiv:2303.07945, 2023

Original

2023

Closest in time.