Fetching the paper…
Reading the bibliography…
We introduce Motion-I2V, a novel framework for consistent and controllable image-to-video generation (I2V).
Determining optical flow
Berthold KP Horn and Brian G Schunck · 1981
Earlier work this paper cites.
A framework for the robust estimation of optical flow
Michael J Black and Padmanabhan Anandan · 1993
Earlier work this paper cites.
Lucas/kanade meets horn/schunck: Combining local and global optic flow methods
Andrés Bruhn, Joachim Weickert, and Christoph Schnörr · 2005
Earlier work this paper cites.
Animating pictures of fluid using video examples
Makoto Okabe, Ken ichi Anjyo, Takeo Igarashi, and Hans-Peter Seidel · 2009
Earlier work this paper cites.
Generative adversarial nets
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P. Kingma and Max Welling · 2014
Earlier work this paper cites.
A quantitative analysis of current practices in optical flow estimation and the principles behind them
Deqing Sun, Stefan Roth, and Michael J Black · 2014
Earlier work this paper cites.
NICE: non-linear independent components estimation
Laurent Dinh, David Krueger, and Yoshua Bengio · 2015
Earlier work this paper cites.
Flownet: Learning optical flow with convolutional networks
Alexey Dosovitskiy, Philipp Fischer, Eddy Ilg, Philip Hausser, Caner Hazirbas, Vladimir Golkov, Patrick Van Der Smagt, Daniel Cremers, and Thomas Brox · 2015
Earlier work this paper cites.
Animating still landscape photographs through cloud motion creation
Wei-Cih Jhou and Wen-Huang Cheng · 2016
Earlier work this paper cites.
Flownet 2.0: Evolution of optical flow estimation with deep networks
Eddy Ilg, Nikolaus Mayer, Tonmoy Saikia, Margret Keuper, Alexey Dosovitskiy, and Thomas Brox · 2017
Earlier work this paper cites.
Decoupled weight decay regularization
Ilya Loshchilov and Frank Hutter · 2017
Earlier work this paper cites.
Optical flow estimation using a spatial pyramid network
Anurag Ranjan and Michael J Black · 2017
Earlier work this paper cites.
Warp-guided gans for single-photo facial animation
Jiahao Geng, Tianjia Shao, Youyi Zheng, Yanlin Weng, and Kun Zhou · 2018
Earlier work this paper cites.
Warp-guided gans for single-photo facial animation
Jiahao Geng, Tianjia Shao, Youyi Zheng, Yanlin Weng, and Kun Zhou · 2018
Earlier work this paper cites.
Liteflownet: A lightweight convolutional neural network for optical flow estimation
Tak-Wai Hui, Xiaoou Tang, and Chen Change Loy · 2018
Earlier work this paper cites.
Pwc-net: Cnns for optical flow using pyramid, warping, and cost volume
Deqing Sun, Xiaodong Yang, Ming-Yu Liu, and Jan Kautz · 2018
Earlier work this paper cites.
Photo wake-up: 3d character animation from a single photo
Chung-Yi Weng, Brian Curless, and Ira Kemelmacher-Shlizerman · 2018
Earlier work this paper cites.
Learning to generate time-lapse videos using multi-stage dynamic generative adversarial networks
Wei Xiong, Wenhan Luo, Lin Ma, Wei Liu, and Jiebo Luo · 2018
Earlier work this paper cites.
Singan: Learning a generative model from a single natural image
Tamar Rott Shaham, Tali Dekel, and Tomer Michaeli · 2019
Earlier work this paper cites.
Volumetric correspondence networks for optical flow
Gengshan Yang and Deva Ramanan · 2019
Earlier work this paper cites.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020
Earlier work this paper cites.
A lightweight optical flow cnn—revisiting data fidelity and regularization
Tak-Wai Hui, Xiaoou Tang, and Chen Change Loy · 2020
Earlier work this paper cites.
Softmax splatting for video frame interpolation
Simon Niklaus and Feng Liu · 2020
Earlier work this paper cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu · 2020
Earlier work this paper cites.
Raft: Recurrent all-pairs field transforms for optical flow
Zachary Teed and Jia Deng · 2020
Earlier work this paper cites.
Imaginator: Conditional spatio-temporal gan for video generation
Yaohui WANG, Piotr Bilinski, Francois Bremond, and Antitza Dantcheva · 2020
Earlier work this paper cites.
Imaginator: Conditional spatio-temporal gan for video generation
Yaohui Wang, Piotr Bilinski, Francois Bremond, and Antitza Dantcheva · 2020
Earlier work this paper cites.
Frozen in time: A joint video and image encoder for end-to-end retrieval
Max Bain, Arsha Nagrani, Gül Varol, and Andrew Zisserman · 2021
Cited alongside, same era.
Understanding object dynamics for interactive image-to-video synthesis
Andreas Blattmann, Timo Milbich, Michael Dorkenwald, and Björn Ommer · 2021
Cited alongside, same era.
Animating pictures with eulerian motion fields
Aleksander Holynski, Brian L. Curless, Steven M. Seitz, and Richard Szeliski · 2021
Cited alongside, same era.
GLIDE: towards photorealistic image generation and editing with text-guided diffusion models
Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen · 2021
Cited alongside, same era.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Cited alongside, same era.
Dreampose: Fashion image-to-video synthesis via stable diffusion, 2023
Johanna Karras, Aleksander Holynski, Ting-Chun Wang, and Ira Kemelmacher-Shlizerman · 2023
Later among the works it cites.
Text2video-zero: Text-to-image diffusion models are zero-shot video generators
Levon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto Henschel, Zhangyang Wang, Shant Navasardyan, and Humphrey Shi · 2023
Later among the works it cites.
3d cinemagraphy from a single image
Xingyi Li, Zhiguo Cao, Huiqiang Sun, Jianming Zhang, Ke Xian, and Guosheng Lin · 2023
Later among the works it cites.
Generative image dynamics, 2023
Zhengqi Li, Richard Tucker, Noah Snavely, and Aleksander Holynski · 2023
Later among the works it cites.
Video-p2p: Video editing with cross-attention control, 2023
Shaoteng Liu, Yuechen Zhang, Wenbo Li, Zhe Lin, and Jiaya Jia · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
High-resolution image synthesis with latent diffusion models, 2021
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2021
Cited alongside, same era.
Motion representations for articulated animation
Aliaksandr Siarohin, Oliver Woodford, Jian Ren, Menglei Chai, and Sergey Tulyakov · 2021
Cited alongside, same era.
Denoising diffusion implicit models
Jiaming Song, Chenlin Meng, and Stefano Ermon · 2021
Cited alongside, same era.
Loftr: Detector-free local feature matching with transformers
Jiaming Sun, Zehong Shen, Yuang Wang, Hujun Bao, and Xiaowei Zhou · 2021
Cited alongside, same era.
Tip-adapter: Training-free clip-adapter for better vision-language modeling
Renrui Zhang, Rongyao Fang, Wei Zhang, Peng Gao, Kunchang Li, Jifeng Dai, Yu Qiao, and Hongsheng Li · 2021
Cited alongside, same era.
Tap-vid: A benchmark for tracking any point in a video
Carl Doersch, Ankush Gupta, Larisa Markeeva, Adrià Recasens, Lucas Smaira, Yusuf Aytar, João Carreira, Andrew Zisserman, and Yi Yang · 2022
Cited alongside, same era.
Particle video revisited: Tracking through occlusions using point trajectories
Adam W Harley, Zhaoyuan Fang, and Katerina Fragkiadaki · 2022
Cited alongside, same era.
Aniruddha Mahapatra, Aliaksandr Siarohin, Hsin-Ying Lee, Sergey Tulyakov, and Jun-Yan Zhu · 2023
Later among the works it cites.
Dense optical tracking: Connecting the dots
Guillaume Le Moing, Jean Ponce, and Cordelia Schmid · 2023
Later among the works it cites.
Dragondiffusion: Enabling drag-style manipulation on diffusion models
Chong Mou, Xintao Wang, Jiechong Song, Ying Shan, and Jian Zhang · 2023
Later among the works it cites.
Drag your gan: Interactive point-based manipulation on the generative image manifold
Xingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu, Abhimitra Meka, and Christian Theobalt · 2023
Later among the works it cites.
Videoflow: Exploiting temporal cues for multi-frame optical flow estimation
Xiaoyu Shi, Zhaoyang Huang, Weikang Bian, Dasong Li, Manyuan Zhang, Ka Chun Cheung, Simon See, Hongwei Qin, Jifeng Dai, and Hongsheng Li · 2023
Later among the works it cites.
Flowformer++: Masked cost volume autoencoding for pretraining optical flow estimation
Xiaoyu Shi, Zhaoyang Huang, Dasong Li, Manyuan Zhang, Ka Chun Cheung, Simon See, Hongwei Qin, Jifeng Dai, and Hongsheng Li · 2023
Later among the works it cites.
Dragdiffusion: Harnessing diffusion models for interactive point-based image editing
Yujun Shi, Chuhui Xue, Jiachun Pan, Wenqing Zhang, Vincent YF Tan, and Song Bai · 2023
Later among the works it cites.
Gen-l-video: Multi-text to long video generation via temporal co-denoising
Fu-Yun Wang, Wenshuo Chen, Guanglu Song, Han-Jia Ye, Yu Liu, and Hongsheng Li · 2023
Later among the works it cites.
Zero-shot video editing using off-the-shelf image diffusion models
Wen Wang, kangyang Xie, Zide Liu, Hao Chen, Yue Cao, Xinlong Wang, and Chunhua Shen · 2023
Later among the works it cites.
Videocomposer: Compositional video synthesis with motion controllability
Xiang* Wang, Hangjie* Yuan, Shiwei* Zhang, Dayou* Chen, Jiuniu Wang, Yingya Zhang, Yujun Shen, Deli Zhao, and Jingren Zhou · 2023
Later among the works it cites.
Context-pips: Persistent independent particles demands context features
BIAN Weikang, Zhaoyang Huang, Xiaoyu Shi, Yitong Dong, Yijin Li, and Hongsheng Li · 2023
Later among the works it cites.
Where you edit is what you get: Text-guided image editing with region-based attention
Changming Xiao, Qi Yang, Xiaoqiang Xu, Jianwei Zhang, Feng Zhou, and Changshui Zhang · 2023
Later among the works it cites.
Automatic animation of hair blowing in still portrait photos
Wenpeng Xiao, Wentao Liu, Yitong Wang, Bernard Ghanem, and Bing Li · 2023
Later among the works it cites.
Dynamicrafter: Animating open-domain images with video diffusion priors
Jinbo Xing, Menghan Xia, Yong Zhang, Haoxin Chen, Wangbo Yu, Hanyuan Liu, Xintao Wang, Tien-Tsin Wong, and Ying Shan · 2023
Later among the works it cites.
Adding conditional control to text-to-image diffusion models, 2023
Lvmin Zhang, Anyi Rao, and Maneesh Agrawala · 2023
Later among the works it cites.
I2vgen-xl: High-quality image-to-video synthesis via cascaded diffusion models
Shiwei Zhang, Jiayu Wang, Yingya Zhang, Kang Zhao, Hangjie Yuan, Zhiwu Qing, Xiang Wang, Deli Zhao, and Jingren Zhou · 2023
Later among the works it cites.
Kbnet: Kernel basis network for image restoration
Yi Zhang, Dasong Li, Xiaoyu Shi, Dailan He, Kangning Song, Xiaogang Wang, Hongwei Qin, and Hongsheng Li · 2023
Later among the works it cites.
A unified conditional framework for diffusion-based image restoration
Yi Zhang, Xiaoyu Shi, Dasong Li, Xiaogang Wang, Jian Wang, and Hongsheng Li · 2023
Later among the works it cites.
Pia: Your personalized image animator via plug-and-play modules in text-to-image models, 2023
Yiming Zhang, Zhening Xing, Yanhong Zeng, Youqing Fang, and Kai Chen · 2023
Later among the works it cites.
Pointodyssey: A large-scale synthetic dataset for long-term point tracking
Yang Zheng, Adam W Harley, Bokui Shen, Gordon Wetzstein, and Leonidas J Guibas · 2023
Later among the works it cites.
Magicvideo: Efficient video generation with latent diffusion models, 2023
Daquan Zhou, Weimin Wang, Hanshu Yan, Weiwei Lv, Yizhe Zhu, and Jiashi Feng · 2023
Later among the works it cites.
Common diffusion noise schedules and sample steps are flawed
Shanchuan Lin, Bingchen Liu, Jiashi Li, and Xiao Yang · 2024
Closest in time.