Fetching the paper…
Reading the bibliography…
Controlling the movements of dynamic objects and the camera within generated videos is a meaningful yet challenging task.
Structure-from-motion revisited
Johannes L. Schönberger and Jan-Michael Frahm · 2016
Earlier work this paper cites.
Towards accurate generative models of video: A new metric & challenges
Thomas Unterthiner, Sjoerd van Steenkiste, Karol Kurach, Raphaël Marinier, Marcin Michalski, and Sylvain Gelly · 2018
Earlier work this paper cites.
Stereo magnification: learning view synthesis using multiplane images
Tinghui Zhou, Richard Tucker, John Flynn, Graham Fyffe, and Noah Snavely · 2018
Earlier work this paper cites.
Denoising diffusion probabilistic models
Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020
Earlier work this paper cites.
A unified framework for shot type classification based on subject centric lens
Anyi Rao, Jiaze Wang, Linning Xu, Xuekun Jiang, Qingqiu Huang, Bolei Zhou, and Dahua Lin · 2020
Earlier work this paper cites.
pytorch-fid: FID Score for PyTorch, 2020
Maximilian Seitzer · 2020
Earlier work this paper cites.
Frozen in time: A joint video and image encoder for end-to-end retrieval
Max Bain, Arsha Nagrani, Gül Varol, and Andrew Zisserman · 2021
Earlier work this paper cites.
Learning transferable visual models from natural language supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever · 2021
Earlier work this paper cites.
LAION-400M: open dataset of clip-filtered 400 million image-text pairs
Christoph Schuhmann, Richard Vencu, Romain Beaumont, Robert Kaczmarczyk, Clayton Mullis, Aarush Katta, Theo Coombes, Jenia Jitsev, and Aran Komatsuzaki · 2021
Earlier work this paper cites.
DROID-SLAM: deep visual SLAM for monocular, stereo, and RGB-D cameras
Zachary Teed and Jia Deng · 2021
Earlier work this paper cites.
Score-based generative modeling through backward stochastic differential equations: Inversion and generation
Zihao Wang · 2021
Earlier work this paper cites.
LoRA: Low-rank adaptation of large language models
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen · 2022
Earlier work this paper cites.
https://mixamo.com , 2022
Mixamo · 2022
Earlier work this paper cites.
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2022
Earlier work this paper cites.
https://www.unrealengine.com/ , 2022
Unreal Engine 5 · 2022
Earlier work this paper cites.
ParticleSfM: Exploiting dense point trajectories for localizing moving cameras in the wild
Wang Zhao, Shaohui Liu, Hengkai Guo, Wenping Wang, and Yong-Jin Liu · 2022
Cited alongside, same era.
BEDLAM: A synthetic dataset of bodies exhibiting detailed lifelike animated motion
Michael J. Black, Priyanka Patel, Joachim Tesch, and Jinlong Yang · 2023
Cited alongside, same era.
Make-a-video: Text-to-video generation without text-video data
Uriel Singer, Adam Polyak, Thomas Hayes, Xi Yin, Jie An, Songyang Zhang, Qiyuan Hu, Harry Yang, Oron Ashual, Oran Gafni, Devi Parikh, Sonal Gupta, and Yaniv Taigman · 2023
Cited alongside, same era.
https://civitai.com/models/4201/realistic-vision-v20 , 2023
Realistic Vision · 2023
Cited alongside, same era.
VideoComposer: Compositional video synthesis with motion controllability
Xiang Wang, Hangjie Yuan, Shiwei Zhang, Dayou Chen, Jiuniu Wang, Yingya Zhang, Yujun Shen, Deli Zhao, and Jingren Zhou · 2023
Cited alongside, same era.
FreeTraj: Tuning-free trajectory control in video diffusion models
Haonan Qiu, Zhaoxi Chen, Zhouxia Wang, Yingqing He, Menghan Xia, and Ziwei Liu · 2024
Later among the works it cites.
Motion-I2V: Consistent and controllable image-to-video generation with explicit motion modeling
Xiaoyu Shi, Zhaoyang Huang, Fu-Yun Wang, Weikang Bian, Dasong Li, Yi Zhang, Manyuan Zhang, Ka Chun Cheung, Simon See, Hongwei Qin, Jifeng Dai, and Hongsheng Li · 2024
Later among the works it cites.
A survey of multimodal-guided image editing with text-to-image diffusion models
Xincheng Shuai, Henghui Ding, Xingjun Ma, Rongcheng Tu, Yu-Gang Jiang, and Dacheng Tao · 2024
Later among the works it cites.
https://civitai.com/models/30240/toonyou , 2024
Bradcatt: Toonyou · 2024
Later among the works it cites.
MotionBooth: Motion-aware customized text-to-video generation
Jianzong Wu, Xiangtai Li, Yanhong Zeng, Jiangning Zhang, Qianyu Zhou, Yining Li, Yunhai Tong, and Kai Chen · 2024
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
SynBody: Synthetic dataset with layered human models for 3d human perception and modeling
Zhitao Yang, Zhongang Cai, Haiyi Mei, Shuai Liu, Zhaoxi Chen, Weiye Xiao, Yukun Wei, Zhongfei Qing, Chen Wei, Bo Dai, Wayne Wu, Chen Qian, Dahua Lin, Ziwei Liu, and Lei Yang · 2023
Cited alongside, same era.
DragNUWA: Fine-grained control in video generation by integrating text, image, and trajectory
Shengming Yin, Chenfei Wu, Jian Liang, Jie Shi, Houqiang Li, Gong Ming, and Nan Duan · 2023
Cited alongside, same era.
I2VGen-XL: High-quality image-to-video synthesis via cascaded diffusion models
Shiwei Zhang, Jiayu Wang, Yingya Zhang, Kang Zhao, Hangjie Yuan, Zhiwu Qin, Xiang Wang, Deli Zhao, and Jingren Zhou · 2023
Cited alongside, same era.
AnimateDiff: Animate your personalized text-to-image diffusion models without specific tuning
Yuwei Guo, Ceyuan Yang, Anyi Rao, Yaohui Wang, Yu Qiao, Dahua Lin, and Bo Dai · 2024
Cited alongside, same era.
CameraCtrl: Enabling camera control for text-to-video generation
Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai, Hongsheng Li, and Ceyuan Yang · 2024
Cited alongside, same era.
Training-free camera control for video generation
Chen Hou, Guoqiang Wei, Yan Zeng, and Zhibo Chen · 2024
Cited alongside, same era.
MotionMaster: Training-free camera motion transfer for video generation
Teng Hu, Jiangning Zhang, Ran Yi, Yating Wang, Hongrui Huang, Jieyu Weng, Yabiao Wang, and Lizhuang Ma · 2024
Cited alongside, same era.
CamCo: Camera-controllable 3d-consistent image-to-video generation
Dejia Xu, Weili Nie, Chao Liu, Sifei Liu, Jan Kautz, Zhangyang Wang, and Arash Vahdat · 2024
Later among the works it cites.
Space-time diffusion features for zero-shot text-driven motion transfer
Danah Yatim, Rafail Fridman, Omer Bar-Tal, Yoni Kasten, and Tali Dekel · 2024
Later among the works it cites.
WHAC: world-grounded humans and cameras
Wanqi Yin, Zhongang Cai, Ruisi Wang, Fanzhou Wang, Chen Wei, Haiyi Mei, Weiye Xiao, Zhitao Yang, Qingping Sun, Atsushi Yamashita, Ziwei Liu, and Lei Yang · 2024
Later among the works it cites.
Tora: Trajectory-oriented diffusion transformer for video generation
Zhenghao Zhang, Junchao Liao, Menghao Li, Long Qin, and Weizhi Wang · 2024
Later among the works it cites.
VD3D: taming large video diffusion transformers for 3d camera control
Sherwin Bahmani, Ivan Skorokhodov, Aliaksandr Siarohin, Willi Menapace, Guocheng Qian, Michael Vasilkovsky, Hsin-Ying Lee, Chaoyang Wang, Jiaxu Zou, Andrea Tagliasacchi, David B. Lindell, and Sergey Tulyakov · 2025
Closest in time.
3DTrajMaster: Mastering 3d trajectory for multi-entity motion in video generation
Xiao Fu, Xian Liu, et al · 2025
Closest in time.
AnyI2V: Animating any conditional image with motion control generation
Ziye Li, Hao Luo, Xincheng Shuai, and Henghui Ding · 2025
Closest in time.
MotionClone: Training-free motion cloning for controllable video generation
Pengyang Ling, Jiazi Bu, Pan Zhang, Xiaoyi Dong, Yuhang Zang, Tong Wu, Huaian Chen, Jiaqi Wang, and Yi Jin · 2025
Closest in time.
CharaConsist: Fine-grained consistent character generation
Mengyu Wang, Henghui Ding, Jianing Peng, Yao Zhao, Yunpeng Chen, and Yunchao Wei · 2025
Closest in time.