AutoVFX: Physically Realistic Video Editing from Natural Language Instructions

Difftaichi: Differentiable programming for physical simulation

Original

Yuanming Hu, Luke Anderson, Tzu-Mao Li, Qi Sun, Nathan Carr, Jonathan Ragan-Kelley, and Frédo Durand · 1910

Earlier work this paper cites.

Flip: a low-dissipation, particle-in-cell method for fluid flow

Jeremiah U Brackbill, Douglas B Kothe, and Hans M Ruppel · 1988

Earlier work this paper cites.

Bézier and B-spline techniques

Hartmut Prautzsch, Wolfgang Boehm, and Marco Paluszny · 2002

Earlier work this paper cites.

Adobe After Effects CC Visual Effects and Compositing Studio Techniques

Mark Christiansen · 2013

Earlier work this paper cites.

Bullet physics simulation

Erwin Coumans · 2015

Earlier work this paper cites.

Structure-from-motion revisited

Johannes Lutz Schönberger and Jan-Michael Frahm · 2016

Earlier work this paper cites.

Structure-from-motion revisited

Johannes L Schonberger and Jan-Michael Frahm · 2016

Earlier work this paper cites.

Tanks and temples: Benchmarking large-scale scene reconstruction

Arno Knapitsch, Jaesik Park, Qian-Yi Zhou, and Vladlen Koltun · 2017

Earlier work this paper cites.

Blender - a 3D modelling and rendering package

Blender Online Community · 2018

Earlier work this paper cites.

SideFX Houdini FX

Side Effects Software Inc · 2018

Earlier work this paper cites.

MantaFlow, 2018

Nils Thuerey and Tobias Pfaff · 2018

Earlier work this paper cites.

Maya, 2019

Autodesk, INC · 2019

Earlier work this paper cites.

Sentence-bert: Sentence embeddings using siamese bert-networks

Original

Nils Reimers and Iryna Gurevych · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models

Original

Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020

Earlier work this paper cites.

Scalability in perception for autonomous driving: Waymo open dataset

Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla, Aurelien Chouard, Vijaysai Patnaik, Paul Tsui, James Guo, Yin Zhou, Yuning Chai, Benjamin Caine, et al · 2020

Earlier work this paper cites.

Program synthesis with large language models

Original

Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, et al · 2021

Earlier work this paper cites.

Emerging properties in self-supervised vision transformers

Mathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou, Julien Mairal, Piotr Bojanowski, and Armand Joulin · 2021

Earlier work this paper cites.

Evaluating large language models trained on code

Original

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al · 2021

Earlier work this paper cites.

Omnidata: A scalable pipeline for making multi-task mid-level vision datasets from 3d scans

Ainaz Eftekhar, Alexander Sax, Jitendra Malik, and Amir Zamir · 2021

Earlier work this paper cites.

Quantaichi: a compiler for quantized simulations

Yuanming Hu, Jiafeng Liu, Xuanda Yang, Mingkuan Xu, Ye Kuang, Weiwei Xu, Qiang Dai, William T Freeman, and Frédo Durand · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021

Earlier work this paper cites.

High-resolution image synthesis with latent diffusion models, 2021

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer · 2021

Earlier work this paper cites.

Segformer: Simple and efficient design for semantic segmentation with transformers

Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M Alvarez, and Ping Luo · 2021

Earlier work this paper cites.

Text2live: Text-driven layered image and video editing

Omer Bar-Tal, Dolev Ofri-Amar, Rafail Fridman, Yoni Kasten, and Tali Dekel · 2022

Earlier work this paper cites.

Mip-nerf 360: Unbounded anti-aliased neural radiance fields

Jonathan T Barron, Ben Mildenhall, Dor Verbin, Pratul P Srinivasan, and Peter Hedman · 2022

Earlier work this paper cites.

Neumesh: Learning disentangled neural mesh-based implicit field for geometry and texture editing

Chong Bao and Bangbang Yang, Zeng Junyi, Bao Hujun, Zhang Yinda, Cui Zhaopeng, and Zhang Guofeng · 2022

Earlier work this paper cites.

A neural network solves, explains, and generates university math problems by program synthesis and few-shot learning at human level

Iddo Drori, Sarah Zhang, Reece Shuttleworth, Leonard Tang, Albert Lu, Elizabeth Ke, Kevin Liu, Linda Chen, Sunny Tran, Newman Cheng, et al · 2022

Earlier work this paper cites.

Mitsuba 3 renderer, 2022

Wenzel Jakob, Sébastien Speierer, Nicolas Roussel, Merlin Nimier-David, Delio Vicini, Tizian Zeltner, Baptiste Nicolet, Miguel Crespo, Vincent Leroy, and Ziyi Zhang · 2022

Earlier work this paper cites.

SDEdit: Guided image synthesis and editing with stochastic differential equations

Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun-Yan Zhu, and Stefano Ermon · 2022

Earlier work this paper cites.

Cagenerf: Cage-based neural radiance field for generalized 3d deformation and animation

Yicong Peng, Yichao Yan, Shengqi Liu, Yuhao Cheng, Shanyan Guan, Bowen Pan, Guangtao Zhai, and Xiaokang Yang · 2022

Earlier work this paper cites.

Neuphysics: Editable neural geometry and physics from monocular videos

Yi-Ling Qiao, Alexander Gao, and Ming C. Lin · 2022

Earlier work this paper cites.

Resolution-robust large mask inpainting with fourier convolutions

Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin, Anastasia Remizova, Arsenii Ashukha, Aleksei Silvestrov, Naejin Kong, Harshith Goka, Kiwoong Park, and Victor Lempitsky · 2022

Earlier work this paper cites.

Grit: A generative region-to-text transformer for object understanding

Original

Jialian Wu, Jianfeng Wang, Zhengyuan Yang, Zhe Gan, Zicheng Liu, Junsong Yuan, and Lijuan Wang · 2022

Earlier work this paper cites.

Deforming radiance fields with cages

Tianhan Xu and Tatsuya Harada · 2022

Earlier work this paper cites.

Sdfstudio: A unified framework for surface reconstruction, 2022

Zehao Yu, Anpei Chen, Bozidar Antic, Songyou Peng, Apratim Bhattacharyya, Michael Niemeyer, Siyu Tang, Torsten Sattler, and Andreas Geiger · 2022

Cited alongside, same era.

Nerf-editing: geometry editing of neural radiance fields

Yu-Jie Yuan, Yang-Tian Sun, Yu-Kun Lai, Yuewen Ma, Rongfei Jia, and Lin Gao · 2022

Cited alongside, same era.

Gpt-4 technical report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al · 2023

Cited alongside, same era.

Stable video diffusion: Scaling latent video diffusion models to large datasets

Original

Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram Voleti, Adam Letts, et al · 2023

Cited alongside, same era.

Instructpix2pix: Learning to follow image editing instructions

Tim Brooks, Aleksander Holynski, and Alexei A. Efros · 2023

Bakedsdf: Meshing neural sdfs for real-time view synthesis

Lior Yariv, Peter Hedman, Christian Reiser, Dor Verbin, Pratul P Srinivasan, Richard Szeliski, Jonathan T Barron, and Ben Mildenhall · 2023

Later among the works it cites.

Scannet++: A high-fidelity dataset of 3d indoor scenes

Chandan Yeshwanth, Yueh-Cheng Liu, Matthias Nießner, and Angela Dai · 2023

Later among the works it cites.

Adding conditional control to text-to-image diffusion models, 2023

Lvmin Zhang, Anyi Rao, and Maneesh Agrawala · 2023

Later among the works it cites.

Dreameditor: Text-driven 3d scene editing with neural fields

Jingyu Zhuang, Chen Wang, Liang Lin, Lingjie Liu, and Guanbin Li · 2023

Later among the works it cites.

Improving diffusion models for virtual try-on

Original

Yisol Choi, Sangkyung Kwak, Kyungmin Lee, Hyungwon Choi, and Jinwoo Shin · 2024

Closest in time.