Fetching the paper…
Reading the bibliography…
We propose a new object-centric video prediction algorithm based on the deep latent particle (DLP) representation.
A learning algorithm for continually running fully recurrent neural networks
Ronald J. Williams and David Zipser · 1989
Earlier work this paper cites.
Space: Unsupervised object-oriented scene representation via spatial attention and decomposition
Zhixuan Lin, Yi-Fu Wu, Skand Vishwanath Peri, Weihao Sun, Gautam Singh, Fei Deng, Jindong Jiang, and Sungjin Ahn · 2001
Earlier work this paper cites.
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli · 2004
Earlier work this paper cites.
Adam: A method for stochastic optimization
Diederik Kingma and Jimmy Ba · 2014
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P. Kingma and Max Welling · 2014
Earlier work this paper cites.
Spatial transformer networks
Max Jaderberg, Karen Simonyan, Andrew Zisserman, et al · 2015
Earlier work this paper cites.
Learning structured output representation using deep conditional generative models
Kihyuk Sohn, Honglak Lee, and Xinchen Yan · 2015
Earlier work this paper cites.
Interaction networks for learning about objects, relations and physics
Peter Battaglia, Razvan Pascanu, Matthew Lai, Danilo Jimenez Rezende, et al · 2016
Earlier work this paper cites.
Deep spatial autoencoders for visuomotor learning
Chelsea Finn, Xin Yu Tan, Yan Duan, Trevor Darrell, Sergey Levine, and Pieter Abbeel · 2016
Earlier work this paper cites.
Learning to track at 100 fps with deep regression networks
David Held, Sebastian Thrun, and Silvio Savarese · 2016
Earlier work this paper cites.
You only look once: Unified, real-time object detection
Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi · 2016
Earlier work this paper cites.
Self-supervised visual planning with temporal skip connections
Frederik Ebert, Chelsea Finn, Alex X Lee, and Sergey Levine · 2017
Earlier work this paper cites.
beta-VAE: Learning basic visual concepts with a constrained variational framework
Irina Higgins, Loic Matthey, Arka Pal, Christopher Burgess, Xavier Glorot, Matthew Botvinick, Shakir Mohamed, and Alexander Lerchner · 2017
Earlier work this paper cites.
Clevr: A diagnostic dataset for compositional language and elementary visual reasoning
Justin Johnson, Bharath Hariharan, Laurens Van Der Maaten, Li Fei-Fei, C Lawrence Zitnick, and Ross Girshick · 2017
Earlier work this paper cites.
Automatic differentiation in PyTorch
Adam Paszke, Sam Gross, Soumith Chintala, Gregory Chanan, Edward Yang, Zachary DeVito, Zeming Lin, Alban Desmaison, Luca Antiga, and Adam Lerer · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Learning to generate long-term future via hierarchical prediction
Ruben Villegas, Jimei Yang, Yuliang Zou, Sungryull Sohn, Xunyu Lin, and Honglak Lee · 2017
Earlier work this paper cites.
The perception-distortion tradeoff
Yochai Blau and Tomer Michaeli · 2018
Earlier work this paper cites.
Stochastic video generation with a learned prior
Emily Denton and Rob Fergus · 2018
Earlier work this paper cites.
Unsupervised learning of object landmarks through conditional image generation
Tomas Jakab, Ankush Gupta, Hakan Bilen, and Andrea Vedaldi · 2018
Earlier work this paper cites.
Stochastic adversarial video prediction
Alex X Lee, Richard Zhang, Frederik Ebert, Pieter Abbeel, Chelsea Finn, and Sergey Levine · 2018
Earlier work this paper cites.
Improving language understanding by generative pre-training
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al · 2018
Earlier work this paper cites.
Self-attention with relative position representations
Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani · 2018
Earlier work this paper cites.
The unreasonable effectiveness of deep features as a perceptual metric
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang · 2018
Earlier work this paper cites.
Phyre: A new benchmark for physical reasoning
Anton Bakhtin, Laurens van der Maaten, Justin Johnson, Laura Gustafson, and Ross Girshick · 2019
Cited alongside, same era.
Monet: Unsupervised scene decomposition and representation
Christopher P Burgess, Loic Matthey, Nicholas Watters, Rishabh Kabra, Irina Higgins, Matt Botvinick, and Alexander Lerchner · 2019
Cited alongside, same era.
Spatially invariant unsupervised object detection with convolutional neural networks
Eric Crawford and Joelle Pineau · 2019
Cited alongside, same era.
Genesis: Generative scene inference and sampling with object-centric latent representations
Martin Engelcke, Adam R Kosiorek, Oiwi Parker Jones, and Ingmar Posner · 2019
Cited alongside, same era.
Multi-object representation learning with iterative variational inference
Klaus Greff, Raphaël Lopez Kaufman, Rishabh Kabra, Nick Watters, Christopher Burgess, Daniel Zoran, Loic Matthey, Matthew Botvinick, and Alexander Lerchner · 2019
Conditional object-centric learning from video
Thomas Kipf, Gamaleldin F Elsayed, Aravindh Mahendran, Austin Stone, Sara Sabour, Georg Heigold, Rico Jonschkowski, Alexey Dosovitskiy, and Klaus Greff · 2021
Later among the works it cites.
Illiterate dall-e learns to compose
Gautam Singh, Fei Deng, and Sungjin Ahn · 2021
Later among the works it cites.
MarioNette: Self-supervised sprite learning
Dmitriy Smirnov, Michael Gharbi, Matthew Fisher, Vitor Guizilini, Alexei A. Efros, and Justin Solomon · 2021
Later among the works it cites.
Jacob Walker, Ali Razavi, and Aäron van den Oord · 2021
Later among the works it cites.
Benchmarking unsupervised object representations for video sequences
Marissa A Weis, Kashyap Chitta, Yash Sharma, Wieland Brendel, Matthias Bethge, Andreas Geiger, and Alexander S Ecker · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Non-adversarial image synthesis with generative latent nearest neighbors
Yedid Hoshen, Ke Li, and Jitendra Malik · 2019
Cited alongside, same era.
Scalor: Generative world models with scalable object representations
Jindong Jiang, Sepehr Janghorbani, Gerard De Melo, and Sungjin Ahn · 2019
Cited alongside, same era.
Unsupervised keypoint learning for guiding class-conditional video prediction
Yunji Kim, Seonghyeon Nam, In Cho, and Seon Joo Kim · 2019
Cited alongside, same era.
Structured object-aware physics prediction for video modeling and planning
Jannik Kossen, Karl Stelzner, Marcel Hussing, Claas Voelcker, and Kristian Kersting · 2019
Cited alongside, same era.
Unsupervised learning of object keypoints for perception and control
Tejas Kulkarni, Ankush Gupta, Catalin Ionescu, Sebastian Borgeaud, Malcolm Reynolds, Andrew Zisserman, and Volodymyr Mnih · 2019
Cited alongside, same era.
Unsupervised learning of object structure and dynamics from videos
Matthias Minderer, Chen Sun, Ruben Villegas, Forrester Cole, Kevin P Murphy, and Honglak Lee · 2019
Cited alongside, same era.
R-sqair: relational sequential attend, infer, repeat
Aleksandar Stanić and Jürgen Schmidhuber · 2019
Cited alongside, same era.
Later among the works it cites.
Videogpt: Video generation using vq-vae and transformers
Wilson Yan, Yunzhi Zhang, Pieter Abbeel, and Aravind Srinivas · 2021
Later among the works it cites.
Parts: Unsupervised segmentation with slots, attention and independence maximization
Daniel Zoran, Rishabh Kabra, Alexander Lerchner, and Danilo J. Rezende · 2021
Later among the works it cites.
SAVi++: Towards end-to-end object-centric learning from real-world videos
Gamaleldin Fathy Elsayed, Aravindh Mahendran, Sjoerd van Steenkiste, Klaus Greff, Michael Curtis Mozer, and Thomas Kipf · 2022
Later among the works it cites.
Particle videos revisited: Tracking through occlusions using point trajectories
Adam W Harley, Zhaoyuan Fang, and Katerina Fragkiadaki · 2022
Later among the works it cites.
Transframer: Arbitrary frame prediction with generative models
Charlie Nash, João Carreira, Jacob Walker, Iain Barr, Andrew Jaegle, Mateusz Malinowski, and Peter Battaglia · 2022
Later among the works it cites.
https://github.com/francois-rozet/piqa , 2022
François Rozet · 2022
Later among the works it cites.
Object scene representation transformer
Mehdi SM Sajjadi, Daniel Duckworth, Aravindh Mahendran, Sjoerd van Steenkiste, Filip Pavetić, Mario Lučić, Leonidas J Guibas, Klaus Greff, and Thomas Kipf · 2022
Later among the works it cites.
Self-supervised keypoint discovery in behavioral videos
Jennifer J Sun, Serim Ryou, Roni H Goldshmid, Brandon Weissbourd, John O Dabiri, David J Anderson, Ann Kennedy, Yisong Yue, and Pietro Perona · 2022
Later among the works it cites.
https://github.com/lucidrains/denoising-diffusion-pytorch , 2022
Phil Wang · 2022
Later among the works it cites.
Predrnn: A recurrent neural network for spatiotemporal predictive learning
Yunbo Wang, Haixu Wu, Jianjin Zhang, Zhifeng Gao, Jianmin Wang, Philip Yu, and Mingsheng Long · 2022
Later among the works it cites.
Slotformer: Unsupervised visual dynamics simulation with object-centric models
Ziyi Wu, Nikita Dvornik, Klaus Greff, Thomas Kipf, and Animesh Garg · 2022
Later among the works it cites.
Magvit: Masked generative video transformer
Lijun Yu, Yong Cheng, Kihyuk Sohn, José Lezama, Han Zhang, Huiwen Chang, Alexander G Hauptmann, Ming-Hsuan Yang, Yuan Hao, Irfan Essa, et al · 2022
Later among the works it cites.
Self-supervised reinforcement learning with independently controllable subgoals
Andrii Zadaianchuk, Georg Martius, and Fanny Yang · 2022
Later among the works it cites.
Structured world representations via block-slot attention
Anonymous · 2023
Closest in time.
Interaction-based disentanglement of entities for object-centric world models
Akihiro Nakano, Masahiro Suzuki, and Yutaka Matsuo · 2023
Closest in time.
Bridging the gap to real-world object-centric learning
Maximilian Seitzer, Max Horn, Andrii Zadaianchuk, Dominik Zietlow, Tianjun Xiao, Carl-Johann Simon-Gabriel, Tong He, Zheng Zhang, Bernhard Schölkopf, Thomas Brox, and Francesco Locatello · 2023
Closest in time.
Object-centric video prediction via decoupling of object dynamics and interactions
Angel Villar-Corrales, Ismail Wahdan, and Sven Behnke · 2023
Closest in time.
https://github.com/pairlab/SlotFormer , 2023
Ziyi Wu, Nikita Dvornik, Klaus Greff, Thomas Kipf, and Animesh Garg · 2023
Closest in time.
An investigation into pre-training object-centric representations for reinforcement learning
Jaesik Yoon, Yi-Fu Wu, Heechul Bae, and Sungjin Ahn · 2023
Closest in time.