Fetching the paper…
Reading the bibliography…
We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks.
Dream to control: Learning behaviors by latent imagination
D. Hafner, T. Lillicrap, J. Ba, and M. Norouzi · 1912
Earlier work this paper cites.
Model predictive control
E. F. Camacho and C. B. Alba · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
D. P. Kingma and J. Ba · 2014
Earlier work this paper cites.
Embed to control: A locally linear latent dynamics model for control from raw images
M. Watter, J. T. Springenberg, J. Boedecker, and M. Riedmiller · 2015
Earlier work this paper cites.
Interaction networks for learning about objects, relations and physics
P. W. Battaglia, R. Pascanu, M. Lai, D. Rezende, and K. Kavukcuoglu · 2016
Earlier work this paper cites.
A compositional object-based approach to learning physical dynamics
M. B. Chang, T. Ullman, A. Torralba, and J. B. Tenenbaum · 2016
Earlier work this paper cites.
Feedback control of the pusher-slider system: A story of hybrid and underactuated contact dynamics
F. R. Hogan and A. Rodriguez · 2016
Earlier work this paper cites.
Unsupervised learning for physical interaction through video prediction
C. Finn, I. Goodfellow, and S. Levine · 2016
Earlier work this paper cites.
Learning to poke by poking: Experiential learning of intuitive physics
P. Agrawal, A. Nair, P. Abbeel, J. Malik, and S. Levine · 2016
Earlier work this paper cites.
Visual interaction networks: Learning a physics simulator from video
N. Watters, D. Zoran, T. Weber, P. Battaglia, R. Pascanu, and A. Tacchetti · 2017
Earlier work this paper cites.
Self-supervised visual planning with temporal skip connections
F. Ebert, C. Finn, A. X. Lee, and S. Levine · 2017
Earlier work this paper cites.
Visual foresight: Model-based deep reinforcement learning for vision-based robotic control
F. Ebert, C. Finn, S. Dasari, A. Xie, A. Lee, and S. Levine · 2018
Earlier work this paper cites.
Relational inductive biases, deep learning, and graph networks
P. W. Battaglia, J. B. Hamrick, V. Bapst, A. Sanchez-Gonzalez, V. Zambaldi, M. Malinowski, A. Tacchetti, D. Raposo, A. Santoro, R. Faulkner, et al · 2018
Earlier work this paper cites.
Graph networks as learnable physics engines for inference and control
A. Sanchez-Gonzalez, N. Heess, J. T. Springenberg, J. Merel, M. Riedmiller, R. Hadsell, and P. Battaglia · 2018
Earlier work this paper cites.
Flexible neural representation for physics prediction
D. Mrowca, C. Zhuang, E. Wang, N. Haber, L. Fei-Fei, J. B. Tenenbaum, and D. L. Yamins · 2018
Earlier work this paper cites.
Learning particle dynamics for manipulating rigid bodies, deformable objects, and fluids
Y. Li, J. Wu, R. Tedrake, J. B. Tenenbaum, and A. Torralba · 2018
Earlier work this paper cites.
Learning to decompose and disentangle representations for video prediction
J.-T. Hsieh, B. Liu, D.-A. Huang, L. Fei-Fei, and J. C. Niebles · 2018
Earlier work this paper cites.
Object-oriented dynamics predictor
G. Zhu, Z. Huang, and C. Zhang · 2018
Earlier work this paper cites.
Semi-infinite programming for trajectory optimization with non-convex obstacles
K. Hauser · 2018
Earlier work this paper cites.
A data-efficient approach to precise and controlled pushing
M. Bauza, F. R. Hogan, and A. Rodriguez · 2018
Earlier work this paper cites.
Perceiving and reasoning about liquids using fully convolutional networks
C. Schenck and D. Fox · 2018
Earlier work this paper cites.
Time-contrastive networks: Self-supervised learning from video
P. Sermanet, C. Lynch, Y. Chebotar, J. Hsu, E. Jang, S. Schaal, S. Levine, and G. Brain · 2018
Earlier work this paper cites.
Propagation networks for model-based control under partial observation
Y. Li, J. Wu, J.-Y. Zhu, J. B. Tenenbaum, A. Torralba, and R. Tedrake · 2019
Earlier work this paper cites.
Lagrangian fluid simulation with continuous convolutions
B. Ummenhofer, L. Prantl, N. Thuerey, and V. Koltun · 2019
Earlier work this paper cites.
Compositional video prediction
Y. Ye, M. Singh, A. Gupta, and S. Tulsiani · 2019
Earlier work this paper cites.
Clevrer: Collision events for video representation and reasoning
K. Yi, C. Gan, Y. Li, P. Kohli, J. Wu, A. Torralba, and J. B. Tenenbaum · 2019
Earlier work this paper cites.
Occupancy networks: Learning 3d reconstruction in function space
L. Mescheder, M. Oechsle, M. Niemeyer, S. Nowozin, and A. Geiger · 2019
Earlier work this paper cites.
Deepsdf: Learning continuous signed distance functions for shape representation
J. J. Park, P. Florence, J. Straub, R. Newcombe, and S. Lovegrove · 2019
Earlier work this paper cites.
Scene representation networks: Continuous 3d-structure-aware neural scene representations
V. Sitzmann, M. Zollhöfer, and G. Wetzstein · 2019
Earlier work this paper cites.
Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization
S. Saito, Z. Huang, R. Natsume, S. Morishima, A. Kanazawa, and H. Li · 2019
Cited alongside, same era.
Occupancy flow: 4d reconstruction by learning particle dynamics
M. Niemeyer, L. Mescheder, M. Oechsle, and A. Geiger · 2019
Cited alongside, same era.
Pushing revisited: Differential flatness, trajectory planning, and stabilization
J. Zhou, Y. Hou, and M. T. Mason · 2019
Cited alongside, same era.
Unsupervised learning of object keypoints for perception and control
T. D. Kulkarni, A. Gupta, C. Ionescu, S. Borgeaud, M. Reynolds, A. Zisserman, and V. Mnih · 2019
Cited alongside, same era.
Robot motion planning in learned latent spaces
B. Ichter and M. Pavone · 2019
Cited alongside, same era.
Nerf: Representing scenes as neural radiance fields for view synthesis
B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng · 2020
Unsupervised discovery of object radiance fields
H.-X. Yu, L. J. Guibas, and J. Wu · 2021
Later among the works it cites.
pixelnerf: Neural radiance fields from one or few images
A. Yu, V. Ye, M. Tancik, and A. Kanazawa · 2021
Later among the works it cites.
D-nerf: Neural radiance fields for dynamic scenes
A. Pumarola, E. Corona, G. Pons-Moll, and F. Moreno-Noguer · 2021
Later among the works it cites.
Nerfies: Deformable neural radiance fields
K. Park, U. Sinha, J. T. Barron, S. Bouaziz, D. B. Goldman, S. M. Seitz, and R. Martin-Brualla · 2021
Later among the works it cites.
Neural radiance flow for 4d view synthesis and video processing
Y. Du, Y. Zhang, H.-X. Yu, J. B. Tenenbaum, and J. Wu · 2021
Later among the works it cites.
H-nerf: Neural radiance fields for rendering and temporal reconstruction of humans in motion
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Visual grounding of learned physical models
Y. Li, T. Lin, K. Yi, D. Bear, D. Yamins, J. Wu, J. Tenenbaum, and A. Torralba · 2020
Cited alongside, same era.
Learning to simulate complex physics with graph networks
A. Sanchez-Gonzalez, J. Godwin, T. Pfaff, R. Ying, J. Leskovec, and P. Battaglia · 2020
Cited alongside, same era.
Learning mesh-based simulation with graph networks
T. Pfaff, M. Fortunato, A. Sanchez-Gonzalez, and P. W. Battaglia · 2020
Cited alongside, same era.
Learning long-term visual dynamics with region proposal interaction networks
H. Qi, X. Wang, D. Pathak, Y. Ma, and J. Malik · 2020
Cited alongside, same era.
3d-oes: Viewpoint-invariant object-factorized environment simulators
H.-Y. F. Tung, Z. Xian, M. Prabhudesai, S. Lal, and K. Fragkiadaki · 2020
Cited alongside, same era.
Convolutional occupancy networks
S. Peng, M. Niemeyer, L. Mescheder, M. Pollefeys, and A. Geiger · 2020
Cited alongside, same era.
H. Xu, T. Alldieck, and C. Sminchisescu · 2021
Later among the works it cites.
Hypernerf: A higher-dimensional representation for topologically varying neural radiance fields
K. Park, U. Sinha, P. Hedman, J. T. Barron, S. Bouaziz, D. B. Goldman, R. Martin-Brualla, and S. M. Seitz · 2021
Later among the works it cites.
Non-rigid neural radiance fields: Reconstruction and novel view synthesis of a dynamic scene from monocular video
E. Tretschk, A. Tewari, V. Golyanik, M. Zollhöfer, C. Lassner, and C. Theobalt · 2021
Later among the works it cites.
Neural scene flow fields for space-time view synthesis of dynamic scenes
Z. Li, S. Niklaus, N. Snavely, and O. Wang · 2021
Later among the works it cites.
Space-time neural irradiance fields for free-viewpoint video
W. Xian, J.-B. Huang, J. Kopf, and C. Kim · 2021
Later among the works it cites.
T. Li, M. Slavcheva, M. Zollhoefer, S. Green, C. Lassner, C. Kim, T. Schmidt, S. Lovegrove, M. Goesele, and Z. Lv · 2021
Later among the works it cites.
Synergies between affordance and geometry: 6-dof grasp detection via implicit representations
Z. Jiang, Y. Zhu, M. Svetlik, K. Fang, and Y. Zhu · 2021
Later among the works it cites.
Dex-nerf: Using a neural radiance field to grasp transparent objects
J. Ichnowski, Y. Avigal, J. Kerr, and K. Goldberg · 2021
Later among the works it cites.
Learning models as functionals of signed-distance fields for manipulation planning
D. Driess, J.-S. Ha, M. Toussaint, and R. Tedrake · 2021
Later among the works it cites.
Learning neural implicit functions as object representations for robotic manipulation
J.-S. Ha, D. Driess, and M. Toussaint · 2021
Later among the works it cites.
Giraffe: Representing scenes as compositional generative neural feature fields
M. Niemeyer and A. Geiger · 2021
Later among the works it cites.
Learning to solve sequential physical reasoning problems from a scene image
D. Driess, J.-S. Ha, and M. Toussaint · 2021
Later among the works it cites.
Learning to execute: Efficient learning of universal plan-conditioned policies in robotics
I. Schubert, D. Driess, O. S. Oguz, and M. Toussaint · 2021
Later among the works it cites.
Plasticinelab: A soft-body manipulation benchmark with differentiable physics
Z. Huang, Y. Hu, T. Du, S. Zhou, H. Su, J. B. Tenenbaum, and C. Gan · 2021
Later among the works it cites.
Kilonerf: Speeding up neural radiance fields with thousands of tiny mlps
C. Reiser, S. Peng, Y. Liao, and A. Geiger · 2021
Later among the works it cites.
Long-horizon multi-robot rearrangement planning for construction assembly
V. N. Hartmann, A. Orthey, D. Driess, O. S. Oguz, and M. Toussaint · 2021
Later among the works it cites.
Learning geometric reasoning and control for long-horizon tasks from visual input
D. Driess, J.-S. Ha, R. Tedrake, and M. Toussaint · 2021
Later among the works it cites.
DiffSDFSim: Differentiable rigid-body dynamics with implicit shapes
M. Strecke and J. Stueckler · 2021
Later among the works it cites.
3d neural scene representations for visuomotor control
Y. Li, S. Li, V. Sitzmann, P. Agrawal, and A. Torralba · 2022
Closest in time.
Underactuated Robotics: Algorithms for Walking, Running, Swimming, Flying, and Manipulation (Course Notes for MIT 6.832)
R. Tedrake · 2022
Closest in time.
Learn2assemble with structured representations and search for robotic architectural construction
N. Funk, G. Chalvatzaki, B. Belousov, and J. Peters · 2022
Closest in time.
Vision-only robot navigation in a neural radiance world
M. Adamkiewicz, T. Chen, A. Caccavale, R. Gardner, P. Culbertson, J. Bohg, and M. Schwager · 2022
Closest in time.
Implicit behavioral cloning
P. Florence, C. Lynch, A. Zeng, O. A. Ramirez, A. Wahid, L. Downs, A. Wong, J. Lee, I. Mordatch, and J. Tompson · 2022
Closest in time.
Virdo: Visio-tactile implicit representations of deformable objects
Y. Wi, P. Florence, A. Zeng, and N. Fazeli · 2022
Closest in time.