2016

To Fall Or Not To Fall: A Visual Approach to Physical Stability Prediction

Li, Wenbin, Azimi, Seyedmajid, Leonardis, Aleš et al.

Understand

Understanding physical phenomena is a key competence that enables humans and animals to act and interact under uncertain perception in previously unseen environments containing novel object and their configurations.

Developmental psychology has shown that such skills are acquired by infants from observations at a very early stage.
In this paper, we contrast a more traditional approach of taking a model-based route with explicit 3D representations and physical simulation by an end-to-end approach that directly predicts stability and related quantities from appearance.
We ask the question if and to what extent and quality such a skill can directly be acquired in a data-driven way bypassing the need for an explicit simulation.

Built on

McCloskey, M.: Intuitive physics. Scientific american (1983)
1983
Earlier work this paper cites.
Baillargeon, R.: How do infants learn about the physical world? Current Directions in Psychological Science (1994)
1994
Earlier work this paper cites.
Smith, B., Casati, R.: Naive Physics: An Essay in Ontology. Philosophical Psychology (1994)
1994
Earlier work this paper cites.
Baillargeon, R.: A model of physical reasoning in infancy. Advances in infancy research (1995)
1995
Earlier work this paper cites.
LeCun, Y., Jackel, L., Bottou, L., Brunot, A., Cortes, C., Denker, J., Drucker, H., Guyon, I., Muller, U., Sackinger, E., et al.: Comparison of learning algorithms for handwritten digit recognition. In: International conference on artificial neural networks (1995)
1995
Earlier work this paper cites.
Baillargeon, R.: The acquisition of physical knowledge in infancy: A summary in eight lessons. Blackwell handbook of childhood cognitive development (2002)
2002
Earlier work this paper cites.
Goslin, M., Mine, M.R.: The panda3d graphics engine. Computer (2004)
2004
Earlier work this paper cites.
Baillargeon, R.: Innate ideas revisited: For a principle of persistence in infants’ physical reasoning. Perspectives on Psychological Science (2008)
2008
Earlier work this paper cites.
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: CVPR (2009)
2009
Earlier work this paper cites.
Coumans, E.: Bullet physics engine. Open Source Software: http://bulletphysics. org 1 (2010)
2010
Earlier work this paper cites.
Gupta, A., Efros, A.A., Hebert, M.: Blocks world revisited: Image understanding using qualitative geometry and mechanics. In: ECCV (2010)
2010
Earlier work this paper cites.

Similar

Hamrick, J., Battaglia, P., Tenenbaum, J.B.: Internal physics models guide probabilistic judgments about object dynamics. In: Proceedings of the 33rd annual conference of the cognitive science society. Cognitive Science Society Austin, TX (2011)
2011
Cited alongside, same era.
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: NIPS (2012)
2012
Cited alongside, same era.
Li, W., Fritz, M.: Recognizing materials from virtual examples. In: ECCV (2012)
2012
Cited alongside, same era.
MacDougal, D.W.: Galileo’s great discovery: How things fall. In: Newton’s Gravity. Springer (2012)
2012
Cited alongside, same era.
Silberman, N., Hoiem, D., Kohli, P., Fergus, R.: Indoor segmentation and support inference from rgbd images. In: ECCV (2012)
2012
Cited alongside, same era.
Battaglia, P.W., Hamrick, J.B., Tenenbaum, J.B.: Simulation as an engine of physical scene understanding. Proceedings of the National Academy of Sciences (2013)
2013
Cited alongside, same era.
Cholewiak, S.A., Fleming, R.W., Singh, M.: Visual perception of the physical stability of asymmetric three-dimensional objects. Journal of vision (2013)
2013
Cited alongside, same era.
Xie, D., Todorovic, S., Zhu, S.C.: Inferring ”dark matter” and ”dark energy” from videos. In: ICCV (2013)
2013
Cited alongside, same era.
Zheng, B., Zhao, Y., Yu, J., Ikeuchi, K., Zhu, S.C.: Beyond point clouds: Scene understanding by reasoning geometry and physics. In: CVPR (2013)
2013
Cited alongside, same era.
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., Darrell, T.: Caffe: Convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia. ACM (2014)
2014
Cited alongside, same era.

Then

Razavian, A., Azizpour, H., Sullivan, J., Carlsson, S.: Cnn features off-the-shelf: an astounding baseline for recognition. In: CVPR workshops (2014)
2014
Later among the works it cites.
Rematas, K., Ritschel, T., Fritz, M., Tuytelaars, T.: Image-based synthesis and re-synthesis of viewpoints guided by 3d models. In: CVPR (2014)
2014
Later among the works it cites.
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Original
2014
Later among the works it cites.
Cholewiak, S.A., Fleming, R.W., Singh, M.: Perception of physical stability and center of mass of 3-d objects. Journal of vision (2015)
2015
Later among the works it cites.
Fragkiadaki, K., Agrawal, P., Levine, S., Malik, J.: Learning visual predictive models of physics for playing billiards. arXiv preprint arXiv:1511.07404 (2015)
Original
2015
Later among the works it cites.
Mottaghi, R., Bagherinezhad, H., Rastegari, M., Farhadi, A.: Newtonian image understanding: Unfolding the dynamics of objects in static images. arXiv preprint arXiv:1511.04048 (2015)
Original
2015
Later among the works it cites.
Peng, X., Sun, B., Ali, K., Saenko, K.: Learning deep object detectors from 3d models. In: ICCV (2015)
2015
Later among the works it cites.
Wu, J., Yildirim, I., Lim, J.J., Freeman, B., Tenenbaum, J.: Galileo: Perceiving physical object properties by integrating a physics engine with deep learning. In: NIPS (2015)
2015
Later among the works it cites.
Lerer, A., Gross, S., Fergus, R.: Learning physical intuition of block towers by example. arXiv preprint arXiv:1603.01312 (2016)
Original
2016
Closest in time.
Rematas, K., Ritschel, T., Fritz, M., Gavves, E., Tuytelaars, T.: Deep reflectance maps. In: CVPR (2016)
2016
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…