2019

Interactive Gibson Benchmark (iGibson 0.5): A Benchmark for Interactive Navigation in Cluttered Environments

Xia, Fei, Shen, William B., Li, Chengshu et al.

Understand

We present Interactive Gibson Benchmark, the first comprehensive benchmark for training and evaluating Interactive Navigation: robot navigation strategies where physical interaction with objects is allowed and even encouraged to accomplish a task.

For example, the robot can move objects if needed in order to clear a path leading to the goal location.
Our benchmark comprises two novel elements: 1) a new experimental setup, the Interactive Gibson Environment (iGibson 0.5), which simulates high fidelity visuals of indoor scenes, and high fidelity physical dynamics of the robot and common objects found in these scenes; 2) a set of Interactive Navigation metrics which allows one to study the interplay between navigation and physical interaction.
We present and evaluate multiple learning-based baselines in Interactive Gibson, and provide insights into regimes of navigation with different trade-offs between navigation path efficiency and disturbance of surrounding objects.

Built on

M. A. Fischler and R. C. Bolles, “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,”
1981
Earlier work this paper cites.
T. Braunl, “Research relevance of mobile robot competitions,”
1999
Earlier work this paper cites.
L. Peterson, D. Austin, and D. Kragic, “High-level control of a mobile manipulator for door opening,” in
2000
Earlier work this paper cites.
H. Shum and S. B. Kang, “Review of image-based rendering techniques,” in
2000
Earlier work this paper cites.
T. Balch and H. Yanco, “Ten years of the aaai mobile robot competition and exhibition,”
2002
Earlier work this paper cites.
K. Suzuki, I. Horiba, and N. Sugie, “Linear-time connected-component labeling based on sequential local operations,”
2003
Earlier work this paper cites.
N. Koenig and A. Howard, “Design and use paradigms for gazebo, an open-source multi-robot simulator,” in
2004
Earlier work this paper cites.
M. Stilman and J. J. Kuffner, “Navigation among movable obstacles: Real-time reasoning in complex environments,”
2005
Earlier work this paper cites.
A. P. del Pobil, R. Madhavan, and E. Messina, “Benchmarks in robotics research,” in
2006
Earlier work this paper cites.
K. Iagnemma and M. Buehler, “Editorial for journal of field robotics—special issue on the darpa grand challenge,”
2006
Earlier work this paper cites.
B. Siciliano and O. Khatib,
2007
Earlier work this paper cites.
A. Petrovskaya and A. Y. Ng, “Probabilistic mobile manipulation in dynamic environments, with application to opening doors.” in
2007
Earlier work this paper cites.
U. Ozguner, C. Stiller, and K. Redmill, “Systems for safety and autonomous behavior in cars: The darpa grand challenge experience,”
2007
Earlier work this paper cites.
N. Munoz, J. Valencia, and N. Londono, “Evaluation of navigation of an autonomous mobile robot,” in
2007
Earlier work this paper cites.
F. Bonin-Font, A. Ortiz, and G. Oliver, “Visual navigation for mobile robots: A survey,”
2008
Earlier work this paper cites.
A. J. Schmid, N. Gorges, D. Goger, and H. Worn, “Opening a door with a humanoid robot using multi-sensory tactile feedback,” in
2008
Earlier work this paper cites.
M. Stilman and J. Kuffner, “Planning among movable obstacles with artificial constraints,”
2008
Earlier work this paper cites.
P. Cignoni
2008
Earlier work this paper cites.

Similar

A. Jain and C. C. Kemp, “Behavior-based door opening with equilibrium point control,” Georgia Institute of Technology, Tech. Rep., 2009
2009
Cited alongside, same era.
W. Nowak, A. Zakharov, S. Blumenthal, and E. Prassler, “Benchmarks for mobile manipulation and robust obstacle avoidance and navigation,”
2010
Cited alongside, same era.
N. D. M. Ceballos, J. A. Valencia, and N. L. Ospina,
2010
Cited alongside, same era.
M. Buhrmester, T. Kwang, and S. D. Gosling, “Amazon’s mechanical turk: A new source of inexpensive, yet high-quality, data?”
2011
Cited alongside, same era.
A. Sengupta, T. Chakraborti, A. Konar, and A. Nagar, “Energy efficient trajectory planning by a robot arm using invasive weed optimization technique,” in
2011
Cited alongside, same era.
E. Todorov, T. Erez, and Y. Tassa, “Mujoco: A physics engine for model-based control,” in
2012
Cited alongside, same era.
E. Coumans
2013
Cited alongside, same era.
M. Levihn, J. Scholz, and M. Stilman, “Hierarchical decision theoretic planning for navigation among movable obstacles,” in
2013
Cited alongside, same era.
A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, “Vision meets robotics: The kitti dataset,”
2013
Cited alongside, same era.
A. Mohammed, B. Schmidt, L. Wang, and L. Gao, “Minimizing energy consumption for robot arm movement,”
2014
Cited alongside, same era.
A. X. Chang
Original
2015
Cited alongside, same era.
T. P. Lillicrap
Original
2016
Cited alongside, same era.

Then

I. Armeni, S. Sax, A. R. Zamir, and S. Savarese, “Joint 2d-3d-semantic data for indoor scene understanding,”
Original
2017
Later among the works it cites.
S. Gupta, J. Davidson, S. Levine, R. Sukthankar, and J. Malik, “Cognitive mapping and planning for visual navigation,” in
2017
Later among the works it cites.
J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,”
Original
2017
Later among the works it cites.
D. Pickem, P. Glotfelter, L. Wang, M. Mote, A. Ames, E. Feron, and M. Egerstedt, “The robotarium: A remotely accessible swarm robotics research testbed,” in
2017
Later among the works it cites.
M. Savva, A. X. Chang, A. Dosovitskiy, T. Funkhouser, and V. Koltun, “Minos: Multimodal indoor simulator for navigation in complex environments,”
Original
2017
Later among the works it cites.
F. Xia, A. R. Zamir, Z. He, A. Sax, J. Malik, and S. Savarese, “Gibson env: Real-world perception for embodied agents,” in
2018
Later among the works it cites.
A. Juliani, V.-P. Berges, E. Vckay, Y. Gao, H. Henry, M. Mattar, and D. Lange, “Unity: A general platform for intelligent agents,”
Original
2018
Later among the works it cites.
P. Anderson
Original
2018
Later among the works it cites.
T. Haarnoja
Original
2018
Later among the works it cites.
Sergio Guadarrama and others, “TF-Agents: A library for reinforcement learning in tensorflow,”
2018
Later among the works it cites.
Manolis Savva, Abhishek Kadian, Oleksandr Maksymets
2019
Closest in time.
N. Hirose, F. Xia, R. Martín-Martín, A. Sadeghian, and S. Savarese, “Deep visual mpc-policy learning for navigation,”
2019
Closest in time.
E. Li, R. Martín-Martín, F. Xia, and S. Savarese, “Hrl4in: Hierarchical reinforcement learning forinteractive navigation with mobile manipulators,” in
2019
Closest in time.
X. Gao, R. Gong, T. Shu, X. Xie, S. Wang, and S.-C. Zhu, “Vrkitchen: an interactive 3d virtual environment for task-oriented learning,”
Original
2019
Closest in time.
Y. Urakami, A. Hodgkinson, C. Carlin, R. Leu, L. Rigazio, and P. Abbeel, “Doorgym: A scalable door opening environment and baseline agent,”
Original
2019
Closest in time.
K. Kang, S. Belkhale, G. Kahn, P. Abbeel, and S. Levine, “Generalization through simulation: Integrating simulated and real data into deep reinforcement learning for vision-based autonomous flight,”
2019
Closest in time.
C. Choy, J. Gwak, and S. Savarese, “4d spatio temporal convnet: Minkowski convolutional neural networks,” in
2019
Closest in time.
A. Avetisyan
2019
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…