Fetching the paper…
Reading the bibliography…
Humans rely on the synergy of their senses for most essential tasks.
Spatial attention and crossmodal interactions between vision and touch
Emiliano Macaluso and Jon Driver · 2001
Earlier work this paper cites.
Approximately optimal approximate reinforcement learning
Sham Kakade and John Langford · 2002
Earlier work this paper cites.
Neural synergy between kinetic vision and touch
Randolph Blake, Kenith V Sobel, and Thomas W James · 2004
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, Pierre-Antoine Manzagol, and Léon Bottou · 2010
Earlier work this paper cites.
Olfaction modulates visual perception in binocular rivalry
Wen Zhou, Yi Jiang, Sheng He, and Denise Chen · 2010
Earlier work this paper cites.
Mujoco: A physics engine for model-based control
Emanuel Todorov, Tom Erez, and Yuval Tassa · 2012
Earlier work this paper cites.
Learning robot tactile sensing for object manipulation
Yevgen Chebotar, Oliver Kroemer, and Jan Peters · 2014
Earlier work this paper cites.
Towards vision-based deep reinforcement learning for robotic motion control
Fangyi Zhang, Jürgen Leitner, Michael Milford, Ben Upcroft, and Peter Corke · 2015
Earlier work this paper cites.
Context encoders: Feature learning by inpainting
Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, and Alexei A Efros · 2016
Earlier work this paper cites.
High-dimensional continuous control using generalized advantage estimation
John Schulman, Philipp Moritz, Sergey Levine, Michael Jordan, and Pieter Abbeel · 2016
Earlier work this paper cites.
Stable reinforcement learning with autoencoders for tactile and visual data
Herke Van Hoof, Nutan Chen, Maximilian Karl, Patrick van der Smagt, and Jan Peters · 2016
Earlier work this paper cites.
Proximal policy optimization algorithms
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Gelsight: High-resolution robot tactile sensors for estimating geometry and force
Wenzhen Yuan, Siyuan Dong, and Edward H Adelson · 2017
Earlier work this paper cites.
Scalable deep reinforcement learning for vision-based robotic manipulation
Dmitry Kalashnikov, Alex Irpan, Peter Pastor, Julian Ibarz, Alexander Herzog, Eric Jang, Deirdre Quillen, Ethan Holly, Mrinal Kalakrishnan, Vincent Vanhoucke, et al · 2018
Earlier work this paper cites.
Multi-goal reinforcement learning: Challenging robotics environments and request for research
Matthias Plappert, Marcin Andrychowicz, Alex Ray, Bob McGrew, Bowen Baker, Glenn Powell, Jonas Schneider, Josh Tobin, Maciek Chociej, Peter Welinder, Vikash Kumar, and Wojciech Zaremba · 2018
Earlier work this paper cites.
Reinforcement learning: An introduction
Richard S Sutton and Andrew G Barto · 2018
Earlier work this paper cites.
The tactip family: Soft optical tactile sensors with 3d-printed biomimetic morphologies
Benjamin Ward-Cherrier, Nicholas Pestell, Luke Cramphorn, Benjamin Winstone, Maria Elena Giannaccini, Jonathan Rossiter, and Nathan F Lepora · 2018
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019
Earlier work this paper cites.
Tactile-based insertion for dense box-packing
Siyuan Dong and Alberto Rodriguez · 2019
Earlier work this paper cites.
See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusion
Nima Fazeli, Miquel Oller, Jiajun Wu, Zheng Wu, Joshua B Tenenbaum, and Alberto Rodriguez · 2019
Cited alongside, same era.
Learning gentle object manipulation with curiosity-driven deep reinforcement learning
Sandy H Huang, Martina Zambelli, Jackie Kay, Murilo F Martins, Yuval Tassa, Patrick M Pilarski, and Raia Hadsell · 2019
Cited alongside, same era.
Sim-to-real via sim-to-sim: Data-efficient robotic grasping via randomized-to-canonical adaptation networks
Stephen James, Paul Wohlhart, Mrinal Kalakrishnan, Dmitry Kalashnikov, Alex Irpan, Julian Ibarz, Sergey Levine, Raia Hadsell, and Konstantinos Bousmalis · 2019
Cited alongside, same era.
Making sense of vision and touch: Self-supervised learning of multimodal representations for contact-rich tasks
Michelle A Lee, Yuke Zhu, Krishnan Srinivasan, Parth Shah, Silvio Savarese, Li Fei-Fei, Animesh Garg, and Jeannette Bohg · 2019
Cited alongside, same era.
Dense tactile force estimation using gelslim and inverse fem
Using tactile sensing to improve the sample efficiency and performance of deep deterministic policy gradients for simulated in-hand manipulation tasks
Andrew Melnik, Luca Lach, Matthias Plappert, Timo Korthals, Robert Haschke, and Helge Ritter · 2021
Later among the works it cites.
Cable manipulation with a tactile-reactive gripper
Yu She, Shaoxiong Wang, Siyuan Dong, Neha Sunil, Alberto Rodriguez, and Edward Adelson · 2021
Later among the works it cites.
Multimodal masked autoencoders learn transferable representations
Xinyang Geng, Hao Liu, Lisa Lee, Dale Schuurams, Sergey Levine, and Pieter Abbeel · 2022
Later among the works it cites.
Ego4d: Around the world in 3,000 hours of egocentric video
Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, et al · 2022
Later among the works it cites.
Visuotactile-rl: Learning multimodal manipulation policies with deep reinforcement learning
Johanna Hansen, Francois Hogan, Dmitriy Rivkin, David Meger, Michael Jenkin, and Gregory Dudek · 2022
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Daolin Ma, Elliott Donlon, Siyuan Dong, and Alberto Rodriguez · 2019
Cited alongside, same era.
Design, motivation and evaluation of a full-resolution optical tactile sensor
Carmelo Sferrazza and Raffaello D’Andrea · 2019
Cited alongside, same era.
Tactile image sensors employing camera: A review
Kazuhiro Shimonomura · 2019
Cited alongside, same era.
Learning latent space dynamics for tactile servoing
Giovanni Sutanto, Nathan Ratliff, Balakumar Sundaralingam, Yevgen Chebotar, Zhe Su, Ankur Handa, and Dieter Fox · 2019
Cited alongside, same era.
Mat: Multi-fingered adaptive tactile grasping via deep reinforcement learning
Bohan Wu, Iretiayo Akinola, Jacob Varley, and Peter Allen · 2019
Cited alongside, same era.
Recent progress in tactile sensing and sensors for robotic manipulation: can we turn tactile sensing into vision?
Akihiko Yamaguchi and Christopher G Atkeson · 2019
Cited alongside, same era.
Visuotactile sensors with emphasis on gelsight sensor: A review
Alexander C Abad and Anuradha Ranasinghe · 2020
Cited alongside, same era.
Deep reinforcement learning for tactile robotics: Learning to type on a braille keyboard
Alex Church, John Lloyd, Raia Hadsell, and Nathan F Lepora · 2020
Cited alongside, same era.
Later among the works it cites.
Masked autoencoders are scalable vision learners
Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick · 2022
Later among the works it cites.
Justin Kerr, Huang Huang, Albert Wilcox, Ryan Hoque, Jeffrey Ichnowski, Roberto Calandra, and Ken Goldberg · 2022
Later among the works it cites.
Active extrinsic contact sensing: Application to general peg-in-hole insertion
Sangwoon Kim and Alberto Rodriguez · 2022
Later among the works it cites.
See, hear, and feel: Smart sensory fusion for robotic manipulation
Hao Li, Yizhi Zhang, Junzhe Zhu, Shaoxiong Wang, Michelle A. Lee, Huazhe Xu, Edward Adelson, Li Fei-Fei, Ruohan Gao, and Jiajun Wu · 2022
Later among the works it cites.
Tactile gym 2.0: Sim-to-real deep reinforcement learning for comparing low-cost high-resolution robot touch
Yijiong Lin, John Lloyd, Alex Church, and Nathan F Lepora · 2022
Later among the works it cites.
Instruction-following agents with jointly pre-trained vision-language models
Hao Liu, Lisa Lee, Kimin Lee, and Pieter Abbeel · 2022
Later among the works it cites.
MuJoCo Menagerie: A collection of high-quality simulation models for MuJoCo, 2022
MuJoCo Menagerie Contributors · 2022
Later among the works it cites.
A biomimetic elastomeric robot skin using electrical impedance and acoustic tomography for tactile sensing
K Park, H Yuk, M Yang, J Cho, H Lee, and Jung Kim · 2022
Later among the works it cites.
Visual-tactile multimodality for following deformable linear objects using reinforcement learning
Leszek Pecyna, Siyuan Dong, and Shan Luo · 2022
Later among the works it cites.
Sim-to-real for high-resolution optical tactile sensing: From images to three-dimensional contact force distributions
Carmelo Sferrazza and Raffaello D’Andrea · 2022
Later among the works it cites.
Masked visual pre-training for motor control
Tete Xiao, Ilija Radosavovic, Trevor Darrell, and Jitendra Malik · 2022
Later among the works it cites.
Learning visual robotic control efficiently with contrastive pre-training and data augmentation
Albert Zhan, Ruihan Zhao, Lerrel Pinto, Pieter Abbeel, and Michael Laskin · 2022
Later among the works it cites.
Lunwei Zhang, Yue Wang, and Yao Jiang · 2022
Later among the works it cites.
Real-world robot learning with masked visual pre-training
Ilija Radosavovic, Tete Xiao, Stephen James, Pieter Abbeel, Jitendra Malik, and Trevor Darrell · 2023
Closest in time.
Efficient tactile simulation with differentiability for robotic manipulation
Jie Xu, Sangwoon Kim, Tao Chen, Alberto Rodriguez Garcia, Pulkit Agrawal, Wojciech Matusik, and Shinjiro Sueda · 2023
Closest in time.