ViTaMIn: Learning Contact-Rich Tasks Through Robot-Free Visuo-Tactile Manipulation Interface

K. Hosoda, K. Igarashi, and M. Asada, “Adaptive hybrid visual servoing/force control in unknown environment,” in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS’96 , vol. 3. IEEE, 1996, pp. 1097–1103

1996

Earlier work this paper cites.

H. Nakagaki, K. Kitagaki, T. Ogasawara, and H. Tsukune, “Study of deformation and insertion tasks of a flexible wire,” in Proceedings of International Conference on Robotics and Automation , vol. 3. IEEE, 1997, pp. 2397–2402

1997

Earlier work this paper cites.

P. Miller and P. Leibowitz, “Integration of vision, force and tactile sensing for grasping,” Int. J. Intell. Mach , vol. 4, pp. 129–149, 1999

1999

Earlier work this paper cites.

O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part III 18 . Springer, 2015, pp. 234–241

2015

Earlier work this paper cites.

S. Levine, C. Finn, T. Darrell, and P. Abbeel, “End-to-end training of deep visuomotor policies,” Journal of Machine Learning Research , vol. 17, no. 39, pp. 1–40, 2016

2016

Earlier work this paper cites.

A. Nagabandi, G. Kahn, S. Levine, and C. Finn, “Deep reinforcement learning for vision-based robotic control with multimodal inputs,” in Conference on Robot Learning (CoRL) , 2020

2020

Earlier work this paper cites.

J. Song, C. Meng, and S. Ermon, “Denoising diffusion implicit models,” arXiv preprint arXiv:2010.02502 , 2020

Original

2020

Earlier work this paper cites.

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark et al. , “Learning transferable visual models from natural language supervision,” in International conference on machine learning . PMLR, 2021, pp. 8748–8763

2021

Earlier work this paper cites.

A. Brohan, N. Brown, J. Carbajal, Y. Chebotar, J. Dabis, C. Finn, K. Gopalakrishnan, K. Hausman, A. Herzog, J. Hsu et al. , “Rt-1: Robotics transformer for real-world control at scale,” arXiv preprint arXiv:2212.06817 , 2022

Original

2022

Earlier work this paper cites.

S. Nair, A. Rajeswaran, V. Kumar, C. Finn, and A. Gupta, “R3m: A universal visual representation for robot manipulation,” in Proceedings of The 6th Conference on Robot Learning (CoRL) , vol. 205. PMLR, 2022, pp. 892–909

2022

Earlier work this paper cites.

T. Xiao, I. Radosavovic, T. Darrell, and J. Malik, “Masked visual pre-training for motor control,” arXiv:2203.06173 , 2022

Original

2022

Earlier work this paper cites.

K. He, X. Chen, S. Xie, Y. Li, P. Dollár, and R. Girshick, “Masked autoencoders are scalable vision learners,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2022, pp. 16 000–16 009

2022

Earlier work this paper cites.

X. Zhang and et al., “Fusing multimodal sensory data for robotic perception,” IEEE Transactions on Robotics , 2022

2022

Earlier work this paper cites.

A. Brohan, N. Brown, J. Carbajal, Y. Chebotar, X. Chen, K. Choromanski, T. Ding, D. Driess, A. Dubey, C. Finn et al. , “Rt-2: Vision-language-action models transfer web knowledge to robotic control,” arXiv preprint arXiv:2307.15818 , 2023

Original

2023

Earlier work this paper cites.

C. Chi, S. Feng, Y. Du, Z. Xu, E. Cousineau, B. Burchfiel, and S. Song, “Diffusion policy: Visuomotor policy learning via action diffusion,” arXiv preprint arXiv:2303.04137 , 2023

Original

2023

Cited alongside, same era.

T. Z. Zhao, V. Kumar, S. Levine, and C. Finn, “Learning fine-grained bimanual manipulation with low-cost hardware,” arXiv preprint arXiv:2304.13705 , 2023

Original

2023

Cited alongside, same era.

Y. Qin, W. Yang, B. Huang, K. Van Wyk, H. Su, X. Wang, Y.-W. Chao, and D. Fox, “Anyteleop: A general vision-based dexterous robot arm-hand teleoperation system,” arXiv preprint arXiv:2307.04577 , 2023

Original

2023

Cited alongside, same era.

F. Sanches, G. Gao, N. Elangovan, R. V. Godoy, J. Chapman, K. Wang, P. Jarvis, and M. Liarokapis, “Scalable. intuitive human to robot skill transfer with wearable human machine interfaces: On complex, dexterous tasks,” in 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2023, pp. 6318–6325

X. Cheng, J. Li, S. Yang, G. Yang, and X. Wang, “Open-television: Teleoperation with immersive active visual feedback,” arXiv preprint arXiv:2407.01512 , 2024

Original

2024

Later among the works it cites.

C. Chi, Z. Xu, C. Pan, E. Cousineau, B. Burchfiel, S. Feng, R. Tedrake, and S. Song, “Universal manipulation interface: In-the-wild robot teaching without in-the-wild robots,” arXiv preprint arXiv:2402.10329 , 2024

Original

2024

Later among the works it cites.

Y. Han, K. Yu, R. Batra, N. Boyd, C. Mehta, T. Zhao, Y. She, S. Hutchinson, and Y. Zhao, “Learning generalizable vision-tactile robotic grasping strategy for deformable objects via transformer,” IEEE/ASME Transactions on Mechatronics , 2024

2024

Later among the works it cites.

R. Bhirangi, V. Pattabiraman, E. Erciyes, Y. Cao, T. Hellebrekers, and L. Pinto, “Anyskin: Plug-and-play skin sensing for robotic touch,” arXiv preprint arXiv:2409.08276 , 2024

Original

2024

Later among the works it cites.