Fetching the paper…
Reading the bibliography…
We present an approach to learn general robot manipulation priors from 3D hand-object interaction trajectories.
Implementing a force strategy for object re-orientation
R. Fearing · 1986
Earlier work this paper cites.
On the limited memory bfgs method for large scale optimization
D. C. Liu and J. Nocedal · 1989
Earlier work this paper cites.
Dextrous manipulation by rolling and finger gaiting
L. Han and J. C. Trinkle · 1998
Earlier work this paper cites.
An overview of dexterous manipulation
A. M. Okamura, N. Smaby, and M. R. Cutkosky · 2000
Earlier work this paper cites.
Human hand function
L. A. Jones and S. J. Lederman · 2006
Earlier work this paper cites.
The NLopt nonlinear-optimization package
S. G. Johnson · 2007
Earlier work this paper cites.
Hand posture subspaces for dexterous robotic grasping
M. T. Ciocarlie and P. K. Allen · 2009
Earlier work this paper cites.
Allegrohand
WonikRobotics · 2013
Earlier work this paper cites.
Robot learning manipulation action plans by” watching” unconstrained videos from the world wide web
Y. Yang, Y. Li, C. Fermuller, and Y. Aloimonos · 2015
Earlier work this paper cites.
Retargeting human-object interaction to virtual avatars
Y. Kim, H. Park, S. Bang, and S.-H. Lee · 2016
Earlier work this paper cites.
Unsupervised learning for physical interaction through video prediction
C. Finn, I. Goodfellow, and S. Levine · 2016
Earlier work this paper cites.
Attention is all you need
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin · 2017
Earlier work this paper cites.
Proximal policy optimization algorithms
J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov · 2017
Earlier work this paper cites.
Learning complex dexterous manipulation with deep reinforcement learning and demonstrations
A. Rajeswaran, V. Kumar, A. Gupta, G. Vezzani, J. Schulman, E. Todorov, and S. Levine · 2017
Earlier work this paper cites.
Learning robot activities from first-person human videos using convolutional future regression
J. Lee and M. S. Ryoo · 2017
Earlier work this paper cites.
Yale-cmu-berkeley dataset for robotic manipulation research
B. Calli, A. Singh, J. Bruce, A. Walsman, K. Konolige, S. Srinivasa, P. Abbeel, and A. M. Dollar · 2017
Earlier work this paper cites.
Sfv: Reinforcement learning of physical skills from videos
X. B. Peng, A. Kanazawa, J. Malik, P. Abbeel, and S. Levine · 2018
Earlier work this paper cites.
Translating videos to commands for robotic manipulation with deep recurrent neural networks
A. Nguyen, D. Kanoulas, L. Muratore, D. G. Caldwell, and N. G. Tsagarakis · 2018
Earlier work this paper cites.
Deepdynamichand: a deep neural architecture for labeling hand manipulation strategies in video sources exploiting temporal information
V. Arapi, C. Della Santina, D. Bacciu, M. Bianchi, and A. Bicchi · 2018
Earlier work this paper cites.
One-shot imitation from observing humans via domain-adaptive meta-learning
T. Yu, C. Finn, A. Xie, S. Dasari, T. Zhang, P. Abbeel, and S. Levine · 2018
Earlier work this paper cites.
Language models are unsupervised multitask learners
A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever, et al · 2019
Earlier work this paper cites.
H+O: Unified egocentric recognition of 3d hand-object poses and interactions
B. Tekin, F. Bogo, and M. Pollefeys · 2019
Earlier work this paper cites.
Learning joint reconstruction of hands and manipulated objects
Y. Hasson, G. Varol, D. Tzionas, I. Kalevatykh, M. J. Black, I. Laptev, and C. Schmid · 2019
Earlier work this paper cites.
Decoupled weight decay regularization
I. Loshchilov and F. Hutter · 2019
Earlier work this paper cites.
Robot eye-hand coordination learning by watching human demonstrations: a task function approximation approach
J. Jin, L. Petrich, M. Dehghan, Z. Zhang, and M. Jagersand · 2019
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova · 2019
Earlier work this paper cites.
Learning dexterous in-hand manipulation
OpenAI, M. Andrychowicz, B. Baker, M. Chociej, R. Józefowicz, B. McGrew, J. Pachocki, A. Petron, M. Plappert, G. Powell, A. Ray, J. Schneider, S. Sidor, J. Tobin, P. Welinder, L. Weng, and W. Zaremba · 2019
Earlier work this paper cites.
Solving rubik’s cube with a robot hand
OpenAI, I. Akkaya, M. Andrychowicz, M. Chociej, M. Litwin, B. McGrew, A. Petron, A. Paino, M. Plappert, G. Powell, R. Ribas, J. Schneider, N. Tezak, J. Tworek, P. Welinder, L. Weng, Q. Yuan, W. Zaremba, and L. Zhang · 2019
Earlier work this paper cites.
Generative pretraining from pixels
M. Chen, A. Radford, R. Child, J. Wu, H. Jun, D. Luan, and I. Sutskever · 2020
Earlier work this paper cites.
Understanding human hands in contact at internet scale
D. Shan, J. Geng, M. Shu, and D. F. Fouhey · 2020
Earlier work this paper cites.
An image is worth 16x16 words: Transformers for image recognition at scale
A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, et al · 2020
Earlier work this paper cites.
Avid: Learning multi-stage tasks via pixel-level translation of human videos
L. Smith, N. Dhawan, M. Zhang, P. Abbeel, and S. Levine · 2020
Cited alongside, same era.
Reconstructing hand-object interactions in the wild
Z. Cao, I. Radosavovic, A. Kanazawa, and J. Malik · 2021
Cited alongside, same era.
Isaac gym: High performance gpu-based physics simulation for robot learning
V. Makoviychuk, L. Wawrzyniak, Y. Guo, M. Lu, K. Storey, M. Macklin, D. Hoeller, N. Rudin, A. Allshire, A. Handa, and G. State · 2021
Cited alongside, same era.
Dexycb: A benchmark for capturing hand grasping of objects
Y.-W. Chao, W. Yang, Y. Xiang, P. Molchanov, A. Handa, J. Tremblay, Y. S. Narang, K. V. Wyk, U. Iqbal, S. Birchfield, J. Kautz, and D. Fox · 2021
Cited alongside, same era.
Decision transformer: Reinforcement learning via sequence modeling
L. Chen, K. Lu, A. Rajeswaran, K. Lee, A. Grover, M. Laskin, P. Abbeel, A. Srinivas, and I. Mordatch · 2021
Cited alongside, same era.
Contact edit: Artist tools for intuitive modeling of hand-object interactions
A. S. Lakshmipathy, N. Feng, Y. X. Lee, M. Mahler, and N. Pollard · 2023
Later among the works it cites.
Pre-training for robots: Offline rl enables learning new tasks from a handful of trials
A. Kumar, A. Singh, F. Ebert, M. Nakamoto, Y. Yang, C. Finn, and S. Levine · 2023
Later among the works it cites.
Dexpbt: Scaling up dexterous manipulation for hand-arm systems with population based training
A. Petrenko, A. Allshire, G. State, A. Handa, and V. Makoviychuk · 2023
Later among the works it cites.
Pirlnav: Pretraining with imitation and rl finetuning for objectnav
R. Ramrakhya, D. Batra, E. Wijmans, and A. Das · 2023
Later among the works it cites.
Zero-shot robot manipulation from passive human videos
H. Bharadhwaj, A. Gupta, S. Tulsiani, and V. Kumar · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
X. B. Peng, Z. Ma, P. Abbeel, S. Levine, and A. Kanazawa · 2021
Cited alongside, same era.
Masked autoencoders are scalable vision learners
K. He, X. Chen, S. Xie, Y. Li, P. Dollár, and R. Girshick · 2022
Cited alongside, same era.
Real-world robot learning with masked visual pre-training
I. Radosavovic, T. Xiao, S. James, P. Abbeel, J. Malik, and T. Darrell · 2022
Cited alongside, same era.
R3m: A universal visual representation for robot manipulation
S. Nair, A. Rajeswaran, V. Kumar, C. Finn, and A. Gupta · 2022
Cited alongside, same era.
Videodex: Learning dexterity from internet videos
K. Shaw, S. Bahl, and D. Pathak · 2022
Cited alongside, same era.
Learning to imitate object interactions from internet videos
A. Patel, A. Wang, I. Radosavovic, and J. Malik · 2022
Cited alongside, same era.
Dexmv: Imitation learning for dexterous manipulation from human videos
Y. Qin, Y.-H. Wu, S. Liu, H. Jiang, R. Yang, Y. Fu, and X. Wang · 2022
Cited alongside, same era.
Affordances from human videos as a versatile representation for robotics
S. Bahl, R. Mendonca, L. Chen, U. Jain, and D. Pathak · 2023
Later among the works it cites.
Towards generalizable zero-shot manipulation via translating human interaction plans
H. Bharadhwaj, A. Gupta, V. Kumar, and S. Tulsiani · 2023
Later among the works it cites.
Any-point trajectory modeling for policy learning
C. Wen, X. Lin, J. So, K. Chen, Q. Dou, Y. Gao, and P. Abbeel · 2023
Later among the works it cites.
Learning continuous grasping function with a dexterous hand from human demonstrations
J. Ye, J. Wang, B. Huang, Y. Qin, and X. Wang · 2023
Later among the works it cites.
Dextreme: Transfer of agile in-hand manipulation from simulation to reality
A. Handa, A. Allshire, V. Makoviychuk, A. Petrenko, R. Singh, J. Liu, D. Makoviichuk, K. Van Wyk, A. Zhurkevich, B. Sundaralingam, Y. Narang, J.-F. Lafleche, D. Fox, and G. State · 2023
Later among the works it cites.
Visual dexterity: In-hand reorientation of novel and complex object shapes
T. Chen, M. Tippur, S. Wu, V. Kumar, E. Adelson, and P. Agrawal · 2023
Later among the works it cites.
General in-hand object rotation with vision and touch
H. Qi, B. Yi, S. Suresh, M. Lambeta, Y. Ma, R. Calandra, and J. Malik · 2023
Later among the works it cites.
Dexterous functional grasping
A. Agarwal, S. Uppal, K. Shaw, and D. Pathak · 2023
Later among the works it cites.
Dexterity from touch: Self-supervised pre-training of tactile representations with robotic play
I. Guzey, B. Evans, S. Chintala, and L. Pinto · 2023
Later among the works it cites.
Dexterous imitation made easy: A learning-based framework for efficient dexterous manipulation
S. P. Arunachalam, S. Silwal, B. Evans, and L. Pinto · 2023
Later among the works it cites.
Unidexgrasp: Universal robotic dexterous grasping via learning diverse proposal generation and goal-conditioned policy
Y. Xu, W. Wan, J. Zhang, H. Liu, Z. Shan, H. Shen, R. Wang, H. Geng, Y. Weng, J. Chen, et al · 2023
Later among the works it cites.
Gello: A general, low-cost, and intuitive teleoperation framework for robot manipulators
P. Wu, Y. Shentu, Z. Yi, X. Lin, and P. Abbeel · 2023
Later among the works it cites.
Diffusion policy: Visuomotor policy learning via action diffusion
C. Chi, S. Feng, Y. Du, Z. Xu, E. Cousineau, B. Burchfiel, and S. Song · 2023
Later among the works it cites.
Humanoid locomotion as next token prediction
I. Radosavovic, B. Zhang, B. Shi, J. Rajasegaran, S. Kamat, T. Darrell, K. Sreenath, and J. Malik · 2024
Closest in time.
Reconstructing hand-held objects in 3d
J. Wu, G. Pavlakos, G. Gkioxari, and J. Malik · 2024
Closest in time.
Reconstructing hands in 3D with transformers
G. Pavlakos, D. Shan, I. Radosavovic, A. Kanazawa, D. Fouhey, and J. Malik · 2024
Closest in time.
Kinematic motion retargeting for contact-rich anthropomorphic manipulations
A. S. Lakshmipathy, J. K. Hodgins, and N. S. Pollard · 2024
Closest in time.
Octo: An open-source generalist robot policy
O. M. Team, D. Ghosh, H. Walke, K. Pertsch, K. Black, O. Mees, S. Dasari, J. Hejna, T. Kreiman, C. Xu, J. Luo, Y. L. Tan, L. Y. Chen, P. Sanketi, Q. Vuong, T. Xiao, D. Sadigh, C. Finn, and S. Levine · 2024
Closest in time.
H-index: Visual reinforcement learning with hand-informed representations for dexterous manipulation
Y. Ze, Y. Liu, R. Shi, J. Qin, Z. Yuan, J. Wang, and H. Xu · 2024
Closest in time.
Transic: Sim-to-real policy transfer by learning from online correction
Y. Jiang, C. Wang, R. Zhang, J. Wu, and L. Fei-Fei · 2024
Closest in time.
Track2act: Predicting point tracks from internet videos enables diverse zero-shot robot manipulation
H. Bharadhwaj, R. Mottaghi, A. Gupta, and S. Tulsiani · 2024
Closest in time.
Dexcap: Scalable and portable mocap data collection system for dexterous manipulation
C. Wang, H. Shi, W. Wang, R. Zhang, L. Fei-Fei, and C. K. Liu · 2024
Closest in time.
See to touch: Learning tactile dexterity through visual incentives
I. Guzey, Y. Dai, B. Evans, S. Chintala, and L. Pinto · 2024
Closest in time.
Open teach: A versatile teleoperation system for robotic manipulation
A. Iyer, Z. Peng, Y. Dai, I. Guzey, S. Haldar, S. Chintala, and L. Pinto · 2024
Closest in time.
Universal manipulation interface: In-the-wild robot teaching without in-the-wild robots
C. Chi, Z. Xu, C. Pan, E. Cousineau, B. Burchfiel, S. Feng, R. Tedrake, and S. Song · 2024
Closest in time.