Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Robotics

Meshless deformations based on shape matching

M. Müller, B. Heidelberger, M. Teschner, and M. Gross · 2005

Earlier work this paper cites.

Position based dynamics

M. Müller, B. Heidelberger, M. Hennix, and J. Ratcliff · 2007

Earlier work this paper cites.

Solid simulation with oriented particles

M. Müller and N. Chentanez · 2011

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

D. P. Kingma and J. Ba · 2014

Earlier work this paper cites.

Unsupervised learning for physical interaction through video prediction

Original

C. Finn, I. J. Goodfellow, and S. Levine · 2016

Earlier work this paper cites.

Xpbd: Position-based simulation of compliant constrained dynamics

M. Macklin, M. Müller, and N. Chentanez · 2016

Earlier work this paper cites.

Nerf: Representing scenes as neural radiance fields for view synthesis

B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng · 2020

Earlier work this paper cites.

Real-to-sim registration of deformable soft tissue with position-based dynamics for surgical robot autonomy

F. Liu, Z. Li, Y. Han, J. Lu, F. Richter, and M. C. Yip · 2021

Earlier work this paper cites.

Reinforcement learning with neural radiance fields

D. Driess, I. Schubert, P. Florence, Y. Li, and M. Toussaint · 2022

Cited alongside, same era.

Warp: A high-performance python framework for gpu simulation and graphics

M. Macklin · 2022

Cited alongside, same era.

SymForce: Symbolic Computation and Code Generation for Robotics

H. Martiros, A. Miller, N. Bucki, B. Solliday, R. Kennedy, J. Zhu, T. Dang, D. Pattison, H. Zheng, T. Tomic, P. Henry, G. Cross, J. VanderMey, A. Sun, S. Wang, and K. Holtz · 2022

Cited alongside, same era.

Visual reinforcement learning with self-supervised 3d representations

Y. Ze, N. Hansen, Y. Chen, M. Jain, and X. Wang · 2023

Cited alongside, same era.

Learning multi-object dynamics with compositional neural radiance fields

D. Driess, Z. Huang, Y. Li, R. Tedrake, and M. Toussaint · 2023

Cited alongside, same era.

3d gaussian splatting for real-time radiance field rendering

Grounding dino: Marrying dino with grounded pre-training for open-set object detection

Original

S. Liu, Z. Zeng, T. Ren, F. Li, H. Zhang, J. Yang, C. Li, J. Yang, H. Su, J. Zhu, et al · 2023

Later among the works it cites.

Cotracker: It is better to track together

Original

N. Karaev, I. Rocco, B. Graham, N. Neverova, A. Vedaldi, and C. Rupprecht · 2023

Later among the works it cites.

Robotic manipulation of deformable rope-like objects using differentiable compliant position-based dynamics

F. Liu, E. Su, J. Lu, M. Li, and M. C. Yip · 2023

Later among the works it cites.

Real-to-sim deformable object manipulation: Optimizing physics models with residual mappings for robotic surgery

Original

X. Liang, F. Liu, Y. Zhang, Y. Li, S. Lin, and M. Yip · 2023

Later among the works it cites.

Tapir: Tracking any point with per-frame initialization and temporal refinement