Realistic Surgical Simulation from Monocular Videos

Understand

This paper tackles the challenge of automatically performing realistic surgical simulations from readily available surgical videos.

• Recent efforts have successfully integrated physically grounded dynamics within 3D Gaussians to perform high-fidelity simulations in well-reconstructed simulation environments from static scenes.
• However, they struggle with the geometric inconsistency in reconstructing simulation environments and unrealistic physical deformations in simulations of soft tissues when it comes to dynamic and complex surgical processes.
• In this paper, we propose SurgiSim, a novel automatic simulation system to overcome these limitations.