Surgical SAM 2: Real-time Segment Anything in Surgical Video by Efficient Frame Pruning

Understand

Surgical video segmentation is a critical task in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes.

• Recently, the Segment Anything Model 2 (SAM2) framework has shown superior advancements in image and video segmentation.
• However, SAM2 struggles with efficiency due to the high computational demands of processing high-resolution images and complex and long-range temporal dynamics in surgical videos.
• To address these challenges, we introduce Surgical SAM 2 (SurgSAM2), an advanced model to utilize SAM2 with an Efficient Frame Pruning (EFP) mechanism, to facilitate real-time surgical video segmentation.