CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal Dissection

Understand

submucosal dissection (ESD) enables rapid resection of large lesions, minimizing recurrence rates and improving long-term overall survival.

• Despite these advantages, ESD is technically challenging and carries high risks of complications, necessitating skilled surgeons and precise instruments.
• Recent advancements in Large Visual-Language Models (LVLMs) offer promising decision support and predictive planning capabilities for robotic systems, which can augment the accuracy of ESD and reduce procedural risks.
• However, existing datasets for multi-level fine-grained ESD surgical motion understanding are scarce and lack detailed annotations.