Fetching the paper…

Reading the bibliography…

2024

SurgBox: Agent-Driven Operating Room Sandbox with Surgery Copilot

Wu, Jinlin, Liang, Xusheng, Bai, Xuexue et al.

Original
PDF
Post on X

Understand

Surgical interventions, particularly in neurology, represent complex and high-stakes scenarios that impose substantial cognitive burdens on surgical teams.

Although deliberate education and practice can enhance cognitive capabilities, surgical training opportunities remain limited due to patient safety concerns.
To address these cognitive challenges in surgical training and operation, we propose SurgBox, an agent-driven sandbox framework to systematically enhance the cognitive capabilities of surgeons in immersive surgical simulations.
Specifically, our SurgBox leverages large language models (LLMs) with tailored Retrieval-Augmented Generation (RAG) to authentically replicate various surgical roles, enabling realistic training environments for deliberate practice.

SurgBox: Agent-Driven Operating Room Sandbox with Surgery Copilot · Around

Built on

J. G. Frederiksen, S. M. D. Sørensen, L. Konge, M. B. S. Svendsen, M. Nobel-Jørgensen, F. Bjerrum, and S. A. W. Andersen, “Cognitive load and performance in immersive virtual reality versus conventional virtual reality simulation training of laparoscopic surgery: a randomized trial,” Surgical endoscopy , vol. 34, pp. 1244–1252, 2020
2020
Earlier work this paper cites.
S. R. Knight, C. A. Shaw, R. Pius, T. M. Drake, L. Norman, A. O. Ademuyiwa, A. O. Adisa, M. L. Aguilera, S. W. Al-Saqqa, I. Al-Slaibi et al. , “Global variation in postoperative mortality and complications after cancer surgery: a multicentre, prospective cohort study in 82 countries,” The Lancet , vol. 397, no. 10272, pp. 387–397, 2021
2021
Earlier work this paper cites.
R. Q. Mao, L. Lan, J. Kay, R. Lohre, O. R. Ayeni, D. P. Goel et al. , “Immersive virtual reality for surgical training: a systematic review,” Journal of Surgical Research , vol. 268, pp. 40–58, 2021
2021
Earlier work this paper cites.
W. Aouicha, M. A. Tlili, J. Sahli, A. Mtiraoui, T. Ajmi, H. Said Latiri, S. Chelbi, M. Ben Rejeb, and M. Mallouli, “Patient safety culture as perceived by operating room professionals: a mixed-methods study,” BMC Health Services Research , vol. 22, no. 1, p. 799, 2022
2022
Earlier work this paper cites.
H. Teymourian, F. Tehrani, K. Longardner, K. Mahato, T. Podhajny, J.-M. Moon, Y. G. Kotagiri, J. R. Sempionatto, I. Litvan, and J. Wang, “Closing the loop for patients with parkinson disease: where are we?” Nature Reviews Neurology , vol. 18, no. 8, pp. 497–507, 2022
2022
Earlier work this paper cites.
S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao, “React: Synergizing reasoning and acting in language models,” arXiv preprint arXiv:2210.03629 , 2022
Original
2022
Earlier work this paper cites.
J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou et al. , “Chain-of-thought prompting elicits reasoning in large language models,” NeurIPS , vol. 35, pp. 24 824–24 837, 2022
2022
Earlier work this paper cites.
Z. Chen, Q. Guo, L. K. Yeung, D. T. Chan, Z. Lei, H. Liu, and J. Wang, “Surgical video captioning with mutual-modal concept alignment,” in MICCAI , 2023, pp. 24–34
2023
Earlier work this paper cites.
Z. Chen, Y. Zhai, J. Zhang, and J. Wang, “Surgical temporal action-aware network with sequence regularization for phase recognition,” in BIBM , 2023
2023
Earlier work this paper cites.
J. S. Park, J. O’Brien, C. J. Cai, M. R. Morris, P. Liang, and M. S. Bernstein, “Generative agents: Interactive simulacra of human behavior,” in Proceedings of the 36th annual acm symposium on user interface software and technology , 2023, pp. 1–22
2023
Earlier work this paper cites.
X. Tang, A. Zou, Z. Zhang, Y. Zhao, X. Zhang, A. Cohan, and M. Gerstein, “Medagents: Large language models as collaborators for zero-shot medical reasoning,” arXiv preprint arXiv:2311.10537 , 2023
Original
2023
Earlier work this paper cites.
Y. Xu, S. Wang, P. Li, F. Luo, X. Wang, W. Liu, and Y. Liu, “Exploring large language models for communication games: An empirical study on werewolf,” arXiv preprint arXiv:2309.04658 , 2023
Original
2023
Earlier work this paper cites.

Similar

S. Hong, X. Zheng, J. Chen, Y. Cheng, J. Wang, C. Zhang, Z. Wang, S. K. S. Yau, Z. Lin, L. Zhou et al. , “Metagpt: Meta programming for multi-agent collaborative framework,” arXiv preprint arXiv:2308.00352 , 2023
Original
2023
Cited alongside, same era.
C. Gao, X. Lan, Z. Lu, J. Mao, J. Piao, H. Wang, D. Jin, and Y. Li, “S3: Social-network simulation system with large language model-empowered agents,” arXiv preprint arXiv:2307.14984 , 2023
Original
2023
Cited alongside, same era.
M. Yan, R. Li, H. Zhang, H. Wang, Z. Yang, and J. Yan, “Larp: Language-agent role play for open-world games,” arXiv preprint arXiv:2312.17653 , 2023
Original
2023
Cited alongside, same era.
Q. Tu, C. Chen, J. Li, Y. Li, S. Shang, D. Zhao, R. Wang, and R. Yan, “Characterchat: Learning towards conversational ai with personalized social support,” arXiv preprint arXiv:2308.10278 , 2023
Original
2023
Cited alongside, same era.

Then

Z. Fan, J. Tang, W. Chen, S. Wang, Z. Wei, J. Xi, F. Huang, and J. Zhou, “Ai hospital: Interactive evaluation and collaboration of llms as intern doctors for clinical diagnosis,” arXiv preprint arXiv:2402.09742 , 2024
Original
2024
Closest in time.
J. Li, S. Wang, M. Zhang, W. Li, Y. Lai, X. Kang, W. Ma, and Y. Liu, “Agent hospital: A simulacrum of hospital with evolvable medical agents,” arXiv preprint arXiv:2405.02957 , 2024
Original
2024
Closest in time.
L. Zhong, Z. Wang, and J. Shang, “Debug like a human: A large language model debugger via verifying runtime execution step by step,” in Findings of ACL , 2024, pp. 851–870
2024
Closest in time.
E. Eigner and T. Händler, “Determinants of llm-assisted decision-making,” arXiv preprint arXiv:2402.17385 , 2024
Original
2024
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

A. Salemi, S. Mysore, M. Bendersky, and H. Zamani, “Lamp: When large language models meet personalization,” arXiv preprint arXiv:2304.11406 , 2023

2023

Cited alongside, same era.

S. A. Cardoso, J. Suyambu, J. Iqbal, D. C. C. Jaimes, A. Amin, J. T. Sikto, M. Valderrama, S. S. Aulakh, V. Ramana, B. Shaukat et al. , “Exploring the role of simulation training in improving surgical skills among residents: a narrative review,” Cureus , vol. 15, no. 9, 2023

2023

Cited alongside, same era.

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , “Gpt-4 technical report,” arXiv preprint arXiv:2303.08774 , 2023

2023

Cited alongside, same era.

C. Varghese, E. M. Harrison, G. O’Grady, and E. J. Topol, “Artificial intelligence in surgery,” Nature Medicine , vol. 30, no. 5, pp. 1257–1268, May 2024

2024

Cited alongside, same era.

C. Varghese, E. M. Harrison, G. O’Grady, and E. J. Topol, “Artificial intelligence in surgery,” Nature Medicine , pp. 1–12, 2024

2024

Cited alongside, same era.

X. Luo, Y. Pang, Z. Chen, J. Wu, Z. Zhang, Z. Lei, and H. Liu, “Surgplan: Surgical phase localization network for phase recognition,” in ISBI . IEEE, 2024, pp. 1–5

2024

Cited alongside, same era.

Z. Chen, Z. Zhang, W. Guo, X. Luo, L. Bai, J. Wu, H. Ren, and H. Liu, “Asi-seg: Audio-driven surgical instrument segmentation with surgeon intention understanding,” in IROS , 2024

2024

Cited alongside, same era.

S. Hong, M. Zhuge, J. Chen, X. Zheng, Y. Cheng, J. Wang, C. Zhang, Z. Wang, S. K. S. Yau, Z. Lin et al. , “Metagpt: Meta programming for a multi-agent collaborative framework,” in ICLR , 2024

2024

Cited alongside, same era.

R. Zhang, H. Du, Y. Liu, D. Niyato, J. Kang, S. Sun, X. Shen, and H. V. Poor, “Interactive ai with retrieval-augmented generation for next generation networking,” IEEE Network , 2024

2024

Closest in time.

S. Yao, D. Yu, J. Zhao, I. Shafran, T. Griffiths, Y. Cao, and K. Narasimhan, “Tree of thoughts: Deliberate problem solving with large language models,” NeurIPS , vol. 36, 2024

2024

Closest in time.

N. Shinn, F. Cassano, A. Gopinath, K. Narasimhan, and S. Yao, “Reflexion: Language agents with verbal reinforcement learning,” NeurIPS , vol. 36, 2024

2024

Closest in time.

S. Barua, “Exploring autonomous agents through the lens of large language models: A review,” arXiv preprint arXiv:2404.04442 , 2024

2024

Closest in time.

H. Chen, H. Chen, M. Yan, W. Xu, X. Gao, W. Shen, X. Quan, C. Li, J. Zhang, F. Huang et al. , “Roleinteract: Evaluating the social interaction of role-playing agents,” arXiv preprint arXiv:2403.13679 , 2024

2024

Closest in time.

Z. Cai, M. Cao, H. Chen, K. Chen, K. Chen, X. Chen, X. Chen, Z. Chen, Z. Chen, P. Chu et al. , “Internlm2 technical report,” arXiv preprint arXiv:2403.17297 , 2024

2024

Closest in time.

A. Meta, “Introducing meta llama 3: The most capable openly available llm to date,” Meta AI , 2024

2024

Closest in time.