Can Large Language Models Find And Fix Vulnerable Software?

Understand

In this study, we evaluated the capability of Large Language Models (LLMs), particularly OpenAI's GPT-4, in detecting software vulnerabilities, comparing their performance against traditional static code analyzers like Snyk and Fortify.

• Our analysis covered numerous repositories, including those from NASA and the Department of Defense.
• GPT-4 identified approximately four times the vulnerabilities than its counterparts.
• Furthermore, it provided viable fixes for each vulnerability, demonstrating a low rate of false positives.