Fetching the paper…

Reading the bibliography…

2024

Review of Generative AI Methods in Cybersecurity

Yigit, Yagmur, Buchanan, William J, Tehrani, Madjid G et al.

Original
PDF
Post on X

Understand

Over the last decade, Artificial Intelligence (AI) has become increasingly popular, especially with the use of chatbots such as ChatGPT, Gemini, and DALL-E.

With this rise, large language models (LLMs) and Generative AI (GenAI) have also become more prevalent in everyday use.
These advancements strengthen cybersecurity's defensive posture and open up new attack avenues for adversaries as well.
This paper provides a comprehensive overview of the current state-of-the-art deployments of GenAI, covering assaults, jailbreaking, and applications of prompt injection and reverse psychology.

Review of Generative AI Methods in Cybersecurity · Around

Built on

Mavroeidis, V., Bromander, S.: Cyber threat intelligence model: an evaluation of taxonomies, sharing standards, and ontologies within cyber threat intelligence. In: 2017 European Intelligence and Security Informatics Conference (EISIC), pp. 91–98 (2017). IEEE
2017
Earlier work this paper cites.
Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., Amodei, D.: Language models are few-shot learners. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., Lin, H. (eds.) Advances in Neural Information Processing Systems, vol. 33, pp. 1877–1901. Curran Associates, Inc., ??? (2020). https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
2020
Earlier work this paper cites.
Gehman, S., Gururangan, S., Sap, M., Choi, Y., Smith, N.A.: Realtoxicityprompts: Evaluating neural toxic degeneration in language models. In: Findings (2020). https://api.semanticscholar.org/CorpusID:221878771
2020
Earlier work this paper cites.
Kwon, R., Ashley, T., Castleberry, J., Mckenzie, P., Gourisetti, S.N.G.: Cyber threat dictionary using mitre att&ck matrix and nist cybersecurity framework mapping. In: 2020 Resilience Week (RWS), pp. 106–112 (2020). IEEE
2020
Earlier work this paper cites.
Brandao, P.R.: Advanced persistent threats (apt)-attribution-mictic framework extension. J. Comput. Sci 17
2021
Earlier work this paper cites.
Sharma, T., Kechagia, M., Georgiou, S., Tiwari, R., Vats, I., Moazen, H., Sarro, F.: A survey on machine learning techniques for source code analysis. arXiv preprint arXiv:2110.09610 (2021)
Original
2021
Earlier work this paper cites.
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H.P.d.O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al.: Evaluating large language models trained on code (2021)
2021
Earlier work this paper cites.
Yigit, Y., Bal, B., Karameseoglu, A., Duong, T.Q., Canberk, B.: Digital twin-enabled intelligent ddos detection mechanism for autonomous core networks. IEEE Communications Standards Magazine 6
2022
Earlier work this paper cites.
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., Zhou, D., et al
2022
Earlier work this paper cites.
Kojima, T., Gu, S.S., Reid, M., Matsuo, Y., Iwasawa, Y.: Large language models are zero-shot reasoners. Advances in neural information processing systems 35
2022
Earlier work this paper cites.
Xiong, W., Legrand, E., Åberg, O., Lagerström, R.: Cyber security threat modeling based on the mitre enterprise att&ck matrix. Software and Systems Modeling 21
2022
Earlier work this paper cites.
Happe, A., Cito, J.: Getting pwn’d by ai: Penetration testing with large language models. arXiv preprint arXiv:2308.00121 (2023)
Original
2023
Earlier work this paper cites.
Park, D., An, G.-t., Kamyod, C., Kim, C.G.: A Study on Performance Improvement of Prompt Engineering for Generative AI with a Large Language Model. Journal of Web Engineering 22
2023
Earlier work this paper cites.
Barreto, F., Moharkar, L., Shirodkar, M., Sarode, V., Gonsalves, S., Johns, A.: Generative Artificial Intelligence: Opportunities and Challenges of Large Language Models. In: Balas, V.E., Semwal, V.B., Khandare, A. (eds.) Intelligent Computing and Networking, pp. 545–553. Springer, ??? (2023)
2023
Earlier work this paper cites.
Naveed, H., Khan, A.U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., Mian, A.: A Comprehensive Overview of Large Language Models (2023)
2023
Earlier work this paper cites.
Alawida, M., Mejri, S., Mehmood, A., Chikhaoui, B., Isaac Abiodun, O.: A comprehensive study of chatgpt: advancements, limitations, and ethical considerations in natural language processing and cybersecurity. Information 14
2023
Earlier work this paper cites.
Dun, C., Garcia, M.H., Zheng, G., Awadallah, A.H., Kyrillidis, A., Sim, R.: Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation (2023)
2023
Earlier work this paper cites.
OpenAI: Introducing Gemini: Our Largest and Most Capable AI Model. [Online]. Available: https://cdn.openai.com/papers/gpt-4.pdf , Accessed Dec 12, 2023 (2023)
2023
Earlier work this paper cites.
Wang, Y., Zhao, Y.: Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models (2023)
2023
Earlier work this paper cites.
Scanlon, M., Breitinger, F., Hargreaves, C., Hilgert, J.-N., Sheppard, J.: Chatgpt for digital forensic investigation: The good, the bad, and the unknown. Forensic Science International: Digital Investigation 46
2023
Earlier work this paper cites.
Zhou, Z., Wang, Q., Jin, M., Yao, J., Ye, J., Liu, W., Wang, W., Huang, X., Huang, K.: MathAttack: Attacking Large Language Models Towards Math Solving Ability (2023)
2023
Earlier work this paper cites.
Begou, N., Vinoy, J., Duda, A., Korczynski, M.: Exploring the dark side of ai: Advanced phishing attack design and deployment using chatgpt. arXiv preprint arXiv:2309.10463 (2023)
Original
2023
Earlier work this paper cites.
AI, A.: GPT-4 Jailbreak ve Hacking Via Rabbithole Attack, Prompt Injection, Content Moderation Bypass ve Weaponizing AI. [Online]. Available: https://adversa.ai/ , Accessed Dec 20, 2023
2023
Earlier work this paper cites.
Yigit, Y., Nguyen, L.D., Ozdem, M., Kinaci, O.K., Hoang, T., Canberk, B., Duong, T.Q.: TwinPort: 5G Drone-assisted Data Collection with Digital Twin for Smart Seaports. Scientific Reports 13
2023
Earlier work this paper cites.
Gupta, M., Akiri, C., Aryal, K., Parker, E., Praharaj, L.: From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy. IEEE Access (2023)
2023
Earlier work this paper cites.
Li, H., Guo, D., Fan, W., Xu, M., Song, Y.: Multi-step jailbreaking privacy attacks on chatgpt. arXiv preprint arXiv:2304.05197 (2023)
Original
2023
Earlier work this paper cites.
Xie, Y., Yi, J., Shao, J., Curl, J., Lyu, L., Chen, Q., Xie, X., Wu, F.: Defending chatgpt against jailbreak attack via self-reminder. Nature Machine Intelligence 5
2023
Earlier work this paper cites.
Falade, P.V.: Decoding the threat landscape: Chatgpt, fraudgpt, and wormgpt in social engineering attacks. arXiv preprint arXiv:2310.05595 (2023)
Original
2023
Earlier work this paper cites.
Roy, S.S., Naragam, K.V., Nilizadeh, S.: Generating phishing attacks using chatgpt. arXiv preprint arXiv:2305.05133 (2023)
Original
2023
Earlier work this paper cites.
Deng, G., Liu, Y., Mayoral-Vilches, V., Liu, P., Li, Y., Xu, Y., Zhang, T., Liu, Y., Pinzger, M., Rass, S.: PentestGPT: An LLM-empowered Automatic Penetration Testing Tool (2023)
2023
Earlier work this paper cites.
AI, O.: Introducing GPTs (2023). https://openai.com/blog/introducing-gpts Accessed 2023-11-12
2023
Earlier work this paper cites.
Montiel, R.: ChatGPT (2021). https://chat.openai.com/g/g-zQfyABDUJ-gp-en-t-ester Accessed 2023-11-12
2023
Earlier work this paper cites.

Similar

Doustaly, L.: ChatGPT (2021). https://chat.openai.com/g/g-zQfyABDUJ-gp-en-t-ester Accessed 2023-11-12
2023
Cited alongside, same era.
Temara, S.: Maximizing penetration testing success with effective reconnaissance techniques using chatgpt (2023)
2023
Cited alongside, same era.
Happe, A., Kaplan, A., Cito, J.: Evaluating llms for privilege-escalation scenarios. arXiv preprint arXiv:2310.11409 (2023)
Original
2023
Cited alongside, same era.
Charan, P., Chunduri, H., Anand, P.M., Shukla, S.K.: From text to mitre techniques: Exploring the malicious use of large language models for generating cyber attack payloads. arXiv preprint arXiv:2305.15336 (2023)
Original
2023
Cited alongside, same era.
ONeal, A.: ChatGPT-Dan-Jailbreak.md (2023). https://gist.github.com/coolaj86/6f4f7b30129b0251f61fa7baaa881516 Accessed 2023-11-13
2023

Then

O’Brien, J., Ee, S., Williams, Z.: Deployment corrections: An incident response framework for frontier ai models. arXiv preprint arXiv:2310.00328 (2023)
Original
2023
Later among the works it cites.
Iqbal, U., Kohno, T., Roesner, F.: Llm platform security: Applying a systematic evaluation framework to openai’s chatgpt plugins. arXiv preprint arXiv:2309.10254 (2023)
Original
2023
Later among the works it cites.
Garza, E., Hemberg, E., Moskal, S., O’Reilly, U.-M.: Assessing large language model’s knowledge of threat behavior in mitre att&ck (2023)
2023
Later among the works it cites.
Ferrag, M.A., Ndhlovu, M., Tihanyi, N., Cordeiro, L.C., Debbah, M., Lestable, T.: Revolutionizing cyber threat detection with large language models. arXiv preprint arXiv:2306.14263 (2023)
Original
2023
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Cited alongside, same era.

AI2.0 (2023). https://01.ai/ Accessed 2023-11-13

2023

Cited alongside, same era.

Kumamoto, T., Yoshida, Y., Fujima, H.: Evaluating large language models in ransomware negotiation: A comparative analysis of chatgpt and claude (2023)

2023

Cited alongside, same era.

Madani, P.: Metamorphic malware evolution: The potential and peril of large language models. In: 2023 5th IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA), pp. 74–81 (2023). IEEE Computer Society

2023

Cited alongside, same era.

Kwon, H., Sim, M., Song, G., Lee, M., Seo, H.: Novel approach to cryptography implementation using chatgpt. Cryptology ePrint Archive (2023)

2023

Cited alongside, same era.

Cintas-Canto, A., Kaur, J., Mozaffari-Kermani, M., Azarderakhsh, R.: Chatgpt vs. lightweight security: First work implementing the nist cryptographic standard ascon. arXiv preprint arXiv:2306.08178 (2023)

2023

Cited alongside, same era.

Iturbe, E., Rios, E., Rego, A., Toledo, N.: Artificial intelligence for next-generation cybersecurity: The ai4cyber framework. In: Proceedings of the 18th International Conference on Availability, Reliability and Security, pp. 1–8 (2023)

2023

Cited alongside, same era.

Fayyazi, R., Yang, S.J.: On the uses of large language models to interpret ambiguous cyberattack descriptions. arXiv preprint arXiv:2306.14062 (2023)

2023

Cited alongside, same era.

Kholgh, D.K., Kostakos, P.: Pac-gpt: A novel approach to generating synthetic network traffic with gpt-3. IEEE Access (2023)

2023

Later among the works it cites.

Simmonds, B.C.: Generating a large web traffic dataset. Master’s thesis, ETH Zurich (2023)

2023

Later among the works it cites.

Zhou, J., Müller, H., Holzinger, A., Chen, F.: Ethical ChatGPT: Concerns, Challenges, and Commandments (2023)

2023

Later among the works it cites.

Wang, C., Liu, S., Yang, H., Guo, J., Wu, Y., Liu, J.: Ethical considerations of using chatgpt in health care. Journal of Medical Internet Research 25

2023

Later among the works it cites.

Yigit, Y., Chrysoulas, C., Yurdakul, G., Maglaras, L., Canberk, B.: Digital Twin-Empowered Smart Attack Detection System for 6G Edge of Things Networks. In: 2023 IEEE Globecom Workshops (GC Wkshps) (2023)

2023

Later among the works it cites.

Yigit, Y., Kinaci, O.K., Duong, T.Q., Canberk, B.: TwinPot: Digital Twin-assisted Honeypot for Cyber-Secure Smart Seaports. In: 2023 IEEE International Conference on Communications Workshops (ICC Workshops), pp. 740–745 (2023). https://doi.org/10.1109/ICCWorkshops57953.2023.10283756

2023

Later among the works it cites.

Capogrosso, L., Cunico, F., Cheng, D.S., Fummi, F., Cristani, M.: A Machine Learning-Oriented Survey on Tiny Machine Learning. IEEE Access 12

2024

Closest in time.

Team, Y.: Yandex Adds Next-generation Neural Network to Alice Virtual Assistant. [Online]. Available: https://yandex.com/company/press_center/press_releases/2023/17-05-23 , Accessed Jan 8, 2024

2024

Closest in time.

Lee, P.: Learning from Tay’s Introduction. [Online]. Available: https://blogs.microsoft.com/blog/2016/03/25/learning-tays-introduction/ , Accessed Jan 8, 2024

2024

Closest in time.

Lab, M.M.: NORMAN: World’s first psychopath AI. [Online]. Available: http://norman-ai.mit.edu/ , Accessed Jan 5, 2024

2024

Closest in time.

Lab, M.M.: Project Norman. [Online]. Available: https://www.media.mit.edu/projects/norman/overview/ , Accessed Jan 5, 2024

2024

Closest in time.

Legoux, G.: History of the Generative AI. Medium. [Online]. Available: https://medium.com/@glegoux/history-of-the-generative-ai-aa1aa7c63f3c , Accessed Feb 15, 2024

2024

Closest in time.

Team, T.: History of the Generative AI. Toloka AI. [Online]. Available: https://toloka.ai/blog/history-of-generative-ai/ , Accessed Feb 15, 2024

2024

Closest in time.

Mohammed, S.P., Hossain, G.: Chatgpt in education, healthcare, and cybersecurity: Opportunities and challenges. In: 2024 IEEE 14th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0316–0321 (2024). IEEE

2024

Closest in time.

AI, G.: AI Principles Progress Update 2023. [Online]. Available: https://ai.google/responsibility/principles/ , Accessed Jan 10, 2024

2024

Closest in time.

AI, G.: GPT-4 Technical Report. [Online]. Available: https://ai.google/responsibility/principles/ , Accessed Jan 10, 2024

2024

Closest in time.

Frieder, S., Pinchetti, L., Griffiths, R.-R., Salvatori, T., Lukasiewicz, T., Petersen, P., Berner, J.: Mathematical capabilities of chatgpt. Advances in Neural Information Processing Systems 36

2024

Closest in time.

Romera-Paredes, B., Barekatain, M., Novikov, A., Balog, M., Kumar, M.P., Dupont, E., Ruiz, F.J.R., Ellenberg, J.S., Wang, P., Fawzi, O., Kohli, P., Fawzi, A.: Mathematical discoveries from program search with large language models. Nature 625

2024

Closest in time.

Lu, C., Qian, C., Zheng, G., Fan, H., Gao, H., Zhang, J., Shao, J., Deng, J., Fu, J., Huang, K., Li, K., Li, L., Wang, L., Sheng, L., Chen, M., Zhang, M., Ren, Q., Chen, S., Gui, T., Ouyang, W., Wang, Y., Teng, Y., Wang, Y., Wang, Y., He, Y., Wang, Y., Wang, Y., Zhang, Y., Qiao, Y., Shen, Y., Mou, Y., Chen, Y., Zhang, Z., Shi, Z., Yin, Z., Wang, Z.: From GPT-4 to Gemini and Beyond: Assessing the Landscape of MLLMs on Generalizability, Trustworthiness and Causality through Four Modalities (2024)

2024

Closest in time.

Shevlane, T.: An early warning system for novel AI risks. Google DeepMind. [Online]. Available: https://deepmind.google/discover/blog/an-early-warning-system-for-novel-ai-risks/ , Accessed Jan 15, 2024

2024

Closest in time.

Tihanyi, N., Ferrag, M.A., Jain, R., Debbah, M.: CyberMetric: A Benchmark Dataset for Evaluating Large Language Models Knowledge in Cybersecurity (2024)

2024

Closest in time.

OpenAI: Disrupting Malicious Uses of AI by State-Affiliated Threat Actors. https://openai.com/blog/disrupting-malicious-uses-of-ai-by-state-affiliated-threat-actors Accessed 2024-02-25

2024

Closest in time.

Elgedawy, R., Sadik, J., Dutta, S., Gautam, A., Georgiou, K., Gholamrezae, F., Ji, F., Lim, K., Liu, Q., Ruoti, S.: Ocassionally secure: A comparative analysis of code generation assistants. arXiv preprint arXiv:2402.00689 (2024)

2024

Closest in time.

Kumar, A., Singh, S., Murty, S.V., Ragupathy, S.: The ethics of interaction: Mitigating security threats in llms. arXiv preprint arXiv:2401.12273 (2024)

2024

Closest in time.

Madiega, T.: Artificial Intelligence Act. European Parliamentary Research Service. [Online]. Available: https://www.europarl.europa.eu/doceo/document/TA-9-2023-0236_EN.pdf , Accessed Jan 9, 2024

2024

Closest in time.

Parliament), E.: EU AI Act: first regulation on artificial intelligence. [Online]. Available: https://www.europarl.europa.eu/topics/en/article/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence , Accessed Jan 8, 2024

2024

Closest in time.

Harris, L.A., Jaikaran, C.: Highlights of the 2023 Executive Order on Artificial Intelligence for Congress. Congressional Research Service. [Online]. Available: https://crsreports.congress.gov/ , Accessed Jan 9, 2024

2024

Closest in time.