NASimEmu: Network Attack Simulator & Emulator for Training Agents Generalizing to Novel Scenarios

Čeleda, P., Čegan, J., Vykopal, J., Tovarňák, D., et al.: Kypo–a platform for cyber defence exercises. M&S Support to Operational Tasks Including War Gaming, Logistics, Cyber Defence. NATO Science and Technology Organization (2015)

2015

Earlier work this paper cites.

Miehling, E., Rasouli, M., Teneketzis, D.: Optimal defense policies for partially observable spreading processes on bayesian attack graphs. In: Proceedings of the second ACM workshop on moving target defense. pp. 67–76 (2015)

2015

Earlier work this paper cites.

Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518

2015

Earlier work this paper cites.

Brockman, G., Cheung, V., Pettersson, L., Schneider, J., Schulman, J., Tang, J., Zaremba, W.: OpenAI gym. arXiv preprint arXiv:1606.01540 10

Original

2016

Earlier work this paper cites.

Mnih, V., Badia, A.P., Mirza, M., Graves, A., Lillicrap, T., Harley, T., Silver, D., Kavukcuoglu, K.: Asynchronous methods for deep reinforcement learning. In: International Conference on Machine Learning. pp. 1928–1937 (2016)

2016

Earlier work this paper cites.

Schulman, J., Wolski, F., Dhariwal, P., Radford, A., Klimov, O.: Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347 (2017)

Original

2017

Earlier work this paper cites.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. Advances in neural information processing systems 30

2017

Earlier work this paper cites.

Schwartz, J., Kurniawati, H.: Autonomous penetration testing using reinforcement learning. arXiv preprint arXiv:1905.05965 (2019)

Original

2019

Earlier work this paper cites.

Buchanan, B., Bansemer, J., Cary, D., Lucas, J., Musser, M.: Automating cyber attacks. Center for Security and Emerging Technology pp. 13–32 (2020)

2020

Cited alongside, same era.

Chowdhary, A., Huang, D., Mahendran, J.S., Romo, D., Deng, Y., Sabur, A.: Autonomous security analysis and penetration testing. In: 2020 16th International Conference on Mobility, Sensing and Networking (MSN). pp. 508–515. IEEE (2020)

2020

Cited alongside, same era.

Drašar, M., Moskal, S., Yang, S., Zat’ko, P.: Session-level adversary intent-driven cyberattack simulator. In: 2020 IEEE/ACM 24th International Symposium on Distributed Simulation and Real Time Applications (DS-RT). pp. 1–9. IEEE (2020)

2020

Cited alongside, same era.

Hammar, K., Stadler, R.: Finding effective security strategies through reinforcement learning and self-play. In: 2020 16th International Conference on Network and Service Management (CNSM). pp. 1–9. IEEE (2020)

2020

Cited alongside, same era.

Microsoft: Cyberbattlesim. https://github.com/microsoft/cyberbattlesim (2021), created by Christian Seifert, Michael Betser, William Blum, James Bono, Kate Farris, Emily Goren, Justin Grana, Kristian Holsheimer, Brandon Marken, Joshua Neil, Nicole Nichols, Jugal Parikh, Haoran Wei

2021

Later among the works it cites.

Molina-Markham, A., Miniter, C., Powell, B., Ridley, A.: Network environment design for autonomous cyberdefense. arXiv preprint arXiv:2103.07583 (2021)

Original

2021

Later among the works it cites.

Standen, M., Lucas, M., Bowman, D., Richer, T.J., Kim, J., Marriott, D.: CybORG: A gym for the development of autonomous cyber agents. Proceedings of the 1st International Workshop on Adaptive Cyber Defense (2021)

2021

Later among the works it cites.

Andrew, A., Spillard, S., Collyer, J., Dhir, N.: Developing optimal causal cyber-defence agents via cyber security simulation. In: Workshop on Machine Learning for Cybersecurity (ML4Cyber) (07 2022)

2022