2023

ChatGPT and Other Large Language Models as Evolutionary Engines for Online Interactive Collaborative Game Design

Lanzi, Pier Luca, Loiacono, Daniele

Understand

Large language models (LLMs) have taken the scientific world by storm, changing the landscape of natural language processing and human-computer interaction.

These powerful tools can answer complex questions and, surprisingly, perform challenging creative tasks (e.g., generate code and applications to solve problems, write stories, pieces of music, etc.).
In this paper, we present a collaborative game design framework that combines interactive evolution and large language models to simulate the typical human design process.
We use the former to exploit users' feedback for selecting the most promising ideas and large language models for a very complex creative task - the recombination and variation of ideas.

Built on

Application of interactive genetic algorithm to fashion design
Hee-Su Kim and Sung-Bae Cho. 2000 · 1976
Earlier work this paper cites.
The Blind Watchmaker: Why the Evidence of Evolution Reveals a Universe without Design
Richard Dawkins. 1986 · 1986
Earlier work this paper cites.
Genetic Programming: On the Programming of Computers by Means of Natural Selection
John R. Koza. 1992 · 1992
Earlier work this paper cites.
Interactive evolutionary computation: fusion of the capabilities of EC optimization and human evaluation
H. Takagi. 2001 · 2001
Earlier work this paper cites.
Language Models are Few-Shot Learners
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, and al. 2020 · 2005
Earlier work this paper cites.
Evolution of Vertex and Pixel Shaders. In Genetic Programming, 8th European Conference, EuroGP2005, Lausanne, Switzerland, March 30 - April 1, 2005, Proceedings (Lecture Notes in Computer Science, Vol. 3447) , Maarten Keijzer, Andrea Tettamanzi, Pierre Collet, Jano I. van Hemert, and Marco Tomassini (Eds.). Springer, 261–270
Marc Ebner, Markus Reinhardt, and Jürgen Albert. 2005 · 2005
Earlier work this paper cites.
Fashion Design Using Interactive Genetic Algorithm with Knowledge-based Encoding
Hee-Su Kim and Sung-Bae Cho. 2005 · 2005
Earlier work this paper cites.
Ergonomic Chair Design by Fusing Qualitative and Quantitative Criteria Using Interactive Genetic Algorithms
A.M. Brintrup, J. Ramsden, H. Takagi, and A. Tiwari. 2008 · 2007
Earlier work this paper cites.
Picbreeder: evolving pictures collaboratively online. In CHI . 1759–1768
Jimmy Secretan and Nicholas Beato. 2008 · 2008
Earlier work this paper cites.
Automatic Content Generation in the Galactic Arms Race Video Game
Erin J. Hastings, Ratan K. Guha, , and Kenneth O. Stanley. 2009 · 2009
Earlier work this paper cites.
Exploiting functional relationships in musical composition
Amy K. Hoover and Kenneth O. Stanley. 2009 · 2009
Earlier work this paper cites.
In search of a minimalist game. In Proceedings of the 2009 DiGRA International Conference: Breaking New Ground: Innovation in Games, Play, Practice and Theory, DiGRA 2009, London, UK, September 1-4, 2009 , Tanya Krzywinska, Helen W. Kennedy, and Barry Atkins (Eds.). Digital Games Research Association
David Myers. 2009 · 2009
Earlier work this paper cites.
Generative Language Modeling for Automated Theorem Proving
Stanislas Polu and Ilya Sutskever. 2020 · 2009
Earlier work this paper cites.
Gamestorming: A Playbook for Innovators, Rulebreakers, and Changemakers
Dave Gray and Sunni Brown. 2010 · 2010
Earlier work this paper cites.
Evolving pixel shaders for the prototype video game Subversion. In Proceedings of the 3rd International Symposium on AI and Games - A Symposium at the AISB 2010 Convention (Proceedings of the 3rd International Symposium on AI and Games - A Symposium at the AISB 2010 Convention) . 41–46
Andrew Howlett, Simon Colton, and Cameron Browne. 2010 · 2010
Earlier work this paper cites.
An emotional harmony generation system. In Evolutionary Computation (CEC), 2010 IEEE Congress on . 1 –7
Bin Xu, Shangfei Wang, and Xian Li. 2010 · 2010
Earlier work this paper cites.
Interactive evolution for the procedural generation of tracks in a high-end racing game. In 13th Annual Genetic and Evolutionary Computation Conference, GECCO 2011, Proceedings, Dublin, Ireland, July 12-16, 2011 , Natalio Krasnogor and Pier Luca Lanzi (Eds.). ACM, 395–402
Luigi Cardamone, Daniele Loiacono, and Pier Luca Lanzi. 2011 · 2011
Earlier work this paper cites.
Interactively evolving harmonies through functional scaffolding. In 13th Annual Genetic and Evolutionary Computation Conference, GECCO 2011, Proceedings, Dublin, Ireland, July 12-16, 2011 , Natalio Krasnogor and Pier Luca Lanzi (Eds.). ACM, 387–394
Amy K. Hoover, Paul A. Szerlip, and Kenneth O. Stanley. 2011 · 2011
Earlier work this paper cites.
Promoting Creative Design in Interactive Evolutionary Computation
Taras Kowaliw, Alan Dorin, and Jon McCormack. 2012 · 2011
Earlier work this paper cites.

Similar

An interactive electronic art system based on artificial ecosystemics. In 2011 IEEE Symposium on Artificial Life, ALIFE 2011, Paris, France, April 13-15, 2011 . IEEE, 162–169
Taras Kowaliw, Jon McCormack, and Alan Dorin. 2011 · 2011
Cited alongside, same era.
Towards minimalist game design. In Foundations of Digital Games, FDG’11, Bordeaux, France, June 28 - July 1, 2011 , Marc Cavazza, Katherine Isbister, and Charles Rich (Eds.). ACM, 38–45
Andrew Nealen, Adam Saltsman, and Eddy Boxerman. 2011 · 2011
Cited alongside, same era.
Experience-Driven Procedural Content Generation
Georgios N. Yannakakis and Julian Togelius. 2011 · 2011
Cited alongside, same era.
Accelerating human-computer collaborative search through learning comparative and predictive user models. In Genetic and Evolutionary Computation Conference, GECCO ’12, Philadelphia, PA, USA, July 7-11, 2012 , Terence Soule and Jason H. Moore (Eds.). ACM, 225–232
Gregory S. Hornby and Josh C. Bongard. 2012 · 2012
Cited alongside, same era.
Combining Search-Based Procedural Content Generation and Social Gaming in the Petalz Video Game. In AIIDE , Mark Riedl and Gita Sukthankar (Eds.). The AAAI Press
Sebastian Risi, Joel Lehman, David B. D’Ambrosio, Ryan Hall, and Kenneth O. Stanley. 2012 · 2012
Cited alongside, same era.
An IGA-based design support system for realistic and practical fashion designs
P.Y. Mok, Jie Xu, X.X. Wang, J.T. Fan, Y.L. Kwok, and John H. Xin. 2013 · 2013
Cited alongside, same era.
The Design Of Everyday Things
Don Norman. 2013 · 2013
Cited alongside, same era.
TrackGen: An interactive track generator for TORCS and Speed-Dreams
Luigi Cardamone, Pier Luca Lanzi, and Daniele Loiacono. 2015 · 2014
Cited alongside, same era.
A Novel Human-Computer Collaboration: Combining Novelty Search with Interactive Evolution. In Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation (Vancouver, BC, Canada) (GECCO ’14) . Association for Computing Machinery, New York, NY, USA, 233–240
Brian G. Woolley and Kenneth O. Stanley. 2014 · 2014
Cited alongside, same era.
Volcano: An interactive sword generator. In 2015 IEEE Games Entertainment Media Conference, GEM 2015, Toronto, ON, Canada, October 14-16, 2015 , Elena G. Bertozzi, Bill Kapralos, Nahum D. Gershon, and Jim R. Parker (Eds.). IEEE, 1–8
Michele Pirovano, Renato Mainetti, and Daniele Loiacono. 2015 · 2015
Cited alongside, same era.
Interactive evolution of levels for a competitive multiplayer FPS. In 2015 IEEE Congress on Evolutionary Computation (CEC) . 1527–1534
Peter Thorup Ølsted, Benjamin Ma, and Sebastian Risi. 2015 · 2015
Cited alongside, same era.
Fashion Design Aid System with Application of Interactive Genetic Algorithms. In Computational Intelligence in Music, Sound, Art and Design , João Correia, Vic Ciesielski, and Antonios Liapis (Eds.). Springer International Publishing, Cham, 289–303
Nazanin Alsadat Tabatabaei Anaraki. 2017 · 2017
Cited alongside, same era.

Then

A method for product form design of integrating interactive genetic algorithm with the interval hesitation time and user satisfaction
Tianxiong Wang and Meiyu Zhou. 2020 · 2019
Later among the works it cites.
Generative Pretraining From Pixels. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13-18 July 2020, Virtual Event (Proceedings of Machine Learning Research, Vol. 119) . PMLR, 1691–1703
Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, and Ilya Sutskever. 2020 · 2020
Later among the works it cites.
Generative adversarial networks
Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio. 2020 · 2020
Later among the works it cites.
Interactive Evolution and Exploration within Latent Level-Design Space of Generative Adversarial Networks. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference (Cancún, Mexico) (GECCO ’20) . Association for Computing Machinery, New York, NY, USA, 148–156
Jacob Schrum, Jake Gutierrez, Vanessa Volz, Jialin Liu, Simon Lucas, and Sebastian Risi. 2020 · 2020
Later among the works it cites.
Evaluating Large Language Models Trained on Code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, and al. 2021 · 2021
Later among the works it cites.
Training Verifiers to Solve Math Word Problems
Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021 · 2021
Later among the works it cites.
AI Charades: Language Models as Interactive Game Environments. In 2021 IEEE Conference on Games (CoG) . 1–2
Kevin Frans. 2021 · 2021
Later among the works it cites.
ChatGPT: a Generative Pre-training Transformer Model for Conversational AI
OpenAI. 2021 · 2021
Later among the works it cites.
Fine-Tuning GPT-2 on Annotated RPG Quests for NPC Dialogue Generation. In Proceedings of the 16th International Conference on the Foundations of Digital Games (Montreal, QC, Canada) (FDG ’21) . Association for Computing Machinery, New York, NY, USA, Article 2, 8 pages
Judith van Stegeren and Jakub Myundefinedliwiec. 2021 · 2021
Later among the works it cites.
Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionals
Piotr Mirowski, Kory W. Mathewson, Jaylen Pittman, and Richard Evans. 2022 · 2022
Later among the works it cites.
Talking About Large Language Models
Original
Murray Shanahan. 2022 · 2022
Later among the works it cites.
Generating Role-Playing Game Quests With GPT Language Models
Susanna Värtinen, Perttu Hämäläinen, and Christian Guckelsberger. 2022 · 2022
Later among the works it cites.
Design Brief (Wikipedia, The Free Encyclopedia)
Wikipedia. 2022 · 2022
Later among the works it cites.
Generative Design Ideation: A Natural Language Generation Approach
Qihao Zhu and Jianxi Luo. 2022 · 2022
Later among the works it cites.
ChatGPT and Other Large Language Models as Evolutionary Engines for Online Interactive Collaborative Game Design
Original
Pier Luca Lanzi and Daniele Loiacono. 2023 · 2023
Closest in time.
Telegram
Telegram FZ LLC and Telegram Messenger Inc. 2023 · 2023
Closest in time.
Dissociating language and thought in large language models: a cognitive perspective
Original
Kyle Mahowald, Anna A. Ivanova, Idan A. Blank, Nancy Kanwisher, Joshua B. Tenenbaum, and Evelina Fedorenko. 2023 · 2023
Closest in time.
DALL·E 2
OpenAI. 2022 · 2023
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…