LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimization

Understand

Large Language Models (LLMs) have emerged as powerful tools capable of accomplishing a broad spectrum of tasks.

• Their abilities span numerous areas, and one area where they have made a significant impact is in the domain of code generation.
• Here, we propose using the coding abilities of LLMs to introduce meaningful variations to code defining neural networks.
• Meanwhile, Quality-Diversity (QD) algorithms are known to discover diverse and robust solutions.