Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation

Understand

Several recent advances in AI systems solve problems by providing a "scaffolding" program that structures multiple calls to language models (LMs) to generate better outputs.

• A scaffolding program is written in a programming language such as Python.
• In this work, we use a language-model-infused scaffolding program to improve itself.
• We start with a seed "improver" that improves an input program according to a given utility function by querying an LM several times and returning the best solution.