What is it like to program with artificial intelligence?

Understand

Large language models, such as OpenAI's codex and Deepmind's AlphaCode, can generate code to solve a variety of problems expressed in natural language.

• This technology has already been commercialised in at least one widely-used programming editor extension: GitHub Copilot.
• In this paper, we explore how programming with large language models (LLM-assisted programming) is similar to, and differs from, prior conceptualisations of programmer assistance.
• We draw upon publicly available experience reports of LLM-assisted programming, as well as prior usability and design studies.